2023-10-05 19:59:52,279 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.snapshot.TestExportSnapshot timeout: 13 mins 2023-10-05 19:59:52,476 DEBUG [main] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/190200ca-70b6-4852-ff08-4943c98578e6 2023-10-05 19:59:52,476 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.snapshot.TestMobExportSnapshot timeout: 13 mins 2023-10-05 19:59:52,476 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.snapshot.TestMobSecureExportSnapshot timeout: 13 mins 2023-10-05 19:59:52,512 WARN [Time-limited test] util.NativeCodeLoader(62): Unable to load native-hadoop library for your platform... using builtin-java classes where applicable 2023-10-05 19:59:52,729 INFO [Time-limited test] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=3, rsPorts=, rsClass=null, numDataNodes=3, dataNodeHosts=null, numZkServers=1, createRootDir=false, createWALDir=false} 2023-10-05 19:59:52,730 INFO [Time-limited test] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/190200ca-70b6-4852-ff08-4943c98578e6/cluster_78e2df33-fa2c-67a8-7ffd-0907f5603662, deleteOnExit=true 2023-10-05 19:59:52,730 INFO [Time-limited test] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-10-05 19:59:52,730 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/190200ca-70b6-4852-ff08-4943c98578e6/test.cache.data in system properties and HBase conf 2023-10-05 19:59:52,731 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/190200ca-70b6-4852-ff08-4943c98578e6/hadoop.tmp.dir in system properties and HBase conf 2023-10-05 19:59:52,731 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/190200ca-70b6-4852-ff08-4943c98578e6/hadoop.log.dir in system properties and HBase conf 2023-10-05 19:59:52,731 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/190200ca-70b6-4852-ff08-4943c98578e6/mapreduce.cluster.local.dir in system properties and HBase conf 2023-10-05 19:59:52,732 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/190200ca-70b6-4852-ff08-4943c98578e6/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-10-05 19:59:52,732 INFO [Time-limited test] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-10-05 19:59:53,062 DEBUG [Time-limited test] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-10-05 19:59:53,067 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/190200ca-70b6-4852-ff08-4943c98578e6/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-10-05 19:59:53,067 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/190200ca-70b6-4852-ff08-4943c98578e6/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-10-05 19:59:53,067 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/190200ca-70b6-4852-ff08-4943c98578e6/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-10-05 19:59:53,068 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/190200ca-70b6-4852-ff08-4943c98578e6/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-10-05 19:59:53,068 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/190200ca-70b6-4852-ff08-4943c98578e6/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-10-05 19:59:53,068 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/190200ca-70b6-4852-ff08-4943c98578e6/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-10-05 19:59:53,069 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/190200ca-70b6-4852-ff08-4943c98578e6/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-10-05 19:59:53,069 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/190200ca-70b6-4852-ff08-4943c98578e6/dfs.journalnode.edits.dir in system properties and HBase conf 2023-10-05 19:59:53,069 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/190200ca-70b6-4852-ff08-4943c98578e6/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-10-05 19:59:53,069 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/190200ca-70b6-4852-ff08-4943c98578e6/nfs.dump.dir in system properties and HBase conf 2023-10-05 19:59:53,070 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/190200ca-70b6-4852-ff08-4943c98578e6/java.io.tmpdir in system properties and HBase conf 2023-10-05 19:59:53,070 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/190200ca-70b6-4852-ff08-4943c98578e6/dfs.journalnode.edits.dir in system properties and HBase conf 2023-10-05 19:59:53,070 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/190200ca-70b6-4852-ff08-4943c98578e6/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-10-05 19:59:53,070 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/190200ca-70b6-4852-ff08-4943c98578e6/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-10-05 19:59:53,560 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-10-05 19:59:53,565 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-10-05 19:59:53,878 WARN [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-namenode.properties,hadoop-metrics2.properties 2023-10-05 19:59:54,041 INFO [Time-limited test] log.Slf4jLog(67): Logging to org.slf4j.impl.Reload4jLoggerAdapter(org.mortbay.log) via org.mortbay.log.Slf4jLog 2023-10-05 19:59:54,055 WARN [Time-limited test] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-10-05 19:59:54,093 INFO [Time-limited test] log.Slf4jLog(67): jetty-6.1.26 2023-10-05 19:59:54,129 INFO [Time-limited test] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/190200ca-70b6-4852-ff08-4943c98578e6/java.io.tmpdir/Jetty_localhost_39003_hdfs____.l20rih/webapp 2023-10-05 19:59:54,286 INFO [Time-limited test] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:39003 2023-10-05 19:59:54,297 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-10-05 19:59:54,298 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-10-05 19:59:54,815 WARN [Listener at localhost/45929] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-10-05 19:59:54,894 WARN [Listener at localhost/45929] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-10-05 19:59:54,916 WARN [Listener at localhost/45929] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-10-05 19:59:54,993 INFO [Listener at localhost/45929] log.Slf4jLog(67): jetty-6.1.26 2023-10-05 19:59:54,999 INFO [Listener at localhost/45929] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/190200ca-70b6-4852-ff08-4943c98578e6/java.io.tmpdir/Jetty_localhost_37713_datanode____c8bsws/webapp 2023-10-05 19:59:55,095 INFO [Listener at localhost/45929] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:37713 2023-10-05 19:59:55,513 WARN [Listener at localhost/32775] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-10-05 19:59:55,530 WARN [Listener at localhost/32775] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-10-05 19:59:55,537 WARN [Listener at localhost/32775] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-10-05 19:59:55,539 INFO [Listener at localhost/32775] log.Slf4jLog(67): jetty-6.1.26 2023-10-05 19:59:55,548 INFO [Listener at localhost/32775] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/190200ca-70b6-4852-ff08-4943c98578e6/java.io.tmpdir/Jetty_localhost_35925_datanode____.a448sf/webapp 2023-10-05 19:59:55,649 INFO [Listener at localhost/32775] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:35925 2023-10-05 19:59:55,660 WARN [Listener at localhost/34893] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-10-05 19:59:55,676 WARN [Listener at localhost/34893] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-10-05 19:59:55,681 WARN [Listener at localhost/34893] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-10-05 19:59:55,683 INFO [Listener at localhost/34893] log.Slf4jLog(67): jetty-6.1.26 2023-10-05 19:59:55,692 INFO [Listener at localhost/34893] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/190200ca-70b6-4852-ff08-4943c98578e6/java.io.tmpdir/Jetty_localhost_34389_datanode____.7qvspy/webapp 2023-10-05 19:59:55,834 INFO [Listener at localhost/34893] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:34389 2023-10-05 19:59:55,849 WARN [Listener at localhost/32941] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-10-05 19:59:56,100 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x4c4e84999d44a670: Processing first storage report for DS-3964a96b-bd5f-494f-b45f-328e1c3a3b46 from datanode a6bc1e55-4d84-41e7-9faa-d661b03673f9 2023-10-05 19:59:56,102 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x4c4e84999d44a670: from storage DS-3964a96b-bd5f-494f-b45f-328e1c3a3b46 node DatanodeRegistration(127.0.0.1:39989, datanodeUuid=a6bc1e55-4d84-41e7-9faa-d661b03673f9, infoPort=39315, infoSecurePort=0, ipcPort=34893, storageInfo=lv=-57;cid=testClusterID;nsid=317512681;c=1696535993647), blocks: 0, hasStaleStorage: true, processing time: 2 msecs, invalidatedBlocks: 0 2023-10-05 19:59:56,102 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x3d85639326455e32: Processing first storage report for DS-14f89e1c-9537-48fa-80e7-914cd145b1db from datanode 1480d934-1e25-4193-8166-2b36d4a3dcd0 2023-10-05 19:59:56,102 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x3d85639326455e32: from storage DS-14f89e1c-9537-48fa-80e7-914cd145b1db node DatanodeRegistration(127.0.0.1:38379, datanodeUuid=1480d934-1e25-4193-8166-2b36d4a3dcd0, infoPort=42641, infoSecurePort=0, ipcPort=32775, storageInfo=lv=-57;cid=testClusterID;nsid=317512681;c=1696535993647), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-10-05 19:59:56,102 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xc6444e68a96158d3: Processing first storage report for DS-b9b047c0-d518-44cc-8476-2aa9c425f47e from datanode d250e794-9c99-414b-885b-44ace439f4e2 2023-10-05 19:59:56,102 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xc6444e68a96158d3: from storage DS-b9b047c0-d518-44cc-8476-2aa9c425f47e node DatanodeRegistration(127.0.0.1:36247, datanodeUuid=d250e794-9c99-414b-885b-44ace439f4e2, infoPort=44607, infoSecurePort=0, ipcPort=32941, storageInfo=lv=-57;cid=testClusterID;nsid=317512681;c=1696535993647), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-10-05 19:59:56,103 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x4c4e84999d44a670: Processing first storage report for DS-e5a3d729-368d-4ff6-8e3a-237c3778424a from datanode a6bc1e55-4d84-41e7-9faa-d661b03673f9 2023-10-05 19:59:56,103 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x4c4e84999d44a670: from storage DS-e5a3d729-368d-4ff6-8e3a-237c3778424a node DatanodeRegistration(127.0.0.1:39989, datanodeUuid=a6bc1e55-4d84-41e7-9faa-d661b03673f9, infoPort=39315, infoSecurePort=0, ipcPort=34893, storageInfo=lv=-57;cid=testClusterID;nsid=317512681;c=1696535993647), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-10-05 19:59:56,103 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x3d85639326455e32: Processing first storage report for DS-ec07cef6-0010-46f0-9b90-c40986481724 from datanode 1480d934-1e25-4193-8166-2b36d4a3dcd0 2023-10-05 19:59:56,103 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x3d85639326455e32: from storage DS-ec07cef6-0010-46f0-9b90-c40986481724 node DatanodeRegistration(127.0.0.1:38379, datanodeUuid=1480d934-1e25-4193-8166-2b36d4a3dcd0, infoPort=42641, infoSecurePort=0, ipcPort=32775, storageInfo=lv=-57;cid=testClusterID;nsid=317512681;c=1696535993647), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-10-05 19:59:56,103 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xc6444e68a96158d3: Processing first storage report for DS-abfdebc9-a177-46f5-8204-1fffcb4bf32d from datanode d250e794-9c99-414b-885b-44ace439f4e2 2023-10-05 19:59:56,103 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xc6444e68a96158d3: from storage DS-abfdebc9-a177-46f5-8204-1fffcb4bf32d node DatanodeRegistration(127.0.0.1:36247, datanodeUuid=d250e794-9c99-414b-885b-44ace439f4e2, infoPort=44607, infoSecurePort=0, ipcPort=32941, storageInfo=lv=-57;cid=testClusterID;nsid=317512681;c=1696535993647), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-10-05 19:59:56,327 DEBUG [Listener at localhost/32941] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/190200ca-70b6-4852-ff08-4943c98578e6 2023-10-05 19:59:56,425 INFO [Listener at localhost/32941] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/190200ca-70b6-4852-ff08-4943c98578e6/cluster_78e2df33-fa2c-67a8-7ffd-0907f5603662/zookeeper_0, clientPort=57530, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/190200ca-70b6-4852-ff08-4943c98578e6/cluster_78e2df33-fa2c-67a8-7ffd-0907f5603662/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/190200ca-70b6-4852-ff08-4943c98578e6/cluster_78e2df33-fa2c-67a8-7ffd-0907f5603662/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-10-05 19:59:56,451 INFO [Listener at localhost/32941] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=57530 2023-10-05 19:59:56,463 INFO [Listener at localhost/32941] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-10-05 19:59:56,466 INFO [Listener at localhost/32941] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-10-05 19:59:57,169 INFO [Listener at localhost/32941] util.FSUtils(471): Created version file at hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2 with version=8 2023-10-05 19:59:57,169 INFO [Listener at localhost/32941] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/hbase-staging 2023-10-05 19:59:57,563 INFO [Listener at localhost/32941] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl 2023-10-05 19:59:58,069 INFO [Listener at localhost/32941] client.ConnectionUtils(127): master/jenkins-hbase4:0 server-side Connection retries=45 2023-10-05 19:59:58,102 INFO [Listener at localhost/32941] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-10-05 19:59:58,102 INFO [Listener at localhost/32941] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-10-05 19:59:58,102 INFO [Listener at localhost/32941] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-10-05 19:59:58,103 INFO [Listener at localhost/32941] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-10-05 19:59:58,103 INFO [Listener at localhost/32941] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-10-05 19:59:58,243 INFO [Listener at localhost/32941] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-10-05 19:59:58,316 DEBUG [Listener at localhost/32941] util.ClassSize(228): Using Unsafe to estimate memory layout 2023-10-05 19:59:58,407 INFO [Listener at localhost/32941] ipc.NettyRpcServer(120): Bind to /172.31.14.131:40857 2023-10-05 19:59:58,420 INFO [Listener at localhost/32941] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-10-05 19:59:58,422 INFO [Listener at localhost/32941] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-10-05 19:59:58,448 INFO [Listener at localhost/32941] zookeeper.RecoverableZooKeeper(93): Process identifier=master:40857 connecting to ZooKeeper ensemble=127.0.0.1:57530 2023-10-05 19:59:58,513 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): master:408570x0, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-10-05 19:59:58,517 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): master:40857-0x101182c1f970000 connected 2023-10-05 19:59:58,545 DEBUG [Listener at localhost/32941] zookeeper.ZKUtil(164): master:40857-0x101182c1f970000, quorum=127.0.0.1:57530, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-10-05 19:59:58,546 DEBUG [Listener at localhost/32941] zookeeper.ZKUtil(164): master:40857-0x101182c1f970000, quorum=127.0.0.1:57530, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-10-05 19:59:58,559 DEBUG [Listener at localhost/32941] zookeeper.ZKUtil(164): master:40857-0x101182c1f970000, quorum=127.0.0.1:57530, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-10-05 19:59:58,567 DEBUG [Listener at localhost/32941] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=40857 2023-10-05 19:59:58,568 DEBUG [Listener at localhost/32941] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=40857 2023-10-05 19:59:58,568 DEBUG [Listener at localhost/32941] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=40857 2023-10-05 19:59:58,568 DEBUG [Listener at localhost/32941] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=40857 2023-10-05 19:59:58,569 DEBUG [Listener at localhost/32941] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=40857 2023-10-05 19:59:58,575 INFO [Listener at localhost/32941] master.HMaster(444): hbase.rootdir=hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2, hbase.cluster.distributed=false 2023-10-05 19:59:58,643 INFO [Listener at localhost/32941] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-10-05 19:59:58,644 INFO [Listener at localhost/32941] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-10-05 19:59:58,644 INFO [Listener at localhost/32941] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-10-05 19:59:58,644 INFO [Listener at localhost/32941] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-10-05 19:59:58,645 INFO [Listener at localhost/32941] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-10-05 19:59:58,645 INFO [Listener at localhost/32941] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-10-05 19:59:58,650 INFO [Listener at localhost/32941] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-10-05 19:59:58,653 INFO [Listener at localhost/32941] ipc.NettyRpcServer(120): Bind to /172.31.14.131:32861 2023-10-05 19:59:58,656 INFO [Listener at localhost/32941] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-10-05 19:59:58,664 INFO [Listener at localhost/32941] mob.MobFileCache(125): MobFileCache disabled 2023-10-05 19:59:58,665 INFO [Listener at localhost/32941] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-10-05 19:59:58,668 INFO [Listener at localhost/32941] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-10-05 19:59:58,670 INFO [Listener at localhost/32941] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:32861 connecting to ZooKeeper ensemble=127.0.0.1:57530 2023-10-05 19:59:58,679 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): regionserver:328610x0, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-10-05 19:59:58,680 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:32861-0x101182c1f970001 connected 2023-10-05 19:59:58,681 DEBUG [Listener at localhost/32941] zookeeper.ZKUtil(164): regionserver:32861-0x101182c1f970001, quorum=127.0.0.1:57530, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-10-05 19:59:58,682 DEBUG [Listener at localhost/32941] zookeeper.ZKUtil(164): regionserver:32861-0x101182c1f970001, quorum=127.0.0.1:57530, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-10-05 19:59:58,683 DEBUG [Listener at localhost/32941] zookeeper.ZKUtil(164): regionserver:32861-0x101182c1f970001, quorum=127.0.0.1:57530, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-10-05 19:59:58,684 DEBUG [Listener at localhost/32941] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=32861 2023-10-05 19:59:58,684 DEBUG [Listener at localhost/32941] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=32861 2023-10-05 19:59:58,684 DEBUG [Listener at localhost/32941] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=32861 2023-10-05 19:59:58,685 DEBUG [Listener at localhost/32941] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=32861 2023-10-05 19:59:58,686 DEBUG [Listener at localhost/32941] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=32861 2023-10-05 19:59:58,698 INFO [Listener at localhost/32941] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-10-05 19:59:58,699 INFO [Listener at localhost/32941] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-10-05 19:59:58,699 INFO [Listener at localhost/32941] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-10-05 19:59:58,699 INFO [Listener at localhost/32941] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-10-05 19:59:58,699 INFO [Listener at localhost/32941] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-10-05 19:59:58,700 INFO [Listener at localhost/32941] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-10-05 19:59:58,700 INFO [Listener at localhost/32941] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-10-05 19:59:58,701 INFO [Listener at localhost/32941] ipc.NettyRpcServer(120): Bind to /172.31.14.131:44821 2023-10-05 19:59:58,702 INFO [Listener at localhost/32941] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-10-05 19:59:58,704 INFO [Listener at localhost/32941] mob.MobFileCache(125): MobFileCache disabled 2023-10-05 19:59:58,705 INFO [Listener at localhost/32941] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-10-05 19:59:58,708 INFO [Listener at localhost/32941] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-10-05 19:59:58,711 INFO [Listener at localhost/32941] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:44821 connecting to ZooKeeper ensemble=127.0.0.1:57530 2023-10-05 19:59:58,715 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): regionserver:448210x0, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-10-05 19:59:58,716 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:44821-0x101182c1f970002 connected 2023-10-05 19:59:58,716 DEBUG [Listener at localhost/32941] zookeeper.ZKUtil(164): regionserver:44821-0x101182c1f970002, quorum=127.0.0.1:57530, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-10-05 19:59:58,717 DEBUG [Listener at localhost/32941] zookeeper.ZKUtil(164): regionserver:44821-0x101182c1f970002, quorum=127.0.0.1:57530, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-10-05 19:59:58,718 DEBUG [Listener at localhost/32941] zookeeper.ZKUtil(164): regionserver:44821-0x101182c1f970002, quorum=127.0.0.1:57530, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-10-05 19:59:58,719 DEBUG [Listener at localhost/32941] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=44821 2023-10-05 19:59:58,719 DEBUG [Listener at localhost/32941] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=44821 2023-10-05 19:59:58,720 DEBUG [Listener at localhost/32941] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=44821 2023-10-05 19:59:58,720 DEBUG [Listener at localhost/32941] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=44821 2023-10-05 19:59:58,720 DEBUG [Listener at localhost/32941] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=44821 2023-10-05 19:59:58,738 INFO [Listener at localhost/32941] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-10-05 19:59:58,738 INFO [Listener at localhost/32941] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-10-05 19:59:58,739 INFO [Listener at localhost/32941] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-10-05 19:59:58,739 INFO [Listener at localhost/32941] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-10-05 19:59:58,739 INFO [Listener at localhost/32941] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-10-05 19:59:58,739 INFO [Listener at localhost/32941] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-10-05 19:59:58,739 INFO [Listener at localhost/32941] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-10-05 19:59:58,741 INFO [Listener at localhost/32941] ipc.NettyRpcServer(120): Bind to /172.31.14.131:36369 2023-10-05 19:59:58,742 INFO [Listener at localhost/32941] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-10-05 19:59:58,742 INFO [Listener at localhost/32941] mob.MobFileCache(125): MobFileCache disabled 2023-10-05 19:59:58,744 INFO [Listener at localhost/32941] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-10-05 19:59:58,745 INFO [Listener at localhost/32941] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-10-05 19:59:58,747 INFO [Listener at localhost/32941] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:36369 connecting to ZooKeeper ensemble=127.0.0.1:57530 2023-10-05 19:59:58,750 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): regionserver:363690x0, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-10-05 19:59:58,751 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:36369-0x101182c1f970003 connected 2023-10-05 19:59:58,751 DEBUG [Listener at localhost/32941] zookeeper.ZKUtil(164): regionserver:36369-0x101182c1f970003, quorum=127.0.0.1:57530, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-10-05 19:59:58,752 DEBUG [Listener at localhost/32941] zookeeper.ZKUtil(164): regionserver:36369-0x101182c1f970003, quorum=127.0.0.1:57530, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-10-05 19:59:58,753 DEBUG [Listener at localhost/32941] zookeeper.ZKUtil(164): regionserver:36369-0x101182c1f970003, quorum=127.0.0.1:57530, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-10-05 19:59:58,753 DEBUG [Listener at localhost/32941] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=36369 2023-10-05 19:59:58,754 DEBUG [Listener at localhost/32941] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=36369 2023-10-05 19:59:58,754 DEBUG [Listener at localhost/32941] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=36369 2023-10-05 19:59:58,754 DEBUG [Listener at localhost/32941] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=36369 2023-10-05 19:59:58,755 DEBUG [Listener at localhost/32941] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=36369 2023-10-05 19:59:58,756 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2168): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase4.apache.org,40857,1696535997381 2023-10-05 19:59:58,765 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): master:40857-0x101182c1f970000, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-10-05 19:59:58,767 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:40857-0x101182c1f970000, quorum=127.0.0.1:57530, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase4.apache.org,40857,1696535997381 2023-10-05 19:59:58,786 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): regionserver:44821-0x101182c1f970002, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-10-05 19:59:58,786 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): regionserver:32861-0x101182c1f970001, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-10-05 19:59:58,786 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): regionserver:36369-0x101182c1f970003, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-10-05 19:59:58,786 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): master:40857-0x101182c1f970000, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-10-05 19:59:58,787 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): master:40857-0x101182c1f970000, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-10-05 19:59:58,787 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:40857-0x101182c1f970000, quorum=127.0.0.1:57530, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-10-05 19:59:58,789 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(227): Deleting ZNode for /hbase/backup-masters/jenkins-hbase4.apache.org,40857,1696535997381 from backup master directory 2023-10-05 19:59:58,789 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:40857-0x101182c1f970000, quorum=127.0.0.1:57530, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-10-05 19:59:58,793 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): master:40857-0x101182c1f970000, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase4.apache.org,40857,1696535997381 2023-10-05 19:59:58,794 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): master:40857-0x101182c1f970000, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-10-05 19:59:58,794 WARN [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-10-05 19:59:58,794 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(237): Registered as active master=jenkins-hbase4.apache.org,40857,1696535997381 2023-10-05 19:59:58,799 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating data MemStoreChunkPool with chunk size 2 MB, max count 352, initial count 0 2023-10-05 19:59:58,800 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating index MemStoreChunkPool with chunk size 204.80 KB, max count 391, initial count 0 2023-10-05 19:59:58,895 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] util.FSUtils(620): Created cluster ID file at hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/hbase.id with ID: 0eb49f2b-1d4c-4627-8b72-ddf2eeaf85a6 2023-10-05 19:59:58,938 INFO [master/jenkins-hbase4:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-10-05 19:59:58,953 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): master:40857-0x101182c1f970000, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-10-05 19:59:59,002 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x66c1b6dc to 127.0.0.1:57530 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-05 19:59:59,037 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3d80e19f, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-05 19:59:59,065 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-10-05 19:59:59,067 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-10-05 19:59:59,084 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(264): ClientProtocol::create wrong number of arguments, should be hadoop 3.2 or below 2023-10-05 19:59:59,085 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(270): ClientProtocol::create wrong number of arguments, should be hadoop 2.x 2023-10-05 19:59:59,086 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(279): can not find SHOULD_REPLICATE flag, should be hadoop 2.x java.lang.IllegalArgumentException: No enum constant org.apache.hadoop.fs.CreateFlag.SHOULD_REPLICATE at java.lang.Enum.valueOf(Enum.java:238) at org.apache.hadoop.fs.CreateFlag.valueOf(CreateFlag.java:63) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.loadShouldReplicateFlag(FanOutOneBlockAsyncDFSOutputHelper.java:277) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.(FanOutOneBlockAsyncDFSOutputHelper.java:304) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:139) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:855) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2193) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:528) at java.lang.Thread.run(Thread.java:750) 2023-10-05 19:59:59,091 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(243): No decryptEncryptedDataEncryptionKey method in DFSClient, should be hadoop version with HDFS-12396 java.lang.NoSuchMethodException: org.apache.hadoop.hdfs.DFSClient.decryptEncryptedDataEncryptionKey(org.apache.hadoop.fs.FileEncryptionInfo) at java.lang.Class.getDeclaredMethod(Class.java:2130) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelperWithoutHDFS12396(FanOutOneBlockAsyncDFSOutputSaslHelper.java:182) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelper(FanOutOneBlockAsyncDFSOutputSaslHelper.java:241) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.(FanOutOneBlockAsyncDFSOutputSaslHelper.java:252) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:140) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:855) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2193) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:528) at java.lang.Thread.run(Thread.java:750) 2023-10-05 19:59:59,092 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-10-05 19:59:59,128 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7693): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/MasterData/data/master/store-tmp 2023-10-05 19:59:59,168 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-05 19:59:59,169 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-10-05 19:59:59,169 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-10-05 19:59:59,169 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-10-05 19:59:59,169 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-10-05 19:59:59,169 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-10-05 19:59:59,169 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-10-05 19:59:59,169 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-10-05 19:59:59,171 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/MasterData/WALs/jenkins-hbase4.apache.org,40857,1696535997381 2023-10-05 19:59:59,194 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C40857%2C1696535997381, suffix=, logDir=hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/MasterData/WALs/jenkins-hbase4.apache.org,40857,1696535997381, archiveDir=hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/MasterData/oldWALs, maxLogs=10 2023-10-05 19:59:59,254 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:38379,DS-14f89e1c-9537-48fa-80e7-914cd145b1db,DISK] 2023-10-05 19:59:59,254 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:36247,DS-b9b047c0-d518-44cc-8476-2aa9c425f47e,DISK] 2023-10-05 19:59:59,254 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:39989,DS-3964a96b-bd5f-494f-b45f-328e1c3a3b46,DISK] 2023-10-05 19:59:59,263 DEBUG [RS-EventLoopGroup-5-1] asyncfs.ProtobufDecoder(123): Hadoop 3.2 and below use unshaded protobuf. java.lang.ClassNotFoundException: org.apache.hadoop.thirdparty.protobuf.MessageLite at java.net.URLClassLoader.findClass(URLClassLoader.java:387) at java.lang.ClassLoader.loadClass(ClassLoader.java:418) at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:352) at java.lang.ClassLoader.loadClass(ClassLoader.java:351) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.io.asyncfs.ProtobufDecoder.(ProtobufDecoder.java:118) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.processWriteBlockResponse(FanOutOneBlockAsyncDFSOutputHelper.java:340) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$100(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$4.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:424) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:557) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.addListener(DefaultPromise.java:185) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.initialize(FanOutOneBlockAsyncDFSOutputHelper.java:418) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$300(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:476) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:471) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:583) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:559) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:636) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setSuccess0(DefaultPromise.java:625) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.trySuccess(DefaultPromise.java:105) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPromise.trySuccess(DefaultChannelPromise.java:84) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.fulfillConnectPromise(AbstractEpollChannel.java:653) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:691) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-10-05 19:59:59,335 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/MasterData/WALs/jenkins-hbase4.apache.org,40857,1696535997381/jenkins-hbase4.apache.org%2C40857%2C1696535997381.1696535999205 2023-10-05 19:59:59,335 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:39989,DS-3964a96b-bd5f-494f-b45f-328e1c3a3b46,DISK], DatanodeInfoWithStorage[127.0.0.1:38379,DS-14f89e1c-9537-48fa-80e7-914cd145b1db,DISK], DatanodeInfoWithStorage[127.0.0.1:36247,DS-b9b047c0-d518-44cc-8476-2aa9c425f47e,DISK]] 2023-10-05 19:59:59,336 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7854): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-10-05 19:59:59,336 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-05 19:59:59,339 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7894): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-10-05 19:59:59,341 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7897): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-10-05 19:59:59,406 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-10-05 19:59:59,413 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-10-05 19:59:59,442 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-10-05 19:59:59,455 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-05 19:59:59,461 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-10-05 19:59:59,463 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-10-05 19:59:59,481 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1055): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-10-05 19:59:59,485 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-05 19:59:59,486 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1072): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69535947, jitterRate=0.03616635501384735}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-10-05 19:59:59,486 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(965): Region open journal for 1595e783b53d99cd5eef43b6debb2682: 2023-10-05 19:59:59,487 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-10-05 19:59:59,509 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-10-05 19:59:59,510 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(561): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-10-05 19:59:59,512 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-10-05 19:59:59,514 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(581): Recovered RegionProcedureStore lease in 1 msec 2023-10-05 19:59:59,550 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(595): Loaded RegionProcedureStore in 35 msec 2023-10-05 19:59:59,550 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(96): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-10-05 19:59:59,582 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-10-05 19:59:59,588 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-10-05 19:59:59,613 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-10-05 19:59:59,618 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-10-05 19:59:59,619 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:40857-0x101182c1f970000, quorum=127.0.0.1:57530, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-10-05 19:59:59,625 INFO [master/jenkins-hbase4:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-10-05 19:59:59,629 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:40857-0x101182c1f970000, quorum=127.0.0.1:57530, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-10-05 19:59:59,632 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): master:40857-0x101182c1f970000, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-10-05 19:59:59,634 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:40857-0x101182c1f970000, quorum=127.0.0.1:57530, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-10-05 19:59:59,635 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:40857-0x101182c1f970000, quorum=127.0.0.1:57530, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-10-05 19:59:59,648 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:40857-0x101182c1f970000, quorum=127.0.0.1:57530, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-10-05 19:59:59,652 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): master:40857-0x101182c1f970000, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-10-05 19:59:59,652 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): regionserver:36369-0x101182c1f970003, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-10-05 19:59:59,652 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): master:40857-0x101182c1f970000, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-10-05 19:59:59,652 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): regionserver:44821-0x101182c1f970002, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-10-05 19:59:59,652 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): regionserver:32861-0x101182c1f970001, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-10-05 19:59:59,653 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(744): Active/primary master=jenkins-hbase4.apache.org,40857,1696535997381, sessionid=0x101182c1f970000, setting cluster-up flag (Was=false) 2023-10-05 19:59:59,674 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): master:40857-0x101182c1f970000, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-10-05 19:59:59,680 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-10-05 19:59:59,682 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,40857,1696535997381 2023-10-05 19:59:59,688 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): master:40857-0x101182c1f970000, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-10-05 19:59:59,693 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-10-05 19:59:59,695 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,40857,1696535997381 2023-10-05 19:59:59,697 WARN [master/jenkins-hbase4:0:becomeActiveMaster] snapshot.SnapshotManager(304): Couldn't delete working snapshot directory: hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/.hbase-snapshot/.tmp 2023-10-05 19:59:59,760 INFO [RS:1;jenkins-hbase4:44821] regionserver.HRegionServer(951): ClusterId : 0eb49f2b-1d4c-4627-8b72-ddf2eeaf85a6 2023-10-05 19:59:59,762 INFO [RS:2;jenkins-hbase4:36369] regionserver.HRegionServer(951): ClusterId : 0eb49f2b-1d4c-4627-8b72-ddf2eeaf85a6 2023-10-05 19:59:59,763 INFO [RS:0;jenkins-hbase4:32861] regionserver.HRegionServer(951): ClusterId : 0eb49f2b-1d4c-4627-8b72-ddf2eeaf85a6 2023-10-05 19:59:59,769 DEBUG [RS:0;jenkins-hbase4:32861] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-10-05 19:59:59,769 DEBUG [RS:2;jenkins-hbase4:36369] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-10-05 19:59:59,769 DEBUG [RS:1;jenkins-hbase4:44821] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-10-05 19:59:59,778 DEBUG [RS:0;jenkins-hbase4:32861] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-10-05 19:59:59,778 DEBUG [RS:2;jenkins-hbase4:36369] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-10-05 19:59:59,778 DEBUG [RS:2;jenkins-hbase4:36369] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-10-05 19:59:59,778 DEBUG [RS:1;jenkins-hbase4:44821] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-10-05 19:59:59,778 DEBUG [RS:0;jenkins-hbase4:32861] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-10-05 19:59:59,778 DEBUG [RS:1;jenkins-hbase4:44821] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-10-05 19:59:59,782 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2930): Registered master coprocessor service: service=AccessControlService 2023-10-05 19:59:59,784 DEBUG [RS:1;jenkins-hbase4:44821] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-10-05 19:59:59,786 DEBUG [RS:2;jenkins-hbase4:36369] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-10-05 19:59:59,786 DEBUG [RS:1;jenkins-hbase4:44821] zookeeper.ReadOnlyZKClient(139): Connect 0x4d1538ce to 127.0.0.1:57530 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-05 19:59:59,787 DEBUG [RS:0;jenkins-hbase4:32861] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-10-05 19:59:59,789 INFO [master/jenkins-hbase4:0:becomeActiveMaster] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-10-05 19:59:59,790 INFO [master/jenkins-hbase4:0:becomeActiveMaster] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver loaded, priority=536870912. 2023-10-05 19:59:59,790 DEBUG [RS:2;jenkins-hbase4:36369] zookeeper.ReadOnlyZKClient(139): Connect 0x209c06dd to 127.0.0.1:57530 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-05 19:59:59,790 DEBUG [RS:0;jenkins-hbase4:32861] zookeeper.ReadOnlyZKClient(139): Connect 0x64df4c58 to 127.0.0.1:57530 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-05 19:59:59,805 DEBUG [RS:1;jenkins-hbase4:44821] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@43d2cf1c, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-05 19:59:59,805 DEBUG [RS:1;jenkins-hbase4:44821] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@47ed53be, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-10-05 19:59:59,807 DEBUG [RS:2;jenkins-hbase4:36369] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2e5becbe, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-05 19:59:59,807 DEBUG [RS:2;jenkins-hbase4:36369] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2a646dad, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-10-05 19:59:59,829 DEBUG [RS:0;jenkins-hbase4:32861] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6a18aeb3, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-05 19:59:59,830 DEBUG [RS:0;jenkins-hbase4:32861] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2b25a488, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-10-05 19:59:59,851 DEBUG [RS:1;jenkins-hbase4:44821] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:1;jenkins-hbase4:44821 2023-10-05 19:59:59,855 DEBUG [RS:0;jenkins-hbase4:32861] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase4:32861 2023-10-05 19:59:59,856 DEBUG [RS:2;jenkins-hbase4:36369] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:2;jenkins-hbase4:36369 2023-10-05 19:59:59,856 INFO [RS:1;jenkins-hbase4:44821] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-10-05 19:59:59,856 INFO [RS:2;jenkins-hbase4:36369] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-10-05 19:59:59,857 INFO [RS:1;jenkins-hbase4:44821] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-10-05 19:59:59,856 INFO [RS:0;jenkins-hbase4:32861] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-10-05 19:59:59,857 INFO [RS:2;jenkins-hbase4:36369] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-10-05 19:59:59,857 INFO [RS:0;jenkins-hbase4:32861] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-10-05 19:59:59,857 DEBUG [RS:2;jenkins-hbase4:36369] regionserver.HRegionServer(839): Registered regionserver coprocessor executorService: executorService=AccessControlService 2023-10-05 19:59:59,857 DEBUG [RS:1;jenkins-hbase4:44821] regionserver.HRegionServer(839): Registered regionserver coprocessor executorService: executorService=AccessControlService 2023-10-05 19:59:59,857 DEBUG [RS:0;jenkins-hbase4:32861] regionserver.HRegionServer(839): Registered regionserver coprocessor executorService: executorService=AccessControlService 2023-10-05 19:59:59,858 INFO [RS:1;jenkins-hbase4:44821] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-10-05 19:59:59,858 INFO [RS:2;jenkins-hbase4:36369] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-10-05 19:59:59,858 DEBUG [RS:1;jenkins-hbase4:44821] regionserver.HRegionServer(1022): About to register with Master. 2023-10-05 19:59:59,858 INFO [RS:0;jenkins-hbase4:32861] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-10-05 19:59:59,858 DEBUG [RS:0;jenkins-hbase4:32861] regionserver.HRegionServer(1022): About to register with Master. 2023-10-05 19:59:59,858 DEBUG [RS:2;jenkins-hbase4:36369] regionserver.HRegionServer(1022): About to register with Master. 2023-10-05 19:59:59,862 INFO [RS:1;jenkins-hbase4:44821] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,40857,1696535997381 with isa=jenkins-hbase4.apache.org/172.31.14.131:44821, startcode=1696535998698 2023-10-05 19:59:59,862 INFO [RS:0;jenkins-hbase4:32861] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,40857,1696535997381 with isa=jenkins-hbase4.apache.org/172.31.14.131:32861, startcode=1696535998642 2023-10-05 19:59:59,862 INFO [RS:2;jenkins-hbase4:36369] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,40857,1696535997381 with isa=jenkins-hbase4.apache.org/172.31.14.131:36369, startcode=1696535998737 2023-10-05 19:59:59,882 DEBUG [RS:2;jenkins-hbase4:36369] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-10-05 19:59:59,882 DEBUG [RS:1;jenkins-hbase4:44821] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-10-05 19:59:59,882 DEBUG [RS:0;jenkins-hbase4:32861] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-10-05 19:59:59,889 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1028): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-10-05 19:59:59,899 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-10-05 19:59:59,899 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-10-05 19:59:59,899 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-10-05 19:59:59,899 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-10-05 19:59:59,899 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase4:0, corePoolSize=10, maxPoolSize=10 2023-10-05 19:59:59,899 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-10-05 19:59:59,899 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-10-05 19:59:59,899 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-10-05 19:59:59,906 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1696536029906 2023-10-05 19:59:59,910 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-10-05 19:59:59,925 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-10-05 19:59:59,931 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-10-05 19:59:59,932 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-10-05 19:59:59,933 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-10-05 19:59:59,933 DEBUG [PEWorker-2] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-10-05 19:59:59,933 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-10-05 19:59:59,933 INFO [PEWorker-2] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-10-05 19:59:59,936 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-10-05 19:59:59,937 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-10-05 19:59:59,939 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-10-05 19:59:59,939 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-10-05 19:59:59,940 INFO [PEWorker-2] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-10-05 19:59:59,945 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-10-05 19:59:59,946 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-10-05 19:59:59,947 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1696535999947,5,FailOnTimeoutGroup] 2023-10-05 19:59:59,947 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1696535999947,5,FailOnTimeoutGroup] 2023-10-05 19:59:59,947 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-10-05 19:59:59,947 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1461): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-10-05 19:59:59,949 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-10-05 19:59:59,949 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:44875, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.1 (auth:SIMPLE), service=RegionServerStatusService 2023-10-05 19:59:59,949 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-10-05 19:59:59,949 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:49513, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.0 (auth:SIMPLE), service=RegionServerStatusService 2023-10-05 19:59:59,949 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:38773, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.2 (auth:SIMPLE), service=RegionServerStatusService 2023-10-05 19:59:59,963 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=40857] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,44821,1696535998698 2023-10-05 19:59:59,976 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=40857] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,36369,1696535998737 2023-10-05 19:59:59,980 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=40857] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,32861,1696535998642 2023-10-05 19:59:59,986 DEBUG [RS:0;jenkins-hbase4:32861] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2 2023-10-05 19:59:59,986 DEBUG [RS:2;jenkins-hbase4:36369] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2 2023-10-05 19:59:59,986 DEBUG [RS:1;jenkins-hbase4:44821] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2 2023-10-05 19:59:59,986 DEBUG [RS:2;jenkins-hbase4:36369] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:45929 2023-10-05 19:59:59,987 DEBUG [RS:2;jenkins-hbase4:36369] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-10-05 19:59:59,986 DEBUG [RS:0;jenkins-hbase4:32861] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:45929 2023-10-05 19:59:59,987 DEBUG [RS:0;jenkins-hbase4:32861] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-10-05 19:59:59,986 DEBUG [RS:1;jenkins-hbase4:44821] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:45929 2023-10-05 19:59:59,987 DEBUG [RS:1;jenkins-hbase4:44821] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-10-05 19:59:59,998 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-10-05 19:59:59,999 INFO [PEWorker-2] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-10-05 19:59:59,999 INFO [PEWorker-2] regionserver.HRegion(7675): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2 2023-10-05 20:00:00,003 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): master:40857-0x101182c1f970000, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-10-05 20:00:00,004 DEBUG [RS:0;jenkins-hbase4:32861] zookeeper.ZKUtil(162): regionserver:32861-0x101182c1f970001, quorum=127.0.0.1:57530, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,32861,1696535998642 2023-10-05 20:00:00,005 DEBUG [RS:2;jenkins-hbase4:36369] zookeeper.ZKUtil(162): regionserver:36369-0x101182c1f970003, quorum=127.0.0.1:57530, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,36369,1696535998737 2023-10-05 20:00:00,005 WARN [RS:0;jenkins-hbase4:32861] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-10-05 20:00:00,005 WARN [RS:2;jenkins-hbase4:36369] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-10-05 20:00:00,006 INFO [RS:0;jenkins-hbase4:32861] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-10-05 20:00:00,006 INFO [RS:2;jenkins-hbase4:36369] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-10-05 20:00:00,006 DEBUG [RS:0;jenkins-hbase4:32861] regionserver.HRegionServer(1948): logDir=hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/WALs/jenkins-hbase4.apache.org,32861,1696535998642 2023-10-05 20:00:00,006 DEBUG [RS:2;jenkins-hbase4:36369] regionserver.HRegionServer(1948): logDir=hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/WALs/jenkins-hbase4.apache.org,36369,1696535998737 2023-10-05 20:00:00,006 DEBUG [RS:1;jenkins-hbase4:44821] zookeeper.ZKUtil(162): regionserver:44821-0x101182c1f970002, quorum=127.0.0.1:57530, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,44821,1696535998698 2023-10-05 20:00:00,007 WARN [RS:1;jenkins-hbase4:44821] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-10-05 20:00:00,007 INFO [RS:1;jenkins-hbase4:44821] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-10-05 20:00:00,007 DEBUG [RS:1;jenkins-hbase4:44821] regionserver.HRegionServer(1948): logDir=hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/WALs/jenkins-hbase4.apache.org,44821,1696535998698 2023-10-05 20:00:00,010 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,32861,1696535998642] 2023-10-05 20:00:00,010 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,36369,1696535998737] 2023-10-05 20:00:00,010 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,44821,1696535998698] 2023-10-05 20:00:00,036 DEBUG [PEWorker-2] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-05 20:00:00,037 DEBUG [RS:1;jenkins-hbase4:44821] zookeeper.ZKUtil(162): regionserver:44821-0x101182c1f970002, quorum=127.0.0.1:57530, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,32861,1696535998642 2023-10-05 20:00:00,037 DEBUG [RS:0;jenkins-hbase4:32861] zookeeper.ZKUtil(162): regionserver:32861-0x101182c1f970001, quorum=127.0.0.1:57530, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,32861,1696535998642 2023-10-05 20:00:00,038 DEBUG [RS:1;jenkins-hbase4:44821] zookeeper.ZKUtil(162): regionserver:44821-0x101182c1f970002, quorum=127.0.0.1:57530, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,36369,1696535998737 2023-10-05 20:00:00,038 DEBUG [RS:0;jenkins-hbase4:32861] zookeeper.ZKUtil(162): regionserver:32861-0x101182c1f970001, quorum=127.0.0.1:57530, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,36369,1696535998737 2023-10-05 20:00:00,038 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-10-05 20:00:00,039 DEBUG [RS:1;jenkins-hbase4:44821] zookeeper.ZKUtil(162): regionserver:44821-0x101182c1f970002, quorum=127.0.0.1:57530, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,44821,1696535998698 2023-10-05 20:00:00,039 DEBUG [RS:2;jenkins-hbase4:36369] zookeeper.ZKUtil(162): regionserver:36369-0x101182c1f970003, quorum=127.0.0.1:57530, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,32861,1696535998642 2023-10-05 20:00:00,039 DEBUG [RS:0;jenkins-hbase4:32861] zookeeper.ZKUtil(162): regionserver:32861-0x101182c1f970001, quorum=127.0.0.1:57530, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,44821,1696535998698 2023-10-05 20:00:00,040 DEBUG [RS:2;jenkins-hbase4:36369] zookeeper.ZKUtil(162): regionserver:36369-0x101182c1f970003, quorum=127.0.0.1:57530, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,36369,1696535998737 2023-10-05 20:00:00,041 DEBUG [RS:2;jenkins-hbase4:36369] zookeeper.ZKUtil(162): regionserver:36369-0x101182c1f970003, quorum=127.0.0.1:57530, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,44821,1696535998698 2023-10-05 20:00:00,041 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/data/hbase/meta/1588230740/info 2023-10-05 20:00:00,042 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-10-05 20:00:00,043 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-05 20:00:00,043 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-10-05 20:00:00,045 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/data/hbase/meta/1588230740/rep_barrier 2023-10-05 20:00:00,046 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-10-05 20:00:00,047 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-05 20:00:00,047 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-10-05 20:00:00,049 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/data/hbase/meta/1588230740/table 2023-10-05 20:00:00,050 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-10-05 20:00:00,051 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-05 20:00:00,052 DEBUG [RS:0;jenkins-hbase4:32861] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-10-05 20:00:00,052 DEBUG [RS:2;jenkins-hbase4:36369] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-10-05 20:00:00,052 DEBUG [RS:1;jenkins-hbase4:44821] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-10-05 20:00:00,054 DEBUG [PEWorker-2] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/data/hbase/meta/1588230740 2023-10-05 20:00:00,055 DEBUG [PEWorker-2] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/data/hbase/meta/1588230740 2023-10-05 20:00:00,060 DEBUG [PEWorker-2] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-10-05 20:00:00,063 DEBUG [PEWorker-2] regionserver.HRegion(1055): writing seq id for 1588230740 2023-10-05 20:00:00,064 INFO [RS:1;jenkins-hbase4:44821] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-10-05 20:00:00,067 DEBUG [PEWorker-2] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-05 20:00:00,068 INFO [PEWorker-2] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68524625, jitterRate=0.02109648287296295}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-10-05 20:00:00,068 DEBUG [PEWorker-2] regionserver.HRegion(965): Region open journal for 1588230740: 2023-10-05 20:00:00,068 DEBUG [PEWorker-2] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-10-05 20:00:00,069 INFO [PEWorker-2] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-10-05 20:00:00,069 DEBUG [PEWorker-2] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-10-05 20:00:00,069 DEBUG [PEWorker-2] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-10-05 20:00:00,069 DEBUG [PEWorker-2] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-10-05 20:00:00,070 INFO [PEWorker-2] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-10-05 20:00:00,070 DEBUG [PEWorker-2] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-10-05 20:00:00,074 INFO [RS:0;jenkins-hbase4:32861] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-10-05 20:00:00,075 INFO [RS:2;jenkins-hbase4:36369] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-10-05 20:00:00,077 DEBUG [PEWorker-2] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-10-05 20:00:00,077 INFO [PEWorker-2] procedure.InitMetaProcedure(103): Going to assign meta 2023-10-05 20:00:00,091 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-10-05 20:00:00,094 INFO [RS:0;jenkins-hbase4:32861] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-10-05 20:00:00,094 INFO [RS:1;jenkins-hbase4:44821] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-10-05 20:00:00,094 INFO [RS:2;jenkins-hbase4:36369] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-10-05 20:00:00,098 INFO [RS:0;jenkins-hbase4:32861] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-10-05 20:00:00,098 INFO [RS:0;jenkins-hbase4:32861] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-10-05 20:00:00,099 INFO [RS:2;jenkins-hbase4:36369] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-10-05 20:00:00,101 INFO [RS:2;jenkins-hbase4:36369] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-10-05 20:00:00,103 INFO [RS:0;jenkins-hbase4:32861] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-10-05 20:00:00,103 INFO [RS:1;jenkins-hbase4:44821] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-10-05 20:00:00,103 INFO [RS:1;jenkins-hbase4:44821] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-10-05 20:00:00,105 INFO [RS:2;jenkins-hbase4:36369] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-10-05 20:00:00,108 INFO [RS:1;jenkins-hbase4:44821] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-10-05 20:00:00,111 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-10-05 20:00:00,113 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-10-05 20:00:00,118 INFO [RS:1;jenkins-hbase4:44821] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-10-05 20:00:00,118 INFO [RS:2;jenkins-hbase4:36369] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-10-05 20:00:00,118 INFO [RS:0;jenkins-hbase4:32861] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-10-05 20:00:00,118 DEBUG [RS:1;jenkins-hbase4:44821] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-10-05 20:00:00,118 DEBUG [RS:2;jenkins-hbase4:36369] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-10-05 20:00:00,125 DEBUG [RS:0;jenkins-hbase4:32861] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-10-05 20:00:00,125 DEBUG [RS:2;jenkins-hbase4:36369] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-10-05 20:00:00,125 DEBUG [RS:0;jenkins-hbase4:32861] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-10-05 20:00:00,125 DEBUG [RS:2;jenkins-hbase4:36369] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-10-05 20:00:00,125 DEBUG [RS:0;jenkins-hbase4:32861] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-10-05 20:00:00,125 DEBUG [RS:2;jenkins-hbase4:36369] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-10-05 20:00:00,126 DEBUG [RS:0;jenkins-hbase4:32861] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-10-05 20:00:00,126 DEBUG [RS:2;jenkins-hbase4:36369] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-10-05 20:00:00,126 DEBUG [RS:0;jenkins-hbase4:32861] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-10-05 20:00:00,126 DEBUG [RS:2;jenkins-hbase4:36369] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-10-05 20:00:00,126 DEBUG [RS:0;jenkins-hbase4:32861] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-10-05 20:00:00,126 DEBUG [RS:2;jenkins-hbase4:36369] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-10-05 20:00:00,126 DEBUG [RS:0;jenkins-hbase4:32861] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-10-05 20:00:00,126 DEBUG [RS:2;jenkins-hbase4:36369] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-10-05 20:00:00,126 DEBUG [RS:0;jenkins-hbase4:32861] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-10-05 20:00:00,126 DEBUG [RS:2;jenkins-hbase4:36369] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-10-05 20:00:00,126 DEBUG [RS:0;jenkins-hbase4:32861] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-10-05 20:00:00,126 DEBUG [RS:2;jenkins-hbase4:36369] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-10-05 20:00:00,126 DEBUG [RS:0;jenkins-hbase4:32861] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-10-05 20:00:00,125 DEBUG [RS:1;jenkins-hbase4:44821] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-10-05 20:00:00,127 DEBUG [RS:1;jenkins-hbase4:44821] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-10-05 20:00:00,127 DEBUG [RS:1;jenkins-hbase4:44821] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-10-05 20:00:00,128 INFO [RS:0;jenkins-hbase4:32861] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-10-05 20:00:00,128 DEBUG [RS:1;jenkins-hbase4:44821] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-10-05 20:00:00,128 INFO [RS:2;jenkins-hbase4:36369] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-10-05 20:00:00,128 DEBUG [RS:1;jenkins-hbase4:44821] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-10-05 20:00:00,128 INFO [RS:0;jenkins-hbase4:32861] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-10-05 20:00:00,128 INFO [RS:2;jenkins-hbase4:36369] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-10-05 20:00:00,128 INFO [RS:0;jenkins-hbase4:32861] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-10-05 20:00:00,128 INFO [RS:2;jenkins-hbase4:36369] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-10-05 20:00:00,128 DEBUG [RS:1;jenkins-hbase4:44821] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-10-05 20:00:00,129 DEBUG [RS:1;jenkins-hbase4:44821] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-10-05 20:00:00,129 DEBUG [RS:1;jenkins-hbase4:44821] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-10-05 20:00:00,129 DEBUG [RS:1;jenkins-hbase4:44821] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-10-05 20:00:00,130 INFO [RS:1;jenkins-hbase4:44821] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-10-05 20:00:00,130 INFO [RS:1;jenkins-hbase4:44821] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-10-05 20:00:00,130 INFO [RS:1;jenkins-hbase4:44821] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-10-05 20:00:00,152 INFO [RS:0;jenkins-hbase4:32861] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-10-05 20:00:00,152 INFO [RS:1;jenkins-hbase4:44821] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-10-05 20:00:00,152 INFO [RS:2;jenkins-hbase4:36369] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-10-05 20:00:00,155 INFO [RS:1;jenkins-hbase4:44821] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,44821,1696535998698-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-10-05 20:00:00,155 INFO [RS:0;jenkins-hbase4:32861] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,32861,1696535998642-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-10-05 20:00:00,155 INFO [RS:2;jenkins-hbase4:36369] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,36369,1696535998737-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-10-05 20:00:00,178 INFO [RS:0;jenkins-hbase4:32861] regionserver.Replication(203): jenkins-hbase4.apache.org,32861,1696535998642 started 2023-10-05 20:00:00,178 INFO [RS:0;jenkins-hbase4:32861] regionserver.HRegionServer(1637): Serving as jenkins-hbase4.apache.org,32861,1696535998642, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:32861, sessionid=0x101182c1f970001 2023-10-05 20:00:00,181 INFO [RS:2;jenkins-hbase4:36369] regionserver.Replication(203): jenkins-hbase4.apache.org,36369,1696535998737 started 2023-10-05 20:00:00,181 INFO [RS:1;jenkins-hbase4:44821] regionserver.Replication(203): jenkins-hbase4.apache.org,44821,1696535998698 started 2023-10-05 20:00:00,181 DEBUG [RS:0;jenkins-hbase4:32861] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-10-05 20:00:00,181 INFO [RS:2;jenkins-hbase4:36369] regionserver.HRegionServer(1637): Serving as jenkins-hbase4.apache.org,36369,1696535998737, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:36369, sessionid=0x101182c1f970003 2023-10-05 20:00:00,181 DEBUG [RS:0;jenkins-hbase4:32861] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,32861,1696535998642 2023-10-05 20:00:00,181 INFO [RS:1;jenkins-hbase4:44821] regionserver.HRegionServer(1637): Serving as jenkins-hbase4.apache.org,44821,1696535998698, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:44821, sessionid=0x101182c1f970002 2023-10-05 20:00:00,181 DEBUG [RS:0;jenkins-hbase4:32861] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,32861,1696535998642' 2023-10-05 20:00:00,181 DEBUG [RS:1;jenkins-hbase4:44821] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-10-05 20:00:00,181 DEBUG [RS:2;jenkins-hbase4:36369] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-10-05 20:00:00,181 DEBUG [RS:1;jenkins-hbase4:44821] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,44821,1696535998698 2023-10-05 20:00:00,181 DEBUG [RS:0;jenkins-hbase4:32861] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-05 20:00:00,182 DEBUG [RS:1;jenkins-hbase4:44821] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,44821,1696535998698' 2023-10-05 20:00:00,183 DEBUG [RS:1;jenkins-hbase4:44821] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-05 20:00:00,182 DEBUG [RS:2;jenkins-hbase4:36369] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,36369,1696535998737 2023-10-05 20:00:00,183 DEBUG [RS:2;jenkins-hbase4:36369] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,36369,1696535998737' 2023-10-05 20:00:00,183 DEBUG [RS:2;jenkins-hbase4:36369] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-05 20:00:00,184 DEBUG [RS:0;jenkins-hbase4:32861] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-05 20:00:00,184 DEBUG [RS:2;jenkins-hbase4:36369] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-05 20:00:00,184 DEBUG [RS:1;jenkins-hbase4:44821] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-05 20:00:00,184 DEBUG [RS:0;jenkins-hbase4:32861] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-10-05 20:00:00,184 DEBUG [RS:2;jenkins-hbase4:36369] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-10-05 20:00:00,184 DEBUG [RS:0;jenkins-hbase4:32861] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-10-05 20:00:00,185 DEBUG [RS:2;jenkins-hbase4:36369] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-10-05 20:00:00,185 DEBUG [RS:0;jenkins-hbase4:32861] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,32861,1696535998642 2023-10-05 20:00:00,185 DEBUG [RS:0;jenkins-hbase4:32861] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,32861,1696535998642' 2023-10-05 20:00:00,185 DEBUG [RS:2;jenkins-hbase4:36369] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,36369,1696535998737 2023-10-05 20:00:00,186 DEBUG [RS:2;jenkins-hbase4:36369] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,36369,1696535998737' 2023-10-05 20:00:00,186 DEBUG [RS:2;jenkins-hbase4:36369] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-05 20:00:00,185 DEBUG [RS:0;jenkins-hbase4:32861] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-05 20:00:00,186 DEBUG [RS:1;jenkins-hbase4:44821] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-10-05 20:00:00,186 DEBUG [RS:1;jenkins-hbase4:44821] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-10-05 20:00:00,186 DEBUG [RS:1;jenkins-hbase4:44821] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,44821,1696535998698 2023-10-05 20:00:00,186 DEBUG [RS:1;jenkins-hbase4:44821] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,44821,1696535998698' 2023-10-05 20:00:00,186 DEBUG [RS:1;jenkins-hbase4:44821] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-05 20:00:00,187 DEBUG [RS:0;jenkins-hbase4:32861] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-05 20:00:00,187 DEBUG [RS:1;jenkins-hbase4:44821] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-05 20:00:00,187 DEBUG [RS:2;jenkins-hbase4:36369] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-05 20:00:00,188 DEBUG [RS:0;jenkins-hbase4:32861] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-10-05 20:00:00,188 INFO [RS:0;jenkins-hbase4:32861] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-10-05 20:00:00,188 INFO [RS:0;jenkins-hbase4:32861] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-10-05 20:00:00,188 DEBUG [RS:1;jenkins-hbase4:44821] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-10-05 20:00:00,188 DEBUG [RS:2;jenkins-hbase4:36369] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-10-05 20:00:00,188 INFO [RS:1;jenkins-hbase4:44821] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-10-05 20:00:00,189 INFO [RS:2;jenkins-hbase4:36369] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-10-05 20:00:00,189 INFO [RS:2;jenkins-hbase4:36369] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-10-05 20:00:00,189 INFO [RS:1;jenkins-hbase4:44821] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-10-05 20:00:00,265 DEBUG [jenkins-hbase4:40857] assignment.AssignmentManager(2176): Processing assignQueue; systemServersCount=3, allServersCount=3 2023-10-05 20:00:00,270 DEBUG [jenkins-hbase4:40857] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-10-05 20:00:00,276 DEBUG [jenkins-hbase4:40857] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-10-05 20:00:00,276 DEBUG [jenkins-hbase4:40857] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-10-05 20:00:00,276 DEBUG [jenkins-hbase4:40857] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-10-05 20:00:00,276 DEBUG [jenkins-hbase4:40857] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-10-05 20:00:00,279 INFO [PEWorker-3] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,44821,1696535998698, state=OPENING 2023-10-05 20:00:00,286 DEBUG [PEWorker-3] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-10-05 20:00:00,288 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): master:40857-0x101182c1f970000, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-10-05 20:00:00,288 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-10-05 20:00:00,292 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,44821,1696535998698}] 2023-10-05 20:00:00,304 INFO [RS:1;jenkins-hbase4:44821] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C44821%2C1696535998698, suffix=, logDir=hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/WALs/jenkins-hbase4.apache.org,44821,1696535998698, archiveDir=hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/oldWALs, maxLogs=32 2023-10-05 20:00:00,304 INFO [RS:0;jenkins-hbase4:32861] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C32861%2C1696535998642, suffix=, logDir=hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/WALs/jenkins-hbase4.apache.org,32861,1696535998642, archiveDir=hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/oldWALs, maxLogs=32 2023-10-05 20:00:00,305 INFO [RS:2;jenkins-hbase4:36369] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C36369%2C1696535998737, suffix=, logDir=hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/WALs/jenkins-hbase4.apache.org,36369,1696535998737, archiveDir=hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/oldWALs, maxLogs=32 2023-10-05 20:00:00,340 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:38379,DS-14f89e1c-9537-48fa-80e7-914cd145b1db,DISK] 2023-10-05 20:00:00,340 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:36247,DS-b9b047c0-d518-44cc-8476-2aa9c425f47e,DISK] 2023-10-05 20:00:00,340 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:39989,DS-3964a96b-bd5f-494f-b45f-328e1c3a3b46,DISK] 2023-10-05 20:00:00,340 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:39989,DS-3964a96b-bd5f-494f-b45f-328e1c3a3b46,DISK] 2023-10-05 20:00:00,341 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:36247,DS-b9b047c0-d518-44cc-8476-2aa9c425f47e,DISK] 2023-10-05 20:00:00,341 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:38379,DS-14f89e1c-9537-48fa-80e7-914cd145b1db,DISK] 2023-10-05 20:00:00,351 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:36247,DS-b9b047c0-d518-44cc-8476-2aa9c425f47e,DISK] 2023-10-05 20:00:00,351 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:39989,DS-3964a96b-bd5f-494f-b45f-328e1c3a3b46,DISK] 2023-10-05 20:00:00,351 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:38379,DS-14f89e1c-9537-48fa-80e7-914cd145b1db,DISK] 2023-10-05 20:00:00,359 INFO [RS:2;jenkins-hbase4:36369] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/WALs/jenkins-hbase4.apache.org,36369,1696535998737/jenkins-hbase4.apache.org%2C36369%2C1696535998737.1696536000311 2023-10-05 20:00:00,359 INFO [RS:1;jenkins-hbase4:44821] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/WALs/jenkins-hbase4.apache.org,44821,1696535998698/jenkins-hbase4.apache.org%2C44821%2C1696535998698.1696536000311 2023-10-05 20:00:00,360 DEBUG [RS:2;jenkins-hbase4:36369] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:36247,DS-b9b047c0-d518-44cc-8476-2aa9c425f47e,DISK], DatanodeInfoWithStorage[127.0.0.1:39989,DS-3964a96b-bd5f-494f-b45f-328e1c3a3b46,DISK], DatanodeInfoWithStorage[127.0.0.1:38379,DS-14f89e1c-9537-48fa-80e7-914cd145b1db,DISK]] 2023-10-05 20:00:00,361 INFO [RS:0;jenkins-hbase4:32861] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/WALs/jenkins-hbase4.apache.org,32861,1696535998642/jenkins-hbase4.apache.org%2C32861%2C1696535998642.1696536000312 2023-10-05 20:00:00,366 DEBUG [RS:1;jenkins-hbase4:44821] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:39989,DS-3964a96b-bd5f-494f-b45f-328e1c3a3b46,DISK], DatanodeInfoWithStorage[127.0.0.1:36247,DS-b9b047c0-d518-44cc-8476-2aa9c425f47e,DISK], DatanodeInfoWithStorage[127.0.0.1:38379,DS-14f89e1c-9537-48fa-80e7-914cd145b1db,DISK]] 2023-10-05 20:00:00,367 DEBUG [RS:0;jenkins-hbase4:32861] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:39989,DS-3964a96b-bd5f-494f-b45f-328e1c3a3b46,DISK], DatanodeInfoWithStorage[127.0.0.1:36247,DS-b9b047c0-d518-44cc-8476-2aa9c425f47e,DISK], DatanodeInfoWithStorage[127.0.0.1:38379,DS-14f89e1c-9537-48fa-80e7-914cd145b1db,DISK]] 2023-10-05 20:00:00,479 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,44821,1696535998698 2023-10-05 20:00:00,481 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-10-05 20:00:00,485 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:33510, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-10-05 20:00:00,501 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:meta,,1.1588230740 2023-10-05 20:00:00,501 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-10-05 20:00:00,504 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C44821%2C1696535998698.meta, suffix=.meta, logDir=hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/WALs/jenkins-hbase4.apache.org,44821,1696535998698, archiveDir=hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/oldWALs, maxLogs=32 2023-10-05 20:00:00,523 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:38379,DS-14f89e1c-9537-48fa-80e7-914cd145b1db,DISK] 2023-10-05 20:00:00,524 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:36247,DS-b9b047c0-d518-44cc-8476-2aa9c425f47e,DISK] 2023-10-05 20:00:00,524 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:39989,DS-3964a96b-bd5f-494f-b45f-328e1c3a3b46,DISK] 2023-10-05 20:00:00,532 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/WALs/jenkins-hbase4.apache.org,44821,1696535998698/jenkins-hbase4.apache.org%2C44821%2C1696535998698.meta.1696536000505.meta 2023-10-05 20:00:00,532 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:38379,DS-14f89e1c-9537-48fa-80e7-914cd145b1db,DISK], DatanodeInfoWithStorage[127.0.0.1:36247,DS-b9b047c0-d518-44cc-8476-2aa9c425f47e,DISK], DatanodeInfoWithStorage[127.0.0.1:39989,DS-3964a96b-bd5f-494f-b45f-328e1c3a3b46,DISK]] 2023-10-05 20:00:00,533 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-10-05 20:00:00,535 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:meta,,1 service=AccessControlService 2023-10-05 20:00:00,537 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-10-05 20:00:00,538 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-10-05 20:00:00,540 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-10-05 20:00:00,542 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-10-05 20:00:00,556 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-10-05 20:00:00,556 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-05 20:00:00,556 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 1588230740 2023-10-05 20:00:00,556 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 1588230740 2023-10-05 20:00:00,559 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-10-05 20:00:00,561 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/data/hbase/meta/1588230740/info 2023-10-05 20:00:00,561 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/data/hbase/meta/1588230740/info 2023-10-05 20:00:00,562 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-10-05 20:00:00,563 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-05 20:00:00,563 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-10-05 20:00:00,564 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/data/hbase/meta/1588230740/rep_barrier 2023-10-05 20:00:00,565 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/data/hbase/meta/1588230740/rep_barrier 2023-10-05 20:00:00,565 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-10-05 20:00:00,566 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-05 20:00:00,566 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-10-05 20:00:00,568 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/data/hbase/meta/1588230740/table 2023-10-05 20:00:00,568 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/data/hbase/meta/1588230740/table 2023-10-05 20:00:00,568 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-10-05 20:00:00,569 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-05 20:00:00,571 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/data/hbase/meta/1588230740 2023-10-05 20:00:00,574 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/data/hbase/meta/1588230740 2023-10-05 20:00:00,578 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-10-05 20:00:00,581 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 1588230740 2023-10-05 20:00:00,582 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68063692, jitterRate=0.01422804594039917}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-10-05 20:00:00,586 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 1588230740: 2023-10-05 20:00:00,599 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1696536000471 2023-10-05 20:00:00,617 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:meta,,1.1588230740 2023-10-05 20:00:00,618 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:meta,,1.1588230740 2023-10-05 20:00:00,618 INFO [PEWorker-5] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,44821,1696535998698, state=OPEN 2023-10-05 20:00:00,623 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): master:40857-0x101182c1f970000, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-10-05 20:00:00,623 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-10-05 20:00:00,628 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=3, resume processing ppid=2 2023-10-05 20:00:00,628 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,44821,1696535998698 in 331 msec 2023-10-05 20:00:00,634 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=2, resume processing ppid=1 2023-10-05 20:00:00,634 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 539 msec 2023-10-05 20:00:00,639 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 839 msec 2023-10-05 20:00:00,639 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(953): Wait for region servers to report in: status=null, state=RUNNING, startTime=1696536000639, completionTime=-1 2023-10-05 20:00:00,640 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=3; waited=0ms, expected min=3 server(s), max=3 server(s), master is running 2023-10-05 20:00:00,640 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1517): Joining cluster... 2023-10-05 20:00:00,717 DEBUG [hconnection-0x13ec5c25-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-05 20:00:00,719 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:33524, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-05 20:00:00,739 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1529): Number of RegionServers=3 2023-10-05 20:00:00,739 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1696536060739 2023-10-05 20:00:00,739 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1696536120739 2023-10-05 20:00:00,739 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1536): Joined the cluster in 99 msec 2023-10-05 20:00:00,762 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,40857,1696535997381-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-10-05 20:00:00,763 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,40857,1696535997381-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-10-05 20:00:00,763 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,40857,1696535997381-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-10-05 20:00:00,765 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase4:40857, period=300000, unit=MILLISECONDS is enabled. 2023-10-05 20:00:00,766 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-10-05 20:00:00,776 DEBUG [master/jenkins-hbase4:0.Chore.1] janitor.CatalogJanitor(175): 2023-10-05 20:00:00,785 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-10-05 20:00:00,786 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2148): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-10-05 20:00:00,797 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1028): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-10-05 20:00:00,800 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-10-05 20:00:00,803 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-10-05 20:00:00,826 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/.tmp/data/hbase/namespace/7dd7dd186e42708b85afa72232ef75c8 2023-10-05 20:00:00,829 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/.tmp/data/hbase/namespace/7dd7dd186e42708b85afa72232ef75c8 empty. 2023-10-05 20:00:00,829 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/.tmp/data/hbase/namespace/7dd7dd186e42708b85afa72232ef75c8 2023-10-05 20:00:00,830 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-10-05 20:00:00,868 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-10-05 20:00:00,870 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7675): creating {ENCODED => 7dd7dd186e42708b85afa72232ef75c8, NAME => 'hbase:namespace,,1696536000786.7dd7dd186e42708b85afa72232ef75c8.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/.tmp 2023-10-05 20:00:00,886 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1696536000786.7dd7dd186e42708b85afa72232ef75c8.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-05 20:00:00,886 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1604): Closing 7dd7dd186e42708b85afa72232ef75c8, disabling compactions & flushes 2023-10-05 20:00:00,886 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1696536000786.7dd7dd186e42708b85afa72232ef75c8. 2023-10-05 20:00:00,886 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1696536000786.7dd7dd186e42708b85afa72232ef75c8. 2023-10-05 20:00:00,886 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1696536000786.7dd7dd186e42708b85afa72232ef75c8. after waiting 0 ms 2023-10-05 20:00:00,886 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1696536000786.7dd7dd186e42708b85afa72232ef75c8. 2023-10-05 20:00:00,886 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1838): Closed hbase:namespace,,1696536000786.7dd7dd186e42708b85afa72232ef75c8. 2023-10-05 20:00:00,887 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1558): Region close journal for 7dd7dd186e42708b85afa72232ef75c8: 2023-10-05 20:00:00,891 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-10-05 20:00:00,907 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1696536000786.7dd7dd186e42708b85afa72232ef75c8.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1696536000894"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696536000894"}]},"ts":"1696536000894"} 2023-10-05 20:00:00,938 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-10-05 20:00:00,940 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-10-05 20:00:00,944 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696536000940"}]},"ts":"1696536000940"} 2023-10-05 20:00:00,947 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-10-05 20:00:00,952 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-10-05 20:00:00,953 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-10-05 20:00:00,953 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-10-05 20:00:00,953 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-10-05 20:00:00,954 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-10-05 20:00:00,956 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=7dd7dd186e42708b85afa72232ef75c8, ASSIGN}] 2023-10-05 20:00:00,959 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=7dd7dd186e42708b85afa72232ef75c8, ASSIGN 2023-10-05 20:00:00,961 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=7dd7dd186e42708b85afa72232ef75c8, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,32861,1696535998642; forceNewPlan=false, retain=false 2023-10-05 20:00:01,113 INFO [jenkins-hbase4:40857] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-10-05 20:00:01,114 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=7dd7dd186e42708b85afa72232ef75c8, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,32861,1696535998642 2023-10-05 20:00:01,114 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1696536000786.7dd7dd186e42708b85afa72232ef75c8.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1696536001114"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696536001114"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696536001114"}]},"ts":"1696536001114"} 2023-10-05 20:00:01,121 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure 7dd7dd186e42708b85afa72232ef75c8, server=jenkins-hbase4.apache.org,32861,1696535998642}] 2023-10-05 20:00:01,275 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,32861,1696535998642 2023-10-05 20:00:01,276 DEBUG [RSProcedureDispatcher-pool-1] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-10-05 20:00:01,280 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:59324, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-10-05 20:00:01,287 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:namespace,,1696536000786.7dd7dd186e42708b85afa72232ef75c8. 2023-10-05 20:00:01,288 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 7dd7dd186e42708b85afa72232ef75c8, NAME => 'hbase:namespace,,1696536000786.7dd7dd186e42708b85afa72232ef75c8.', STARTKEY => '', ENDKEY => ''} 2023-10-05 20:00:01,289 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:namespace,,1696536000786.7dd7dd186e42708b85afa72232ef75c8. service=AccessControlService 2023-10-05 20:00:01,289 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-10-05 20:00:01,290 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace 7dd7dd186e42708b85afa72232ef75c8 2023-10-05 20:00:01,290 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1696536000786.7dd7dd186e42708b85afa72232ef75c8.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-05 20:00:01,290 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 7dd7dd186e42708b85afa72232ef75c8 2023-10-05 20:00:01,290 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 7dd7dd186e42708b85afa72232ef75c8 2023-10-05 20:00:01,293 INFO [StoreOpener-7dd7dd186e42708b85afa72232ef75c8-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 7dd7dd186e42708b85afa72232ef75c8 2023-10-05 20:00:01,295 DEBUG [StoreOpener-7dd7dd186e42708b85afa72232ef75c8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/data/hbase/namespace/7dd7dd186e42708b85afa72232ef75c8/info 2023-10-05 20:00:01,296 DEBUG [StoreOpener-7dd7dd186e42708b85afa72232ef75c8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/data/hbase/namespace/7dd7dd186e42708b85afa72232ef75c8/info 2023-10-05 20:00:01,296 INFO [StoreOpener-7dd7dd186e42708b85afa72232ef75c8-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 7dd7dd186e42708b85afa72232ef75c8 columnFamilyName info 2023-10-05 20:00:01,297 INFO [StoreOpener-7dd7dd186e42708b85afa72232ef75c8-1] regionserver.HStore(310): Store=7dd7dd186e42708b85afa72232ef75c8/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-05 20:00:01,299 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/data/hbase/namespace/7dd7dd186e42708b85afa72232ef75c8 2023-10-05 20:00:01,300 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/data/hbase/namespace/7dd7dd186e42708b85afa72232ef75c8 2023-10-05 20:00:01,304 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 7dd7dd186e42708b85afa72232ef75c8 2023-10-05 20:00:01,308 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/data/hbase/namespace/7dd7dd186e42708b85afa72232ef75c8/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-05 20:00:01,309 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 7dd7dd186e42708b85afa72232ef75c8; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62118630, jitterRate=-0.07436028122901917}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-10-05 20:00:01,309 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 7dd7dd186e42708b85afa72232ef75c8: 2023-10-05 20:00:01,311 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:namespace,,1696536000786.7dd7dd186e42708b85afa72232ef75c8., pid=6, masterSystemTime=1696536001275 2023-10-05 20:00:01,315 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:namespace,,1696536000786.7dd7dd186e42708b85afa72232ef75c8. 2023-10-05 20:00:01,316 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:namespace,,1696536000786.7dd7dd186e42708b85afa72232ef75c8. 2023-10-05 20:00:01,317 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=7dd7dd186e42708b85afa72232ef75c8, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,32861,1696535998642 2023-10-05 20:00:01,318 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1696536000786.7dd7dd186e42708b85afa72232ef75c8.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1696536001317"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1696536001317"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1696536001317"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1696536001317"}]},"ts":"1696536001317"} 2023-10-05 20:00:01,327 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=6, resume processing ppid=5 2023-10-05 20:00:01,327 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure 7dd7dd186e42708b85afa72232ef75c8, server=jenkins-hbase4.apache.org,32861,1696535998642 in 200 msec 2023-10-05 20:00:01,331 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=5, resume processing ppid=4 2023-10-05 20:00:01,332 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=7dd7dd186e42708b85afa72232ef75c8, ASSIGN in 371 msec 2023-10-05 20:00:01,333 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-10-05 20:00:01,334 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696536001333"}]},"ts":"1696536001333"} 2023-10-05 20:00:01,336 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-10-05 20:00:01,340 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-10-05 20:00:01,342 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 553 msec 2023-10-05 20:00:01,400 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:40857-0x101182c1f970000, quorum=127.0.0.1:57530, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-10-05 20:00:01,401 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): master:40857-0x101182c1f970000, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-10-05 20:00:01,402 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): master:40857-0x101182c1f970000, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-10-05 20:00:01,429 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-05 20:00:01,433 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:59328, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-05 20:00:01,447 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1028): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-10-05 20:00:01,464 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): master:40857-0x101182c1f970000, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-10-05 20:00:01,472 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 33 msec 2023-10-05 20:00:01,480 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1028): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-10-05 20:00:01,492 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): master:40857-0x101182c1f970000, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-10-05 20:00:01,498 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 17 msec 2023-10-05 20:00:01,507 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): master:40857-0x101182c1f970000, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-10-05 20:00:01,510 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): master:40857-0x101182c1f970000, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-10-05 20:00:01,511 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1083): Master has completed initialization 2.716sec 2023-10-05 20:00:01,515 INFO [master/jenkins-hbase4:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-10-05 20:00:01,517 INFO [master/jenkins-hbase4:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-10-05 20:00:01,517 INFO [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-10-05 20:00:01,519 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,40857,1696535997381-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-10-05 20:00:01,520 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,40857,1696535997381-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-10-05 20:00:01,548 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster$4(2112): Client=null/null create 'hbase:acl', {NAME => 'l', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-10-05 20:00:01,550 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1028): Stored pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:acl 2023-10-05 20:00:01,552 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_PRE_OPERATION 2023-10-05 20:00:01,554 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-10-05 20:00:01,557 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(700): Client=null/null procedure request for creating table: namespace: "hbase" qualifier: "acl" procId is: 9 2023-10-05 20:00:01,557 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/.tmp/data/hbase/acl/12bcfc4a1a38b61d92a51bfd9d1d5629 2023-10-05 20:00:01,558 DEBUG [HFileArchiver-2] backup.HFileArchiver(153): Directory hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/.tmp/data/hbase/acl/12bcfc4a1a38b61d92a51bfd9d1d5629 empty. 2023-10-05 20:00:01,561 DEBUG [HFileArchiver-2] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/.tmp/data/hbase/acl/12bcfc4a1a38b61d92a51bfd9d1d5629 2023-10-05 20:00:01,561 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived hbase:acl regions 2023-10-05 20:00:01,565 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-10-05 20:00:01,567 DEBUG [Listener at localhost/32941] zookeeper.ReadOnlyZKClient(139): Connect 0x782e04b0 to 127.0.0.1:57530 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-05 20:00:01,577 DEBUG [Listener at localhost/32941] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@10016256, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-05 20:00:01,596 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/.tmp/data/hbase/acl/.tabledesc/.tableinfo.0000000001 2023-10-05 20:00:01,600 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(7675): creating {ENCODED => 12bcfc4a1a38b61d92a51bfd9d1d5629, NAME => 'hbase:acl,,1696536001542.12bcfc4a1a38b61d92a51bfd9d1d5629.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:acl', {NAME => 'l', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/.tmp 2023-10-05 20:00:01,616 DEBUG [hconnection-0x4e0a2980-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-05 20:00:01,634 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:33530, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-05 20:00:01,635 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(866): Instantiated hbase:acl,,1696536001542.12bcfc4a1a38b61d92a51bfd9d1d5629.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-05 20:00:01,635 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1604): Closing 12bcfc4a1a38b61d92a51bfd9d1d5629, disabling compactions & flushes 2023-10-05 20:00:01,635 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1626): Closing region hbase:acl,,1696536001542.12bcfc4a1a38b61d92a51bfd9d1d5629. 2023-10-05 20:00:01,635 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:acl,,1696536001542.12bcfc4a1a38b61d92a51bfd9d1d5629. 2023-10-05 20:00:01,635 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1714): Acquired close lock on hbase:acl,,1696536001542.12bcfc4a1a38b61d92a51bfd9d1d5629. after waiting 0 ms 2023-10-05 20:00:01,635 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1724): Updates disabled for region hbase:acl,,1696536001542.12bcfc4a1a38b61d92a51bfd9d1d5629. 2023-10-05 20:00:01,635 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1838): Closed hbase:acl,,1696536001542.12bcfc4a1a38b61d92a51bfd9d1d5629. 2023-10-05 20:00:01,635 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1558): Region close journal for 12bcfc4a1a38b61d92a51bfd9d1d5629: 2023-10-05 20:00:01,638 INFO [Listener at localhost/32941] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase4.apache.org,40857,1696535997381 2023-10-05 20:00:01,638 INFO [Listener at localhost/32941] hbase.HBaseTestingUtility(2699): Starting mini mapreduce cluster... 2023-10-05 20:00:01,638 INFO [Listener at localhost/32941] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/190200ca-70b6-4852-ff08-4943c98578e6/test.cache.data in system properties and HBase conf 2023-10-05 20:00:01,639 INFO [Listener at localhost/32941] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/190200ca-70b6-4852-ff08-4943c98578e6/hadoop.tmp.dir in system properties and HBase conf 2023-10-05 20:00:01,639 INFO [Listener at localhost/32941] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/190200ca-70b6-4852-ff08-4943c98578e6/hadoop.log.dir in system properties and HBase conf 2023-10-05 20:00:01,639 INFO [Listener at localhost/32941] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/190200ca-70b6-4852-ff08-4943c98578e6/mapreduce.cluster.local.dir in system properties and HBase conf 2023-10-05 20:00:01,639 INFO [Listener at localhost/32941] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/190200ca-70b6-4852-ff08-4943c98578e6/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-10-05 20:00:01,639 INFO [Listener at localhost/32941] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-10-05 20:00:01,639 INFO [Listener at localhost/32941] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/190200ca-70b6-4852-ff08-4943c98578e6/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-10-05 20:00:01,639 INFO [Listener at localhost/32941] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/190200ca-70b6-4852-ff08-4943c98578e6/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-10-05 20:00:01,640 INFO [Listener at localhost/32941] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/190200ca-70b6-4852-ff08-4943c98578e6/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-10-05 20:00:01,640 INFO [Listener at localhost/32941] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/190200ca-70b6-4852-ff08-4943c98578e6/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-10-05 20:00:01,640 INFO [Listener at localhost/32941] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/190200ca-70b6-4852-ff08-4943c98578e6/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-10-05 20:00:01,640 INFO [Listener at localhost/32941] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/190200ca-70b6-4852-ff08-4943c98578e6/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-10-05 20:00:01,640 INFO [Listener at localhost/32941] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/190200ca-70b6-4852-ff08-4943c98578e6/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-10-05 20:00:01,640 INFO [Listener at localhost/32941] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/190200ca-70b6-4852-ff08-4943c98578e6/dfs.journalnode.edits.dir in system properties and HBase conf 2023-10-05 20:00:01,641 INFO [Listener at localhost/32941] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/190200ca-70b6-4852-ff08-4943c98578e6/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-10-05 20:00:01,641 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_ADD_TO_META 2023-10-05 20:00:01,641 INFO [Listener at localhost/32941] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/190200ca-70b6-4852-ff08-4943c98578e6/nfs.dump.dir in system properties and HBase conf 2023-10-05 20:00:01,641 INFO [Listener at localhost/32941] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/190200ca-70b6-4852-ff08-4943c98578e6/java.io.tmpdir in system properties and HBase conf 2023-10-05 20:00:01,641 INFO [Listener at localhost/32941] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/190200ca-70b6-4852-ff08-4943c98578e6/dfs.journalnode.edits.dir in system properties and HBase conf 2023-10-05 20:00:01,641 INFO [Listener at localhost/32941] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/190200ca-70b6-4852-ff08-4943c98578e6/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-10-05 20:00:01,641 INFO [Listener at localhost/32941] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/190200ca-70b6-4852-ff08-4943c98578e6/fs.s3a.committer.staging.tmp.path in system properties and HBase conf 2023-10-05 20:00:01,642 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:acl,,1696536001542.12bcfc4a1a38b61d92a51bfd9d1d5629.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1696536001642"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696536001642"}]},"ts":"1696536001642"} 2023-10-05 20:00:01,645 INFO [PEWorker-1] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-10-05 20:00:01,646 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-10-05 20:00:01,646 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:acl","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696536001646"}]},"ts":"1696536001646"} 2023-10-05 20:00:01,648 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=hbase:acl, state=ENABLING in hbase:meta 2023-10-05 20:00:01,655 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-10-05 20:00:01,656 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-10-05 20:00:01,656 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-10-05 20:00:01,656 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-10-05 20:00:01,656 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-10-05 20:00:01,656 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:acl, region=12bcfc4a1a38b61d92a51bfd9d1d5629, ASSIGN}] 2023-10-05 20:00:01,659 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:acl, region=12bcfc4a1a38b61d92a51bfd9d1d5629, ASSIGN 2023-10-05 20:00:01,661 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:acl, region=12bcfc4a1a38b61d92a51bfd9d1d5629, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,32861,1696535998642; forceNewPlan=false, retain=false 2023-10-05 20:00:01,670 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-10-05 20:00:01,811 INFO [jenkins-hbase4:40857] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-10-05 20:00:01,812 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=12bcfc4a1a38b61d92a51bfd9d1d5629, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,32861,1696535998642 2023-10-05 20:00:01,812 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:acl,,1696536001542.12bcfc4a1a38b61d92a51bfd9d1d5629.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1696536001812"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696536001812"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696536001812"}]},"ts":"1696536001812"} 2023-10-05 20:00:01,819 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE; OpenRegionProcedure 12bcfc4a1a38b61d92a51bfd9d1d5629, server=jenkins-hbase4.apache.org,32861,1696535998642}] 2023-10-05 20:00:01,870 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-10-05 20:00:01,979 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:acl,,1696536001542.12bcfc4a1a38b61d92a51bfd9d1d5629. 2023-10-05 20:00:01,980 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 12bcfc4a1a38b61d92a51bfd9d1d5629, NAME => 'hbase:acl,,1696536001542.12bcfc4a1a38b61d92a51bfd9d1d5629.', STARTKEY => '', ENDKEY => ''} 2023-10-05 20:00:01,980 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:acl,,1696536001542.12bcfc4a1a38b61d92a51bfd9d1d5629. service=AccessControlService 2023-10-05 20:00:01,980 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-10-05 20:00:01,981 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table acl 12bcfc4a1a38b61d92a51bfd9d1d5629 2023-10-05 20:00:01,981 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:acl,,1696536001542.12bcfc4a1a38b61d92a51bfd9d1d5629.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-05 20:00:01,981 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 12bcfc4a1a38b61d92a51bfd9d1d5629 2023-10-05 20:00:01,981 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 12bcfc4a1a38b61d92a51bfd9d1d5629 2023-10-05 20:00:01,983 INFO [StoreOpener-12bcfc4a1a38b61d92a51bfd9d1d5629-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family l of region 12bcfc4a1a38b61d92a51bfd9d1d5629 2023-10-05 20:00:01,986 DEBUG [StoreOpener-12bcfc4a1a38b61d92a51bfd9d1d5629-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/data/hbase/acl/12bcfc4a1a38b61d92a51bfd9d1d5629/l 2023-10-05 20:00:01,986 DEBUG [StoreOpener-12bcfc4a1a38b61d92a51bfd9d1d5629-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/data/hbase/acl/12bcfc4a1a38b61d92a51bfd9d1d5629/l 2023-10-05 20:00:01,987 INFO [StoreOpener-12bcfc4a1a38b61d92a51bfd9d1d5629-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 12bcfc4a1a38b61d92a51bfd9d1d5629 columnFamilyName l 2023-10-05 20:00:01,988 INFO [StoreOpener-12bcfc4a1a38b61d92a51bfd9d1d5629-1] regionserver.HStore(310): Store=12bcfc4a1a38b61d92a51bfd9d1d5629/l, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-05 20:00:01,990 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/data/hbase/acl/12bcfc4a1a38b61d92a51bfd9d1d5629 2023-10-05 20:00:01,992 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/data/hbase/acl/12bcfc4a1a38b61d92a51bfd9d1d5629 2023-10-05 20:00:01,997 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 12bcfc4a1a38b61d92a51bfd9d1d5629 2023-10-05 20:00:02,001 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/data/hbase/acl/12bcfc4a1a38b61d92a51bfd9d1d5629/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-05 20:00:02,002 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 12bcfc4a1a38b61d92a51bfd9d1d5629; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=75427418, jitterRate=0.1239561140537262}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-10-05 20:00:02,003 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 12bcfc4a1a38b61d92a51bfd9d1d5629: 2023-10-05 20:00:02,004 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:acl,,1696536001542.12bcfc4a1a38b61d92a51bfd9d1d5629., pid=11, masterSystemTime=1696536001973 2023-10-05 20:00:02,008 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:acl,,1696536001542.12bcfc4a1a38b61d92a51bfd9d1d5629. 2023-10-05 20:00:02,008 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:acl,,1696536001542.12bcfc4a1a38b61d92a51bfd9d1d5629. 2023-10-05 20:00:02,009 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=12bcfc4a1a38b61d92a51bfd9d1d5629, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,32861,1696535998642 2023-10-05 20:00:02,009 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:acl,,1696536001542.12bcfc4a1a38b61d92a51bfd9d1d5629.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1696536002009"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1696536002009"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1696536002009"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1696536002009"}]},"ts":"1696536002009"} 2023-10-05 20:00:02,017 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=11, resume processing ppid=10 2023-10-05 20:00:02,017 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=11, ppid=10, state=SUCCESS; OpenRegionProcedure 12bcfc4a1a38b61d92a51bfd9d1d5629, server=jenkins-hbase4.apache.org,32861,1696535998642 in 194 msec 2023-10-05 20:00:02,025 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=10, resume processing ppid=9 2023-10-05 20:00:02,025 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=10, ppid=9, state=SUCCESS; TransitRegionStateProcedure table=hbase:acl, region=12bcfc4a1a38b61d92a51bfd9d1d5629, ASSIGN in 361 msec 2023-10-05 20:00:02,026 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-10-05 20:00:02,026 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:acl","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696536002026"}]},"ts":"1696536002026"} 2023-10-05 20:00:02,029 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:acl, state=ENABLED in hbase:meta 2023-10-05 20:00:02,033 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_POST_OPERATION 2023-10-05 20:00:02,036 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=9, state=SUCCESS; CreateTableProcedure table=hbase:acl in 484 msec 2023-10-05 20:00:02,171 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-10-05 20:00:02,171 INFO [master/jenkins-hbase4:0:becomeActiveMaster] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: hbase:acl, procId: 9 completed 2023-10-05 20:00:02,184 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1175): Balancer post startup initialization complete, took 0 seconds 2023-10-05 20:00:02,986 WARN [Thread-382] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-10-05 20:00:03,418 INFO [Thread-382] log.Slf4jLog(67): jetty-6.1.26 2023-10-05 20:00:03,428 INFO [Thread-382] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/jobhistory to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/190200ca-70b6-4852-ff08-4943c98578e6/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_39407_jobhistory____.u2oqrm/webapp 2023-10-05 20:00:03,630 INFO [Thread-382] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.mapreduce.v2.hs.webapp.HsWebServices as a root resource class 2023-10-05 20:00:03,630 INFO [Thread-382] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.mapreduce.v2.hs.webapp.JAXBContextResolver as a provider class 2023-10-05 20:00:03,630 INFO [Thread-382] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-10-05 20:00:03,633 INFO [Thread-382] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-10-05 20:00:03,723 INFO [Thread-382] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.mapreduce.v2.hs.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-10-05 20:00:04,045 INFO [Thread-382] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-10-05 20:00:04,404 INFO [Thread-382] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.mapreduce.v2.hs.webapp.HsWebServices to GuiceManagedComponentProvider with the scope "PerRequest" 2023-10-05 20:00:04,449 INFO [Thread-382] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:39407 2023-10-05 20:00:05,982 WARN [Listener at jenkins-hbase4.apache.org/35337] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-10-05 20:00:06,187 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-10-05 20:00:06,303 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:meta' 2023-10-05 20:00:06,305 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:namespace' 2023-10-05 20:00:06,306 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:acl' 2023-10-05 20:00:06,314 WARN [Listener at jenkins-hbase4.apache.org/35337] servlet.GuiceFilter(87): Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected. 2023-10-05 20:00:06,314 INFO [Listener at jenkins-hbase4.apache.org/35337] log.Slf4jLog(67): jetty-6.1.26 2023-10-05 20:00:06,325 INFO [Listener at jenkins-hbase4.apache.org/35337] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/cluster to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/190200ca-70b6-4852-ff08-4943c98578e6/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_36485_cluster____.7qn7d6/webapp 2023-10-05 20:00:06,429 INFO [Listener at jenkins-hbase4.apache.org/35337] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.server.resourcemanager.webapp.JAXBContextResolver as a provider class 2023-10-05 20:00:06,429 INFO [Listener at jenkins-hbase4.apache.org/35337] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.yarn.server.resourcemanager.webapp.RMWebServices as a root resource class 2023-10-05 20:00:06,430 INFO [Listener at jenkins-hbase4.apache.org/35337] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-10-05 20:00:06,430 INFO [Listener at jenkins-hbase4.apache.org/35337] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-10-05 20:00:06,443 INFO [Listener at jenkins-hbase4.apache.org/35337] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.resourcemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-10-05 20:00:06,666 INFO [Listener at jenkins-hbase4.apache.org/35337] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-10-05 20:00:06,795 INFO [Listener at jenkins-hbase4.apache.org/35337] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.resourcemanager.webapp.RMWebServices to GuiceManagedComponentProvider with the scope "Singleton" 2023-10-05 20:00:06,805 INFO [Listener at jenkins-hbase4.apache.org/35337] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:36485 2023-10-05 20:00:07,275 WARN [Listener at jenkins-hbase4.apache.org/39077] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-10-05 20:00:07,303 WARN [Listener at jenkins-hbase4.apache.org/39077] servlet.GuiceFilter(87): Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected. 2023-10-05 20:00:07,304 INFO [Listener at jenkins-hbase4.apache.org/39077] log.Slf4jLog(67): jetty-6.1.26 2023-10-05 20:00:07,313 INFO [Listener at jenkins-hbase4.apache.org/39077] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/node to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/190200ca-70b6-4852-ff08-4943c98578e6/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_40065_node____jy58oh/webapp 2023-10-05 20:00:07,366 INFO [Listener at jenkins-hbase4.apache.org/39077] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices as a root resource class 2023-10-05 20:00:07,366 INFO [Listener at jenkins-hbase4.apache.org/39077] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-10-05 20:00:07,366 INFO [Listener at jenkins-hbase4.apache.org/39077] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver as a provider class 2023-10-05 20:00:07,366 INFO [Listener at jenkins-hbase4.apache.org/39077] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-10-05 20:00:07,374 INFO [Listener at jenkins-hbase4.apache.org/39077] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-10-05 20:00:07,395 INFO [Listener at jenkins-hbase4.apache.org/39077] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-10-05 20:00:07,458 INFO [Listener at jenkins-hbase4.apache.org/39077] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices to GuiceManagedComponentProvider with the scope "Singleton" 2023-10-05 20:00:07,467 INFO [Listener at jenkins-hbase4.apache.org/39077] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:40065 2023-10-05 20:00:07,564 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.RegionServer.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-10-05 20:00:07,564 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.RegionServer.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase RegionServerObservers 2023-10-05 20:00:07,565 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-10-05 20:00:07,565 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase MasterObservers 2023-10-05 20:00:07,565 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver 2023-10-05 20:00:07,565 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver Metrics about HBase MasterObservers 2023-10-05 20:00:07,565 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-10-05 20:00:07,565 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase RegionObservers 2023-10-05 20:00:07,566 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-10-05 20:00:07,566 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint Metrics about HBase RegionObservers 2023-10-05 20:00:07,667 WARN [Listener at jenkins-hbase4.apache.org/35067] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-10-05 20:00:07,672 WARN [Listener at jenkins-hbase4.apache.org/35067] servlet.GuiceFilter(87): Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected. 2023-10-05 20:00:07,673 INFO [Listener at jenkins-hbase4.apache.org/35067] log.Slf4jLog(67): jetty-6.1.26 2023-10-05 20:00:07,679 INFO [Listener at jenkins-hbase4.apache.org/35067] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/node to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/190200ca-70b6-4852-ff08-4943c98578e6/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_45223_node____.r279bk/webapp 2023-10-05 20:00:07,729 INFO [Listener at jenkins-hbase4.apache.org/35067] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices as a root resource class 2023-10-05 20:00:07,729 INFO [Listener at jenkins-hbase4.apache.org/35067] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-10-05 20:00:07,729 INFO [Listener at jenkins-hbase4.apache.org/35067] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver as a provider class 2023-10-05 20:00:07,730 INFO [Listener at jenkins-hbase4.apache.org/35067] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-10-05 20:00:07,737 INFO [Listener at jenkins-hbase4.apache.org/35067] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-10-05 20:00:07,765 INFO [Listener at jenkins-hbase4.apache.org/35067] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-10-05 20:00:07,843 INFO [Listener at jenkins-hbase4.apache.org/35067] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices to GuiceManagedComponentProvider with the scope "Singleton" 2023-10-05 20:00:07,851 INFO [Listener at jenkins-hbase4.apache.org/35067] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:45223 2023-10-05 20:00:07,874 INFO [Listener at jenkins-hbase4.apache.org/35067] hbase.HBaseTestingUtility(2726): Mini mapreduce cluster started 2023-10-05 20:00:07,875 INFO [Listener at jenkins-hbase4.apache.org/35067] hbase.Waiter(180): Waiting up to [30,000] milli-secs(wait.for.ratio=[1]) 2023-10-05 20:00:07,937 INFO [Listener at jenkins-hbase4.apache.org/35067] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testExportWithTargetName Thread=706, OpenFileDescriptor=896, MaxFileDescriptor=60000, SystemLoadAverage=191, ProcessCount=168, AvailableMemoryMB=6922 2023-10-05 20:00:07,938 WARN [Listener at jenkins-hbase4.apache.org/35067] hbase.ResourceChecker(130): Thread=706 is superior to 500 2023-10-05 20:00:07,956 DEBUG [Listener at jenkins-hbase4.apache.org/35067] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-10-05 20:00:07,963 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:38404, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-10-05 20:00:07,971 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40857] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportWithTargetName', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-10-05 20:00:07,975 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40857] procedure2.ProcedureExecutor(1028): Stored pid=12, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportWithTargetName 2023-10-05 20:00:07,977 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_PRE_OPERATION 2023-10-05 20:00:07,978 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40857] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportWithTargetName" procId is: 12 2023-10-05 20:00:07,980 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-10-05 20:00:07,981 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40857] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-10-05 20:00:07,993 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/.tmp/data/default/testtb-testExportWithTargetName/42b08d50808ded52c1d3d92f8450d54e 2023-10-05 20:00:07,993 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/.tmp/data/default/testtb-testExportWithTargetName/897da2b0932b7dd6fce7cdb7be302914 2023-10-05 20:00:07,997 DEBUG [HFileArchiver-3] backup.HFileArchiver(153): Directory hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/.tmp/data/default/testtb-testExportWithTargetName/42b08d50808ded52c1d3d92f8450d54e empty. 2023-10-05 20:00:07,997 DEBUG [HFileArchiver-4] backup.HFileArchiver(153): Directory hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/.tmp/data/default/testtb-testExportWithTargetName/897da2b0932b7dd6fce7cdb7be302914 empty. 2023-10-05 20:00:07,999 DEBUG [HFileArchiver-4] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/.tmp/data/default/testtb-testExportWithTargetName/897da2b0932b7dd6fce7cdb7be302914 2023-10-05 20:00:07,999 DEBUG [HFileArchiver-3] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/.tmp/data/default/testtb-testExportWithTargetName/42b08d50808ded52c1d3d92f8450d54e 2023-10-05 20:00:07,999 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testExportWithTargetName regions 2023-10-05 20:00:08,036 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/.tmp/data/default/testtb-testExportWithTargetName/.tabledesc/.tableinfo.0000000001 2023-10-05 20:00:08,038 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(7675): creating {ENCODED => 42b08d50808ded52c1d3d92f8450d54e, NAME => 'testtb-testExportWithTargetName,,1696536007971.42b08d50808ded52c1d3d92f8450d54e.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportWithTargetName', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/.tmp 2023-10-05 20:00:08,038 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(7675): creating {ENCODED => 897da2b0932b7dd6fce7cdb7be302914, NAME => 'testtb-testExportWithTargetName,1,1696536007971.897da2b0932b7dd6fce7cdb7be302914.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportWithTargetName', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/.tmp 2023-10-05 20:00:08,083 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,,1696536007971.42b08d50808ded52c1d3d92f8450d54e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-05 20:00:08,085 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1604): Closing 42b08d50808ded52c1d3d92f8450d54e, disabling compactions & flushes 2023-10-05 20:00:08,085 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,,1696536007971.42b08d50808ded52c1d3d92f8450d54e. 2023-10-05 20:00:08,085 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,,1696536007971.42b08d50808ded52c1d3d92f8450d54e. 2023-10-05 20:00:08,085 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,,1696536007971.42b08d50808ded52c1d3d92f8450d54e. after waiting 0 ms 2023-10-05 20:00:08,085 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,,1696536007971.42b08d50808ded52c1d3d92f8450d54e. 2023-10-05 20:00:08,085 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,,1696536007971.42b08d50808ded52c1d3d92f8450d54e. 2023-10-05 20:00:08,085 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1558): Region close journal for 42b08d50808ded52c1d3d92f8450d54e: 2023-10-05 20:00:08,085 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,1,1696536007971.897da2b0932b7dd6fce7cdb7be302914.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-05 20:00:08,086 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1604): Closing 897da2b0932b7dd6fce7cdb7be302914, disabling compactions & flushes 2023-10-05 20:00:08,086 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,1,1696536007971.897da2b0932b7dd6fce7cdb7be302914. 2023-10-05 20:00:08,086 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,1,1696536007971.897da2b0932b7dd6fce7cdb7be302914. 2023-10-05 20:00:08,086 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,1,1696536007971.897da2b0932b7dd6fce7cdb7be302914. after waiting 0 ms 2023-10-05 20:00:08,086 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,1,1696536007971.897da2b0932b7dd6fce7cdb7be302914. 2023-10-05 20:00:08,086 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,1,1696536007971.897da2b0932b7dd6fce7cdb7be302914. 2023-10-05 20:00:08,086 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1558): Region close journal for 897da2b0932b7dd6fce7cdb7be302914: 2023-10-05 20:00:08,087 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40857] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-10-05 20:00:08,090 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_ADD_TO_META 2023-10-05 20:00:08,091 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,,1696536007971.42b08d50808ded52c1d3d92f8450d54e.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1696536008091"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696536008091"}]},"ts":"1696536008091"} 2023-10-05 20:00:08,091 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,1,1696536007971.897da2b0932b7dd6fce7cdb7be302914.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1696536008091"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696536008091"}]},"ts":"1696536008091"} 2023-10-05 20:00:08,139 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-10-05 20:00:08,140 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-10-05 20:00:08,141 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696536008140"}]},"ts":"1696536008140"} 2023-10-05 20:00:08,143 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=ENABLING in hbase:meta 2023-10-05 20:00:08,148 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-10-05 20:00:08,150 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-10-05 20:00:08,150 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-10-05 20:00:08,150 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-10-05 20:00:08,150 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-10-05 20:00:08,150 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=42b08d50808ded52c1d3d92f8450d54e, ASSIGN}, {pid=14, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=897da2b0932b7dd6fce7cdb7be302914, ASSIGN}] 2023-10-05 20:00:08,153 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=14, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=897da2b0932b7dd6fce7cdb7be302914, ASSIGN 2023-10-05 20:00:08,153 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=42b08d50808ded52c1d3d92f8450d54e, ASSIGN 2023-10-05 20:00:08,155 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=14, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=897da2b0932b7dd6fce7cdb7be302914, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,44821,1696535998698; forceNewPlan=false, retain=false 2023-10-05 20:00:08,155 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=42b08d50808ded52c1d3d92f8450d54e, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,36369,1696535998737; forceNewPlan=false, retain=false 2023-10-05 20:00:08,289 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40857] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-10-05 20:00:08,305 INFO [jenkins-hbase4:40857] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-10-05 20:00:08,308 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=42b08d50808ded52c1d3d92f8450d54e, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,36369,1696535998737 2023-10-05 20:00:08,308 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=897da2b0932b7dd6fce7cdb7be302914, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,44821,1696535998698 2023-10-05 20:00:08,308 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,,1696536007971.42b08d50808ded52c1d3d92f8450d54e.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1696536008308"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696536008308"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696536008308"}]},"ts":"1696536008308"} 2023-10-05 20:00:08,308 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,1,1696536007971.897da2b0932b7dd6fce7cdb7be302914.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1696536008308"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696536008308"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696536008308"}]},"ts":"1696536008308"} 2023-10-05 20:00:08,311 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=15, ppid=13, state=RUNNABLE; OpenRegionProcedure 42b08d50808ded52c1d3d92f8450d54e, server=jenkins-hbase4.apache.org,36369,1696535998737}] 2023-10-05 20:00:08,312 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=16, ppid=14, state=RUNNABLE; OpenRegionProcedure 897da2b0932b7dd6fce7cdb7be302914, server=jenkins-hbase4.apache.org,44821,1696535998698}] 2023-10-05 20:00:08,466 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,36369,1696535998737 2023-10-05 20:00:08,466 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-10-05 20:00:08,467 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:45710, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-10-05 20:00:08,475 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportWithTargetName,1,1696536007971.897da2b0932b7dd6fce7cdb7be302914. 2023-10-05 20:00:08,475 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportWithTargetName,,1696536007971.42b08d50808ded52c1d3d92f8450d54e. 2023-10-05 20:00:08,475 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 897da2b0932b7dd6fce7cdb7be302914, NAME => 'testtb-testExportWithTargetName,1,1696536007971.897da2b0932b7dd6fce7cdb7be302914.', STARTKEY => '1', ENDKEY => ''} 2023-10-05 20:00:08,475 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 42b08d50808ded52c1d3d92f8450d54e, NAME => 'testtb-testExportWithTargetName,,1696536007971.42b08d50808ded52c1d3d92f8450d54e.', STARTKEY => '', ENDKEY => '1'} 2023-10-05 20:00:08,475 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportWithTargetName,1,1696536007971.897da2b0932b7dd6fce7cdb7be302914. service=AccessControlService 2023-10-05 20:00:08,475 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportWithTargetName,,1696536007971.42b08d50808ded52c1d3d92f8450d54e. service=AccessControlService 2023-10-05 20:00:08,475 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-10-05 20:00:08,476 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-10-05 20:00:08,476 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportWithTargetName 897da2b0932b7dd6fce7cdb7be302914 2023-10-05 20:00:08,476 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportWithTargetName 42b08d50808ded52c1d3d92f8450d54e 2023-10-05 20:00:08,476 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,1,1696536007971.897da2b0932b7dd6fce7cdb7be302914.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-05 20:00:08,476 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,,1696536007971.42b08d50808ded52c1d3d92f8450d54e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-05 20:00:08,476 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 897da2b0932b7dd6fce7cdb7be302914 2023-10-05 20:00:08,476 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 897da2b0932b7dd6fce7cdb7be302914 2023-10-05 20:00:08,476 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 42b08d50808ded52c1d3d92f8450d54e 2023-10-05 20:00:08,476 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 42b08d50808ded52c1d3d92f8450d54e 2023-10-05 20:00:08,480 INFO [StoreOpener-897da2b0932b7dd6fce7cdb7be302914-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 897da2b0932b7dd6fce7cdb7be302914 2023-10-05 20:00:08,480 INFO [StoreOpener-42b08d50808ded52c1d3d92f8450d54e-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 42b08d50808ded52c1d3d92f8450d54e 2023-10-05 20:00:08,482 DEBUG [StoreOpener-897da2b0932b7dd6fce7cdb7be302914-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/data/default/testtb-testExportWithTargetName/897da2b0932b7dd6fce7cdb7be302914/cf 2023-10-05 20:00:08,482 DEBUG [StoreOpener-897da2b0932b7dd6fce7cdb7be302914-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/data/default/testtb-testExportWithTargetName/897da2b0932b7dd6fce7cdb7be302914/cf 2023-10-05 20:00:08,485 DEBUG [StoreOpener-42b08d50808ded52c1d3d92f8450d54e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/data/default/testtb-testExportWithTargetName/42b08d50808ded52c1d3d92f8450d54e/cf 2023-10-05 20:00:08,485 DEBUG [StoreOpener-42b08d50808ded52c1d3d92f8450d54e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/data/default/testtb-testExportWithTargetName/42b08d50808ded52c1d3d92f8450d54e/cf 2023-10-05 20:00:08,485 INFO [StoreOpener-897da2b0932b7dd6fce7cdb7be302914-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 897da2b0932b7dd6fce7cdb7be302914 columnFamilyName cf 2023-10-05 20:00:08,485 INFO [StoreOpener-42b08d50808ded52c1d3d92f8450d54e-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 42b08d50808ded52c1d3d92f8450d54e columnFamilyName cf 2023-10-05 20:00:08,489 INFO [StoreOpener-42b08d50808ded52c1d3d92f8450d54e-1] regionserver.HStore(310): Store=42b08d50808ded52c1d3d92f8450d54e/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-05 20:00:08,490 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/data/default/testtb-testExportWithTargetName/42b08d50808ded52c1d3d92f8450d54e 2023-10-05 20:00:08,493 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/data/default/testtb-testExportWithTargetName/42b08d50808ded52c1d3d92f8450d54e 2023-10-05 20:00:08,493 INFO [StoreOpener-897da2b0932b7dd6fce7cdb7be302914-1] regionserver.HStore(310): Store=897da2b0932b7dd6fce7cdb7be302914/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-05 20:00:08,495 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/data/default/testtb-testExportWithTargetName/897da2b0932b7dd6fce7cdb7be302914 2023-10-05 20:00:08,495 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/data/default/testtb-testExportWithTargetName/897da2b0932b7dd6fce7cdb7be302914 2023-10-05 20:00:08,497 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 42b08d50808ded52c1d3d92f8450d54e 2023-10-05 20:00:08,507 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 897da2b0932b7dd6fce7cdb7be302914 2023-10-05 20:00:08,507 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/data/default/testtb-testExportWithTargetName/42b08d50808ded52c1d3d92f8450d54e/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-05 20:00:08,509 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 42b08d50808ded52c1d3d92f8450d54e; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63261151, jitterRate=-0.05733539164066315}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-10-05 20:00:08,509 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 42b08d50808ded52c1d3d92f8450d54e: 2023-10-05 20:00:08,511 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportWithTargetName,,1696536007971.42b08d50808ded52c1d3d92f8450d54e., pid=15, masterSystemTime=1696536008466 2023-10-05 20:00:08,515 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/data/default/testtb-testExportWithTargetName/897da2b0932b7dd6fce7cdb7be302914/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-05 20:00:08,516 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 897da2b0932b7dd6fce7cdb7be302914; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60656843, jitterRate=-0.09614260494709015}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-10-05 20:00:08,516 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 897da2b0932b7dd6fce7cdb7be302914: 2023-10-05 20:00:08,517 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportWithTargetName,,1696536007971.42b08d50808ded52c1d3d92f8450d54e. 2023-10-05 20:00:08,518 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportWithTargetName,,1696536007971.42b08d50808ded52c1d3d92f8450d54e. 2023-10-05 20:00:08,518 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportWithTargetName,1,1696536007971.897da2b0932b7dd6fce7cdb7be302914., pid=16, masterSystemTime=1696536008466 2023-10-05 20:00:08,520 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=42b08d50808ded52c1d3d92f8450d54e, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,36369,1696535998737 2023-10-05 20:00:08,520 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportWithTargetName,,1696536007971.42b08d50808ded52c1d3d92f8450d54e.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1696536008519"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1696536008519"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1696536008519"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1696536008519"}]},"ts":"1696536008519"} 2023-10-05 20:00:08,521 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportWithTargetName,1,1696536007971.897da2b0932b7dd6fce7cdb7be302914. 2023-10-05 20:00:08,521 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportWithTargetName,1,1696536007971.897da2b0932b7dd6fce7cdb7be302914. 2023-10-05 20:00:08,523 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=897da2b0932b7dd6fce7cdb7be302914, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,44821,1696535998698 2023-10-05 20:00:08,524 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportWithTargetName,1,1696536007971.897da2b0932b7dd6fce7cdb7be302914.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1696536008523"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1696536008523"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1696536008523"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1696536008523"}]},"ts":"1696536008523"} 2023-10-05 20:00:08,528 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=15, resume processing ppid=13 2023-10-05 20:00:08,528 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=15, ppid=13, state=SUCCESS; OpenRegionProcedure 42b08d50808ded52c1d3d92f8450d54e, server=jenkins-hbase4.apache.org,36369,1696535998737 in 212 msec 2023-10-05 20:00:08,530 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=13, ppid=12, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=42b08d50808ded52c1d3d92f8450d54e, ASSIGN in 378 msec 2023-10-05 20:00:08,532 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=16, resume processing ppid=14 2023-10-05 20:00:08,532 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=16, ppid=14, state=SUCCESS; OpenRegionProcedure 897da2b0932b7dd6fce7cdb7be302914, server=jenkins-hbase4.apache.org,44821,1696535998698 in 216 msec 2023-10-05 20:00:08,535 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=14, resume processing ppid=12 2023-10-05 20:00:08,535 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=14, ppid=12, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=897da2b0932b7dd6fce7cdb7be302914, ASSIGN in 382 msec 2023-10-05 20:00:08,536 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-10-05 20:00:08,536 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696536008536"}]},"ts":"1696536008536"} 2023-10-05 20:00:08,538 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=ENABLED in hbase:meta 2023-10-05 20:00:08,541 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_POST_OPERATION 2023-10-05 20:00:08,547 DEBUG [PEWorker-5] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportWithTargetName jenkins: RWXCA 2023-10-05 20:00:08,558 DEBUG [hconnection-0x1804b230-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-05 20:00:08,562 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:48688, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.0 (auth:SIMPLE), service=ClientService 2023-10-05 20:00:08,571 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=32861] access.PermissionStorage(611): Read acl: entry[testtb-testExportWithTargetName], kv [jenkins: RWXCA] 2023-10-05 20:00:08,592 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40857] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-10-05 20:00:08,605 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): master:40857-0x101182c1f970000, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-10-05 20:00:08,605 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): regionserver:32861-0x101182c1f970001, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-10-05 20:00:08,605 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): master:40857-0x101182c1f970000, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-10-05 20:00:08,605 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): regionserver:36369-0x101182c1f970003, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-10-05 20:00:08,605 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): regionserver:44821-0x101182c1f970002, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-10-05 20:00:08,612 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): master:40857-0x101182c1f970000, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-10-05 20:00:08,612 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-10-05 20:00:08,612 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-10-05 20:00:08,612 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-10-05 20:00:08,613 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-10-05 20:00:08,616 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=12, state=SUCCESS; CreateTableProcedure table=testtb-testExportWithTargetName in 642 msec 2023-10-05 20:00:09,094 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40857] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-10-05 20:00:09,095 INFO [Listener at jenkins-hbase4.apache.org/35067] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportWithTargetName, procId: 12 completed 2023-10-05 20:00:09,099 DEBUG [Listener at jenkins-hbase4.apache.org/35067] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportWithTargetName 2023-10-05 20:00:09,101 DEBUG [Listener at jenkins-hbase4.apache.org/35067] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportWithTargetName,,1696536007971.42b08d50808ded52c1d3d92f8450d54e. 2023-10-05 20:00:09,103 INFO [Listener at jenkins-hbase4.apache.org/35067] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-10-05 20:00:09,131 DEBUG [hconnection-0x4e0a2980-shared-pool-4] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-05 20:00:09,135 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:45716, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-05 20:00:09,157 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40857] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-10-05 20:00:09,157 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40857] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1696536009157 (current time:1696536009157). 2023-10-05 20:00:09,157 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40857] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-10-05 20:00:09,159 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40857] zookeeper.ReadOnlyZKClient(139): Connect 0x1c44414c to 127.0.0.1:57530 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-05 20:00:09,167 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40857] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@816e4cf, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-05 20:00:09,168 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40857] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-05 20:00:09,171 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:48700, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-05 20:00:09,172 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40857] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1c44414c to 127.0.0.1:57530 2023-10-05 20:00:09,172 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40857] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-05 20:00:09,176 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40857] zookeeper.ReadOnlyZKClient(139): Connect 0x1da41d55 to 127.0.0.1:57530 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-05 20:00:09,184 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40857] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6d3af36f, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-05 20:00:09,278 DEBUG [hconnection-0x2fee091c-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-05 20:00:09,279 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:48710, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-05 20:00:09,284 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40857] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-05 20:00:09,285 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:46476, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-05 20:00:09,286 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40857] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1da41d55 to 127.0.0.1:57530 2023-10-05 20:00:09,286 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40857] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-05 20:00:09,286 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40857] access.PermissionStorage(611): Read acl: entry[testtb-testExportWithTargetName], kv [jenkins: RWXCA] 2023-10-05 20:00:09,307 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40857] snapshot.SnapshotManager(637): No existing snapshot, attempting snapshot... 2023-10-05 20:00:09,308 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40857] snapshot.SnapshotManager(684): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-10-05 20:00:09,321 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40857] snapshot.SnapshotManager(519): Unable to retrieve ACL status for path: hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/.hbase-snapshot, current working dir path: hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName org.apache.hadoop.hdfs.protocol.AclException: The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.ipc.RemoteException.instantiateException(RemoteException.java:121) at org.apache.hadoop.ipc.RemoteException.unwrapRemoteException(RemoteException.java:88) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2736) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2294) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2291) at org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81) at org.apache.hadoop.hdfs.DistributedFileSystem.getAclStatus(DistributedFileSystem.java:2291) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.updateWorkingDirAclsIfRequired(SnapshotManager.java:517) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.prepareToTakeSnapshot(SnapshotManager.java:490) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.snapshotEnabledTable(SnapshotManager.java:559) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshotInternal(SnapshotManager.java:687) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshot(SnapshotManager.java:623) at org.apache.hadoop.hbase.master.MasterRpcServices.snapshot(MasterRpcServices.java:1588) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) Caused by: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.hdfs.protocol.AclException): The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at org.apache.hadoop.ipc.Client.getRpcResponse(Client.java:1540) at org.apache.hadoop.ipc.Client.call(Client.java:1486) at org.apache.hadoop.ipc.Client.call(Client.java:1385) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:232) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:118) at com.sun.proxy.$Proxy32.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.getAclStatus(ClientNamenodeProtocolTranslatorPB.java:1385) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:422) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeMethod(RetryInvocationHandler.java:165) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invoke(RetryInvocationHandler.java:157) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeOnce(RetryInvocationHandler.java:95) at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:359) at com.sun.proxy.$Proxy35.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2734) ... 15 more 2023-10-05 20:00:09,339 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40857] procedure2.ProcedureExecutor(1028): Stored pid=17, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-10-05 20:00:09,340 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=17, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-10-05 20:00:09,342 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=17, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE; timeout=600000, timestamp=1696536609342 2023-10-05 20:00:09,342 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40857] snapshot.SnapshotManager(689): Started snapshot: { ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-10-05 20:00:09,342 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName 2023-10-05 20:00:09,345 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=17, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-10-05 20:00:09,346 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=18, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-10-05 20:00:09,347 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=17, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE in 13 msec 2023-10-05 20:00:09,348 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=18, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-10-05 20:00:09,349 DEBUG [Listener at jenkins-hbase4.apache.org/35067] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-10-05 20:00:09,349 DEBUG [Listener at jenkins-hbase4.apache.org/35067] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-10-05 20:00:09,350 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=18, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED; timeout=600000, timestamp=1696536609350 2023-10-05 20:00:09,374 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportWithTargetName 2023-10-05 20:00:09,374 INFO [(jenkins-hbase4.apache.org,40857,1696535997381)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportWithTargetName' 2023-10-05 20:00:09,374 DEBUG [(jenkins-hbase4.apache.org,40857,1696535997381)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-05 20:00:09,375 DEBUG [(jenkins-hbase4.apache.org,40857,1696535997381)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' 2023-10-05 20:00:09,375 DEBUG [(jenkins-hbase4.apache.org,40857,1696535997381)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportWithTargetName', kicking off acquire phase on members. 2023-10-05 20:00:09,376 DEBUG [(jenkins-hbase4.apache.org,40857,1696535997381)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40857-0x101182c1f970000, quorum=127.0.0.1:57530, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-10-05 20:00:09,376 DEBUG [(jenkins-hbase4.apache.org,40857,1696535997381)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-10-05 20:00:09,385 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): regionserver:44821-0x101182c1f970002, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-05 20:00:09,385 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): regionserver:36369-0x101182c1f970003, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-05 20:00:09,385 DEBUG [(jenkins-hbase4.apache.org,40857,1696535997381)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,44821,1696535998698 2023-10-05 20:00:09,385 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): regionserver:32861-0x101182c1f970001, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-05 20:00:09,385 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-05 20:00:09,385 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-05 20:00:09,385 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-05 20:00:09,386 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-05 20:00:09,386 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-05 20:00:09,386 DEBUG [(jenkins-hbase4.apache.org,40857,1696535997381)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40857-0x101182c1f970000, quorum=127.0.0.1:57530, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,44821,1696535998698 2023-10-05 20:00:09,386 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-05 20:00:09,386 DEBUG [(jenkins-hbase4.apache.org,40857,1696535997381)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,36369,1696535998737 2023-10-05 20:00:09,386 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-10-05 20:00:09,386 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-10-05 20:00:09,386 DEBUG [(jenkins-hbase4.apache.org,40857,1696535997381)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40857-0x101182c1f970000, quorum=127.0.0.1:57530, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,36369,1696535998737 2023-10-05 20:00:09,386 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-10-05 20:00:09,386 DEBUG [(jenkins-hbase4.apache.org,40857,1696535997381)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-05 20:00:09,387 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44821-0x101182c1f970002, quorum=127.0.0.1:57530, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-10-05 20:00:09,387 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:32861-0x101182c1f970001, quorum=127.0.0.1:57530, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-10-05 20:00:09,387 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36369-0x101182c1f970003, quorum=127.0.0.1:57530, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-10-05 20:00:09,387 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 171 2023-10-05 20:00:09,387 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-10-05 20:00:09,387 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 171 2023-10-05 20:00:09,387 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-10-05 20:00:09,387 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 171 2023-10-05 20:00:09,388 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-10-05 20:00:09,388 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-10-05 20:00:09,388 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-10-05 20:00:09,388 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-10-05 20:00:09,396 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportWithTargetName 2023-10-05 20:00:09,396 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportWithTargetName 2023-10-05 20:00:09,397 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportWithTargetName 2023-10-05 20:00:09,397 DEBUG [member: 'jenkins-hbase4.apache.org,44821,1696535998698' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportWithTargetName' with timeout 300000ms 2023-10-05 20:00:09,397 DEBUG [member: 'jenkins-hbase4.apache.org,32861,1696535998642' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportWithTargetName' with timeout 300000ms 2023-10-05 20:00:09,397 DEBUG [member: 'jenkins-hbase4.apache.org,32861,1696535998642' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-05 20:00:09,397 DEBUG [member: 'jenkins-hbase4.apache.org,36369,1696535998737' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportWithTargetName' with timeout 300000ms 2023-10-05 20:00:09,398 DEBUG [member: 'jenkins-hbase4.apache.org,32861,1696535998642' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' stage 2023-10-05 20:00:09,397 DEBUG [member: 'jenkins-hbase4.apache.org,44821,1696535998698' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-05 20:00:09,398 DEBUG [member: 'jenkins-hbase4.apache.org,32861,1696535998642' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally acquired 2023-10-05 20:00:09,399 DEBUG [member: 'jenkins-hbase4.apache.org,44821,1696535998698' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' stage 2023-10-05 20:00:09,398 DEBUG [member: 'jenkins-hbase4.apache.org,36369,1696535998737' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-05 20:00:09,399 DEBUG [member: 'jenkins-hbase4.apache.org,44821,1696535998698' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally acquired 2023-10-05 20:00:09,399 DEBUG [member: 'jenkins-hbase4.apache.org,32861,1696535998642' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,32861,1696535998642' joining acquired barrier for procedure (emptySnaptb0-testExportWithTargetName) in zk 2023-10-05 20:00:09,400 DEBUG [member: 'jenkins-hbase4.apache.org,44821,1696535998698' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44821,1696535998698' joining acquired barrier for procedure (emptySnaptb0-testExportWithTargetName) in zk 2023-10-05 20:00:09,400 DEBUG [member: 'jenkins-hbase4.apache.org,36369,1696535998737' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' stage 2023-10-05 20:00:09,400 DEBUG [member: 'jenkins-hbase4.apache.org,36369,1696535998737' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally acquired 2023-10-05 20:00:09,400 DEBUG [member: 'jenkins-hbase4.apache.org,36369,1696535998737' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,36369,1696535998737' joining acquired barrier for procedure (emptySnaptb0-testExportWithTargetName) in zk 2023-10-05 20:00:09,402 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): master:40857-0x101182c1f970000, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,44821,1696535998698 2023-10-05 20:00:09,402 DEBUG [member: 'jenkins-hbase4.apache.org,44821,1696535998698' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-10-05 20:00:09,403 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,44821,1696535998698 2023-10-05 20:00:09,402 DEBUG [member: 'jenkins-hbase4.apache.org,32861,1696535998642' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-10-05 20:00:09,403 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-05 20:00:09,403 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-05 20:00:09,403 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): master:40857-0x101182c1f970000, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,36369,1696535998737 2023-10-05 20:00:09,403 DEBUG [member: 'jenkins-hbase4.apache.org,44821,1696535998698' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44821-0x101182c1f970002, quorum=127.0.0.1:57530, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-10-05 20:00:09,403 DEBUG [member: 'jenkins-hbase4.apache.org,32861,1696535998642' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:32861-0x101182c1f970001, quorum=127.0.0.1:57530, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-10-05 20:00:09,403 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-05 20:00:09,403 DEBUG [member: 'jenkins-hbase4.apache.org,36369,1696535998737' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-10-05 20:00:09,403 DEBUG [member: 'jenkins-hbase4.apache.org,32861,1696535998642' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-05 20:00:09,403 DEBUG [member: 'jenkins-hbase4.apache.org,44821,1696535998698' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-05 20:00:09,404 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-05 20:00:09,404 DEBUG [member: 'jenkins-hbase4.apache.org,36369,1696535998737' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36369-0x101182c1f970003, quorum=127.0.0.1:57530, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-10-05 20:00:09,404 DEBUG [member: 'jenkins-hbase4.apache.org,36369,1696535998737' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-05 20:00:09,404 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-10-05 20:00:09,405 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32861,1696535998642 2023-10-05 20:00:09,405 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36369,1696535998737 2023-10-05 20:00:09,405 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44821,1696535998698 2023-10-05 20:00:09,406 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-05 20:00:09,406 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,44821,1696535998698' joining acquired barrier for procedure 'emptySnaptb0-testExportWithTargetName' on coordinator 2023-10-05 20:00:09,406 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@46baf9c6[Count = 1] remaining members to acquire global barrier 2023-10-05 20:00:09,406 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,36369,1696535998737 2023-10-05 20:00:09,406 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-05 20:00:09,406 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-05 20:00:09,407 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-05 20:00:09,407 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-05 20:00:09,407 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-10-05 20:00:09,408 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32861,1696535998642 2023-10-05 20:00:09,408 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36369,1696535998737 2023-10-05 20:00:09,408 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44821,1696535998698 2023-10-05 20:00:09,409 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-05 20:00:09,409 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,36369,1696535998737' joining acquired barrier for procedure 'emptySnaptb0-testExportWithTargetName' on coordinator 2023-10-05 20:00:09,409 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@46baf9c6[Count = 0] remaining members to acquire global barrier 2023-10-05 20:00:09,409 DEBUG [(jenkins-hbase4.apache.org,40857,1696535997381)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportWithTargetName' starting 'in-barrier' execution. 2023-10-05 20:00:09,409 DEBUG [(jenkins-hbase4.apache.org,40857,1696535997381)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-10-05 20:00:09,411 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): regionserver:44821-0x101182c1f970002, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-10-05 20:00:09,412 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): regionserver:36369-0x101182c1f970003, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-10-05 20:00:09,412 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-10-05 20:00:09,412 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-10-05 20:00:09,412 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-10-05 20:00:09,412 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): regionserver:32861-0x101182c1f970001, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-10-05 20:00:09,412 DEBUG [member: 'jenkins-hbase4.apache.org,44821,1696535998698' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-10-05 20:00:09,412 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-10-05 20:00:09,412 DEBUG [(jenkins-hbase4.apache.org,40857,1696535997381)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40857-0x101182c1f970000, quorum=127.0.0.1:57530, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,44821,1696535998698 2023-10-05 20:00:09,412 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-10-05 20:00:09,412 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-10-05 20:00:09,412 DEBUG [member: 'jenkins-hbase4.apache.org,36369,1696535998737' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-10-05 20:00:09,412 DEBUG [(jenkins-hbase4.apache.org,40857,1696535997381)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40857-0x101182c1f970000, quorum=127.0.0.1:57530, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,36369,1696535998737 2023-10-05 20:00:09,412 DEBUG [(jenkins-hbase4.apache.org,40857,1696535997381)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-05 20:00:09,413 DEBUG [member: 'jenkins-hbase4.apache.org,36369,1696535998737' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-05 20:00:09,413 DEBUG [rs(jenkins-hbase4.apache.org,36369,1696535998737)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,,1696536007971.42b08d50808ded52c1d3d92f8450d54e. 2023-10-05 20:00:09,413 DEBUG [rs(jenkins-hbase4.apache.org,44821,1696535998698)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,1,1696536007971.897da2b0932b7dd6fce7cdb7be302914. 2023-10-05 20:00:09,413 DEBUG [member: 'jenkins-hbase4.apache.org,44821,1696535998698' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-05 20:00:09,413 DEBUG [member: 'jenkins-hbase4.apache.org,44821,1696535998698' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-05 20:00:09,413 DEBUG [member: 'jenkins-hbase4.apache.org,36369,1696535998737' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-05 20:00:09,413 DEBUG [rs(jenkins-hbase4.apache.org,36369,1696535998737)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,,1696536007971.42b08d50808ded52c1d3d92f8450d54e. started... 2023-10-05 20:00:09,413 DEBUG [rs(jenkins-hbase4.apache.org,44821,1696535998698)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,1,1696536007971.897da2b0932b7dd6fce7cdb7be302914. started... 2023-10-05 20:00:09,415 DEBUG [member: 'jenkins-hbase4.apache.org,32861,1696535998642' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-10-05 20:00:09,415 DEBUG [member: 'jenkins-hbase4.apache.org,32861,1696535998642' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally completed 2023-10-05 20:00:09,415 DEBUG [member: 'jenkins-hbase4.apache.org,32861,1696535998642' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,32861,1696535998642' in zk 2023-10-05 20:00:09,417 DEBUG [rs(jenkins-hbase4.apache.org,44821,1696535998698)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 897da2b0932b7dd6fce7cdb7be302914: 2023-10-05 20:00:09,417 DEBUG [rs(jenkins-hbase4.apache.org,36369,1696535998737)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 42b08d50808ded52c1d3d92f8450d54e: 2023-10-05 20:00:09,419 DEBUG [rs(jenkins-hbase4.apache.org,44821,1696535998698)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,1,1696536007971.897da2b0932b7dd6fce7cdb7be302914.' region-info for snapshot=emptySnaptb0-testExportWithTargetName 2023-10-05 20:00:09,419 DEBUG [member: 'jenkins-hbase4.apache.org,32861,1696535998642' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportWithTargetName' has notified controller of completion 2023-10-05 20:00:09,419 DEBUG [rs(jenkins-hbase4.apache.org,36369,1696535998737)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,,1696536007971.42b08d50808ded52c1d3d92f8450d54e.' region-info for snapshot=emptySnaptb0-testExportWithTargetName 2023-10-05 20:00:09,419 DEBUG [member: 'jenkins-hbase4.apache.org,32861,1696535998642' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-05 20:00:09,419 DEBUG [member: 'jenkins-hbase4.apache.org,32861,1696535998642' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportWithTargetName' completed. 2023-10-05 20:00:09,426 DEBUG [rs(jenkins-hbase4.apache.org,36369,1696535998737)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-05 20:00:09,426 DEBUG [rs(jenkins-hbase4.apache.org,44821,1696535998698)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-05 20:00:09,430 DEBUG [rs(jenkins-hbase4.apache.org,36369,1696535998737)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-10-05 20:00:09,430 DEBUG [rs(jenkins-hbase4.apache.org,44821,1696535998698)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-10-05 20:00:09,452 DEBUG [Listener at jenkins-hbase4.apache.org/35067] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-05 20:00:09,458 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40857] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-10-05 20:00:09,460 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40857] snapshot.SnapshotManager(406): Snapshoting '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-10-05 20:00:09,460 DEBUG [Listener at jenkins-hbase4.apache.org/35067] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-10-05 20:00:09,462 DEBUG [rs(jenkins-hbase4.apache.org,36369,1696535998737)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,,1696536007971.42b08d50808ded52c1d3d92f8450d54e. completed. 2023-10-05 20:00:09,462 DEBUG [rs(jenkins-hbase4.apache.org,36369,1696535998737)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,,1696536007971.42b08d50808ded52c1d3d92f8450d54e. 2023-10-05 20:00:09,463 DEBUG [member: 'jenkins-hbase4.apache.org,36369,1696535998737' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-05 20:00:09,463 DEBUG [member: 'jenkins-hbase4.apache.org,36369,1696535998737' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-05 20:00:09,463 DEBUG [member: 'jenkins-hbase4.apache.org,36369,1696535998737' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,36369,1696535998737 2023-10-05 20:00:09,464 DEBUG [member: 'jenkins-hbase4.apache.org,36369,1696535998737' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally completed 2023-10-05 20:00:09,464 DEBUG [member: 'jenkins-hbase4.apache.org,36369,1696535998737' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,36369,1696535998737' in zk 2023-10-05 20:00:09,466 DEBUG [member: 'jenkins-hbase4.apache.org,36369,1696535998737' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportWithTargetName' has notified controller of completion 2023-10-05 20:00:09,466 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): master:40857-0x101182c1f970000, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,36369,1696535998737 2023-10-05 20:00:09,466 DEBUG [member: 'jenkins-hbase4.apache.org,36369,1696535998737' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-05 20:00:09,466 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,36369,1696535998737 2023-10-05 20:00:09,466 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-05 20:00:09,466 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-05 20:00:09,466 DEBUG [member: 'jenkins-hbase4.apache.org,36369,1696535998737' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportWithTargetName' completed. 2023-10-05 20:00:09,467 DEBUG [rs(jenkins-hbase4.apache.org,44821,1696535998698)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,1,1696536007971.897da2b0932b7dd6fce7cdb7be302914. completed. 2023-10-05 20:00:09,467 DEBUG [rs(jenkins-hbase4.apache.org,44821,1696535998698)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,1,1696536007971.897da2b0932b7dd6fce7cdb7be302914. 2023-10-05 20:00:09,467 DEBUG [member: 'jenkins-hbase4.apache.org,44821,1696535998698' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-05 20:00:09,467 DEBUG [member: 'jenkins-hbase4.apache.org,44821,1696535998698' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-05 20:00:09,467 DEBUG [member: 'jenkins-hbase4.apache.org,44821,1696535998698' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,44821,1696535998698 2023-10-05 20:00:09,467 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-05 20:00:09,468 DEBUG [member: 'jenkins-hbase4.apache.org,44821,1696535998698' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally completed 2023-10-05 20:00:09,468 DEBUG [member: 'jenkins-hbase4.apache.org,44821,1696535998698' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,44821,1696535998698' in zk 2023-10-05 20:00:09,468 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-05 20:00:09,469 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-10-05 20:00:09,470 DEBUG [member: 'jenkins-hbase4.apache.org,44821,1696535998698' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportWithTargetName' has notified controller of completion 2023-10-05 20:00:09,470 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): master:40857-0x101182c1f970000, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,44821,1696535998698 2023-10-05 20:00:09,470 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32861,1696535998642 2023-10-05 20:00:09,470 DEBUG [member: 'jenkins-hbase4.apache.org,44821,1696535998698' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-05 20:00:09,470 DEBUG [member: 'jenkins-hbase4.apache.org,44821,1696535998698' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportWithTargetName' completed. 2023-10-05 20:00:09,471 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36369,1696535998737 2023-10-05 20:00:09,471 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44821,1696535998698 2023-10-05 20:00:09,472 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-05 20:00:09,472 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-10-05 20:00:09,473 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32861,1696535998642 2023-10-05 20:00:09,473 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36369,1696535998737 2023-10-05 20:00:09,473 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44821,1696535998698 2023-10-05 20:00:09,474 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,36369,1696535998737': 2023-10-05 20:00:09,474 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,36369,1696535998737' released barrier for procedure'emptySnaptb0-testExportWithTargetName', counting down latch. Waiting for 1 more 2023-10-05 20:00:09,475 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,44821,1696535998698 2023-10-05 20:00:09,475 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-05 20:00:09,475 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-05 20:00:09,475 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-05 20:00:09,476 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-05 20:00:09,476 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-10-05 20:00:09,476 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32861,1696535998642 2023-10-05 20:00:09,477 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36369,1696535998737 2023-10-05 20:00:09,477 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44821,1696535998698 2023-10-05 20:00:09,478 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-05 20:00:09,478 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-10-05 20:00:09,478 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32861,1696535998642 2023-10-05 20:00:09,479 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36369,1696535998737 2023-10-05 20:00:09,479 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44821,1696535998698 2023-10-05 20:00:09,479 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,44821,1696535998698': 2023-10-05 20:00:09,479 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,44821,1696535998698' released barrier for procedure'emptySnaptb0-testExportWithTargetName', counting down latch. Waiting for 0 more 2023-10-05 20:00:09,479 INFO [(jenkins-hbase4.apache.org,40857,1696535997381)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportWithTargetName' execution completed 2023-10-05 20:00:09,480 DEBUG [(jenkins-hbase4.apache.org,40857,1696535997381)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-05 20:00:09,480 DEBUG [(jenkins-hbase4.apache.org,40857,1696535997381)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-05 20:00:09,480 DEBUG [(jenkins-hbase4.apache.org,40857,1696535997381)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportWithTargetName 2023-10-05 20:00:09,480 INFO [(jenkins-hbase4.apache.org,40857,1696535997381)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportWithTargetNameincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-10-05 20:00:09,483 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): regionserver:44821-0x101182c1f970002, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-10-05 20:00:09,483 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): regionserver:32861-0x101182c1f970001, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-10-05 20:00:09,483 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): regionserver:36369-0x101182c1f970003, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-10-05 20:00:09,483 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-10-05 20:00:09,483 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-10-05 20:00:09,483 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): regionserver:36369-0x101182c1f970003, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-05 20:00:09,483 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): regionserver:32861-0x101182c1f970001, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-05 20:00:09,483 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): master:40857-0x101182c1f970000, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-10-05 20:00:09,483 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-10-05 20:00:09,483 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-10-05 20:00:09,483 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): regionserver:44821-0x101182c1f970002, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-05 20:00:09,483 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-10-05 20:00:09,484 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-05 20:00:09,484 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-05 20:00:09,483 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-10-05 20:00:09,483 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-10-05 20:00:09,484 DEBUG [(jenkins-hbase4.apache.org,40857,1696535997381)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40857-0x101182c1f970000, quorum=127.0.0.1:57530, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,32861,1696535998642 2023-10-05 20:00:09,484 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-05 20:00:09,484 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-05 20:00:09,484 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-05 20:00:09,484 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-05 20:00:09,484 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-05 20:00:09,484 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-05 20:00:09,484 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-05 20:00:09,485 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-10-05 20:00:09,485 DEBUG [(jenkins-hbase4.apache.org,40857,1696535997381)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40857-0x101182c1f970000, quorum=127.0.0.1:57530, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,36369,1696535998737 2023-10-05 20:00:09,485 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-10-05 20:00:09,485 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-10-05 20:00:09,485 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-10-05 20:00:09,485 DEBUG [(jenkins-hbase4.apache.org,40857,1696535997381)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40857-0x101182c1f970000, quorum=127.0.0.1:57530, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,44821,1696535998698 2023-10-05 20:00:09,486 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-05 20:00:09,486 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-10-05 20:00:09,486 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32861,1696535998642 2023-10-05 20:00:09,487 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36369,1696535998737 2023-10-05 20:00:09,487 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44821,1696535998698 2023-10-05 20:00:09,488 DEBUG [(jenkins-hbase4.apache.org,40857,1696535997381)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40857-0x101182c1f970000, quorum=127.0.0.1:57530, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,32861,1696535998642 2023-10-05 20:00:09,488 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-05 20:00:09,488 DEBUG [(jenkins-hbase4.apache.org,40857,1696535997381)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40857-0x101182c1f970000, quorum=127.0.0.1:57530, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,36369,1696535998737 2023-10-05 20:00:09,488 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-10-05 20:00:09,488 DEBUG [(jenkins-hbase4.apache.org,40857,1696535997381)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40857-0x101182c1f970000, quorum=127.0.0.1:57530, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,44821,1696535998698 2023-10-05 20:00:09,488 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32861,1696535998642 2023-10-05 20:00:09,489 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36369,1696535998737 2023-10-05 20:00:09,489 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44821,1696535998698 2023-10-05 20:00:09,502 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): master:40857-0x101182c1f970000, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,44821,1696535998698 2023-10-05 20:00:09,502 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): regionserver:44821-0x101182c1f970002, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-05 20:00:09,502 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): master:40857-0x101182c1f970000, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-10-05 20:00:09,502 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-05 20:00:09,502 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): regionserver:32861-0x101182c1f970001, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-05 20:00:09,502 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): regionserver:36369-0x101182c1f970003, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-05 20:00:09,502 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-05 20:00:09,502 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): regionserver:44821-0x101182c1f970002, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-05 20:00:09,502 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-05 20:00:09,502 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): master:40857-0x101182c1f970000, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,36369,1696535998737 2023-10-05 20:00:09,502 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportWithTargetName 2023-10-05 20:00:09,502 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): regionserver:36369-0x101182c1f970003, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-05 20:00:09,502 DEBUG [(jenkins-hbase4.apache.org,40857,1696535997381)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-05 20:00:09,502 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-05 20:00:09,502 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-05 20:00:09,503 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-05 20:00:09,502 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): regionserver:32861-0x101182c1f970001, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-05 20:00:09,503 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-05 20:00:09,503 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-05 20:00:09,502 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportWithTargetName 2023-10-05 20:00:09,502 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): master:40857-0x101182c1f970000, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,32861,1696535998642 2023-10-05 20:00:09,504 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): master:40857-0x101182c1f970000, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-10-05 20:00:09,504 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 90c8eeaaf01a24f585da11044309be71, NAME => 'testtb-testExportWithTargetName,.mob,0.90c8eeaaf01a24f585da11044309be71.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testExportWithTargetName 2023-10-05 20:00:09,504 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): master:40857-0x101182c1f970000, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,44821,1696535998698 2023-10-05 20:00:09,504 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-05 20:00:09,504 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-05 20:00:09,504 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-05 20:00:09,504 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-05 20:00:09,504 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): master:40857-0x101182c1f970000, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-10-05 20:00:09,504 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-10-05 20:00:09,504 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): master:40857-0x101182c1f970000, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,36369,1696535998737 2023-10-05 20:00:09,504 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): master:40857-0x101182c1f970000, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,32861,1696535998642 2023-10-05 20:00:09,504 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): master:40857-0x101182c1f970000, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-10-05 20:00:09,504 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): master:40857-0x101182c1f970000, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-10-05 20:00:09,505 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-10-05 20:00:09,524 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportWithTargetName 2023-10-05 20:00:09,526 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName 2023-10-05 20:00:09,577 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName to hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/.hbase-snapshot/emptySnaptb0-testExportWithTargetName 2023-10-05 20:00:09,578 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed 2023-10-05 20:00:09,578 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName 2023-10-05 20:00:09,579 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName 2023-10-05 20:00:09,579 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName at 1696536009342Completed referencing HFiles for the mob region of table: testtb-testExportWithTargetName at 1696536009524 (+182 ms)Consolidate snapshot: emptySnaptb0-testExportWithTargetName at 1696536009524Loading Region manifests for emptySnaptb0-testExportWithTargetName at 1696536009524Writing data manifest for emptySnaptb0-testExportWithTargetName at 1696536009536 (+12 ms)Verifying snapshot: emptySnaptb0-testExportWithTargetName at 1696536009565 (+29 ms)Snapshot emptySnaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed at 1696536009578 (+13 ms) 2023-10-05 20:00:09,581 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=18, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-10-05 20:00:09,583 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=18, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED in 238 msec 2023-10-05 20:00:09,660 DEBUG [Listener at jenkins-hbase4.apache.org/35067] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-05 20:00:09,665 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40857] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-10-05 20:00:09,666 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40857] snapshot.SnapshotManager(403): Snapshot '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' has completed, notifying client. 2023-10-05 20:00:09,679 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36369] regionserver.HRegion(8805): writing data to region testtb-testExportWithTargetName,,1696536007971.42b08d50808ded52c1d3d92f8450d54e. with WAL disabled. Data may be lost in the event of a crash. 2023-10-05 20:00:09,682 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44821] regionserver.HRegion(8805): writing data to region testtb-testExportWithTargetName,1,1696536007971.897da2b0932b7dd6fce7cdb7be302914. with WAL disabled. Data may be lost in the event of a crash. 2023-10-05 20:00:09,687 DEBUG [Listener at jenkins-hbase4.apache.org/35067] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportWithTargetName 2023-10-05 20:00:09,687 DEBUG [Listener at jenkins-hbase4.apache.org/35067] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportWithTargetName,,1696536007971.42b08d50808ded52c1d3d92f8450d54e. 2023-10-05 20:00:09,687 INFO [Listener at jenkins-hbase4.apache.org/35067] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-10-05 20:00:09,703 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40857] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-10-05 20:00:09,704 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40857] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1696536009704 (current time:1696536009704). 2023-10-05 20:00:09,704 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40857] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-10-05 20:00:09,705 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40857] zookeeper.ReadOnlyZKClient(139): Connect 0x3c0dffb7 to 127.0.0.1:57530 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-05 20:00:09,711 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40857] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@8da7a10, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-05 20:00:09,712 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40857] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-05 20:00:09,715 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:48726, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-05 20:00:09,716 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40857] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x3c0dffb7 to 127.0.0.1:57530 2023-10-05 20:00:09,716 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40857] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-05 20:00:09,717 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40857] zookeeper.ReadOnlyZKClient(139): Connect 0x4f9fe6d1 to 127.0.0.1:57530 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-05 20:00:09,724 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40857] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1cbc58d2, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-05 20:00:09,725 DEBUG [hconnection-0x47edbbaf-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-05 20:00:09,728 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:48732, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-05 20:00:09,731 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40857] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-05 20:00:09,734 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:46484, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-05 20:00:09,735 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40857] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4f9fe6d1 to 127.0.0.1:57530 2023-10-05 20:00:09,735 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40857] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-05 20:00:09,735 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40857] access.PermissionStorage(611): Read acl: entry[testtb-testExportWithTargetName], kv [jenkins: RWXCA] 2023-10-05 20:00:09,736 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40857] snapshot.SnapshotManager(637): No existing snapshot, attempting snapshot... 2023-10-05 20:00:09,736 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40857] snapshot.SnapshotManager(684): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-10-05 20:00:09,739 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40857] snapshot.SnapshotManager(519): Unable to retrieve ACL status for path: hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/.hbase-snapshot, current working dir path: hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName org.apache.hadoop.hdfs.protocol.AclException: The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.ipc.RemoteException.instantiateException(RemoteException.java:121) at org.apache.hadoop.ipc.RemoteException.unwrapRemoteException(RemoteException.java:88) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2736) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2294) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2291) at org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81) at org.apache.hadoop.hdfs.DistributedFileSystem.getAclStatus(DistributedFileSystem.java:2291) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.updateWorkingDirAclsIfRequired(SnapshotManager.java:517) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.prepareToTakeSnapshot(SnapshotManager.java:490) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.snapshotEnabledTable(SnapshotManager.java:559) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshotInternal(SnapshotManager.java:687) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshot(SnapshotManager.java:623) at org.apache.hadoop.hbase.master.MasterRpcServices.snapshot(MasterRpcServices.java:1588) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) Caused by: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.hdfs.protocol.AclException): The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at org.apache.hadoop.ipc.Client.getRpcResponse(Client.java:1540) at org.apache.hadoop.ipc.Client.call(Client.java:1486) at org.apache.hadoop.ipc.Client.call(Client.java:1385) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:232) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:118) at com.sun.proxy.$Proxy32.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.getAclStatus(ClientNamenodeProtocolTranslatorPB.java:1385) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:422) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeMethod(RetryInvocationHandler.java:165) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invoke(RetryInvocationHandler.java:157) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeOnce(RetryInvocationHandler.java:95) at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:359) at com.sun.proxy.$Proxy35.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2734) ... 15 more 2023-10-05 20:00:09,740 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40857] procedure2.ProcedureExecutor(1028): Stored pid=19, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-10-05 20:00:09,741 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=19, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-10-05 20:00:09,742 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=19, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE; timeout=600000, timestamp=1696536609742 2023-10-05 20:00:09,742 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName 2023-10-05 20:00:09,742 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40857] snapshot.SnapshotManager(689): Started snapshot: { ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-10-05 20:00:09,744 DEBUG [Listener at jenkins-hbase4.apache.org/35067] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-10-05 20:00:09,744 DEBUG [Listener at jenkins-hbase4.apache.org/35067] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-10-05 20:00:09,745 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=19, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-10-05 20:00:09,745 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=20, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-10-05 20:00:09,746 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=19, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE in 6 msec 2023-10-05 20:00:09,747 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=20, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-10-05 20:00:09,748 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=20, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED; timeout=600000, timestamp=1696536609748 2023-10-05 20:00:09,765 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportWithTargetName 2023-10-05 20:00:09,765 INFO [(jenkins-hbase4.apache.org,40857,1696535997381)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportWithTargetName' 2023-10-05 20:00:09,765 DEBUG [(jenkins-hbase4.apache.org,40857,1696535997381)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-05 20:00:09,766 DEBUG [(jenkins-hbase4.apache.org,40857,1696535997381)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportWithTargetName' starting 'acquire' 2023-10-05 20:00:09,766 DEBUG [(jenkins-hbase4.apache.org,40857,1696535997381)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportWithTargetName', kicking off acquire phase on members. 2023-10-05 20:00:09,766 DEBUG [(jenkins-hbase4.apache.org,40857,1696535997381)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40857-0x101182c1f970000, quorum=127.0.0.1:57530, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-10-05 20:00:09,766 DEBUG [(jenkins-hbase4.apache.org,40857,1696535997381)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-10-05 20:00:09,768 DEBUG [(jenkins-hbase4.apache.org,40857,1696535997381)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,44821,1696535998698 2023-10-05 20:00:09,768 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): regionserver:44821-0x101182c1f970002, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-05 20:00:09,768 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): regionserver:32861-0x101182c1f970001, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-05 20:00:09,768 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-05 20:00:09,768 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-05 20:00:09,768 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-05 20:00:09,768 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): regionserver:36369-0x101182c1f970003, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-05 20:00:09,768 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-05 20:00:09,768 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-05 20:00:09,768 DEBUG [(jenkins-hbase4.apache.org,40857,1696535997381)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40857-0x101182c1f970000, quorum=127.0.0.1:57530, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,44821,1696535998698 2023-10-05 20:00:09,768 DEBUG [(jenkins-hbase4.apache.org,40857,1696535997381)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,36369,1696535998737 2023-10-05 20:00:09,768 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-05 20:00:09,769 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-10-05 20:00:09,769 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-10-05 20:00:09,769 DEBUG [(jenkins-hbase4.apache.org,40857,1696535997381)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40857-0x101182c1f970000, quorum=127.0.0.1:57530, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,36369,1696535998737 2023-10-05 20:00:09,769 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-10-05 20:00:09,769 DEBUG [(jenkins-hbase4.apache.org,40857,1696535997381)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-05 20:00:09,769 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:32861-0x101182c1f970001, quorum=127.0.0.1:57530, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-10-05 20:00:09,769 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44821-0x101182c1f970002, quorum=127.0.0.1:57530, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-10-05 20:00:09,769 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36369-0x101182c1f970003, quorum=127.0.0.1:57530, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-10-05 20:00:09,769 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 166 2023-10-05 20:00:09,770 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-10-05 20:00:09,770 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 166 2023-10-05 20:00:09,770 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-10-05 20:00:09,770 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 166 2023-10-05 20:00:09,770 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-10-05 20:00:09,770 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-10-05 20:00:09,770 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-10-05 20:00:09,770 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-10-05 20:00:09,770 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportWithTargetName 2023-10-05 20:00:09,770 DEBUG [member: 'jenkins-hbase4.apache.org,32861,1696535998642' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportWithTargetName' with timeout 300000ms 2023-10-05 20:00:09,770 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportWithTargetName 2023-10-05 20:00:09,770 DEBUG [member: 'jenkins-hbase4.apache.org,32861,1696535998642' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-05 20:00:09,770 DEBUG [member: 'jenkins-hbase4.apache.org,36369,1696535998737' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportWithTargetName' with timeout 300000ms 2023-10-05 20:00:09,771 DEBUG [member: 'jenkins-hbase4.apache.org,32861,1696535998642' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportWithTargetName' starting 'acquire' stage 2023-10-05 20:00:09,771 DEBUG [member: 'jenkins-hbase4.apache.org,32861,1696535998642' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportWithTargetName' locally acquired 2023-10-05 20:00:09,770 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportWithTargetName 2023-10-05 20:00:09,774 DEBUG [member: 'jenkins-hbase4.apache.org,32861,1696535998642' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,32861,1696535998642' joining acquired barrier for procedure (snaptb0-testExportWithTargetName) in zk 2023-10-05 20:00:09,774 DEBUG [member: 'jenkins-hbase4.apache.org,44821,1696535998698' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportWithTargetName' with timeout 300000ms 2023-10-05 20:00:09,771 DEBUG [member: 'jenkins-hbase4.apache.org,36369,1696535998737' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-05 20:00:09,774 DEBUG [member: 'jenkins-hbase4.apache.org,44821,1696535998698' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-05 20:00:09,775 DEBUG [member: 'jenkins-hbase4.apache.org,36369,1696535998737' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportWithTargetName' starting 'acquire' stage 2023-10-05 20:00:09,776 DEBUG [member: 'jenkins-hbase4.apache.org,44821,1696535998698' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportWithTargetName' starting 'acquire' stage 2023-10-05 20:00:09,776 DEBUG [member: 'jenkins-hbase4.apache.org,44821,1696535998698' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportWithTargetName' locally acquired 2023-10-05 20:00:09,776 DEBUG [member: 'jenkins-hbase4.apache.org,36369,1696535998737' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportWithTargetName' locally acquired 2023-10-05 20:00:09,776 DEBUG [member: 'jenkins-hbase4.apache.org,44821,1696535998698' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44821,1696535998698' joining acquired barrier for procedure (snaptb0-testExportWithTargetName) in zk 2023-10-05 20:00:09,776 DEBUG [member: 'jenkins-hbase4.apache.org,36369,1696535998737' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,36369,1696535998737' joining acquired barrier for procedure (snaptb0-testExportWithTargetName) in zk 2023-10-05 20:00:09,778 DEBUG [member: 'jenkins-hbase4.apache.org,32861,1696535998642' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-10-05 20:00:09,779 DEBUG [member: 'jenkins-hbase4.apache.org,44821,1696535998698' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-10-05 20:00:09,779 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): master:40857-0x101182c1f970000, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,44821,1696535998698 2023-10-05 20:00:09,779 DEBUG [member: 'jenkins-hbase4.apache.org,32861,1696535998642' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:32861-0x101182c1f970001, quorum=127.0.0.1:57530, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-10-05 20:00:09,779 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,44821,1696535998698 2023-10-05 20:00:09,779 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): master:40857-0x101182c1f970000, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,36369,1696535998737 2023-10-05 20:00:09,779 DEBUG [member: 'jenkins-hbase4.apache.org,32861,1696535998642' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-05 20:00:09,779 DEBUG [member: 'jenkins-hbase4.apache.org,36369,1696535998737' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-10-05 20:00:09,779 DEBUG [member: 'jenkins-hbase4.apache.org,44821,1696535998698' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44821-0x101182c1f970002, quorum=127.0.0.1:57530, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-10-05 20:00:09,779 DEBUG [member: 'jenkins-hbase4.apache.org,44821,1696535998698' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-05 20:00:09,779 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-05 20:00:09,780 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-05 20:00:09,780 DEBUG [member: 'jenkins-hbase4.apache.org,36369,1696535998737' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36369-0x101182c1f970003, quorum=127.0.0.1:57530, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-10-05 20:00:09,780 DEBUG [member: 'jenkins-hbase4.apache.org,36369,1696535998737' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-05 20:00:09,780 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-05 20:00:09,780 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-05 20:00:09,781 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-10-05 20:00:09,781 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32861,1696535998642 2023-10-05 20:00:09,781 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36369,1696535998737 2023-10-05 20:00:09,782 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44821,1696535998698 2023-10-05 20:00:09,782 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-05 20:00:09,782 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,44821,1696535998698' joining acquired barrier for procedure 'snaptb0-testExportWithTargetName' on coordinator 2023-10-05 20:00:09,782 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6bec080f[Count = 1] remaining members to acquire global barrier 2023-10-05 20:00:09,782 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,36369,1696535998737 2023-10-05 20:00:09,783 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-05 20:00:09,783 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-05 20:00:09,783 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-05 20:00:09,783 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-05 20:00:09,783 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-10-05 20:00:09,784 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32861,1696535998642 2023-10-05 20:00:09,784 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36369,1696535998737 2023-10-05 20:00:09,784 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44821,1696535998698 2023-10-05 20:00:09,785 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-05 20:00:09,785 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,36369,1696535998737' joining acquired barrier for procedure 'snaptb0-testExportWithTargetName' on coordinator 2023-10-05 20:00:09,785 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6bec080f[Count = 0] remaining members to acquire global barrier 2023-10-05 20:00:09,785 DEBUG [(jenkins-hbase4.apache.org,40857,1696535997381)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportWithTargetName' starting 'in-barrier' execution. 2023-10-05 20:00:09,785 DEBUG [(jenkins-hbase4.apache.org,40857,1696535997381)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-10-05 20:00:09,789 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): regionserver:44821-0x101182c1f970002, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-10-05 20:00:09,789 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): regionserver:36369-0x101182c1f970003, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-10-05 20:00:09,789 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-10-05 20:00:09,789 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): regionserver:32861-0x101182c1f970001, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-10-05 20:00:09,789 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-10-05 20:00:09,790 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-10-05 20:00:09,789 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-10-05 20:00:09,790 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-10-05 20:00:09,790 DEBUG [member: 'jenkins-hbase4.apache.org,44821,1696535998698' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-10-05 20:00:09,790 DEBUG [member: 'jenkins-hbase4.apache.org,32861,1696535998642' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-10-05 20:00:09,790 DEBUG [member: 'jenkins-hbase4.apache.org,32861,1696535998642' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportWithTargetName' locally completed 2023-10-05 20:00:09,790 DEBUG [(jenkins-hbase4.apache.org,40857,1696535997381)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40857-0x101182c1f970000, quorum=127.0.0.1:57530, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,44821,1696535998698 2023-10-05 20:00:09,790 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-10-05 20:00:09,790 DEBUG [member: 'jenkins-hbase4.apache.org,32861,1696535998642' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,32861,1696535998642' in zk 2023-10-05 20:00:09,790 DEBUG [member: 'jenkins-hbase4.apache.org,36369,1696535998737' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-10-05 20:00:09,790 DEBUG [rs(jenkins-hbase4.apache.org,44821,1696535998698)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,1,1696536007971.897da2b0932b7dd6fce7cdb7be302914. 2023-10-05 20:00:09,790 DEBUG [member: 'jenkins-hbase4.apache.org,44821,1696535998698' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-05 20:00:09,790 DEBUG [member: 'jenkins-hbase4.apache.org,44821,1696535998698' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-05 20:00:09,790 DEBUG [rs(jenkins-hbase4.apache.org,44821,1696535998698)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,1,1696536007971.897da2b0932b7dd6fce7cdb7be302914. started... 2023-10-05 20:00:09,790 DEBUG [member: 'jenkins-hbase4.apache.org,36369,1696535998737' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-05 20:00:09,790 DEBUG [member: 'jenkins-hbase4.apache.org,36369,1696535998737' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-05 20:00:09,790 DEBUG [(jenkins-hbase4.apache.org,40857,1696535997381)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40857-0x101182c1f970000, quorum=127.0.0.1:57530, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,36369,1696535998737 2023-10-05 20:00:09,790 DEBUG [rs(jenkins-hbase4.apache.org,36369,1696535998737)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,,1696536007971.42b08d50808ded52c1d3d92f8450d54e. 2023-10-05 20:00:09,791 DEBUG [(jenkins-hbase4.apache.org,40857,1696535997381)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-05 20:00:09,791 INFO [rs(jenkins-hbase4.apache.org,44821,1696535998698)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 897da2b0932b7dd6fce7cdb7be302914 1/1 column families, dataSize=3.06 KB heapSize=6.86 KB 2023-10-05 20:00:09,791 DEBUG [rs(jenkins-hbase4.apache.org,36369,1696535998737)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,,1696536007971.42b08d50808ded52c1d3d92f8450d54e. started... 2023-10-05 20:00:09,791 INFO [rs(jenkins-hbase4.apache.org,36369,1696535998737)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 42b08d50808ded52c1d3d92f8450d54e 1/1 column families, dataSize=199 B heapSize=688 B 2023-10-05 20:00:09,793 DEBUG [member: 'jenkins-hbase4.apache.org,32861,1696535998642' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportWithTargetName' has notified controller of completion 2023-10-05 20:00:09,793 DEBUG [member: 'jenkins-hbase4.apache.org,32861,1696535998642' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-05 20:00:09,793 DEBUG [member: 'jenkins-hbase4.apache.org,32861,1696535998642' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportWithTargetName' completed. 2023-10-05 20:00:09,844 DEBUG [Listener at jenkins-hbase4.apache.org/35067] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-05 20:00:09,845 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40857] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-10-05 20:00:09,845 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40857] snapshot.SnapshotManager(406): Snapshoting '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-10-05 20:00:09,846 DEBUG [Listener at jenkins-hbase4.apache.org/35067] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-10-05 20:00:09,926 INFO [rs(jenkins-hbase4.apache.org,36369,1696535998737)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231005876891c6343a4d659a208bfd6e0695de to hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e20231005876891c6343a4d659a208bfd6e0695de 2023-10-05 20:00:09,926 INFO [rs(jenkins-hbase4.apache.org,44821,1696535998698)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202310058d4f082320e74a90ad27238411d9a5ae to hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b202310058d4f082320e74a90ad27238411d9a5ae 2023-10-05 20:00:09,965 INFO [rs(jenkins-hbase4.apache.org,36369,1696535998737)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=199, hasBloomFilter=true, into tmp file hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/data/default/testtb-testExportWithTargetName/42b08d50808ded52c1d3d92f8450d54e/.tmp/cf/dc3bafe8509e4ea6ac3f0ebd50218a4e 2023-10-05 20:00:09,970 INFO [rs(jenkins-hbase4.apache.org,44821,1696535998698)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=3.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/data/default/testtb-testExportWithTargetName/897da2b0932b7dd6fce7cdb7be302914/.tmp/cf/8687d669b42a4528bf3a77a7cd44c6f0 2023-10-05 20:00:09,981 DEBUG [rs(jenkins-hbase4.apache.org,36369,1696535998737)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/data/default/testtb-testExportWithTargetName/42b08d50808ded52c1d3d92f8450d54e/.tmp/cf/dc3bafe8509e4ea6ac3f0ebd50218a4e as hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/data/default/testtb-testExportWithTargetName/42b08d50808ded52c1d3d92f8450d54e/cf/dc3bafe8509e4ea6ac3f0ebd50218a4e 2023-10-05 20:00:09,988 DEBUG [rs(jenkins-hbase4.apache.org,44821,1696535998698)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/data/default/testtb-testExportWithTargetName/897da2b0932b7dd6fce7cdb7be302914/.tmp/cf/8687d669b42a4528bf3a77a7cd44c6f0 as hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/data/default/testtb-testExportWithTargetName/897da2b0932b7dd6fce7cdb7be302914/cf/8687d669b42a4528bf3a77a7cd44c6f0 2023-10-05 20:00:09,991 INFO [rs(jenkins-hbase4.apache.org,36369,1696535998737)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/data/default/testtb-testExportWithTargetName/42b08d50808ded52c1d3d92f8450d54e/cf/dc3bafe8509e4ea6ac3f0ebd50218a4e, entries=3, sequenceid=6, filesize=5.4 K 2023-10-05 20:00:09,994 INFO [rs(jenkins-hbase4.apache.org,36369,1696535998737)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~199 B/199, heapSize ~672 B/672, currentSize=0 B/0 for 42b08d50808ded52c1d3d92f8450d54e in 203ms, sequenceid=6, compaction requested=false 2023-10-05 20:00:09,994 DEBUG [rs(jenkins-hbase4.apache.org,36369,1696535998737)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportWithTargetName' 2023-10-05 20:00:09,995 DEBUG [rs(jenkins-hbase4.apache.org,36369,1696535998737)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 42b08d50808ded52c1d3d92f8450d54e: 2023-10-05 20:00:09,996 DEBUG [rs(jenkins-hbase4.apache.org,36369,1696535998737)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,,1696536007971.42b08d50808ded52c1d3d92f8450d54e.' region-info for snapshot=snaptb0-testExportWithTargetName 2023-10-05 20:00:09,996 DEBUG [rs(jenkins-hbase4.apache.org,36369,1696535998737)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-05 20:00:09,996 DEBUG [rs(jenkins-hbase4.apache.org,36369,1696535998737)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/data/default/testtb-testExportWithTargetName/42b08d50808ded52c1d3d92f8450d54e/cf/dc3bafe8509e4ea6ac3f0ebd50218a4e] hfiles 2023-10-05 20:00:09,996 DEBUG [rs(jenkins-hbase4.apache.org,36369,1696535998737)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/data/default/testtb-testExportWithTargetName/42b08d50808ded52c1d3d92f8450d54e/cf/dc3bafe8509e4ea6ac3f0ebd50218a4e for snapshot=snaptb0-testExportWithTargetName 2023-10-05 20:00:09,998 INFO [rs(jenkins-hbase4.apache.org,44821,1696535998698)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/data/default/testtb-testExportWithTargetName/897da2b0932b7dd6fce7cdb7be302914/cf/8687d669b42a4528bf3a77a7cd44c6f0, entries=47, sequenceid=6, filesize=12.8 K 2023-10-05 20:00:10,001 INFO [rs(jenkins-hbase4.apache.org,44821,1696535998698)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.06 KB/3137, heapSize ~6.84 KB/7008, currentSize=0 B/0 for 897da2b0932b7dd6fce7cdb7be302914 in 210ms, sequenceid=6, compaction requested=false 2023-10-05 20:00:10,002 DEBUG [rs(jenkins-hbase4.apache.org,44821,1696535998698)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 897da2b0932b7dd6fce7cdb7be302914: 2023-10-05 20:00:10,002 DEBUG [rs(jenkins-hbase4.apache.org,44821,1696535998698)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,1,1696536007971.897da2b0932b7dd6fce7cdb7be302914.' region-info for snapshot=snaptb0-testExportWithTargetName 2023-10-05 20:00:10,002 DEBUG [rs(jenkins-hbase4.apache.org,44821,1696535998698)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-05 20:00:10,002 DEBUG [rs(jenkins-hbase4.apache.org,44821,1696535998698)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/data/default/testtb-testExportWithTargetName/897da2b0932b7dd6fce7cdb7be302914/cf/8687d669b42a4528bf3a77a7cd44c6f0] hfiles 2023-10-05 20:00:10,002 DEBUG [rs(jenkins-hbase4.apache.org,44821,1696535998698)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/data/default/testtb-testExportWithTargetName/897da2b0932b7dd6fce7cdb7be302914/cf/8687d669b42a4528bf3a77a7cd44c6f0 for snapshot=snaptb0-testExportWithTargetName 2023-10-05 20:00:10,028 DEBUG [rs(jenkins-hbase4.apache.org,44821,1696535998698)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,1,1696536007971.897da2b0932b7dd6fce7cdb7be302914. completed. 2023-10-05 20:00:10,029 DEBUG [rs(jenkins-hbase4.apache.org,44821,1696535998698)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,1,1696536007971.897da2b0932b7dd6fce7cdb7be302914. 2023-10-05 20:00:10,029 DEBUG [member: 'jenkins-hbase4.apache.org,44821,1696535998698' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-05 20:00:10,029 DEBUG [member: 'jenkins-hbase4.apache.org,44821,1696535998698' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-05 20:00:10,029 DEBUG [member: 'jenkins-hbase4.apache.org,44821,1696535998698' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,44821,1696535998698 2023-10-05 20:00:10,029 DEBUG [rs(jenkins-hbase4.apache.org,36369,1696535998737)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,,1696536007971.42b08d50808ded52c1d3d92f8450d54e. completed. 2023-10-05 20:00:10,029 DEBUG [rs(jenkins-hbase4.apache.org,36369,1696535998737)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,,1696536007971.42b08d50808ded52c1d3d92f8450d54e. 2023-10-05 20:00:10,029 DEBUG [member: 'jenkins-hbase4.apache.org,44821,1696535998698' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportWithTargetName' locally completed 2023-10-05 20:00:10,029 DEBUG [member: 'jenkins-hbase4.apache.org,36369,1696535998737' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-05 20:00:10,029 DEBUG [member: 'jenkins-hbase4.apache.org,36369,1696535998737' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-05 20:00:10,029 DEBUG [member: 'jenkins-hbase4.apache.org,36369,1696535998737' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,36369,1696535998737 2023-10-05 20:00:10,029 DEBUG [member: 'jenkins-hbase4.apache.org,44821,1696535998698' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,44821,1696535998698' in zk 2023-10-05 20:00:10,029 DEBUG [member: 'jenkins-hbase4.apache.org,36369,1696535998737' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportWithTargetName' locally completed 2023-10-05 20:00:10,030 DEBUG [member: 'jenkins-hbase4.apache.org,36369,1696535998737' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,36369,1696535998737' in zk 2023-10-05 20:00:10,031 DEBUG [member: 'jenkins-hbase4.apache.org,44821,1696535998698' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportWithTargetName' has notified controller of completion 2023-10-05 20:00:10,032 DEBUG [member: 'jenkins-hbase4.apache.org,36369,1696535998737' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportWithTargetName' has notified controller of completion 2023-10-05 20:00:10,032 DEBUG [member: 'jenkins-hbase4.apache.org,36369,1696535998737' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-05 20:00:10,031 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): master:40857-0x101182c1f970000, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,44821,1696535998698 2023-10-05 20:00:10,032 DEBUG [member: 'jenkins-hbase4.apache.org,36369,1696535998737' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportWithTargetName' completed. 2023-10-05 20:00:10,033 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,44821,1696535998698 2023-10-05 20:00:10,032 DEBUG [member: 'jenkins-hbase4.apache.org,44821,1696535998698' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-05 20:00:10,033 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-05 20:00:10,033 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): master:40857-0x101182c1f970000, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,36369,1696535998737 2023-10-05 20:00:10,033 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-05 20:00:10,033 DEBUG [member: 'jenkins-hbase4.apache.org,44821,1696535998698' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportWithTargetName' completed. 2023-10-05 20:00:10,034 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-05 20:00:10,034 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-05 20:00:10,035 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-10-05 20:00:10,035 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32861,1696535998642 2023-10-05 20:00:10,036 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36369,1696535998737 2023-10-05 20:00:10,036 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44821,1696535998698 2023-10-05 20:00:10,036 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-05 20:00:10,037 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-10-05 20:00:10,037 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32861,1696535998642 2023-10-05 20:00:10,037 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36369,1696535998737 2023-10-05 20:00:10,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44821,1696535998698 2023-10-05 20:00:10,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,44821,1696535998698': 2023-10-05 20:00:10,039 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,44821,1696535998698' released barrier for procedure'snaptb0-testExportWithTargetName', counting down latch. Waiting for 1 more 2023-10-05 20:00:10,039 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,36369,1696535998737 2023-10-05 20:00:10,039 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-05 20:00:10,039 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-05 20:00:10,039 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-05 20:00:10,039 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-05 20:00:10,040 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-10-05 20:00:10,040 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32861,1696535998642 2023-10-05 20:00:10,040 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36369,1696535998737 2023-10-05 20:00:10,041 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44821,1696535998698 2023-10-05 20:00:10,041 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-05 20:00:10,041 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-10-05 20:00:10,042 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32861,1696535998642 2023-10-05 20:00:10,042 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36369,1696535998737 2023-10-05 20:00:10,042 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44821,1696535998698 2023-10-05 20:00:10,043 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,36369,1696535998737': 2023-10-05 20:00:10,043 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,36369,1696535998737' released barrier for procedure'snaptb0-testExportWithTargetName', counting down latch. Waiting for 0 more 2023-10-05 20:00:10,043 INFO [(jenkins-hbase4.apache.org,40857,1696535997381)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportWithTargetName' execution completed 2023-10-05 20:00:10,043 DEBUG [(jenkins-hbase4.apache.org,40857,1696535997381)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-05 20:00:10,043 DEBUG [(jenkins-hbase4.apache.org,40857,1696535997381)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-05 20:00:10,043 DEBUG [(jenkins-hbase4.apache.org,40857,1696535997381)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportWithTargetName 2023-10-05 20:00:10,043 INFO [(jenkins-hbase4.apache.org,40857,1696535997381)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportWithTargetNameincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-10-05 20:00:10,045 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): regionserver:44821-0x101182c1f970002, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-10-05 20:00:10,045 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): regionserver:36369-0x101182c1f970003, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-10-05 20:00:10,045 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): regionserver:32861-0x101182c1f970001, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-10-05 20:00:10,045 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-10-05 20:00:10,045 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): master:40857-0x101182c1f970000, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-10-05 20:00:10,045 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-10-05 20:00:10,045 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-10-05 20:00:10,045 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): regionserver:32861-0x101182c1f970001, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-05 20:00:10,045 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): regionserver:36369-0x101182c1f970003, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-05 20:00:10,045 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-10-05 20:00:10,046 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-10-05 20:00:10,045 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): regionserver:44821-0x101182c1f970002, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-05 20:00:10,045 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-10-05 20:00:10,046 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-05 20:00:10,046 DEBUG [(jenkins-hbase4.apache.org,40857,1696535997381)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40857-0x101182c1f970000, quorum=127.0.0.1:57530, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,32861,1696535998642 2023-10-05 20:00:10,045 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-10-05 20:00:10,046 DEBUG [Listener at jenkins-hbase4.apache.org/35067] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-05 20:00:10,046 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-05 20:00:10,046 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-05 20:00:10,046 DEBUG [(jenkins-hbase4.apache.org,40857,1696535997381)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40857-0x101182c1f970000, quorum=127.0.0.1:57530, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,36369,1696535998737 2023-10-05 20:00:10,046 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-05 20:00:10,046 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-05 20:00:10,046 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-05 20:00:10,046 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-05 20:00:10,047 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-05 20:00:10,047 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-10-05 20:00:10,047 DEBUG [(jenkins-hbase4.apache.org,40857,1696535997381)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40857-0x101182c1f970000, quorum=127.0.0.1:57530, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,44821,1696535998698 2023-10-05 20:00:10,047 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-10-05 20:00:10,047 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-10-05 20:00:10,047 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-05 20:00:10,048 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40857] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-10-05 20:00:10,048 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40857] snapshot.SnapshotManager(406): Snapshoting '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-10-05 20:00:10,048 DEBUG [Listener at jenkins-hbase4.apache.org/35067] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-10-05 20:00:10,048 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-10-05 20:00:10,049 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-05 20:00:10,049 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-10-05 20:00:10,050 DEBUG [(jenkins-hbase4.apache.org,40857,1696535997381)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40857-0x101182c1f970000, quorum=127.0.0.1:57530, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,32861,1696535998642 2023-10-05 20:00:10,050 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32861,1696535998642 2023-10-05 20:00:10,050 DEBUG [(jenkins-hbase4.apache.org,40857,1696535997381)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40857-0x101182c1f970000, quorum=127.0.0.1:57530, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,36369,1696535998737 2023-10-05 20:00:10,050 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36369,1696535998737 2023-10-05 20:00:10,050 DEBUG [(jenkins-hbase4.apache.org,40857,1696535997381)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40857-0x101182c1f970000, quorum=127.0.0.1:57530, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,44821,1696535998698 2023-10-05 20:00:10,051 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44821,1696535998698 2023-10-05 20:00:10,051 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-05 20:00:10,051 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-10-05 20:00:10,052 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32861,1696535998642 2023-10-05 20:00:10,052 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36369,1696535998737 2023-10-05 20:00:10,053 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44821,1696535998698 2023-10-05 20:00:10,063 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): master:40857-0x101182c1f970000, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,44821,1696535998698 2023-10-05 20:00:10,063 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): regionserver:44821-0x101182c1f970002, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-05 20:00:10,063 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): master:40857-0x101182c1f970000, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-10-05 20:00:10,063 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): master:40857-0x101182c1f970000, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,36369,1696535998737 2023-10-05 20:00:10,063 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): regionserver:32861-0x101182c1f970001, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-05 20:00:10,063 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): regionserver:44821-0x101182c1f970002, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-05 20:00:10,063 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-05 20:00:10,063 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): master:40857-0x101182c1f970000, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,32861,1696535998642 2023-10-05 20:00:10,063 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-05 20:00:10,063 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-05 20:00:10,064 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-05 20:00:10,063 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): regionserver:36369-0x101182c1f970003, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-05 20:00:10,063 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportWithTargetName 2023-10-05 20:00:10,064 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): regionserver:36369-0x101182c1f970003, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-05 20:00:10,064 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportWithTargetName 2023-10-05 20:00:10,063 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): master:40857-0x101182c1f970000, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-10-05 20:00:10,063 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:40857-0x101182c1f970000, quorum=127.0.0.1:57530, baseZNode=/hbase Unable to get data of znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName because node does not exist (not an error) 2023-10-05 20:00:10,063 DEBUG [(jenkins-hbase4.apache.org,40857,1696535997381)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-05 20:00:10,063 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): regionserver:32861-0x101182c1f970001, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-05 20:00:10,064 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 90c8eeaaf01a24f585da11044309be71, NAME => 'testtb-testExportWithTargetName,.mob,0.90c8eeaaf01a24f585da11044309be71.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testExportWithTargetName 2023-10-05 20:00:10,064 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): master:40857-0x101182c1f970000, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,44821,1696535998698 2023-10-05 20:00:10,065 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-10-05 20:00:10,065 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-05 20:00:10,065 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-05 20:00:10,064 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-05 20:00:10,065 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): master:40857-0x101182c1f970000, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-10-05 20:00:10,066 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-05 20:00:10,066 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): master:40857-0x101182c1f970000, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,36369,1696535998737 2023-10-05 20:00:10,066 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): master:40857-0x101182c1f970000, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,32861,1696535998642 2023-10-05 20:00:10,066 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): master:40857-0x101182c1f970000, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-10-05 20:00:10,066 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): master:40857-0x101182c1f970000, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-10-05 20:00:10,066 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-05 20:00:10,066 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-05 20:00:10,066 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-05 20:00:10,066 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-05 20:00:10,066 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b202310058d4f082320e74a90ad27238411d9a5ae, hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e20231005876891c6343a4d659a208bfd6e0695de] mob files 2023-10-05 20:00:10,067 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b202310058d4f082320e74a90ad27238411d9a5ae 2023-10-05 20:00:10,067 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e20231005876891c6343a4d659a208bfd6e0695de 2023-10-05 20:00:10,082 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportWithTargetName 2023-10-05 20:00:10,083 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName 2023-10-05 20:00:10,120 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName to hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/.hbase-snapshot/snaptb0-testExportWithTargetName 2023-10-05 20:00:10,121 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed 2023-10-05 20:00:10,122 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName 2023-10-05 20:00:10,122 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName 2023-10-05 20:00:10,122 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName at 1696536009742Completed referencing HFiles for the mob region of table: testtb-testExportWithTargetName at 1696536010082 (+340 ms)Consolidate snapshot: snaptb0-testExportWithTargetName at 1696536010082Loading Region manifests for snaptb0-testExportWithTargetName at 1696536010082Writing data manifest for snaptb0-testExportWithTargetName at 1696536010087 (+5 ms)Verifying snapshot: snaptb0-testExportWithTargetName at 1696536010109 (+22 ms)Snapshot snaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed at 1696536010121 (+12 ms) 2023-10-05 20:00:10,124 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=20, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-10-05 20:00:10,127 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=20, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED in 382 msec 2023-10-05 20:00:10,348 DEBUG [Listener at jenkins-hbase4.apache.org/35067] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-05 20:00:10,351 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40857] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-10-05 20:00:10,351 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40857] snapshot.SnapshotManager(403): Snapshot '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' has completed, notifying client. 2023-10-05 20:00:10,352 INFO [Listener at jenkins-hbase4.apache.org/35067] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/export-test/export-1696536010352 2023-10-05 20:00:10,352 INFO [Listener at jenkins-hbase4.apache.org/35067] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:45929, tgtDir=hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/export-test/export-1696536010352, rawTgtDir=hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/export-test/export-1696536010352, srcFsUri=hdfs://localhost:45929, srcDir=hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2 2023-10-05 20:00:10,403 DEBUG [Listener at jenkins-hbase4.apache.org/35067] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:45929, inputRoot=hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2 2023-10-05 20:00:10,404 DEBUG [Listener at jenkins-hbase4.apache.org/35067] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1293747191_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/export-test/export-1696536010352, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/export-test/export-1696536010352/.hbase-snapshot/.tmp/testExportWithTargetName 2023-10-05 20:00:10,404 INFO [Listener at jenkins-hbase4.apache.org/35067] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:45929, inputRoot=hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2, snapshotDir=hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/.hbase-snapshot/snaptb0-testExportWithTargetName. 2023-10-05 20:00:10,433 INFO [Listener at jenkins-hbase4.apache.org/35067] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/.hbase-snapshot/snaptb0-testExportWithTargetName to hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/export-test/export-1696536010352/.hbase-snapshot/.tmp/testExportWithTargetName 2023-10-05 20:00:10,512 DEBUG [Listener at jenkins-hbase4.apache.org/35067] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-10-05 20:00:10,513 DEBUG [Listener at jenkins-hbase4.apache.org/35067] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-10-05 20:00:10,514 DEBUG [Listener at jenkins-hbase4.apache.org/35067] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-10-05 20:00:10,514 DEBUG [Listener at jenkins-hbase4.apache.org/35067] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-10-05 20:00:11,453 DEBUG [Listener at jenkins-hbase4.apache.org/35067] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/190200ca-70b6-4852-ff08-4943c98578e6/hadoop-5564660932891638076.jar 2023-10-05 20:00:11,453 DEBUG [Listener at jenkins-hbase4.apache.org/35067] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-10-05 20:00:11,454 DEBUG [Listener at jenkins-hbase4.apache.org/35067] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-10-05 20:00:11,523 DEBUG [Listener at jenkins-hbase4.apache.org/35067] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/190200ca-70b6-4852-ff08-4943c98578e6/hadoop-7767658942900030935.jar 2023-10-05 20:00:11,524 DEBUG [Listener at jenkins-hbase4.apache.org/35067] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-10-05 20:00:11,524 DEBUG [Listener at jenkins-hbase4.apache.org/35067] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-10-05 20:00:11,525 DEBUG [Listener at jenkins-hbase4.apache.org/35067] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-10-05 20:00:11,526 DEBUG [Listener at jenkins-hbase4.apache.org/35067] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-10-05 20:00:11,526 DEBUG [Listener at jenkins-hbase4.apache.org/35067] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-10-05 20:00:11,526 DEBUG [Listener at jenkins-hbase4.apache.org/35067] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-10-05 20:00:11,527 DEBUG [Listener at jenkins-hbase4.apache.org/35067] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-10-05 20:00:11,528 DEBUG [Listener at jenkins-hbase4.apache.org/35067] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-10-05 20:00:11,528 DEBUG [Listener at jenkins-hbase4.apache.org/35067] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-10-05 20:00:11,529 DEBUG [Listener at jenkins-hbase4.apache.org/35067] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-10-05 20:00:11,529 DEBUG [Listener at jenkins-hbase4.apache.org/35067] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-10-05 20:00:11,530 DEBUG [Listener at jenkins-hbase4.apache.org/35067] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-10-05 20:00:11,530 DEBUG [Listener at jenkins-hbase4.apache.org/35067] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-10-05 20:00:11,530 DEBUG [Listener at jenkins-hbase4.apache.org/35067] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-10-05 20:00:11,531 DEBUG [Listener at jenkins-hbase4.apache.org/35067] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-10-05 20:00:11,531 DEBUG [Listener at jenkins-hbase4.apache.org/35067] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-10-05 20:00:11,535 DEBUG [Listener at jenkins-hbase4.apache.org/35067] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-05 20:00:11,536 DEBUG [Listener at jenkins-hbase4.apache.org/35067] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-05 20:00:11,536 DEBUG [Listener at jenkins-hbase4.apache.org/35067] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-10-05 20:00:11,536 DEBUG [Listener at jenkins-hbase4.apache.org/35067] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-05 20:00:11,537 DEBUG [Listener at jenkins-hbase4.apache.org/35067] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-05 20:00:11,538 DEBUG [Listener at jenkins-hbase4.apache.org/35067] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-10-05 20:00:11,538 DEBUG [Listener at jenkins-hbase4.apache.org/35067] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-10-05 20:00:12,342 WARN [Listener at jenkins-hbase4.apache.org/35067] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-10-05 20:00:12,348 INFO [Listener at jenkins-hbase4.apache.org/35067] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportWithTargetName' hfile list 2023-10-05 20:00:12,356 DEBUG [Listener at jenkins-hbase4.apache.org/35067] snapshot.ExportSnapshot(671): export split=0 size=30.9 K 2023-10-05 20:00:12,812 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-10-05 20:00:12,814 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-10-05 20:00:13,041 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696536006875_0001_000001 (auth:SIMPLE) 2023-10-05 20:00:13,997 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-10-05 20:00:17,474 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696536006875_0001_000001 (auth:SIMPLE) 2023-10-05 20:00:19,739 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696536006875_0001_000001 (auth:SIMPLE) 2023-10-05 20:00:22,968 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696536006875_0001_000001 (auth:SIMPLE) 2023-10-05 20:00:24,219 INFO [Listener at jenkins-hbase4.apache.org/35067] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-10-05 20:00:24,223 INFO [Listener at jenkins-hbase4.apache.org/35067] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-10-05 20:00:24,234 INFO [Listener at jenkins-hbase4.apache.org/35067] snapshot.ExportSnapshot(1127): Export Completed: testExportWithTargetName 2023-10-05 20:00:24,235 INFO [Listener at jenkins-hbase4.apache.org/35067] snapshot.TestExportSnapshot(279): Exported snapshot 2023-10-05 20:00:24,236 INFO [Listener at jenkins-hbase4.apache.org/35067] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-10-05 20:00:24,236 DEBUG [Listener at jenkins-hbase4.apache.org/35067] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-2070727397_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/.hbase-snapshot/snaptb0-testExportWithTargetName at hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/.hbase-snapshot/snaptb0-testExportWithTargetName 2023-10-05 20:00:24,237 DEBUG [Listener at jenkins-hbase4.apache.org/35067] snapshot.TestExportSnapshot(367): hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/.hbase-snapshot/snaptb0-testExportWithTargetName/.snapshotinfo 2023-10-05 20:00:24,237 DEBUG [Listener at jenkins-hbase4.apache.org/35067] snapshot.TestExportSnapshot(367): hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/.hbase-snapshot/snaptb0-testExportWithTargetName/data.manifest 2023-10-05 20:00:24,237 DEBUG [Listener at jenkins-hbase4.apache.org/35067] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-2070727397_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/export-test/export-1696536010352/.hbase-snapshot/testExportWithTargetName at hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/export-test/export-1696536010352/.hbase-snapshot/testExportWithTargetName 2023-10-05 20:00:24,238 DEBUG [Listener at jenkins-hbase4.apache.org/35067] snapshot.TestExportSnapshot(367): hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/export-test/export-1696536010352/.hbase-snapshot/testExportWithTargetName/.snapshotinfo 2023-10-05 20:00:24,238 DEBUG [Listener at jenkins-hbase4.apache.org/35067] snapshot.TestExportSnapshot(367): hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/export-test/export-1696536010352/.hbase-snapshot/testExportWithTargetName/data.manifest 2023-10-05 20:00:24,250 INFO [Listener at jenkins-hbase4.apache.org/35067] client.HBaseAdmin$15(890): Started disable of testtb-testExportWithTargetName 2023-10-05 20:00:24,254 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40857] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportWithTargetName 2023-10-05 20:00:24,263 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40857] procedure2.ProcedureExecutor(1028): Stored pid=21, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportWithTargetName 2023-10-05 20:00:24,269 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696536024269"}]},"ts":"1696536024269"} 2023-10-05 20:00:24,270 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40857] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-10-05 20:00:24,271 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=DISABLING in hbase:meta 2023-10-05 20:00:24,273 INFO [PEWorker-4] procedure.DisableTableProcedure(293): Set testtb-testExportWithTargetName to state=DISABLING 2023-10-05 20:00:24,276 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=22, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=42b08d50808ded52c1d3d92f8450d54e, UNASSIGN}, {pid=23, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=897da2b0932b7dd6fce7cdb7be302914, UNASSIGN}] 2023-10-05 20:00:24,278 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=22, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=42b08d50808ded52c1d3d92f8450d54e, UNASSIGN 2023-10-05 20:00:24,279 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=23, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=897da2b0932b7dd6fce7cdb7be302914, UNASSIGN 2023-10-05 20:00:24,279 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=23 updating hbase:meta row=897da2b0932b7dd6fce7cdb7be302914, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,44821,1696535998698 2023-10-05 20:00:24,280 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=22 updating hbase:meta row=42b08d50808ded52c1d3d92f8450d54e, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,36369,1696535998737 2023-10-05 20:00:24,280 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,1,1696536007971.897da2b0932b7dd6fce7cdb7be302914.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1696536024279"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696536024279"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696536024279"}]},"ts":"1696536024279"} 2023-10-05 20:00:24,280 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,,1696536007971.42b08d50808ded52c1d3d92f8450d54e.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1696536024279"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696536024279"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696536024279"}]},"ts":"1696536024279"} 2023-10-05 20:00:24,282 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=24, ppid=23, state=RUNNABLE; CloseRegionProcedure 897da2b0932b7dd6fce7cdb7be302914, server=jenkins-hbase4.apache.org,44821,1696535998698}] 2023-10-05 20:00:24,282 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=25, ppid=22, state=RUNNABLE; CloseRegionProcedure 42b08d50808ded52c1d3d92f8450d54e, server=jenkins-hbase4.apache.org,36369,1696535998737}] 2023-10-05 20:00:24,371 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40857] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-10-05 20:00:24,442 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 897da2b0932b7dd6fce7cdb7be302914 2023-10-05 20:00:24,442 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 42b08d50808ded52c1d3d92f8450d54e 2023-10-05 20:00:24,443 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 897da2b0932b7dd6fce7cdb7be302914, disabling compactions & flushes 2023-10-05 20:00:24,443 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 42b08d50808ded52c1d3d92f8450d54e, disabling compactions & flushes 2023-10-05 20:00:24,443 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,1,1696536007971.897da2b0932b7dd6fce7cdb7be302914. 2023-10-05 20:00:24,443 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,,1696536007971.42b08d50808ded52c1d3d92f8450d54e. 2023-10-05 20:00:24,443 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,1,1696536007971.897da2b0932b7dd6fce7cdb7be302914. 2023-10-05 20:00:24,443 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,,1696536007971.42b08d50808ded52c1d3d92f8450d54e. 2023-10-05 20:00:24,443 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,1,1696536007971.897da2b0932b7dd6fce7cdb7be302914. after waiting 0 ms 2023-10-05 20:00:24,443 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,1,1696536007971.897da2b0932b7dd6fce7cdb7be302914. 2023-10-05 20:00:24,443 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,,1696536007971.42b08d50808ded52c1d3d92f8450d54e. after waiting 0 ms 2023-10-05 20:00:24,443 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,,1696536007971.42b08d50808ded52c1d3d92f8450d54e. 2023-10-05 20:00:24,460 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/data/default/testtb-testExportWithTargetName/42b08d50808ded52c1d3d92f8450d54e/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-10-05 20:00:24,460 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/data/default/testtb-testExportWithTargetName/897da2b0932b7dd6fce7cdb7be302914/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-10-05 20:00:24,461 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-10-05 20:00:24,461 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-10-05 20:00:24,463 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,1,1696536007971.897da2b0932b7dd6fce7cdb7be302914. 2023-10-05 20:00:24,463 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,,1696536007971.42b08d50808ded52c1d3d92f8450d54e. 2023-10-05 20:00:24,463 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 897da2b0932b7dd6fce7cdb7be302914: 2023-10-05 20:00:24,463 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 42b08d50808ded52c1d3d92f8450d54e: 2023-10-05 20:00:24,465 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 897da2b0932b7dd6fce7cdb7be302914 2023-10-05 20:00:24,465 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=23 updating hbase:meta row=897da2b0932b7dd6fce7cdb7be302914, regionState=CLOSED 2023-10-05 20:00:24,466 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 42b08d50808ded52c1d3d92f8450d54e 2023-10-05 20:00:24,466 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,1,1696536007971.897da2b0932b7dd6fce7cdb7be302914.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1696536024465"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696536024465"}]},"ts":"1696536024465"} 2023-10-05 20:00:24,466 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=22 updating hbase:meta row=42b08d50808ded52c1d3d92f8450d54e, regionState=CLOSED 2023-10-05 20:00:24,467 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,,1696536007971.42b08d50808ded52c1d3d92f8450d54e.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1696536024466"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696536024466"}]},"ts":"1696536024466"} 2023-10-05 20:00:24,471 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=24, resume processing ppid=23 2023-10-05 20:00:24,471 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=24, ppid=23, state=SUCCESS; CloseRegionProcedure 897da2b0932b7dd6fce7cdb7be302914, server=jenkins-hbase4.apache.org,44821,1696535998698 in 185 msec 2023-10-05 20:00:24,472 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=25, resume processing ppid=22 2023-10-05 20:00:24,472 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=25, ppid=22, state=SUCCESS; CloseRegionProcedure 42b08d50808ded52c1d3d92f8450d54e, server=jenkins-hbase4.apache.org,36369,1696535998737 in 187 msec 2023-10-05 20:00:24,473 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=23, ppid=21, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=897da2b0932b7dd6fce7cdb7be302914, UNASSIGN in 196 msec 2023-10-05 20:00:24,474 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=22, resume processing ppid=21 2023-10-05 20:00:24,474 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=22, ppid=21, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=42b08d50808ded52c1d3d92f8450d54e, UNASSIGN in 197 msec 2023-10-05 20:00:24,477 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696536024477"}]},"ts":"1696536024477"} 2023-10-05 20:00:24,479 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=DISABLED in hbase:meta 2023-10-05 20:00:24,480 INFO [PEWorker-1] procedure.DisableTableProcedure(305): Set testtb-testExportWithTargetName to state=DISABLED 2023-10-05 20:00:24,483 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=21, state=SUCCESS; DisableTableProcedure table=testtb-testExportWithTargetName in 223 msec 2023-10-05 20:00:24,572 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40857] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-10-05 20:00:24,573 INFO [Listener at jenkins-hbase4.apache.org/35067] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportWithTargetName, procId: 21 completed 2023-10-05 20:00:24,578 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40857] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportWithTargetName 2023-10-05 20:00:24,584 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40857] procedure2.ProcedureExecutor(1028): Stored pid=26, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-10-05 20:00:24,587 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=26, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-10-05 20:00:24,588 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40857] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportWithTargetName 2023-10-05 20:00:24,589 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=26, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-10-05 20:00:24,592 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=32861] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportWithTargetName 2023-10-05 20:00:24,595 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/.tmp/data/default/testtb-testExportWithTargetName/42b08d50808ded52c1d3d92f8450d54e 2023-10-05 20:00:24,595 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/.tmp/data/default/testtb-testExportWithTargetName/897da2b0932b7dd6fce7cdb7be302914 2023-10-05 20:00:24,596 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): regionserver:44821-0x101182c1f970002, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-10-05 20:00:24,596 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): master:40857-0x101182c1f970000, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-10-05 20:00:24,596 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): regionserver:36369-0x101182c1f970003, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-10-05 20:00:24,596 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): regionserver:32861-0x101182c1f970001, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-10-05 20:00:24,597 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF 2023-10-05 20:00:24,597 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF 2023-10-05 20:00:24,597 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF 2023-10-05 20:00:24,597 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF 2023-10-05 20:00:24,598 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): master:40857-0x101182c1f970000, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-10-05 20:00:24,598 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): master:40857-0x101182c1f970000, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-05 20:00:24,598 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): regionserver:36369-0x101182c1f970003, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-10-05 20:00:24,598 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): regionserver:44821-0x101182c1f970002, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-10-05 20:00:24,598 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): regionserver:36369-0x101182c1f970003, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-05 20:00:24,598 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): regionserver:32861-0x101182c1f970001, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-10-05 20:00:24,598 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): regionserver:32861-0x101182c1f970001, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-05 20:00:24,598 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): regionserver:44821-0x101182c1f970002, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-05 20:00:24,600 DEBUG [HFileArchiver-6] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/.tmp/data/default/testtb-testExportWithTargetName/897da2b0932b7dd6fce7cdb7be302914/cf, FileablePath, hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/.tmp/data/default/testtb-testExportWithTargetName/897da2b0932b7dd6fce7cdb7be302914/recovered.edits] 2023-10-05 20:00:24,600 DEBUG [HFileArchiver-5] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/.tmp/data/default/testtb-testExportWithTargetName/42b08d50808ded52c1d3d92f8450d54e/cf, FileablePath, hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/.tmp/data/default/testtb-testExportWithTargetName/42b08d50808ded52c1d3d92f8450d54e/recovered.edits] 2023-10-05 20:00:24,602 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40857] master.MasterRpcServices(1230): Checking to see if procedure is done pid=26 2023-10-05 20:00:24,608 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/.tmp/data/default/testtb-testExportWithTargetName/897da2b0932b7dd6fce7cdb7be302914/cf/8687d669b42a4528bf3a77a7cd44c6f0 to hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/archive/data/default/testtb-testExportWithTargetName/897da2b0932b7dd6fce7cdb7be302914/cf/8687d669b42a4528bf3a77a7cd44c6f0 2023-10-05 20:00:24,608 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/.tmp/data/default/testtb-testExportWithTargetName/42b08d50808ded52c1d3d92f8450d54e/cf/dc3bafe8509e4ea6ac3f0ebd50218a4e to hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/archive/data/default/testtb-testExportWithTargetName/42b08d50808ded52c1d3d92f8450d54e/cf/dc3bafe8509e4ea6ac3f0ebd50218a4e 2023-10-05 20:00:24,612 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/.tmp/data/default/testtb-testExportWithTargetName/897da2b0932b7dd6fce7cdb7be302914/recovered.edits/9.seqid to hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/archive/data/default/testtb-testExportWithTargetName/897da2b0932b7dd6fce7cdb7be302914/recovered.edits/9.seqid 2023-10-05 20:00:24,613 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/.tmp/data/default/testtb-testExportWithTargetName/42b08d50808ded52c1d3d92f8450d54e/recovered.edits/9.seqid to hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/archive/data/default/testtb-testExportWithTargetName/42b08d50808ded52c1d3d92f8450d54e/recovered.edits/9.seqid 2023-10-05 20:00:24,613 DEBUG [HFileArchiver-6] backup.HFileArchiver(596): Deleted hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/.tmp/data/default/testtb-testExportWithTargetName/897da2b0932b7dd6fce7cdb7be302914 2023-10-05 20:00:24,613 DEBUG [HFileArchiver-5] backup.HFileArchiver(596): Deleted hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/.tmp/data/default/testtb-testExportWithTargetName/42b08d50808ded52c1d3d92f8450d54e 2023-10-05 20:00:24,614 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testtb-testExportWithTargetName regions 2023-10-05 20:00:24,614 DEBUG [PEWorker-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71 2023-10-05 20:00:24,615 DEBUG [PEWorker-3] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf] 2023-10-05 20:00:24,619 DEBUG [PEWorker-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b202310058d4f082320e74a90ad27238411d9a5ae to hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/archive/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b202310058d4f082320e74a90ad27238411d9a5ae 2023-10-05 20:00:24,620 DEBUG [PEWorker-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e20231005876891c6343a4d659a208bfd6e0695de to hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/archive/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e20231005876891c6343a4d659a208bfd6e0695de 2023-10-05 20:00:24,621 DEBUG [PEWorker-3] backup.HFileArchiver(596): Deleted hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71 2023-10-05 20:00:24,624 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=26, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-10-05 20:00:24,646 WARN [PEWorker-3] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportWithTargetName from hbase:meta 2023-10-05 20:00:24,648 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportWithTargetName' descriptor. 2023-10-05 20:00:24,650 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=26, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-10-05 20:00:24,650 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportWithTargetName' from region states. 2023-10-05 20:00:24,650 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportWithTargetName,,1696536007971.42b08d50808ded52c1d3d92f8450d54e.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1696536024650"}]},"ts":"9223372036854775807"} 2023-10-05 20:00:24,650 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportWithTargetName,1,1696536007971.897da2b0932b7dd6fce7cdb7be302914.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1696536024650"}]},"ts":"9223372036854775807"} 2023-10-05 20:00:24,652 INFO [PEWorker-3] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-10-05 20:00:24,652 DEBUG [PEWorker-3] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 42b08d50808ded52c1d3d92f8450d54e, NAME => 'testtb-testExportWithTargetName,,1696536007971.42b08d50808ded52c1d3d92f8450d54e.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 897da2b0932b7dd6fce7cdb7be302914, NAME => 'testtb-testExportWithTargetName,1,1696536007971.897da2b0932b7dd6fce7cdb7be302914.', STARTKEY => '1', ENDKEY => ''}] 2023-10-05 20:00:24,652 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportWithTargetName' as deleted. 2023-10-05 20:00:24,652 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1696536024652"}]},"ts":"9223372036854775807"} 2023-10-05 20:00:24,654 INFO [PEWorker-3] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportWithTargetName state from META 2023-10-05 20:00:24,657 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(130): Finished pid=26, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-10-05 20:00:24,658 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=26, state=SUCCESS; DeleteTableProcedure table=testtb-testExportWithTargetName in 78 msec 2023-10-05 20:00:24,703 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40857] master.MasterRpcServices(1230): Checking to see if procedure is done pid=26 2023-10-05 20:00:24,705 INFO [Listener at jenkins-hbase4.apache.org/35067] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportWithTargetName, procId: 26 completed 2023-10-05 20:00:24,722 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40857] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportWithTargetName" 2023-10-05 20:00:24,725 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40857] snapshot.SnapshotManager(335): Deleting snapshot: emptySnaptb0-testExportWithTargetName 2023-10-05 20:00:24,728 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40857] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportWithTargetName" 2023-10-05 20:00:24,730 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40857] snapshot.SnapshotManager(335): Deleting snapshot: snaptb0-testExportWithTargetName 2023-10-05 20:00:24,758 INFO [Listener at jenkins-hbase4.apache.org/35067] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testExportWithTargetName Thread=755 (was 706) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-4 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Container metrics unregistration java.lang.Object.wait(Native Method) java.util.TimerThread.mainLoop(Timer.java:552) java.util.TimerThread.run(Timer.java:505) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-3 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_246645895_1 at /127.0.0.1:41244 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/190200ca-70b6-4852-ff08-4943c98578e6/cluster_78e2df33-fa2c-67a8-7ffd-0907f5603662/dfs/data/data3/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-2070727397_17 at /127.0.0.1:41254 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/190200ca-70b6-4852-ff08-4943c98578e6/cluster_78e2df33-fa2c-67a8-7ffd-0907f5603662/dfs/data/data4/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: member: 'jenkins-hbase4.apache.org,36369,1696535998737' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-6 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (638145229) connection to jenkins-hbase4.apache.org/172.31.14.131:43253 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_246645895_1 at /127.0.0.1:54926 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: htable-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-2070727397_17 at /127.0.0.1:45122 [Waiting for operation #6] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-1282 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-2 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ContainersLauncher #0 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.read1(BufferedReader.java:212) java.io.BufferedReader.read(BufferedReader.java:286) org.apache.hadoop.util.Shell$ShellCommandExecutor.parseExecResult(Shell.java:1229) org.apache.hadoop.util.Shell.runCommand(Shell.java:984) org.apache.hadoop.util.Shell.run(Shell.java:884) org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:1216) org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor.launchContainer(DefaultContainerExecutor.java:294) org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.launchContainer(ContainerLaunch.java:442) org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:293) org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:97) java.util.concurrent.FutureTask.run(FutureTask.java:266) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/190200ca-70b6-4852-ff08-4943c98578e6/cluster_78e2df33-fa2c-67a8-7ffd-0907f5603662/dfs/data/data6/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: htable-pool-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: (jenkins-hbase4.apache.org,40857,1696535997381)-proc-coordinator-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (638145229) connection to jenkins-hbase4.apache.org/172.31.14.131:35067 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (638145229) connection to jenkins-hbase4.apache.org/172.31.14.131:37961 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: hconnection-0x13ec5c25-shared-pool-12 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/190200ca-70b6-4852-ff08-4943c98578e6/cluster_78e2df33-fa2c-67a8-7ffd-0907f5603662/dfs/data/data2/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: member: 'jenkins-hbase4.apache.org,44821,1696535998698' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-5 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ContainersLauncher #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x13ec5c25-shared-pool-10 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/190200ca-70b6-4852-ff08-4943c98578e6/cluster_78e2df33-fa2c-67a8-7ffd-0907f5603662/dfs/data/data5/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x13ec5c25-shared-pool-11 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/190200ca-70b6-4852-ff08-4943c98578e6/cluster_78e2df33-fa2c-67a8-7ffd-0907f5603662/dfs/data/data1/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MutableQuantiles-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x13ec5c25-shared-pool-9 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: member: 'jenkins-hbase4.apache.org,32861,1696535998642' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (638145229) connection to jenkins-hbase4.apache.org/172.31.14.131:39077 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) - Thread LEAK? -, OpenFileDescriptor=933 (was 896) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=245 (was 191) - SystemLoadAverage LEAK? -, ProcessCount=168 (was 168), AvailableMemoryMB=6171 (was 6922) 2023-10-05 20:00:24,758 WARN [Listener at jenkins-hbase4.apache.org/35067] hbase.ResourceChecker(130): Thread=755 is superior to 500 2023-10-05 20:00:24,776 INFO [Listener at jenkins-hbase4.apache.org/35067] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testExportFileSystemState Thread=755, OpenFileDescriptor=933, MaxFileDescriptor=60000, SystemLoadAverage=245, ProcessCount=168, AvailableMemoryMB=6170 2023-10-05 20:00:24,777 WARN [Listener at jenkins-hbase4.apache.org/35067] hbase.ResourceChecker(130): Thread=755 is superior to 500 2023-10-05 20:00:24,779 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40857] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-10-05 20:00:24,781 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40857] procedure2.ProcedureExecutor(1028): Stored pid=27, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemState 2023-10-05 20:00:24,783 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_PRE_OPERATION 2023-10-05 20:00:24,784 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40857] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemState" procId is: 27 2023-10-05 20:00:24,785 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40857] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-10-05 20:00:24,785 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-10-05 20:00:24,788 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/.tmp/data/default/testtb-testExportFileSystemState/cfae8165c705c25ee6fc04a7bf3b51de 2023-10-05 20:00:24,788 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/.tmp/data/default/testtb-testExportFileSystemState/4f68bf1d8d8715f529d452a612f9a34f 2023-10-05 20:00:24,789 DEBUG [HFileArchiver-7] backup.HFileArchiver(153): Directory hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/.tmp/data/default/testtb-testExportFileSystemState/cfae8165c705c25ee6fc04a7bf3b51de empty. 2023-10-05 20:00:24,789 DEBUG [HFileArchiver-8] backup.HFileArchiver(153): Directory hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/.tmp/data/default/testtb-testExportFileSystemState/4f68bf1d8d8715f529d452a612f9a34f empty. 2023-10-05 20:00:24,789 DEBUG [HFileArchiver-7] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/.tmp/data/default/testtb-testExportFileSystemState/cfae8165c705c25ee6fc04a7bf3b51de 2023-10-05 20:00:24,790 DEBUG [HFileArchiver-8] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/.tmp/data/default/testtb-testExportFileSystemState/4f68bf1d8d8715f529d452a612f9a34f 2023-10-05 20:00:24,790 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemState regions 2023-10-05 20:00:24,801 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/.tmp/data/default/testtb-testExportFileSystemState/.tabledesc/.tableinfo.0000000001 2023-10-05 20:00:24,802 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(7675): creating {ENCODED => cfae8165c705c25ee6fc04a7bf3b51de, NAME => 'testtb-testExportFileSystemState,,1696536024778.cfae8165c705c25ee6fc04a7bf3b51de.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/.tmp 2023-10-05 20:00:24,803 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(7675): creating {ENCODED => 4f68bf1d8d8715f529d452a612f9a34f, NAME => 'testtb-testExportFileSystemState,1,1696536024778.4f68bf1d8d8715f529d452a612f9a34f.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/.tmp 2023-10-05 20:00:24,826 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,,1696536024778.cfae8165c705c25ee6fc04a7bf3b51de.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-05 20:00:24,826 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,1,1696536024778.4f68bf1d8d8715f529d452a612f9a34f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-05 20:00:24,827 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1604): Closing cfae8165c705c25ee6fc04a7bf3b51de, disabling compactions & flushes 2023-10-05 20:00:24,827 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1604): Closing 4f68bf1d8d8715f529d452a612f9a34f, disabling compactions & flushes 2023-10-05 20:00:24,827 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,,1696536024778.cfae8165c705c25ee6fc04a7bf3b51de. 2023-10-05 20:00:24,827 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,1,1696536024778.4f68bf1d8d8715f529d452a612f9a34f. 2023-10-05 20:00:24,827 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,,1696536024778.cfae8165c705c25ee6fc04a7bf3b51de. 2023-10-05 20:00:24,828 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,1,1696536024778.4f68bf1d8d8715f529d452a612f9a34f. 2023-10-05 20:00:24,828 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,,1696536024778.cfae8165c705c25ee6fc04a7bf3b51de. after waiting 0 ms 2023-10-05 20:00:24,828 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,1,1696536024778.4f68bf1d8d8715f529d452a612f9a34f. after waiting 0 ms 2023-10-05 20:00:24,828 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,,1696536024778.cfae8165c705c25ee6fc04a7bf3b51de. 2023-10-05 20:00:24,828 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,1,1696536024778.4f68bf1d8d8715f529d452a612f9a34f. 2023-10-05 20:00:24,828 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,,1696536024778.cfae8165c705c25ee6fc04a7bf3b51de. 2023-10-05 20:00:24,828 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,1,1696536024778.4f68bf1d8d8715f529d452a612f9a34f. 2023-10-05 20:00:24,828 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1558): Region close journal for cfae8165c705c25ee6fc04a7bf3b51de: 2023-10-05 20:00:24,828 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1558): Region close journal for 4f68bf1d8d8715f529d452a612f9a34f: 2023-10-05 20:00:24,831 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_ADD_TO_META 2023-10-05 20:00:24,832 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,,1696536024778.cfae8165c705c25ee6fc04a7bf3b51de.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1696536024832"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696536024832"}]},"ts":"1696536024832"} 2023-10-05 20:00:24,833 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,1,1696536024778.4f68bf1d8d8715f529d452a612f9a34f.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1696536024832"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696536024832"}]},"ts":"1696536024832"} 2023-10-05 20:00:24,835 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-10-05 20:00:24,836 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-10-05 20:00:24,836 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696536024836"}]},"ts":"1696536024836"} 2023-10-05 20:00:24,838 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=ENABLING in hbase:meta 2023-10-05 20:00:24,843 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-10-05 20:00:24,844 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-10-05 20:00:24,844 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-10-05 20:00:24,844 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-10-05 20:00:24,844 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-10-05 20:00:24,844 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=cfae8165c705c25ee6fc04a7bf3b51de, ASSIGN}, {pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=4f68bf1d8d8715f529d452a612f9a34f, ASSIGN}] 2023-10-05 20:00:24,847 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=4f68bf1d8d8715f529d452a612f9a34f, ASSIGN 2023-10-05 20:00:24,847 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=cfae8165c705c25ee6fc04a7bf3b51de, ASSIGN 2023-10-05 20:00:24,848 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=4f68bf1d8d8715f529d452a612f9a34f, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,36369,1696535998737; forceNewPlan=false, retain=false 2023-10-05 20:00:24,848 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=cfae8165c705c25ee6fc04a7bf3b51de, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,32861,1696535998642; forceNewPlan=false, retain=false 2023-10-05 20:00:24,886 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40857] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-10-05 20:00:24,999 INFO [jenkins-hbase4:40857] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-10-05 20:00:25,002 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=28 updating hbase:meta row=cfae8165c705c25ee6fc04a7bf3b51de, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,32861,1696535998642 2023-10-05 20:00:25,002 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=29 updating hbase:meta row=4f68bf1d8d8715f529d452a612f9a34f, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,36369,1696535998737 2023-10-05 20:00:25,002 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,,1696536024778.cfae8165c705c25ee6fc04a7bf3b51de.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1696536025002"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696536025002"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696536025002"}]},"ts":"1696536025002"} 2023-10-05 20:00:25,003 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,1,1696536024778.4f68bf1d8d8715f529d452a612f9a34f.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1696536025002"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696536025002"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696536025002"}]},"ts":"1696536025002"} 2023-10-05 20:00:25,005 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=30, ppid=28, state=RUNNABLE; OpenRegionProcedure cfae8165c705c25ee6fc04a7bf3b51de, server=jenkins-hbase4.apache.org,32861,1696535998642}] 2023-10-05 20:00:25,006 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=31, ppid=29, state=RUNNABLE; OpenRegionProcedure 4f68bf1d8d8715f529d452a612f9a34f, server=jenkins-hbase4.apache.org,36369,1696535998737}] 2023-10-05 20:00:25,088 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40857] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-10-05 20:00:25,166 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemState,1,1696536024778.4f68bf1d8d8715f529d452a612f9a34f. 2023-10-05 20:00:25,167 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 4f68bf1d8d8715f529d452a612f9a34f, NAME => 'testtb-testExportFileSystemState,1,1696536024778.4f68bf1d8d8715f529d452a612f9a34f.', STARTKEY => '1', ENDKEY => ''} 2023-10-05 20:00:25,167 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemState,,1696536024778.cfae8165c705c25ee6fc04a7bf3b51de. 2023-10-05 20:00:25,167 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemState,1,1696536024778.4f68bf1d8d8715f529d452a612f9a34f. service=AccessControlService 2023-10-05 20:00:25,167 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => cfae8165c705c25ee6fc04a7bf3b51de, NAME => 'testtb-testExportFileSystemState,,1696536024778.cfae8165c705c25ee6fc04a7bf3b51de.', STARTKEY => '', ENDKEY => '1'} 2023-10-05 20:00:25,167 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-10-05 20:00:25,167 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemState 4f68bf1d8d8715f529d452a612f9a34f 2023-10-05 20:00:25,167 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,1,1696536024778.4f68bf1d8d8715f529d452a612f9a34f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-05 20:00:25,167 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 4f68bf1d8d8715f529d452a612f9a34f 2023-10-05 20:00:25,167 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 4f68bf1d8d8715f529d452a612f9a34f 2023-10-05 20:00:25,168 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemState,,1696536024778.cfae8165c705c25ee6fc04a7bf3b51de. service=AccessControlService 2023-10-05 20:00:25,168 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-10-05 20:00:25,168 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemState cfae8165c705c25ee6fc04a7bf3b51de 2023-10-05 20:00:25,168 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,,1696536024778.cfae8165c705c25ee6fc04a7bf3b51de.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-05 20:00:25,168 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for cfae8165c705c25ee6fc04a7bf3b51de 2023-10-05 20:00:25,168 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for cfae8165c705c25ee6fc04a7bf3b51de 2023-10-05 20:00:25,169 INFO [StoreOpener-4f68bf1d8d8715f529d452a612f9a34f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 4f68bf1d8d8715f529d452a612f9a34f 2023-10-05 20:00:25,171 INFO [StoreOpener-cfae8165c705c25ee6fc04a7bf3b51de-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region cfae8165c705c25ee6fc04a7bf3b51de 2023-10-05 20:00:25,173 DEBUG [StoreOpener-4f68bf1d8d8715f529d452a612f9a34f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/data/default/testtb-testExportFileSystemState/4f68bf1d8d8715f529d452a612f9a34f/cf 2023-10-05 20:00:25,173 DEBUG [StoreOpener-cfae8165c705c25ee6fc04a7bf3b51de-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/data/default/testtb-testExportFileSystemState/cfae8165c705c25ee6fc04a7bf3b51de/cf 2023-10-05 20:00:25,173 DEBUG [StoreOpener-cfae8165c705c25ee6fc04a7bf3b51de-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/data/default/testtb-testExportFileSystemState/cfae8165c705c25ee6fc04a7bf3b51de/cf 2023-10-05 20:00:25,173 DEBUG [StoreOpener-4f68bf1d8d8715f529d452a612f9a34f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/data/default/testtb-testExportFileSystemState/4f68bf1d8d8715f529d452a612f9a34f/cf 2023-10-05 20:00:25,173 INFO [StoreOpener-cfae8165c705c25ee6fc04a7bf3b51de-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region cfae8165c705c25ee6fc04a7bf3b51de columnFamilyName cf 2023-10-05 20:00:25,173 INFO [StoreOpener-4f68bf1d8d8715f529d452a612f9a34f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 4f68bf1d8d8715f529d452a612f9a34f columnFamilyName cf 2023-10-05 20:00:25,175 INFO [StoreOpener-cfae8165c705c25ee6fc04a7bf3b51de-1] regionserver.HStore(310): Store=cfae8165c705c25ee6fc04a7bf3b51de/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-05 20:00:25,175 INFO [StoreOpener-4f68bf1d8d8715f529d452a612f9a34f-1] regionserver.HStore(310): Store=4f68bf1d8d8715f529d452a612f9a34f/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-05 20:00:25,178 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/data/default/testtb-testExportFileSystemState/4f68bf1d8d8715f529d452a612f9a34f 2023-10-05 20:00:25,178 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/data/default/testtb-testExportFileSystemState/cfae8165c705c25ee6fc04a7bf3b51de 2023-10-05 20:00:25,178 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/data/default/testtb-testExportFileSystemState/4f68bf1d8d8715f529d452a612f9a34f 2023-10-05 20:00:25,178 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/data/default/testtb-testExportFileSystemState/cfae8165c705c25ee6fc04a7bf3b51de 2023-10-05 20:00:25,182 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 4f68bf1d8d8715f529d452a612f9a34f 2023-10-05 20:00:25,182 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for cfae8165c705c25ee6fc04a7bf3b51de 2023-10-05 20:00:25,185 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/data/default/testtb-testExportFileSystemState/4f68bf1d8d8715f529d452a612f9a34f/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-05 20:00:25,185 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/data/default/testtb-testExportFileSystemState/cfae8165c705c25ee6fc04a7bf3b51de/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-05 20:00:25,185 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened cfae8165c705c25ee6fc04a7bf3b51de; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70998222, jitterRate=0.05795595049858093}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-10-05 20:00:25,185 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 4f68bf1d8d8715f529d452a612f9a34f; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64053965, jitterRate=-0.04552154242992401}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-10-05 20:00:25,185 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for cfae8165c705c25ee6fc04a7bf3b51de: 2023-10-05 20:00:25,185 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 4f68bf1d8d8715f529d452a612f9a34f: 2023-10-05 20:00:25,187 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemState,1,1696536024778.4f68bf1d8d8715f529d452a612f9a34f., pid=31, masterSystemTime=1696536025160 2023-10-05 20:00:25,187 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemState,,1696536024778.cfae8165c705c25ee6fc04a7bf3b51de., pid=30, masterSystemTime=1696536025157 2023-10-05 20:00:25,188 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemState,1,1696536024778.4f68bf1d8d8715f529d452a612f9a34f. 2023-10-05 20:00:25,189 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemState,1,1696536024778.4f68bf1d8d8715f529d452a612f9a34f. 2023-10-05 20:00:25,189 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=29 updating hbase:meta row=4f68bf1d8d8715f529d452a612f9a34f, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,36369,1696535998737 2023-10-05 20:00:25,190 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemState,1,1696536024778.4f68bf1d8d8715f529d452a612f9a34f.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1696536025189"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1696536025189"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1696536025189"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1696536025189"}]},"ts":"1696536025189"} 2023-10-05 20:00:25,190 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemState,,1696536024778.cfae8165c705c25ee6fc04a7bf3b51de. 2023-10-05 20:00:25,190 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemState,,1696536024778.cfae8165c705c25ee6fc04a7bf3b51de. 2023-10-05 20:00:25,191 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=28 updating hbase:meta row=cfae8165c705c25ee6fc04a7bf3b51de, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,32861,1696535998642 2023-10-05 20:00:25,192 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemState,,1696536024778.cfae8165c705c25ee6fc04a7bf3b51de.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1696536025191"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1696536025191"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1696536025191"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1696536025191"}]},"ts":"1696536025191"} 2023-10-05 20:00:25,196 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=31, resume processing ppid=29 2023-10-05 20:00:25,196 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=31, ppid=29, state=SUCCESS; OpenRegionProcedure 4f68bf1d8d8715f529d452a612f9a34f, server=jenkins-hbase4.apache.org,36369,1696535998737 in 187 msec 2023-10-05 20:00:25,197 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=30, resume processing ppid=28 2023-10-05 20:00:25,200 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=30, ppid=28, state=SUCCESS; OpenRegionProcedure cfae8165c705c25ee6fc04a7bf3b51de, server=jenkins-hbase4.apache.org,32861,1696535998642 in 189 msec 2023-10-05 20:00:25,201 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=29, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=4f68bf1d8d8715f529d452a612f9a34f, ASSIGN in 352 msec 2023-10-05 20:00:25,203 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=28, resume processing ppid=27 2023-10-05 20:00:25,203 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=28, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=cfae8165c705c25ee6fc04a7bf3b51de, ASSIGN in 356 msec 2023-10-05 20:00:25,205 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-10-05 20:00:25,205 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696536025205"}]},"ts":"1696536025205"} 2023-10-05 20:00:25,207 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=ENABLED in hbase:meta 2023-10-05 20:00:25,210 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_POST_OPERATION 2023-10-05 20:00:25,210 DEBUG [PEWorker-5] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemState jenkins: RWXCA 2023-10-05 20:00:25,212 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=32861] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemState], kv [jenkins: RWXCA] 2023-10-05 20:00:25,214 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): regionserver:44821-0x101182c1f970002, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-05 20:00:25,214 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): master:40857-0x101182c1f970000, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-05 20:00:25,214 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): regionserver:32861-0x101182c1f970001, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-05 20:00:25,214 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): regionserver:36369-0x101182c1f970003, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-05 20:00:25,216 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-10-05 20:00:25,216 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-10-05 20:00:25,216 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-10-05 20:00:25,216 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-10-05 20:00:25,218 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=27, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemState in 437 msec 2023-10-05 20:00:25,389 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40857] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-10-05 20:00:25,390 INFO [Listener at jenkins-hbase4.apache.org/35067] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemState, procId: 27 completed 2023-10-05 20:00:25,392 DEBUG [Listener at jenkins-hbase4.apache.org/35067] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemState 2023-10-05 20:00:25,393 DEBUG [Listener at jenkins-hbase4.apache.org/35067] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemState,,1696536024778.cfae8165c705c25ee6fc04a7bf3b51de. 2023-10-05 20:00:25,395 INFO [Listener at jenkins-hbase4.apache.org/35067] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-10-05 20:00:25,405 DEBUG [hconnection-0x4e0a2980-shared-pool-10] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-05 20:00:25,411 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:51560, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-05 20:00:25,417 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40857] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-10-05 20:00:25,417 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40857] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1696536025417 (current time:1696536025417). 2023-10-05 20:00:25,417 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40857] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-10-05 20:00:25,418 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40857] zookeeper.ReadOnlyZKClient(139): Connect 0x05e8d114 to 127.0.0.1:57530 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-05 20:00:25,425 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40857] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@747133f7, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-05 20:00:25,427 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40857] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-05 20:00:25,428 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:60050, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-05 20:00:25,429 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40857] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x05e8d114 to 127.0.0.1:57530 2023-10-05 20:00:25,429 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40857] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-05 20:00:25,430 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40857] zookeeper.ReadOnlyZKClient(139): Connect 0x12d529d3 to 127.0.0.1:57530 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-05 20:00:25,435 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40857] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@51f63aec, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-05 20:00:25,437 DEBUG [hconnection-0x2ce555ae-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-05 20:00:25,439 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:60066, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-05 20:00:25,444 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40857] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-05 20:00:25,445 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:51572, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-05 20:00:25,446 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40857] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x12d529d3 to 127.0.0.1:57530 2023-10-05 20:00:25,446 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40857] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-05 20:00:25,446 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40857] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemState], kv [jenkins: RWXCA] 2023-10-05 20:00:25,447 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40857] snapshot.SnapshotManager(637): No existing snapshot, attempting snapshot... 2023-10-05 20:00:25,448 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40857] snapshot.SnapshotManager(684): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-10-05 20:00:25,451 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40857] snapshot.SnapshotManager(519): Unable to retrieve ACL status for path: hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/.hbase-snapshot, current working dir path: hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState org.apache.hadoop.hdfs.protocol.AclException: The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.ipc.RemoteException.instantiateException(RemoteException.java:121) at org.apache.hadoop.ipc.RemoteException.unwrapRemoteException(RemoteException.java:88) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2736) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2294) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2291) at org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81) at org.apache.hadoop.hdfs.DistributedFileSystem.getAclStatus(DistributedFileSystem.java:2291) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.updateWorkingDirAclsIfRequired(SnapshotManager.java:517) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.prepareToTakeSnapshot(SnapshotManager.java:490) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.snapshotEnabledTable(SnapshotManager.java:559) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshotInternal(SnapshotManager.java:687) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshot(SnapshotManager.java:623) at org.apache.hadoop.hbase.master.MasterRpcServices.snapshot(MasterRpcServices.java:1588) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) Caused by: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.hdfs.protocol.AclException): The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at org.apache.hadoop.ipc.Client.getRpcResponse(Client.java:1540) at org.apache.hadoop.ipc.Client.call(Client.java:1486) at org.apache.hadoop.ipc.Client.call(Client.java:1385) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:232) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:118) at com.sun.proxy.$Proxy32.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.getAclStatus(ClientNamenodeProtocolTranslatorPB.java:1385) at sun.reflect.GeneratedMethodAccessor62.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:422) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeMethod(RetryInvocationHandler.java:165) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invoke(RetryInvocationHandler.java:157) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeOnce(RetryInvocationHandler.java:95) at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:359) at com.sun.proxy.$Proxy35.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor62.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2734) ... 15 more 2023-10-05 20:00:25,453 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40857] procedure2.ProcedureExecutor(1028): Stored pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-10-05 20:00:25,454 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-10-05 20:00:25,455 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=32, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1696536625455 2023-10-05 20:00:25,455 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40857] snapshot.SnapshotManager(689): Started snapshot: { ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-10-05 20:00:25,455 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState 2023-10-05 20:00:25,456 DEBUG [Listener at jenkins-hbase4.apache.org/35067] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-10-05 20:00:25,457 DEBUG [Listener at jenkins-hbase4.apache.org/35067] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-10-05 20:00:25,462 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=33, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-10-05 20:00:25,462 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=32, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-10-05 20:00:25,464 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=32, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE in 10 msec 2023-10-05 20:00:25,465 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=33, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-10-05 20:00:25,466 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=33, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED; timeout=600000, timestamp=1696536625466 2023-10-05 20:00:25,480 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportFileSystemState 2023-10-05 20:00:25,480 INFO [(jenkins-hbase4.apache.org,40857,1696535997381)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportFileSystemState' 2023-10-05 20:00:25,480 DEBUG [(jenkins-hbase4.apache.org,40857,1696535997381)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-05 20:00:25,481 DEBUG [(jenkins-hbase4.apache.org,40857,1696535997381)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' 2023-10-05 20:00:25,481 DEBUG [(jenkins-hbase4.apache.org,40857,1696535997381)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportFileSystemState', kicking off acquire phase on members. 2023-10-05 20:00:25,482 DEBUG [(jenkins-hbase4.apache.org,40857,1696535997381)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40857-0x101182c1f970000, quorum=127.0.0.1:57530, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-10-05 20:00:25,482 DEBUG [(jenkins-hbase4.apache.org,40857,1696535997381)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-10-05 20:00:25,484 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): regionserver:44821-0x101182c1f970002, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-05 20:00:25,484 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): regionserver:36369-0x101182c1f970003, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-05 20:00:25,484 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-05 20:00:25,484 DEBUG [(jenkins-hbase4.apache.org,40857,1696535997381)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,32861,1696535998642 2023-10-05 20:00:25,484 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): regionserver:32861-0x101182c1f970001, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-05 20:00:25,484 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-05 20:00:25,484 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-05 20:00:25,484 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-05 20:00:25,484 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-05 20:00:25,485 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-05 20:00:25,485 DEBUG [(jenkins-hbase4.apache.org,40857,1696535997381)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40857-0x101182c1f970000, quorum=127.0.0.1:57530, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,32861,1696535998642 2023-10-05 20:00:25,485 DEBUG [(jenkins-hbase4.apache.org,40857,1696535997381)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,36369,1696535998737 2023-10-05 20:00:25,485 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-10-05 20:00:25,485 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-10-05 20:00:25,485 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-10-05 20:00:25,485 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36369-0x101182c1f970003, quorum=127.0.0.1:57530, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-10-05 20:00:25,485 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44821-0x101182c1f970002, quorum=127.0.0.1:57530, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-10-05 20:00:25,485 DEBUG [(jenkins-hbase4.apache.org,40857,1696535997381)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40857-0x101182c1f970000, quorum=127.0.0.1:57530, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,36369,1696535998737 2023-10-05 20:00:25,486 DEBUG [(jenkins-hbase4.apache.org,40857,1696535997381)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-05 20:00:25,486 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:32861-0x101182c1f970001, quorum=127.0.0.1:57530, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-10-05 20:00:25,486 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 174 2023-10-05 20:00:25,486 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-10-05 20:00:25,486 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 174 2023-10-05 20:00:25,486 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 174 2023-10-05 20:00:25,486 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-10-05 20:00:25,486 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-10-05 20:00:25,486 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-10-05 20:00:25,486 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-10-05 20:00:25,486 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-10-05 20:00:25,487 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemState 2023-10-05 20:00:25,487 DEBUG [member: 'jenkins-hbase4.apache.org,32861,1696535998642' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemState' with timeout 300000ms 2023-10-05 20:00:25,487 DEBUG [member: 'jenkins-hbase4.apache.org,32861,1696535998642' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-05 20:00:25,488 DEBUG [member: 'jenkins-hbase4.apache.org,32861,1696535998642' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' stage 2023-10-05 20:00:25,488 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemState 2023-10-05 20:00:25,488 DEBUG [member: 'jenkins-hbase4.apache.org,32861,1696535998642' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally acquired 2023-10-05 20:00:25,489 DEBUG [member: 'jenkins-hbase4.apache.org,44821,1696535998698' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemState' with timeout 300000ms 2023-10-05 20:00:25,489 DEBUG [member: 'jenkins-hbase4.apache.org,44821,1696535998698' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-05 20:00:25,488 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemState 2023-10-05 20:00:25,490 DEBUG [member: 'jenkins-hbase4.apache.org,44821,1696535998698' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' stage 2023-10-05 20:00:25,490 DEBUG [member: 'jenkins-hbase4.apache.org,36369,1696535998737' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemState' with timeout 300000ms 2023-10-05 20:00:25,490 DEBUG [member: 'jenkins-hbase4.apache.org,36369,1696535998737' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-05 20:00:25,489 DEBUG [member: 'jenkins-hbase4.apache.org,32861,1696535998642' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,32861,1696535998642' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemState) in zk 2023-10-05 20:00:25,492 DEBUG [member: 'jenkins-hbase4.apache.org,36369,1696535998737' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' stage 2023-10-05 20:00:25,492 DEBUG [member: 'jenkins-hbase4.apache.org,36369,1696535998737' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally acquired 2023-10-05 20:00:25,490 DEBUG [member: 'jenkins-hbase4.apache.org,44821,1696535998698' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally acquired 2023-10-05 20:00:25,492 DEBUG [member: 'jenkins-hbase4.apache.org,36369,1696535998737' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,36369,1696535998737' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemState) in zk 2023-10-05 20:00:25,492 DEBUG [member: 'jenkins-hbase4.apache.org,44821,1696535998698' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44821,1696535998698' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemState) in zk 2023-10-05 20:00:25,493 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): master:40857-0x101182c1f970000, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,32861,1696535998642 2023-10-05 20:00:25,493 DEBUG [member: 'jenkins-hbase4.apache.org,32861,1696535998642' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-10-05 20:00:25,494 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,32861,1696535998642 2023-10-05 20:00:25,494 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-05 20:00:25,494 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-05 20:00:25,499 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): master:40857-0x101182c1f970000, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,36369,1696535998737 2023-10-05 20:00:25,499 DEBUG [member: 'jenkins-hbase4.apache.org,44821,1696535998698' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-10-05 20:00:25,499 DEBUG [member: 'jenkins-hbase4.apache.org,32861,1696535998642' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:32861-0x101182c1f970001, quorum=127.0.0.1:57530, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-10-05 20:00:25,499 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-05 20:00:25,499 DEBUG [member: 'jenkins-hbase4.apache.org,36369,1696535998737' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-10-05 20:00:25,499 DEBUG [member: 'jenkins-hbase4.apache.org,32861,1696535998642' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-05 20:00:25,500 DEBUG [member: 'jenkins-hbase4.apache.org,44821,1696535998698' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44821-0x101182c1f970002, quorum=127.0.0.1:57530, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-10-05 20:00:25,500 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-05 20:00:25,500 DEBUG [member: 'jenkins-hbase4.apache.org,36369,1696535998737' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36369-0x101182c1f970003, quorum=127.0.0.1:57530, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-10-05 20:00:25,500 DEBUG [member: 'jenkins-hbase4.apache.org,36369,1696535998737' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-05 20:00:25,500 DEBUG [member: 'jenkins-hbase4.apache.org,44821,1696535998698' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-05 20:00:25,500 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-10-05 20:00:25,500 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32861,1696535998642 2023-10-05 20:00:25,501 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36369,1696535998737 2023-10-05 20:00:25,501 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44821,1696535998698 2023-10-05 20:00:25,501 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-05 20:00:25,502 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,32861,1696535998642' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemState' on coordinator 2023-10-05 20:00:25,502 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@957302f[Count = 1] remaining members to acquire global barrier 2023-10-05 20:00:25,502 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,36369,1696535998737 2023-10-05 20:00:25,502 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-05 20:00:25,502 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-05 20:00:25,502 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-05 20:00:25,502 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-05 20:00:25,502 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-10-05 20:00:25,503 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32861,1696535998642 2023-10-05 20:00:25,503 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36369,1696535998737 2023-10-05 20:00:25,504 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44821,1696535998698 2023-10-05 20:00:25,504 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-05 20:00:25,505 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,36369,1696535998737' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemState' on coordinator 2023-10-05 20:00:25,505 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@957302f[Count = 0] remaining members to acquire global barrier 2023-10-05 20:00:25,505 DEBUG [(jenkins-hbase4.apache.org,40857,1696535997381)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportFileSystemState' starting 'in-barrier' execution. 2023-10-05 20:00:25,505 DEBUG [(jenkins-hbase4.apache.org,40857,1696535997381)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-10-05 20:00:25,506 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): regionserver:44821-0x101182c1f970002, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-10-05 20:00:25,506 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): regionserver:36369-0x101182c1f970003, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-10-05 20:00:25,506 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): regionserver:32861-0x101182c1f970001, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-10-05 20:00:25,507 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-10-05 20:00:25,506 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-10-05 20:00:25,507 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-10-05 20:00:25,507 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-10-05 20:00:25,507 DEBUG [member: 'jenkins-hbase4.apache.org,36369,1696535998737' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-10-05 20:00:25,507 DEBUG [(jenkins-hbase4.apache.org,40857,1696535997381)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40857-0x101182c1f970000, quorum=127.0.0.1:57530, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,32861,1696535998642 2023-10-05 20:00:25,507 DEBUG [member: 'jenkins-hbase4.apache.org,36369,1696535998737' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-05 20:00:25,507 DEBUG [member: 'jenkins-hbase4.apache.org,36369,1696535998737' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-05 20:00:25,507 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-10-05 20:00:25,507 DEBUG [rs(jenkins-hbase4.apache.org,36369,1696535998737)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,1,1696536024778.4f68bf1d8d8715f529d452a612f9a34f. 2023-10-05 20:00:25,507 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-10-05 20:00:25,507 DEBUG [rs(jenkins-hbase4.apache.org,36369,1696535998737)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,1,1696536024778.4f68bf1d8d8715f529d452a612f9a34f. started... 2023-10-05 20:00:25,507 DEBUG [member: 'jenkins-hbase4.apache.org,44821,1696535998698' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-10-05 20:00:25,508 DEBUG [(jenkins-hbase4.apache.org,40857,1696535997381)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40857-0x101182c1f970000, quorum=127.0.0.1:57530, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,36369,1696535998737 2023-10-05 20:00:25,508 DEBUG [(jenkins-hbase4.apache.org,40857,1696535997381)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-05 20:00:25,508 DEBUG [member: 'jenkins-hbase4.apache.org,32861,1696535998642' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-10-05 20:00:25,508 DEBUG [member: 'jenkins-hbase4.apache.org,44821,1696535998698' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally completed 2023-10-05 20:00:25,509 DEBUG [member: 'jenkins-hbase4.apache.org,44821,1696535998698' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,44821,1696535998698' in zk 2023-10-05 20:00:25,509 DEBUG [rs(jenkins-hbase4.apache.org,36369,1696535998737)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 4f68bf1d8d8715f529d452a612f9a34f: 2023-10-05 20:00:25,509 DEBUG [member: 'jenkins-hbase4.apache.org,32861,1696535998642' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-05 20:00:25,509 DEBUG [member: 'jenkins-hbase4.apache.org,32861,1696535998642' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-05 20:00:25,509 DEBUG [rs(jenkins-hbase4.apache.org,32861,1696535998642)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,,1696536024778.cfae8165c705c25ee6fc04a7bf3b51de. 2023-10-05 20:00:25,510 DEBUG [rs(jenkins-hbase4.apache.org,36369,1696535998737)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,1,1696536024778.4f68bf1d8d8715f529d452a612f9a34f.' region-info for snapshot=emptySnaptb0-testExportFileSystemState 2023-10-05 20:00:25,510 DEBUG [rs(jenkins-hbase4.apache.org,32861,1696535998642)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,,1696536024778.cfae8165c705c25ee6fc04a7bf3b51de. started... 2023-10-05 20:00:25,510 DEBUG [rs(jenkins-hbase4.apache.org,36369,1696535998737)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-05 20:00:25,510 DEBUG [rs(jenkins-hbase4.apache.org,36369,1696535998737)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-10-05 20:00:25,510 DEBUG [rs(jenkins-hbase4.apache.org,32861,1696535998642)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for cfae8165c705c25ee6fc04a7bf3b51de: 2023-10-05 20:00:25,510 DEBUG [rs(jenkins-hbase4.apache.org,32861,1696535998642)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,,1696536024778.cfae8165c705c25ee6fc04a7bf3b51de.' region-info for snapshot=emptySnaptb0-testExportFileSystemState 2023-10-05 20:00:25,510 DEBUG [rs(jenkins-hbase4.apache.org,32861,1696535998642)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-05 20:00:25,510 DEBUG [rs(jenkins-hbase4.apache.org,32861,1696535998642)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-10-05 20:00:25,511 DEBUG [member: 'jenkins-hbase4.apache.org,44821,1696535998698' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemState' has notified controller of completion 2023-10-05 20:00:25,511 DEBUG [member: 'jenkins-hbase4.apache.org,44821,1696535998698' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-05 20:00:25,511 DEBUG [member: 'jenkins-hbase4.apache.org,44821,1696535998698' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemState' completed. 2023-10-05 20:00:25,525 DEBUG [rs(jenkins-hbase4.apache.org,36369,1696535998737)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,1,1696536024778.4f68bf1d8d8715f529d452a612f9a34f. completed. 2023-10-05 20:00:25,525 DEBUG [rs(jenkins-hbase4.apache.org,36369,1696535998737)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,1,1696536024778.4f68bf1d8d8715f529d452a612f9a34f. 2023-10-05 20:00:25,525 DEBUG [member: 'jenkins-hbase4.apache.org,36369,1696535998737' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-05 20:00:25,525 DEBUG [member: 'jenkins-hbase4.apache.org,36369,1696535998737' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-05 20:00:25,525 DEBUG [member: 'jenkins-hbase4.apache.org,36369,1696535998737' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,36369,1696535998737 2023-10-05 20:00:25,525 DEBUG [member: 'jenkins-hbase4.apache.org,36369,1696535998737' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally completed 2023-10-05 20:00:25,525 DEBUG [member: 'jenkins-hbase4.apache.org,36369,1696535998737' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,36369,1696535998737' in zk 2023-10-05 20:00:25,527 DEBUG [member: 'jenkins-hbase4.apache.org,36369,1696535998737' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemState' has notified controller of completion 2023-10-05 20:00:25,527 DEBUG [member: 'jenkins-hbase4.apache.org,36369,1696535998737' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-05 20:00:25,527 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): master:40857-0x101182c1f970000, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,36369,1696535998737 2023-10-05 20:00:25,527 DEBUG [member: 'jenkins-hbase4.apache.org,36369,1696535998737' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemState' completed. 2023-10-05 20:00:25,527 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,36369,1696535998737 2023-10-05 20:00:25,527 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-05 20:00:25,527 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-05 20:00:25,529 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-05 20:00:25,530 DEBUG [rs(jenkins-hbase4.apache.org,32861,1696535998642)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,,1696536024778.cfae8165c705c25ee6fc04a7bf3b51de. completed. 2023-10-05 20:00:25,530 DEBUG [rs(jenkins-hbase4.apache.org,32861,1696535998642)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,,1696536024778.cfae8165c705c25ee6fc04a7bf3b51de. 2023-10-05 20:00:25,530 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-05 20:00:25,530 DEBUG [member: 'jenkins-hbase4.apache.org,32861,1696535998642' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-05 20:00:25,530 DEBUG [member: 'jenkins-hbase4.apache.org,32861,1696535998642' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-05 20:00:25,530 DEBUG [member: 'jenkins-hbase4.apache.org,32861,1696535998642' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,32861,1696535998642 2023-10-05 20:00:25,530 DEBUG [member: 'jenkins-hbase4.apache.org,32861,1696535998642' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally completed 2023-10-05 20:00:25,530 DEBUG [member: 'jenkins-hbase4.apache.org,32861,1696535998642' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,32861,1696535998642' in zk 2023-10-05 20:00:25,532 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-10-05 20:00:25,533 DEBUG [member: 'jenkins-hbase4.apache.org,32861,1696535998642' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemState' has notified controller of completion 2023-10-05 20:00:25,534 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): master:40857-0x101182c1f970000, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,32861,1696535998642 2023-10-05 20:00:25,534 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32861,1696535998642 2023-10-05 20:00:25,534 DEBUG [member: 'jenkins-hbase4.apache.org,32861,1696535998642' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-05 20:00:25,534 DEBUG [member: 'jenkins-hbase4.apache.org,32861,1696535998642' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemState' completed. 2023-10-05 20:00:25,535 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36369,1696535998737 2023-10-05 20:00:25,535 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44821,1696535998698 2023-10-05 20:00:25,535 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-05 20:00:25,536 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-10-05 20:00:25,536 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32861,1696535998642 2023-10-05 20:00:25,536 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36369,1696535998737 2023-10-05 20:00:25,537 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44821,1696535998698 2023-10-05 20:00:25,537 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,36369,1696535998737': 2023-10-05 20:00:25,537 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,36369,1696535998737' released barrier for procedure'emptySnaptb0-testExportFileSystemState', counting down latch. Waiting for 1 more 2023-10-05 20:00:25,537 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,32861,1696535998642 2023-10-05 20:00:25,537 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-05 20:00:25,537 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-05 20:00:25,538 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-05 20:00:25,538 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-05 20:00:25,538 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-10-05 20:00:25,538 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32861,1696535998642 2023-10-05 20:00:25,539 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36369,1696535998737 2023-10-05 20:00:25,539 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44821,1696535998698 2023-10-05 20:00:25,539 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-05 20:00:25,539 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-10-05 20:00:25,540 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32861,1696535998642 2023-10-05 20:00:25,540 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36369,1696535998737 2023-10-05 20:00:25,540 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44821,1696535998698 2023-10-05 20:00:25,541 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,32861,1696535998642': 2023-10-05 20:00:25,541 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,32861,1696535998642' released barrier for procedure'emptySnaptb0-testExportFileSystemState', counting down latch. Waiting for 0 more 2023-10-05 20:00:25,541 INFO [(jenkins-hbase4.apache.org,40857,1696535997381)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportFileSystemState' execution completed 2023-10-05 20:00:25,541 DEBUG [(jenkins-hbase4.apache.org,40857,1696535997381)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-05 20:00:25,541 DEBUG [(jenkins-hbase4.apache.org,40857,1696535997381)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-05 20:00:25,541 DEBUG [(jenkins-hbase4.apache.org,40857,1696535997381)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportFileSystemState 2023-10-05 20:00:25,541 INFO [(jenkins-hbase4.apache.org,40857,1696535997381)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-10-05 20:00:25,543 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): master:40857-0x101182c1f970000, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-10-05 20:00:25,543 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): regionserver:44821-0x101182c1f970002, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-10-05 20:00:25,543 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-10-05 20:00:25,543 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-10-05 20:00:25,543 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): regionserver:44821-0x101182c1f970002, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-05 20:00:25,543 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): regionserver:36369-0x101182c1f970003, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-10-05 20:00:25,543 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): regionserver:32861-0x101182c1f970001, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-10-05 20:00:25,543 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): regionserver:36369-0x101182c1f970003, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-05 20:00:25,543 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-10-05 20:00:25,543 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-10-05 20:00:25,543 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): regionserver:32861-0x101182c1f970001, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-05 20:00:25,543 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-10-05 20:00:25,543 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-10-05 20:00:25,543 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-05 20:00:25,544 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-05 20:00:25,544 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-10-05 20:00:25,544 DEBUG [(jenkins-hbase4.apache.org,40857,1696535997381)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40857-0x101182c1f970000, quorum=127.0.0.1:57530, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,32861,1696535998642 2023-10-05 20:00:25,544 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-05 20:00:25,544 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-05 20:00:25,544 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-05 20:00:25,544 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-05 20:00:25,544 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-05 20:00:25,544 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-05 20:00:25,544 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-05 20:00:25,544 DEBUG [(jenkins-hbase4.apache.org,40857,1696535997381)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40857-0x101182c1f970000, quorum=127.0.0.1:57530, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,36369,1696535998737 2023-10-05 20:00:25,544 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-10-05 20:00:25,545 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-10-05 20:00:25,545 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-10-05 20:00:25,545 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-10-05 20:00:25,545 DEBUG [(jenkins-hbase4.apache.org,40857,1696535997381)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40857-0x101182c1f970000, quorum=127.0.0.1:57530, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,44821,1696535998698 2023-10-05 20:00:25,545 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-05 20:00:25,546 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-10-05 20:00:25,546 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32861,1696535998642 2023-10-05 20:00:25,546 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36369,1696535998737 2023-10-05 20:00:25,547 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44821,1696535998698 2023-10-05 20:00:25,547 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-05 20:00:25,548 DEBUG [(jenkins-hbase4.apache.org,40857,1696535997381)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40857-0x101182c1f970000, quorum=127.0.0.1:57530, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,32861,1696535998642 2023-10-05 20:00:25,548 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-10-05 20:00:25,548 DEBUG [(jenkins-hbase4.apache.org,40857,1696535997381)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40857-0x101182c1f970000, quorum=127.0.0.1:57530, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,36369,1696535998737 2023-10-05 20:00:25,548 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32861,1696535998642 2023-10-05 20:00:25,548 DEBUG [(jenkins-hbase4.apache.org,40857,1696535997381)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40857-0x101182c1f970000, quorum=127.0.0.1:57530, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,44821,1696535998698 2023-10-05 20:00:25,549 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36369,1696535998737 2023-10-05 20:00:25,549 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44821,1696535998698 2023-10-05 20:00:25,552 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): regionserver:32861-0x101182c1f970001, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-05 20:00:25,552 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): regionserver:36369-0x101182c1f970003, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-05 20:00:25,552 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): regionserver:32861-0x101182c1f970001, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-05 20:00:25,552 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): regionserver:36369-0x101182c1f970003, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-05 20:00:25,552 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): regionserver:44821-0x101182c1f970002, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-05 20:00:25,552 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): master:40857-0x101182c1f970000, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,44821,1696535998698 2023-10-05 20:00:25,552 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-05 20:00:25,552 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-05 20:00:25,552 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): master:40857-0x101182c1f970000, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-10-05 20:00:25,552 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): regionserver:44821-0x101182c1f970002, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-05 20:00:25,552 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-05 20:00:25,553 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-05 20:00:25,552 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-05 20:00:25,553 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-05 20:00:25,553 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportFileSystemState 2023-10-05 20:00:25,553 DEBUG [(jenkins-hbase4.apache.org,40857,1696535997381)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-05 20:00:25,553 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): master:40857-0x101182c1f970000, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,36369,1696535998737 2023-10-05 20:00:25,553 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemState 2023-10-05 20:00:25,553 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-05 20:00:25,554 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-05 20:00:25,554 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 8c2558c0b59bb3a4e2e578c2c8e8915d, NAME => 'testtb-testExportFileSystemState,.mob,0.8c2558c0b59bb3a4e2e578c2c8e8915d.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testExportFileSystemState 2023-10-05 20:00:25,554 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): master:40857-0x101182c1f970000, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,32861,1696535998642 2023-10-05 20:00:25,555 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-05 20:00:25,555 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-05 20:00:25,555 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): master:40857-0x101182c1f970000, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-10-05 20:00:25,554 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-10-05 20:00:25,554 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-05 20:00:25,555 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): master:40857-0x101182c1f970000, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,44821,1696535998698 2023-10-05 20:00:25,555 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): master:40857-0x101182c1f970000, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-10-05 20:00:25,555 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): master:40857-0x101182c1f970000, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,36369,1696535998737 2023-10-05 20:00:25,555 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): master:40857-0x101182c1f970000, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,32861,1696535998642 2023-10-05 20:00:25,555 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): master:40857-0x101182c1f970000, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-10-05 20:00:25,555 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): master:40857-0x101182c1f970000, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-10-05 20:00:25,555 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-05 20:00:25,555 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-10-05 20:00:25,557 DEBUG [Listener at jenkins-hbase4.apache.org/35067] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-05 20:00:25,558 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40857] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-10-05 20:00:25,558 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40857] snapshot.SnapshotManager(406): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-10-05 20:00:25,558 DEBUG [Listener at jenkins-hbase4.apache.org/35067] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-10-05 20:00:25,570 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportFileSystemState 2023-10-05 20:00:25,571 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState 2023-10-05 20:00:25,597 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState to hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/.hbase-snapshot/emptySnaptb0-testExportFileSystemState 2023-10-05 20:00:25,598 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed 2023-10-05 20:00:25,598 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState 2023-10-05 20:00:25,599 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState 2023-10-05 20:00:25,599 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState at 1696536025456Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemState at 1696536025570 (+114 ms)Consolidate snapshot: emptySnaptb0-testExportFileSystemState at 1696536025570Loading Region manifests for emptySnaptb0-testExportFileSystemState at 1696536025570Writing data manifest for emptySnaptb0-testExportFileSystemState at 1696536025575 (+5 ms)Verifying snapshot: emptySnaptb0-testExportFileSystemState at 1696536025590 (+15 ms)Snapshot emptySnaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed at 1696536025598 (+8 ms) 2023-10-05 20:00:25,602 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=33, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-10-05 20:00:25,604 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=33, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED in 146 msec 2023-10-05 20:00:25,758 DEBUG [Listener at jenkins-hbase4.apache.org/35067] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-05 20:00:25,760 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40857] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-10-05 20:00:25,760 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40857] snapshot.SnapshotManager(403): Snapshot '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-10-05 20:00:25,763 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32861] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemState,,1696536024778.cfae8165c705c25ee6fc04a7bf3b51de. with WAL disabled. Data may be lost in the event of a crash. 2023-10-05 20:00:25,766 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36369] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemState,1,1696536024778.4f68bf1d8d8715f529d452a612f9a34f. with WAL disabled. Data may be lost in the event of a crash. 2023-10-05 20:00:25,770 DEBUG [Listener at jenkins-hbase4.apache.org/35067] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemState 2023-10-05 20:00:25,770 DEBUG [Listener at jenkins-hbase4.apache.org/35067] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemState,,1696536024778.cfae8165c705c25ee6fc04a7bf3b51de. 2023-10-05 20:00:25,771 INFO [Listener at jenkins-hbase4.apache.org/35067] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-10-05 20:00:25,783 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40857] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-10-05 20:00:25,783 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40857] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1696536025783 (current time:1696536025783). 2023-10-05 20:00:25,783 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40857] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-10-05 20:00:25,784 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40857] zookeeper.ReadOnlyZKClient(139): Connect 0x2d9d49c7 to 127.0.0.1:57530 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-05 20:00:25,791 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40857] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@196939cc, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-05 20:00:25,792 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40857] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-05 20:00:25,794 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:60082, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-05 20:00:25,795 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40857] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x2d9d49c7 to 127.0.0.1:57530 2023-10-05 20:00:25,796 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40857] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-05 20:00:25,797 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40857] zookeeper.ReadOnlyZKClient(139): Connect 0x135c35cd to 127.0.0.1:57530 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-05 20:00:25,806 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40857] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@43f710c, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-05 20:00:25,807 DEBUG [hconnection-0x541e672e-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-05 20:00:25,808 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:60098, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-05 20:00:25,814 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40857] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-05 20:00:25,817 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:51584, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-05 20:00:25,818 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40857] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x135c35cd to 127.0.0.1:57530 2023-10-05 20:00:25,818 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40857] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-05 20:00:25,818 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40857] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemState], kv [jenkins: RWXCA] 2023-10-05 20:00:25,820 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40857] snapshot.SnapshotManager(637): No existing snapshot, attempting snapshot... 2023-10-05 20:00:25,820 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40857] snapshot.SnapshotManager(684): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-10-05 20:00:25,823 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40857] snapshot.SnapshotManager(519): Unable to retrieve ACL status for path: hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/.hbase-snapshot, current working dir path: hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState org.apache.hadoop.hdfs.protocol.AclException: The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.ipc.RemoteException.instantiateException(RemoteException.java:121) at org.apache.hadoop.ipc.RemoteException.unwrapRemoteException(RemoteException.java:88) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2736) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2294) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2291) at org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81) at org.apache.hadoop.hdfs.DistributedFileSystem.getAclStatus(DistributedFileSystem.java:2291) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.updateWorkingDirAclsIfRequired(SnapshotManager.java:517) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.prepareToTakeSnapshot(SnapshotManager.java:490) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.snapshotEnabledTable(SnapshotManager.java:559) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshotInternal(SnapshotManager.java:687) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshot(SnapshotManager.java:623) at org.apache.hadoop.hbase.master.MasterRpcServices.snapshot(MasterRpcServices.java:1588) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) Caused by: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.hdfs.protocol.AclException): The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at org.apache.hadoop.ipc.Client.getRpcResponse(Client.java:1540) at org.apache.hadoop.ipc.Client.call(Client.java:1486) at org.apache.hadoop.ipc.Client.call(Client.java:1385) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:232) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:118) at com.sun.proxy.$Proxy32.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.getAclStatus(ClientNamenodeProtocolTranslatorPB.java:1385) at sun.reflect.GeneratedMethodAccessor62.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:422) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeMethod(RetryInvocationHandler.java:165) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invoke(RetryInvocationHandler.java:157) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeOnce(RetryInvocationHandler.java:95) at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:359) at com.sun.proxy.$Proxy35.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor62.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor62.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor62.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor62.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor62.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2734) ... 15 more 2023-10-05 20:00:25,825 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40857] procedure2.ProcedureExecutor(1028): Stored pid=34, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-10-05 20:00:25,827 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=34, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-10-05 20:00:25,828 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=34, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1696536625828 2023-10-05 20:00:25,828 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40857] snapshot.SnapshotManager(689): Started snapshot: { ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-10-05 20:00:25,828 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState 2023-10-05 20:00:25,829 DEBUG [Listener at jenkins-hbase4.apache.org/35067] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-10-05 20:00:25,829 DEBUG [Listener at jenkins-hbase4.apache.org/35067] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-10-05 20:00:25,831 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=34, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-10-05 20:00:25,831 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=35, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-10-05 20:00:25,832 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=34, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE in 7 msec 2023-10-05 20:00:25,833 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=35, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-10-05 20:00:25,834 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=35, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED; timeout=600000, timestamp=1696536625834 2023-10-05 20:00:25,847 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemState 2023-10-05 20:00:25,847 INFO [(jenkins-hbase4.apache.org,40857,1696535997381)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemState' 2023-10-05 20:00:25,847 DEBUG [(jenkins-hbase4.apache.org,40857,1696535997381)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-05 20:00:25,848 DEBUG [(jenkins-hbase4.apache.org,40857,1696535997381)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemState' starting 'acquire' 2023-10-05 20:00:25,848 DEBUG [(jenkins-hbase4.apache.org,40857,1696535997381)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemState', kicking off acquire phase on members. 2023-10-05 20:00:25,849 DEBUG [(jenkins-hbase4.apache.org,40857,1696535997381)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40857-0x101182c1f970000, quorum=127.0.0.1:57530, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-10-05 20:00:25,849 DEBUG [(jenkins-hbase4.apache.org,40857,1696535997381)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-10-05 20:00:25,850 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): regionserver:44821-0x101182c1f970002, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-05 20:00:25,850 DEBUG [(jenkins-hbase4.apache.org,40857,1696535997381)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,32861,1696535998642 2023-10-05 20:00:25,850 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-05 20:00:25,850 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-05 20:00:25,850 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): regionserver:32861-0x101182c1f970001, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-05 20:00:25,850 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): regionserver:36369-0x101182c1f970003, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-05 20:00:25,850 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-05 20:00:25,850 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-05 20:00:25,850 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-05 20:00:25,850 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-05 20:00:25,850 DEBUG [(jenkins-hbase4.apache.org,40857,1696535997381)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40857-0x101182c1f970000, quorum=127.0.0.1:57530, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,32861,1696535998642 2023-10-05 20:00:25,850 DEBUG [(jenkins-hbase4.apache.org,40857,1696535997381)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,36369,1696535998737 2023-10-05 20:00:25,850 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-10-05 20:00:25,851 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-10-05 20:00:25,851 DEBUG [(jenkins-hbase4.apache.org,40857,1696535997381)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40857-0x101182c1f970000, quorum=127.0.0.1:57530, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,36369,1696535998737 2023-10-05 20:00:25,851 DEBUG [(jenkins-hbase4.apache.org,40857,1696535997381)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-05 20:00:25,851 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-10-05 20:00:25,851 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44821-0x101182c1f970002, quorum=127.0.0.1:57530, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-10-05 20:00:25,851 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36369-0x101182c1f970003, quorum=127.0.0.1:57530, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-10-05 20:00:25,851 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:32861-0x101182c1f970001, quorum=127.0.0.1:57530, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-10-05 20:00:25,851 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 169 2023-10-05 20:00:25,851 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 169 2023-10-05 20:00:25,851 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-10-05 20:00:25,851 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-10-05 20:00:25,851 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 169 2023-10-05 20:00:25,852 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-10-05 20:00:25,852 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-10-05 20:00:25,852 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-10-05 20:00:25,852 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-10-05 20:00:25,852 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemState 2023-10-05 20:00:25,852 DEBUG [member: 'jenkins-hbase4.apache.org,36369,1696535998737' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemState' with timeout 300000ms 2023-10-05 20:00:25,852 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemState 2023-10-05 20:00:25,852 DEBUG [member: 'jenkins-hbase4.apache.org,36369,1696535998737' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-05 20:00:25,852 DEBUG [member: 'jenkins-hbase4.apache.org,44821,1696535998698' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemState' with timeout 300000ms 2023-10-05 20:00:25,853 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemState 2023-10-05 20:00:25,853 DEBUG [member: 'jenkins-hbase4.apache.org,44821,1696535998698' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-05 20:00:25,853 DEBUG [member: 'jenkins-hbase4.apache.org,32861,1696535998642' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemState' with timeout 300000ms 2023-10-05 20:00:25,853 DEBUG [member: 'jenkins-hbase4.apache.org,36369,1696535998737' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemState' starting 'acquire' stage 2023-10-05 20:00:25,854 DEBUG [member: 'jenkins-hbase4.apache.org,36369,1696535998737' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemState' locally acquired 2023-10-05 20:00:25,854 DEBUG [member: 'jenkins-hbase4.apache.org,36369,1696535998737' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,36369,1696535998737' joining acquired barrier for procedure (snaptb0-testExportFileSystemState) in zk 2023-10-05 20:00:25,854 DEBUG [member: 'jenkins-hbase4.apache.org,32861,1696535998642' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-05 20:00:25,854 DEBUG [member: 'jenkins-hbase4.apache.org,44821,1696535998698' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemState' starting 'acquire' stage 2023-10-05 20:00:25,855 DEBUG [member: 'jenkins-hbase4.apache.org,44821,1696535998698' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemState' locally acquired 2023-10-05 20:00:25,855 DEBUG [member: 'jenkins-hbase4.apache.org,32861,1696535998642' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemState' starting 'acquire' stage 2023-10-05 20:00:25,855 DEBUG [member: 'jenkins-hbase4.apache.org,32861,1696535998642' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemState' locally acquired 2023-10-05 20:00:25,855 DEBUG [member: 'jenkins-hbase4.apache.org,44821,1696535998698' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44821,1696535998698' joining acquired barrier for procedure (snaptb0-testExportFileSystemState) in zk 2023-10-05 20:00:25,855 DEBUG [member: 'jenkins-hbase4.apache.org,32861,1696535998642' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,32861,1696535998642' joining acquired barrier for procedure (snaptb0-testExportFileSystemState) in zk 2023-10-05 20:00:25,857 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): master:40857-0x101182c1f970000, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,36369,1696535998737 2023-10-05 20:00:25,857 DEBUG [member: 'jenkins-hbase4.apache.org,36369,1696535998737' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-10-05 20:00:25,857 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,36369,1696535998737 2023-10-05 20:00:25,857 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-05 20:00:25,858 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-05 20:00:25,859 DEBUG [member: 'jenkins-hbase4.apache.org,44821,1696535998698' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-10-05 20:00:25,859 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-05 20:00:25,859 DEBUG [member: 'jenkins-hbase4.apache.org,36369,1696535998737' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36369-0x101182c1f970003, quorum=127.0.0.1:57530, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-10-05 20:00:25,859 DEBUG [member: 'jenkins-hbase4.apache.org,36369,1696535998737' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-05 20:00:25,860 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): master:40857-0x101182c1f970000, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,32861,1696535998642 2023-10-05 20:00:25,860 DEBUG [member: 'jenkins-hbase4.apache.org,32861,1696535998642' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-10-05 20:00:25,860 DEBUG [member: 'jenkins-hbase4.apache.org,44821,1696535998698' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44821-0x101182c1f970002, quorum=127.0.0.1:57530, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-10-05 20:00:25,860 DEBUG [member: 'jenkins-hbase4.apache.org,44821,1696535998698' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-05 20:00:25,860 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-05 20:00:25,860 DEBUG [member: 'jenkins-hbase4.apache.org,32861,1696535998642' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:32861-0x101182c1f970001, quorum=127.0.0.1:57530, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-10-05 20:00:25,860 DEBUG [member: 'jenkins-hbase4.apache.org,32861,1696535998642' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-05 20:00:25,860 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-10-05 20:00:25,860 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32861,1696535998642 2023-10-05 20:00:25,861 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36369,1696535998737 2023-10-05 20:00:25,861 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44821,1696535998698 2023-10-05 20:00:25,861 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-05 20:00:25,862 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,36369,1696535998737' joining acquired barrier for procedure 'snaptb0-testExportFileSystemState' on coordinator 2023-10-05 20:00:25,862 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@18b28c0a[Count = 1] remaining members to acquire global barrier 2023-10-05 20:00:25,862 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,32861,1696535998642 2023-10-05 20:00:25,862 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-05 20:00:25,862 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-05 20:00:25,862 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-05 20:00:25,862 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-05 20:00:25,863 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-10-05 20:00:25,863 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32861,1696535998642 2023-10-05 20:00:25,863 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36369,1696535998737 2023-10-05 20:00:25,863 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44821,1696535998698 2023-10-05 20:00:25,864 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-05 20:00:25,864 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,32861,1696535998642' joining acquired barrier for procedure 'snaptb0-testExportFileSystemState' on coordinator 2023-10-05 20:00:25,864 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@18b28c0a[Count = 0] remaining members to acquire global barrier 2023-10-05 20:00:25,864 DEBUG [(jenkins-hbase4.apache.org,40857,1696535997381)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemState' starting 'in-barrier' execution. 2023-10-05 20:00:25,864 DEBUG [(jenkins-hbase4.apache.org,40857,1696535997381)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-10-05 20:00:25,865 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): regionserver:44821-0x101182c1f970002, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-10-05 20:00:25,865 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): regionserver:32861-0x101182c1f970001, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-10-05 20:00:25,865 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-10-05 20:00:25,865 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-10-05 20:00:25,866 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-10-05 20:00:25,865 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-10-05 20:00:25,865 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): regionserver:36369-0x101182c1f970003, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-10-05 20:00:25,866 DEBUG [member: 'jenkins-hbase4.apache.org,44821,1696535998698' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-10-05 20:00:25,866 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-10-05 20:00:25,866 DEBUG [member: 'jenkins-hbase4.apache.org,44821,1696535998698' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemState' locally completed 2023-10-05 20:00:25,866 DEBUG [(jenkins-hbase4.apache.org,40857,1696535997381)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40857-0x101182c1f970000, quorum=127.0.0.1:57530, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,36369,1696535998737 2023-10-05 20:00:25,866 DEBUG [member: 'jenkins-hbase4.apache.org,32861,1696535998642' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-10-05 20:00:25,866 DEBUG [member: 'jenkins-hbase4.apache.org,44821,1696535998698' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,44821,1696535998698' in zk 2023-10-05 20:00:25,866 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-10-05 20:00:25,866 DEBUG [member: 'jenkins-hbase4.apache.org,32861,1696535998642' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-05 20:00:25,866 DEBUG [member: 'jenkins-hbase4.apache.org,32861,1696535998642' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-05 20:00:25,866 DEBUG [member: 'jenkins-hbase4.apache.org,36369,1696535998737' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-10-05 20:00:25,866 DEBUG [rs(jenkins-hbase4.apache.org,32861,1696535998642)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,,1696536024778.cfae8165c705c25ee6fc04a7bf3b51de. 2023-10-05 20:00:25,866 DEBUG [(jenkins-hbase4.apache.org,40857,1696535997381)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40857-0x101182c1f970000, quorum=127.0.0.1:57530, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,32861,1696535998642 2023-10-05 20:00:25,866 DEBUG [rs(jenkins-hbase4.apache.org,32861,1696535998642)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,,1696536024778.cfae8165c705c25ee6fc04a7bf3b51de. started... 2023-10-05 20:00:25,866 DEBUG [rs(jenkins-hbase4.apache.org,36369,1696535998737)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,1,1696536024778.4f68bf1d8d8715f529d452a612f9a34f. 2023-10-05 20:00:25,866 DEBUG [(jenkins-hbase4.apache.org,40857,1696535997381)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-05 20:00:25,867 INFO [rs(jenkins-hbase4.apache.org,32861,1696535998642)-snapshot-pool-0] regionserver.HRegion(2745): Flushing cfae8165c705c25ee6fc04a7bf3b51de 1/1 column families, dataSize=132 B heapSize=544 B 2023-10-05 20:00:25,866 DEBUG [member: 'jenkins-hbase4.apache.org,36369,1696535998737' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-05 20:00:25,867 DEBUG [member: 'jenkins-hbase4.apache.org,36369,1696535998737' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-05 20:00:25,866 DEBUG [rs(jenkins-hbase4.apache.org,36369,1696535998737)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,1,1696536024778.4f68bf1d8d8715f529d452a612f9a34f. started... 2023-10-05 20:00:25,867 INFO [rs(jenkins-hbase4.apache.org,36369,1696535998737)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 4f68bf1d8d8715f529d452a612f9a34f 1/1 column families, dataSize=3.13 KB heapSize=7 KB 2023-10-05 20:00:25,872 DEBUG [member: 'jenkins-hbase4.apache.org,44821,1696535998698' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemState' has notified controller of completion 2023-10-05 20:00:25,872 DEBUG [member: 'jenkins-hbase4.apache.org,44821,1696535998698' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-05 20:00:25,872 DEBUG [member: 'jenkins-hbase4.apache.org,44821,1696535998698' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemState' completed. 2023-10-05 20:00:25,900 INFO [rs(jenkins-hbase4.apache.org,32861,1696535998642)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202310057b0fbbd3047b41529f29163286b90d69 to hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e202310057b0fbbd3047b41529f29163286b90d69 2023-10-05 20:00:25,906 INFO [rs(jenkins-hbase4.apache.org,36369,1696535998737)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023100540d7b148183b408f8a62ebfe79f6ccb4 to hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b2023100540d7b148183b408f8a62ebfe79f6ccb4 2023-10-05 20:00:25,923 INFO [rs(jenkins-hbase4.apache.org,32861,1696535998642)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=132, hasBloomFilter=true, into tmp file hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/data/default/testtb-testExportFileSystemState/cfae8165c705c25ee6fc04a7bf3b51de/.tmp/cf/366319bc24404468a1aaf1cb8531a141 2023-10-05 20:00:25,926 INFO [rs(jenkins-hbase4.apache.org,36369,1696535998737)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=3.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/data/default/testtb-testExportFileSystemState/4f68bf1d8d8715f529d452a612f9a34f/.tmp/cf/fe23b4b417e4426d85bcaec62944a42d 2023-10-05 20:00:25,929 DEBUG [Listener at jenkins-hbase4.apache.org/35067] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-05 20:00:25,931 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40857] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-10-05 20:00:25,931 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40857] snapshot.SnapshotManager(406): Snapshoting '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-10-05 20:00:25,931 DEBUG [rs(jenkins-hbase4.apache.org,32861,1696535998642)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/data/default/testtb-testExportFileSystemState/cfae8165c705c25ee6fc04a7bf3b51de/.tmp/cf/366319bc24404468a1aaf1cb8531a141 as hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/data/default/testtb-testExportFileSystemState/cfae8165c705c25ee6fc04a7bf3b51de/cf/366319bc24404468a1aaf1cb8531a141 2023-10-05 20:00:25,931 DEBUG [Listener at jenkins-hbase4.apache.org/35067] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-10-05 20:00:25,932 DEBUG [rs(jenkins-hbase4.apache.org,36369,1696535998737)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/data/default/testtb-testExportFileSystemState/4f68bf1d8d8715f529d452a612f9a34f/.tmp/cf/fe23b4b417e4426d85bcaec62944a42d as hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/data/default/testtb-testExportFileSystemState/4f68bf1d8d8715f529d452a612f9a34f/cf/fe23b4b417e4426d85bcaec62944a42d 2023-10-05 20:00:25,938 INFO [rs(jenkins-hbase4.apache.org,32861,1696535998642)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/data/default/testtb-testExportFileSystemState/cfae8165c705c25ee6fc04a7bf3b51de/cf/366319bc24404468a1aaf1cb8531a141, entries=2, sequenceid=6, filesize=5.2 K 2023-10-05 20:00:25,938 INFO [rs(jenkins-hbase4.apache.org,36369,1696535998737)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/data/default/testtb-testExportFileSystemState/4f68bf1d8d8715f529d452a612f9a34f/cf/fe23b4b417e4426d85bcaec62944a42d, entries=48, sequenceid=6, filesize=13.0 K 2023-10-05 20:00:25,939 INFO [rs(jenkins-hbase4.apache.org,32861,1696535998642)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~132 B/132, heapSize ~528 B/528, currentSize=0 B/0 for cfae8165c705c25ee6fc04a7bf3b51de in 72ms, sequenceid=6, compaction requested=false 2023-10-05 20:00:25,939 INFO [rs(jenkins-hbase4.apache.org,36369,1696535998737)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.13 KB/3204, heapSize ~6.98 KB/7152, currentSize=0 B/0 for 4f68bf1d8d8715f529d452a612f9a34f in 72ms, sequenceid=6, compaction requested=false 2023-10-05 20:00:25,939 DEBUG [rs(jenkins-hbase4.apache.org,32861,1696535998642)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemState' 2023-10-05 20:00:25,939 DEBUG [rs(jenkins-hbase4.apache.org,36369,1696535998737)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemState' 2023-10-05 20:00:25,942 DEBUG [rs(jenkins-hbase4.apache.org,32861,1696535998642)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for cfae8165c705c25ee6fc04a7bf3b51de: 2023-10-05 20:00:25,942 DEBUG [rs(jenkins-hbase4.apache.org,36369,1696535998737)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 4f68bf1d8d8715f529d452a612f9a34f: 2023-10-05 20:00:25,942 DEBUG [rs(jenkins-hbase4.apache.org,32861,1696535998642)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,,1696536024778.cfae8165c705c25ee6fc04a7bf3b51de.' region-info for snapshot=snaptb0-testExportFileSystemState 2023-10-05 20:00:25,942 DEBUG [rs(jenkins-hbase4.apache.org,36369,1696535998737)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,1,1696536024778.4f68bf1d8d8715f529d452a612f9a34f.' region-info for snapshot=snaptb0-testExportFileSystemState 2023-10-05 20:00:25,942 DEBUG [rs(jenkins-hbase4.apache.org,32861,1696535998642)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-05 20:00:25,942 DEBUG [rs(jenkins-hbase4.apache.org,36369,1696535998737)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-05 20:00:25,942 DEBUG [rs(jenkins-hbase4.apache.org,32861,1696535998642)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/data/default/testtb-testExportFileSystemState/cfae8165c705c25ee6fc04a7bf3b51de/cf/366319bc24404468a1aaf1cb8531a141] hfiles 2023-10-05 20:00:25,942 DEBUG [rs(jenkins-hbase4.apache.org,36369,1696535998737)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/data/default/testtb-testExportFileSystemState/4f68bf1d8d8715f529d452a612f9a34f/cf/fe23b4b417e4426d85bcaec62944a42d] hfiles 2023-10-05 20:00:25,942 DEBUG [rs(jenkins-hbase4.apache.org,32861,1696535998642)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/data/default/testtb-testExportFileSystemState/cfae8165c705c25ee6fc04a7bf3b51de/cf/366319bc24404468a1aaf1cb8531a141 for snapshot=snaptb0-testExportFileSystemState 2023-10-05 20:00:25,943 DEBUG [rs(jenkins-hbase4.apache.org,36369,1696535998737)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/data/default/testtb-testExportFileSystemState/4f68bf1d8d8715f529d452a612f9a34f/cf/fe23b4b417e4426d85bcaec62944a42d for snapshot=snaptb0-testExportFileSystemState 2023-10-05 20:00:25,956 DEBUG [rs(jenkins-hbase4.apache.org,36369,1696535998737)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,1,1696536024778.4f68bf1d8d8715f529d452a612f9a34f. completed. 2023-10-05 20:00:25,957 DEBUG [rs(jenkins-hbase4.apache.org,36369,1696535998737)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,1,1696536024778.4f68bf1d8d8715f529d452a612f9a34f. 2023-10-05 20:00:25,957 DEBUG [member: 'jenkins-hbase4.apache.org,36369,1696535998737' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-05 20:00:25,958 DEBUG [member: 'jenkins-hbase4.apache.org,36369,1696535998737' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-05 20:00:25,958 DEBUG [member: 'jenkins-hbase4.apache.org,36369,1696535998737' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,36369,1696535998737 2023-10-05 20:00:25,958 DEBUG [member: 'jenkins-hbase4.apache.org,36369,1696535998737' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemState' locally completed 2023-10-05 20:00:25,958 DEBUG [member: 'jenkins-hbase4.apache.org,36369,1696535998737' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,36369,1696535998737' in zk 2023-10-05 20:00:25,959 DEBUG [rs(jenkins-hbase4.apache.org,32861,1696535998642)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,,1696536024778.cfae8165c705c25ee6fc04a7bf3b51de. completed. 2023-10-05 20:00:25,959 DEBUG [rs(jenkins-hbase4.apache.org,32861,1696535998642)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,,1696536024778.cfae8165c705c25ee6fc04a7bf3b51de. 2023-10-05 20:00:25,959 DEBUG [member: 'jenkins-hbase4.apache.org,32861,1696535998642' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-05 20:00:25,959 DEBUG [member: 'jenkins-hbase4.apache.org,32861,1696535998642' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-05 20:00:25,959 DEBUG [member: 'jenkins-hbase4.apache.org,32861,1696535998642' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,32861,1696535998642 2023-10-05 20:00:25,959 DEBUG [member: 'jenkins-hbase4.apache.org,32861,1696535998642' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemState' locally completed 2023-10-05 20:00:25,959 DEBUG [member: 'jenkins-hbase4.apache.org,32861,1696535998642' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,32861,1696535998642' in zk 2023-10-05 20:00:25,964 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): master:40857-0x101182c1f970000, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,36369,1696535998737 2023-10-05 20:00:25,964 DEBUG [member: 'jenkins-hbase4.apache.org,36369,1696535998737' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemState' has notified controller of completion 2023-10-05 20:00:25,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,36369,1696535998737 2023-10-05 20:00:25,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-05 20:00:25,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-05 20:00:25,964 DEBUG [member: 'jenkins-hbase4.apache.org,36369,1696535998737' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-05 20:00:25,964 DEBUG [member: 'jenkins-hbase4.apache.org,36369,1696535998737' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemState' completed. 2023-10-05 20:00:25,966 DEBUG [member: 'jenkins-hbase4.apache.org,32861,1696535998642' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemState' has notified controller of completion 2023-10-05 20:00:25,966 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): master:40857-0x101182c1f970000, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,32861,1696535998642 2023-10-05 20:00:25,966 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-05 20:00:25,966 DEBUG [member: 'jenkins-hbase4.apache.org,32861,1696535998642' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-05 20:00:25,966 DEBUG [member: 'jenkins-hbase4.apache.org,32861,1696535998642' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemState' completed. 2023-10-05 20:00:25,967 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-05 20:00:25,967 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-10-05 20:00:25,968 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32861,1696535998642 2023-10-05 20:00:25,968 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36369,1696535998737 2023-10-05 20:00:25,968 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44821,1696535998698 2023-10-05 20:00:25,968 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-05 20:00:25,969 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-10-05 20:00:25,969 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32861,1696535998642 2023-10-05 20:00:25,969 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36369,1696535998737 2023-10-05 20:00:25,969 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44821,1696535998698 2023-10-05 20:00:25,970 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,36369,1696535998737': 2023-10-05 20:00:25,970 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,36369,1696535998737' released barrier for procedure'snaptb0-testExportFileSystemState', counting down latch. Waiting for 1 more 2023-10-05 20:00:25,970 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,32861,1696535998642 2023-10-05 20:00:25,970 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-05 20:00:25,970 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-05 20:00:25,970 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-05 20:00:25,971 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-05 20:00:25,971 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-10-05 20:00:25,971 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32861,1696535998642 2023-10-05 20:00:25,971 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36369,1696535998737 2023-10-05 20:00:25,972 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44821,1696535998698 2023-10-05 20:00:25,972 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-05 20:00:25,972 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-10-05 20:00:25,972 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32861,1696535998642 2023-10-05 20:00:25,973 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36369,1696535998737 2023-10-05 20:00:25,973 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44821,1696535998698 2023-10-05 20:00:25,974 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,32861,1696535998642': 2023-10-05 20:00:25,974 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,32861,1696535998642' released barrier for procedure'snaptb0-testExportFileSystemState', counting down latch. Waiting for 0 more 2023-10-05 20:00:25,974 INFO [(jenkins-hbase4.apache.org,40857,1696535997381)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemState' execution completed 2023-10-05 20:00:25,974 DEBUG [(jenkins-hbase4.apache.org,40857,1696535997381)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-05 20:00:25,974 DEBUG [(jenkins-hbase4.apache.org,40857,1696535997381)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-05 20:00:25,974 DEBUG [(jenkins-hbase4.apache.org,40857,1696535997381)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemState 2023-10-05 20:00:25,974 INFO [(jenkins-hbase4.apache.org,40857,1696535997381)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-10-05 20:00:25,976 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): regionserver:44821-0x101182c1f970002, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-10-05 20:00:25,976 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): regionserver:32861-0x101182c1f970001, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-10-05 20:00:25,976 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-10-05 20:00:25,976 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-10-05 20:00:25,976 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-10-05 20:00:25,976 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): regionserver:32861-0x101182c1f970001, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-05 20:00:25,976 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): master:40857-0x101182c1f970000, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-10-05 20:00:25,976 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): regionserver:44821-0x101182c1f970002, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-05 20:00:25,977 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-10-05 20:00:25,977 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-05 20:00:25,977 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-05 20:00:25,976 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-10-05 20:00:25,977 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-05 20:00:25,976 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): regionserver:36369-0x101182c1f970003, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-10-05 20:00:25,977 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-05 20:00:25,977 DEBUG [(jenkins-hbase4.apache.org,40857,1696535997381)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40857-0x101182c1f970000, quorum=127.0.0.1:57530, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,32861,1696535998642 2023-10-05 20:00:25,977 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-10-05 20:00:25,977 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-10-05 20:00:25,977 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): regionserver:36369-0x101182c1f970003, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-05 20:00:25,977 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-10-05 20:00:25,977 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-05 20:00:25,977 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-05 20:00:25,978 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-05 20:00:25,978 DEBUG [(jenkins-hbase4.apache.org,40857,1696535997381)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40857-0x101182c1f970000, quorum=127.0.0.1:57530, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,36369,1696535998737 2023-10-05 20:00:25,978 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-05 20:00:25,978 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-05 20:00:25,978 DEBUG [(jenkins-hbase4.apache.org,40857,1696535997381)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40857-0x101182c1f970000, quorum=127.0.0.1:57530, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,44821,1696535998698 2023-10-05 20:00:25,978 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-10-05 20:00:25,978 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-10-05 20:00:25,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-10-05 20:00:25,980 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-05 20:00:25,980 DEBUG [(jenkins-hbase4.apache.org,40857,1696535997381)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40857-0x101182c1f970000, quorum=127.0.0.1:57530, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,32861,1696535998642 2023-10-05 20:00:25,980 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-10-05 20:00:25,980 DEBUG [(jenkins-hbase4.apache.org,40857,1696535997381)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40857-0x101182c1f970000, quorum=127.0.0.1:57530, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,36369,1696535998737 2023-10-05 20:00:25,980 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32861,1696535998642 2023-10-05 20:00:25,981 DEBUG [(jenkins-hbase4.apache.org,40857,1696535997381)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40857-0x101182c1f970000, quorum=127.0.0.1:57530, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,44821,1696535998698 2023-10-05 20:00:25,981 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36369,1696535998737 2023-10-05 20:00:25,981 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44821,1696535998698 2023-10-05 20:00:25,981 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-05 20:00:25,982 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-10-05 20:00:25,982 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32861,1696535998642 2023-10-05 20:00:25,982 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36369,1696535998737 2023-10-05 20:00:25,983 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44821,1696535998698 2023-10-05 20:00:25,984 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): master:40857-0x101182c1f970000, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,44821,1696535998698 2023-10-05 20:00:25,984 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): regionserver:44821-0x101182c1f970002, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-05 20:00:25,984 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-05 20:00:25,984 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): master:40857-0x101182c1f970000, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-10-05 20:00:25,984 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): regionserver:36369-0x101182c1f970003, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-05 20:00:25,984 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): regionserver:32861-0x101182c1f970001, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-05 20:00:25,985 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-05 20:00:25,985 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): regionserver:32861-0x101182c1f970001, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-05 20:00:25,985 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): regionserver:36369-0x101182c1f970003, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-05 20:00:25,984 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): master:40857-0x101182c1f970000, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,36369,1696535998737 2023-10-05 20:00:25,984 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-05 20:00:25,984 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): regionserver:44821-0x101182c1f970002, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-05 20:00:25,985 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): master:40857-0x101182c1f970000, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,32861,1696535998642 2023-10-05 20:00:25,985 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemState 2023-10-05 20:00:25,985 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-05 20:00:25,985 DEBUG [(jenkins-hbase4.apache.org,40857,1696535997381)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-05 20:00:25,985 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-05 20:00:25,987 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-05 20:00:25,985 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-05 20:00:25,985 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:40857-0x101182c1f970000, quorum=127.0.0.1:57530, baseZNode=/hbase Unable to get data of znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState because node does not exist (not an error) 2023-10-05 20:00:25,985 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemState 2023-10-05 20:00:25,987 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-05 20:00:25,987 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-05 20:00:25,985 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): master:40857-0x101182c1f970000, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-10-05 20:00:25,987 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 8c2558c0b59bb3a4e2e578c2c8e8915d, NAME => 'testtb-testExportFileSystemState,.mob,0.8c2558c0b59bb3a4e2e578c2c8e8915d.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testExportFileSystemState 2023-10-05 20:00:25,987 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-05 20:00:25,987 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-10-05 20:00:25,987 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-05 20:00:25,987 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): master:40857-0x101182c1f970000, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,44821,1696535998698 2023-10-05 20:00:25,988 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): master:40857-0x101182c1f970000, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-10-05 20:00:25,988 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): master:40857-0x101182c1f970000, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,36369,1696535998737 2023-10-05 20:00:25,988 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): master:40857-0x101182c1f970000, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,32861,1696535998642 2023-10-05 20:00:25,988 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): master:40857-0x101182c1f970000, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-10-05 20:00:25,988 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): master:40857-0x101182c1f970000, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-10-05 20:00:25,988 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-05 20:00:25,988 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b2023100540d7b148183b408f8a62ebfe79f6ccb4, hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e202310057b0fbbd3047b41529f29163286b90d69] mob files 2023-10-05 20:00:25,989 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b2023100540d7b148183b408f8a62ebfe79f6ccb4 2023-10-05 20:00:25,989 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e202310057b0fbbd3047b41529f29163286b90d69 2023-10-05 20:00:25,997 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemState 2023-10-05 20:00:25,998 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-10-05 20:00:26,021 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState to hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/.hbase-snapshot/snaptb0-testExportFileSystemState 2023-10-05 20:00:26,022 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed 2023-10-05 20:00:26,023 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-10-05 20:00:26,023 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-10-05 20:00:26,023 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState at 1696536025828Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemState at 1696536025997 (+169 ms)Consolidate snapshot: snaptb0-testExportFileSystemState at 1696536025997Loading Region manifests for snaptb0-testExportFileSystemState at 1696536025998 (+1 ms)Writing data manifest for snaptb0-testExportFileSystemState at 1696536026003 (+5 ms)Verifying snapshot: snaptb0-testExportFileSystemState at 1696536026011 (+8 ms)Snapshot snaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed at 1696536026022 (+11 ms) 2023-10-05 20:00:26,026 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=35, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-10-05 20:00:26,029 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=35, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED in 198 msec 2023-10-05 20:00:26,131 DEBUG [Listener at jenkins-hbase4.apache.org/35067] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-05 20:00:26,132 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40857] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-10-05 20:00:26,132 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40857] snapshot.SnapshotManager(403): Snapshot '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-10-05 20:00:26,133 INFO [Listener at jenkins-hbase4.apache.org/35067] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/export-test/export-1696536026133 2023-10-05 20:00:26,133 INFO [Listener at jenkins-hbase4.apache.org/35067] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:45929, tgtDir=hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/export-test/export-1696536026133, rawTgtDir=hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/export-test/export-1696536026133, srcFsUri=hdfs://localhost:45929, srcDir=hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2 2023-10-05 20:00:26,157 DEBUG [Listener at jenkins-hbase4.apache.org/35067] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:45929, inputRoot=hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2 2023-10-05 20:00:26,157 DEBUG [Listener at jenkins-hbase4.apache.org/35067] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_2042783811_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/export-test/export-1696536026133, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/export-test/export-1696536026133/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-10-05 20:00:26,157 INFO [Listener at jenkins-hbase4.apache.org/35067] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:45929, inputRoot=hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2, snapshotDir=hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/.hbase-snapshot/snaptb0-testExportFileSystemState. 2023-10-05 20:00:26,172 INFO [Listener at jenkins-hbase4.apache.org/35067] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/.hbase-snapshot/snaptb0-testExportFileSystemState to hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/export-test/export-1696536026133/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-10-05 20:00:26,205 DEBUG [Listener at jenkins-hbase4.apache.org/35067] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-10-05 20:00:26,205 DEBUG [Listener at jenkins-hbase4.apache.org/35067] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-10-05 20:00:26,206 DEBUG [Listener at jenkins-hbase4.apache.org/35067] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-10-05 20:00:26,206 DEBUG [Listener at jenkins-hbase4.apache.org/35067] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-10-05 20:00:27,120 DEBUG [Listener at jenkins-hbase4.apache.org/35067] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/190200ca-70b6-4852-ff08-4943c98578e6/hadoop-317537286397967573.jar 2023-10-05 20:00:27,121 DEBUG [Listener at jenkins-hbase4.apache.org/35067] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-10-05 20:00:27,121 DEBUG [Listener at jenkins-hbase4.apache.org/35067] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-10-05 20:00:27,194 DEBUG [Listener at jenkins-hbase4.apache.org/35067] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/190200ca-70b6-4852-ff08-4943c98578e6/hadoop-2068360870089056427.jar 2023-10-05 20:00:27,195 DEBUG [Listener at jenkins-hbase4.apache.org/35067] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-10-05 20:00:27,195 DEBUG [Listener at jenkins-hbase4.apache.org/35067] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-10-05 20:00:27,195 DEBUG [Listener at jenkins-hbase4.apache.org/35067] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-10-05 20:00:27,196 DEBUG [Listener at jenkins-hbase4.apache.org/35067] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-10-05 20:00:27,196 DEBUG [Listener at jenkins-hbase4.apache.org/35067] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-10-05 20:00:27,196 DEBUG [Listener at jenkins-hbase4.apache.org/35067] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-10-05 20:00:27,197 DEBUG [Listener at jenkins-hbase4.apache.org/35067] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-10-05 20:00:27,197 DEBUG [Listener at jenkins-hbase4.apache.org/35067] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-10-05 20:00:27,198 DEBUG [Listener at jenkins-hbase4.apache.org/35067] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-10-05 20:00:27,198 DEBUG [Listener at jenkins-hbase4.apache.org/35067] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-10-05 20:00:27,198 DEBUG [Listener at jenkins-hbase4.apache.org/35067] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-10-05 20:00:27,199 DEBUG [Listener at jenkins-hbase4.apache.org/35067] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-10-05 20:00:27,199 DEBUG [Listener at jenkins-hbase4.apache.org/35067] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-10-05 20:00:27,200 DEBUG [Listener at jenkins-hbase4.apache.org/35067] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-10-05 20:00:27,200 DEBUG [Listener at jenkins-hbase4.apache.org/35067] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-10-05 20:00:27,201 DEBUG [Listener at jenkins-hbase4.apache.org/35067] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-10-05 20:00:27,202 DEBUG [Listener at jenkins-hbase4.apache.org/35067] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-05 20:00:27,202 DEBUG [Listener at jenkins-hbase4.apache.org/35067] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-05 20:00:27,203 DEBUG [Listener at jenkins-hbase4.apache.org/35067] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-10-05 20:00:27,203 DEBUG [Listener at jenkins-hbase4.apache.org/35067] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-05 20:00:27,204 DEBUG [Listener at jenkins-hbase4.apache.org/35067] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-05 20:00:27,204 DEBUG [Listener at jenkins-hbase4.apache.org/35067] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-10-05 20:00:27,205 DEBUG [Listener at jenkins-hbase4.apache.org/35067] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-10-05 20:00:27,677 WARN [Listener at jenkins-hbase4.apache.org/35067] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-10-05 20:00:27,680 INFO [Listener at jenkins-hbase4.apache.org/35067] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportFileSystemState' hfile list 2023-10-05 20:00:27,682 DEBUG [Listener at jenkins-hbase4.apache.org/35067] snapshot.ExportSnapshot(671): export split=0 size=30.9 K 2023-10-05 20:00:29,211 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-10-05 20:00:29,211 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-10-05 20:00:29,219 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696536006875_0001_000001 (auth:SIMPLE) 2023-10-05 20:00:29,973 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696536006875_0002_000001 (auth:SIMPLE) 2023-10-05 20:00:30,067 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-10-05 20:00:33,912 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696536006875_0002_000001 (auth:SIMPLE) 2023-10-05 20:00:36,125 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696536006875_0002_000001 (auth:SIMPLE) 2023-10-05 20:00:38,624 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696536006875_0002_000001 (auth:SIMPLE) 2023-10-05 20:00:39,870 INFO [Listener at jenkins-hbase4.apache.org/35067] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-10-05 20:00:39,871 INFO [Listener at jenkins-hbase4.apache.org/35067] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-10-05 20:00:39,879 INFO [Listener at jenkins-hbase4.apache.org/35067] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testExportFileSystemState 2023-10-05 20:00:39,880 INFO [Listener at jenkins-hbase4.apache.org/35067] snapshot.TestExportSnapshot(279): Exported snapshot 2023-10-05 20:00:39,880 INFO [Listener at jenkins-hbase4.apache.org/35067] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-10-05 20:00:39,880 DEBUG [Listener at jenkins-hbase4.apache.org/35067] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-2070727397_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/.hbase-snapshot/snaptb0-testExportFileSystemState at hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/.hbase-snapshot/snaptb0-testExportFileSystemState 2023-10-05 20:00:39,881 DEBUG [Listener at jenkins-hbase4.apache.org/35067] snapshot.TestExportSnapshot(367): hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/.hbase-snapshot/snaptb0-testExportFileSystemState/.snapshotinfo 2023-10-05 20:00:39,881 DEBUG [Listener at jenkins-hbase4.apache.org/35067] snapshot.TestExportSnapshot(367): hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/.hbase-snapshot/snaptb0-testExportFileSystemState/data.manifest 2023-10-05 20:00:39,881 DEBUG [Listener at jenkins-hbase4.apache.org/35067] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-2070727397_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/export-test/export-1696536026133/.hbase-snapshot/snaptb0-testExportFileSystemState at hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/export-test/export-1696536026133/.hbase-snapshot/snaptb0-testExportFileSystemState 2023-10-05 20:00:39,882 DEBUG [Listener at jenkins-hbase4.apache.org/35067] snapshot.TestExportSnapshot(367): hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/export-test/export-1696536026133/.hbase-snapshot/snaptb0-testExportFileSystemState/.snapshotinfo 2023-10-05 20:00:39,882 DEBUG [Listener at jenkins-hbase4.apache.org/35067] snapshot.TestExportSnapshot(367): hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/export-test/export-1696536026133/.hbase-snapshot/snaptb0-testExportFileSystemState/data.manifest 2023-10-05 20:00:39,890 INFO [Listener at jenkins-hbase4.apache.org/35067] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemState 2023-10-05 20:00:39,891 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40857] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemState 2023-10-05 20:00:39,892 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40857] procedure2.ProcedureExecutor(1028): Stored pid=36, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemState 2023-10-05 20:00:39,895 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40857] master.MasterRpcServices(1230): Checking to see if procedure is done pid=36 2023-10-05 20:00:39,896 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696536039896"}]},"ts":"1696536039896"} 2023-10-05 20:00:39,897 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=DISABLING in hbase:meta 2023-10-05 20:00:39,899 INFO [PEWorker-2] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemState to state=DISABLING 2023-10-05 20:00:39,900 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=37, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=cfae8165c705c25ee6fc04a7bf3b51de, UNASSIGN}, {pid=38, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=4f68bf1d8d8715f529d452a612f9a34f, UNASSIGN}] 2023-10-05 20:00:39,902 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=37, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=cfae8165c705c25ee6fc04a7bf3b51de, UNASSIGN 2023-10-05 20:00:39,902 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=38, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=4f68bf1d8d8715f529d452a612f9a34f, UNASSIGN 2023-10-05 20:00:39,903 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=37 updating hbase:meta row=cfae8165c705c25ee6fc04a7bf3b51de, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,32861,1696535998642 2023-10-05 20:00:39,903 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=38 updating hbase:meta row=4f68bf1d8d8715f529d452a612f9a34f, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,36369,1696535998737 2023-10-05 20:00:39,903 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,,1696536024778.cfae8165c705c25ee6fc04a7bf3b51de.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1696536039903"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696536039903"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696536039903"}]},"ts":"1696536039903"} 2023-10-05 20:00:39,903 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,1,1696536024778.4f68bf1d8d8715f529d452a612f9a34f.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1696536039903"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696536039903"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696536039903"}]},"ts":"1696536039903"} 2023-10-05 20:00:39,904 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=39, ppid=37, state=RUNNABLE; CloseRegionProcedure cfae8165c705c25ee6fc04a7bf3b51de, server=jenkins-hbase4.apache.org,32861,1696535998642}] 2023-10-05 20:00:39,905 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=40, ppid=38, state=RUNNABLE; CloseRegionProcedure 4f68bf1d8d8715f529d452a612f9a34f, server=jenkins-hbase4.apache.org,36369,1696535998737}] 2023-10-05 20:00:39,997 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40857] master.MasterRpcServices(1230): Checking to see if procedure is done pid=36 2023-10-05 20:00:40,057 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close cfae8165c705c25ee6fc04a7bf3b51de 2023-10-05 20:00:40,057 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing cfae8165c705c25ee6fc04a7bf3b51de, disabling compactions & flushes 2023-10-05 20:00:40,057 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,,1696536024778.cfae8165c705c25ee6fc04a7bf3b51de. 2023-10-05 20:00:40,057 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,,1696536024778.cfae8165c705c25ee6fc04a7bf3b51de. 2023-10-05 20:00:40,057 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,,1696536024778.cfae8165c705c25ee6fc04a7bf3b51de. after waiting 0 ms 2023-10-05 20:00:40,057 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,,1696536024778.cfae8165c705c25ee6fc04a7bf3b51de. 2023-10-05 20:00:40,058 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 4f68bf1d8d8715f529d452a612f9a34f 2023-10-05 20:00:40,061 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 4f68bf1d8d8715f529d452a612f9a34f, disabling compactions & flushes 2023-10-05 20:00:40,061 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,1,1696536024778.4f68bf1d8d8715f529d452a612f9a34f. 2023-10-05 20:00:40,061 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,1,1696536024778.4f68bf1d8d8715f529d452a612f9a34f. 2023-10-05 20:00:40,061 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,1,1696536024778.4f68bf1d8d8715f529d452a612f9a34f. after waiting 0 ms 2023-10-05 20:00:40,061 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,1,1696536024778.4f68bf1d8d8715f529d452a612f9a34f. 2023-10-05 20:00:40,067 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/data/default/testtb-testExportFileSystemState/cfae8165c705c25ee6fc04a7bf3b51de/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-10-05 20:00:40,067 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/data/default/testtb-testExportFileSystemState/4f68bf1d8d8715f529d452a612f9a34f/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-10-05 20:00:40,068 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-10-05 20:00:40,068 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-10-05 20:00:40,069 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,,1696536024778.cfae8165c705c25ee6fc04a7bf3b51de. 2023-10-05 20:00:40,069 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for cfae8165c705c25ee6fc04a7bf3b51de: 2023-10-05 20:00:40,069 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,1,1696536024778.4f68bf1d8d8715f529d452a612f9a34f. 2023-10-05 20:00:40,069 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 4f68bf1d8d8715f529d452a612f9a34f: 2023-10-05 20:00:40,071 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed cfae8165c705c25ee6fc04a7bf3b51de 2023-10-05 20:00:40,072 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=37 updating hbase:meta row=cfae8165c705c25ee6fc04a7bf3b51de, regionState=CLOSED 2023-10-05 20:00:40,072 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,,1696536024778.cfae8165c705c25ee6fc04a7bf3b51de.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1696536040072"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696536040072"}]},"ts":"1696536040072"} 2023-10-05 20:00:40,072 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 4f68bf1d8d8715f529d452a612f9a34f 2023-10-05 20:00:40,072 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=38 updating hbase:meta row=4f68bf1d8d8715f529d452a612f9a34f, regionState=CLOSED 2023-10-05 20:00:40,073 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,1,1696536024778.4f68bf1d8d8715f529d452a612f9a34f.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1696536040072"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696536040072"}]},"ts":"1696536040072"} 2023-10-05 20:00:40,077 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=39, resume processing ppid=37 2023-10-05 20:00:40,078 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=39, ppid=37, state=SUCCESS; CloseRegionProcedure cfae8165c705c25ee6fc04a7bf3b51de, server=jenkins-hbase4.apache.org,32861,1696535998642 in 169 msec 2023-10-05 20:00:40,078 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=40, resume processing ppid=38 2023-10-05 20:00:40,078 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=40, ppid=38, state=SUCCESS; CloseRegionProcedure 4f68bf1d8d8715f529d452a612f9a34f, server=jenkins-hbase4.apache.org,36369,1696535998737 in 169 msec 2023-10-05 20:00:40,079 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=37, ppid=36, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=cfae8165c705c25ee6fc04a7bf3b51de, UNASSIGN in 178 msec 2023-10-05 20:00:40,080 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=38, resume processing ppid=36 2023-10-05 20:00:40,080 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=38, ppid=36, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=4f68bf1d8d8715f529d452a612f9a34f, UNASSIGN in 178 msec 2023-10-05 20:00:40,081 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696536040081"}]},"ts":"1696536040081"} 2023-10-05 20:00:40,082 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=DISABLED in hbase:meta 2023-10-05 20:00:40,084 INFO [PEWorker-3] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemState to state=DISABLED 2023-10-05 20:00:40,086 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=36, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemState in 193 msec 2023-10-05 20:00:40,198 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40857] master.MasterRpcServices(1230): Checking to see if procedure is done pid=36 2023-10-05 20:00:40,198 INFO [Listener at jenkins-hbase4.apache.org/35067] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemState, procId: 36 completed 2023-10-05 20:00:40,199 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40857] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemState 2023-10-05 20:00:40,200 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40857] procedure2.ProcedureExecutor(1028): Stored pid=41, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-10-05 20:00:40,203 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=41, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-10-05 20:00:40,203 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40857] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemState 2023-10-05 20:00:40,204 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=41, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-10-05 20:00:40,205 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=32861] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemState 2023-10-05 20:00:40,209 DEBUG [HFileArchiver-9] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/.tmp/data/default/testtb-testExportFileSystemState/cfae8165c705c25ee6fc04a7bf3b51de 2023-10-05 20:00:40,209 DEBUG [HFileArchiver-10] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/.tmp/data/default/testtb-testExportFileSystemState/4f68bf1d8d8715f529d452a612f9a34f 2023-10-05 20:00:40,211 DEBUG [HFileArchiver-9] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/.tmp/data/default/testtb-testExportFileSystemState/cfae8165c705c25ee6fc04a7bf3b51de/cf, FileablePath, hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/.tmp/data/default/testtb-testExportFileSystemState/cfae8165c705c25ee6fc04a7bf3b51de/recovered.edits] 2023-10-05 20:00:40,212 DEBUG [HFileArchiver-10] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/.tmp/data/default/testtb-testExportFileSystemState/4f68bf1d8d8715f529d452a612f9a34f/cf, FileablePath, hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/.tmp/data/default/testtb-testExportFileSystemState/4f68bf1d8d8715f529d452a612f9a34f/recovered.edits] 2023-10-05 20:00:40,212 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): regionserver:44821-0x101182c1f970002, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-10-05 20:00:40,212 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): regionserver:36369-0x101182c1f970003, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-10-05 20:00:40,212 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): master:40857-0x101182c1f970000, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-10-05 20:00:40,212 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): regionserver:32861-0x101182c1f970001, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-10-05 20:00:40,213 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-10-05 20:00:40,213 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-10-05 20:00:40,213 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-10-05 20:00:40,214 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): regionserver:36369-0x101182c1f970003, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-10-05 20:00:40,214 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): regionserver:36369-0x101182c1f970003, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-05 20:00:40,214 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): master:40857-0x101182c1f970000, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-10-05 20:00:40,214 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): master:40857-0x101182c1f970000, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-05 20:00:40,215 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): regionserver:32861-0x101182c1f970001, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-05 20:00:40,215 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data null 2023-10-05 20:00:40,215 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-10-05 20:00:40,215 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): regionserver:44821-0x101182c1f970002, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-10-05 20:00:40,215 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): regionserver:44821-0x101182c1f970002, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-05 20:00:40,216 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40857] master.MasterRpcServices(1230): Checking to see if procedure is done pid=41 2023-10-05 20:00:40,218 DEBUG [HFileArchiver-10] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/.tmp/data/default/testtb-testExportFileSystemState/4f68bf1d8d8715f529d452a612f9a34f/cf/fe23b4b417e4426d85bcaec62944a42d to hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/archive/data/default/testtb-testExportFileSystemState/4f68bf1d8d8715f529d452a612f9a34f/cf/fe23b4b417e4426d85bcaec62944a42d 2023-10-05 20:00:40,219 DEBUG [HFileArchiver-9] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/.tmp/data/default/testtb-testExportFileSystemState/cfae8165c705c25ee6fc04a7bf3b51de/cf/366319bc24404468a1aaf1cb8531a141 to hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/archive/data/default/testtb-testExportFileSystemState/cfae8165c705c25ee6fc04a7bf3b51de/cf/366319bc24404468a1aaf1cb8531a141 2023-10-05 20:00:40,222 DEBUG [HFileArchiver-10] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/.tmp/data/default/testtb-testExportFileSystemState/4f68bf1d8d8715f529d452a612f9a34f/recovered.edits/9.seqid to hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/archive/data/default/testtb-testExportFileSystemState/4f68bf1d8d8715f529d452a612f9a34f/recovered.edits/9.seqid 2023-10-05 20:00:40,223 DEBUG [HFileArchiver-10] backup.HFileArchiver(596): Deleted hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/.tmp/data/default/testtb-testExportFileSystemState/4f68bf1d8d8715f529d452a612f9a34f 2023-10-05 20:00:40,223 DEBUG [HFileArchiver-9] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/.tmp/data/default/testtb-testExportFileSystemState/cfae8165c705c25ee6fc04a7bf3b51de/recovered.edits/9.seqid to hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/archive/data/default/testtb-testExportFileSystemState/cfae8165c705c25ee6fc04a7bf3b51de/recovered.edits/9.seqid 2023-10-05 20:00:40,224 DEBUG [HFileArchiver-9] backup.HFileArchiver(596): Deleted hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/.tmp/data/default/testtb-testExportFileSystemState/cfae8165c705c25ee6fc04a7bf3b51de 2023-10-05 20:00:40,224 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemState regions 2023-10-05 20:00:40,225 DEBUG [PEWorker-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d 2023-10-05 20:00:40,225 DEBUG [PEWorker-1] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf] 2023-10-05 20:00:40,229 DEBUG [PEWorker-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b2023100540d7b148183b408f8a62ebfe79f6ccb4 to hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/archive/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b2023100540d7b148183b408f8a62ebfe79f6ccb4 2023-10-05 20:00:40,231 DEBUG [PEWorker-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e202310057b0fbbd3047b41529f29163286b90d69 to hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/archive/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e202310057b0fbbd3047b41529f29163286b90d69 2023-10-05 20:00:40,232 DEBUG [PEWorker-1] backup.HFileArchiver(596): Deleted hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d 2023-10-05 20:00:40,234 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=41, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-10-05 20:00:40,237 WARN [PEWorker-1] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportFileSystemState from hbase:meta 2023-10-05 20:00:40,239 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemState' descriptor. 2023-10-05 20:00:40,241 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=41, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-10-05 20:00:40,241 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemState' from region states. 2023-10-05 20:00:40,241 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemState,,1696536024778.cfae8165c705c25ee6fc04a7bf3b51de.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1696536040241"}]},"ts":"9223372036854775807"} 2023-10-05 20:00:40,241 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemState,1,1696536024778.4f68bf1d8d8715f529d452a612f9a34f.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1696536040241"}]},"ts":"9223372036854775807"} 2023-10-05 20:00:40,243 INFO [PEWorker-1] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-10-05 20:00:40,243 DEBUG [PEWorker-1] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => cfae8165c705c25ee6fc04a7bf3b51de, NAME => 'testtb-testExportFileSystemState,,1696536024778.cfae8165c705c25ee6fc04a7bf3b51de.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 4f68bf1d8d8715f529d452a612f9a34f, NAME => 'testtb-testExportFileSystemState,1,1696536024778.4f68bf1d8d8715f529d452a612f9a34f.', STARTKEY => '1', ENDKEY => ''}] 2023-10-05 20:00:40,243 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemState' as deleted. 2023-10-05 20:00:40,243 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1696536040243"}]},"ts":"9223372036854775807"} 2023-10-05 20:00:40,245 INFO [PEWorker-1] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemState state from META 2023-10-05 20:00:40,247 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(130): Finished pid=41, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-10-05 20:00:40,253 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=41, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemState in 48 msec 2023-10-05 20:00:40,317 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40857] master.MasterRpcServices(1230): Checking to see if procedure is done pid=41 2023-10-05 20:00:40,318 INFO [Listener at jenkins-hbase4.apache.org/35067] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemState, procId: 41 completed 2023-10-05 20:00:40,326 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40857] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportFileSystemState" 2023-10-05 20:00:40,328 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40857] snapshot.SnapshotManager(335): Deleting snapshot: emptySnaptb0-testExportFileSystemState 2023-10-05 20:00:40,329 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40857] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemState" 2023-10-05 20:00:40,331 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40857] snapshot.SnapshotManager(335): Deleting snapshot: snaptb0-testExportFileSystemState 2023-10-05 20:00:40,358 INFO [Listener at jenkins-hbase4.apache.org/35067] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testExportFileSystemState Thread=766 (was 755) Potentially hanging thread: Thread-2080 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: HFileArchiver-8 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x13ec5c25-shared-pool-15 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-9 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1755305456_1 at /127.0.0.1:60590 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1755305456_1 at /127.0.0.1:56174 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-10 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-2070727397_17 at /127.0.0.1:60612 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x13ec5c25-shared-pool-16 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-4 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LogDeleter #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ContainersLauncher #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-2070727397_17 at /127.0.0.1:39756 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x13ec5c25-shared-pool-18 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (638145229) connection to jenkins-hbase4.apache.org/172.31.14.131:36387 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: hconnection-0x13ec5c25-shared-pool-17 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-7 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LogDeleter #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-2070727397_17 at /127.0.0.1:56196 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=932 (was 933), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=273 (was 245) - SystemLoadAverage LEAK? -, ProcessCount=168 (was 168), AvailableMemoryMB=6089 (was 6170) 2023-10-05 20:00:40,358 WARN [Listener at jenkins-hbase4.apache.org/35067] hbase.ResourceChecker(130): Thread=766 is superior to 500 2023-10-05 20:00:40,377 INFO [Listener at jenkins-hbase4.apache.org/35067] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testConsecutiveExports Thread=766, OpenFileDescriptor=932, MaxFileDescriptor=60000, SystemLoadAverage=273, ProcessCount=168, AvailableMemoryMB=6089 2023-10-05 20:00:40,378 WARN [Listener at jenkins-hbase4.apache.org/35067] hbase.ResourceChecker(130): Thread=766 is superior to 500 2023-10-05 20:00:40,379 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40857] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testConsecutiveExports', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-10-05 20:00:40,381 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40857] procedure2.ProcedureExecutor(1028): Stored pid=42, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testConsecutiveExports 2023-10-05 20:00:40,383 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_PRE_OPERATION 2023-10-05 20:00:40,383 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40857] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testConsecutiveExports" procId is: 42 2023-10-05 20:00:40,384 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-10-05 20:00:40,384 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40857] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-10-05 20:00:40,387 DEBUG [HFileArchiver-11] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/.tmp/data/default/testtb-testConsecutiveExports/7dea6e77f4b5fc4af09b824e7b08d75b 2023-10-05 20:00:40,387 DEBUG [HFileArchiver-12] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/.tmp/data/default/testtb-testConsecutiveExports/b51e0a70eafb119fb7846b617d12594a 2023-10-05 20:00:40,388 DEBUG [HFileArchiver-11] backup.HFileArchiver(153): Directory hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/.tmp/data/default/testtb-testConsecutiveExports/7dea6e77f4b5fc4af09b824e7b08d75b empty. 2023-10-05 20:00:40,388 DEBUG [HFileArchiver-12] backup.HFileArchiver(153): Directory hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/.tmp/data/default/testtb-testConsecutiveExports/b51e0a70eafb119fb7846b617d12594a empty. 2023-10-05 20:00:40,388 DEBUG [HFileArchiver-11] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/.tmp/data/default/testtb-testConsecutiveExports/7dea6e77f4b5fc4af09b824e7b08d75b 2023-10-05 20:00:40,388 DEBUG [HFileArchiver-12] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/.tmp/data/default/testtb-testConsecutiveExports/b51e0a70eafb119fb7846b617d12594a 2023-10-05 20:00:40,388 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testtb-testConsecutiveExports regions 2023-10-05 20:00:40,400 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/.tmp/data/default/testtb-testConsecutiveExports/.tabledesc/.tableinfo.0000000001 2023-10-05 20:00:40,401 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(7675): creating {ENCODED => 7dea6e77f4b5fc4af09b824e7b08d75b, NAME => 'testtb-testConsecutiveExports,,1696536040379.7dea6e77f4b5fc4af09b824e7b08d75b.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testConsecutiveExports', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/.tmp 2023-10-05 20:00:40,401 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(7675): creating {ENCODED => b51e0a70eafb119fb7846b617d12594a, NAME => 'testtb-testConsecutiveExports,1,1696536040379.b51e0a70eafb119fb7846b617d12594a.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testConsecutiveExports', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/.tmp 2023-10-05 20:00:40,417 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,1,1696536040379.b51e0a70eafb119fb7846b617d12594a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-05 20:00:40,417 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1604): Closing b51e0a70eafb119fb7846b617d12594a, disabling compactions & flushes 2023-10-05 20:00:40,417 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,1,1696536040379.b51e0a70eafb119fb7846b617d12594a. 2023-10-05 20:00:40,417 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,1,1696536040379.b51e0a70eafb119fb7846b617d12594a. 2023-10-05 20:00:40,417 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,1,1696536040379.b51e0a70eafb119fb7846b617d12594a. after waiting 0 ms 2023-10-05 20:00:40,417 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,1,1696536040379.b51e0a70eafb119fb7846b617d12594a. 2023-10-05 20:00:40,417 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,1,1696536040379.b51e0a70eafb119fb7846b617d12594a. 2023-10-05 20:00:40,417 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1558): Region close journal for b51e0a70eafb119fb7846b617d12594a: 2023-10-05 20:00:40,417 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,,1696536040379.7dea6e77f4b5fc4af09b824e7b08d75b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-05 20:00:40,417 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1604): Closing 7dea6e77f4b5fc4af09b824e7b08d75b, disabling compactions & flushes 2023-10-05 20:00:40,417 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,,1696536040379.7dea6e77f4b5fc4af09b824e7b08d75b. 2023-10-05 20:00:40,417 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,,1696536040379.7dea6e77f4b5fc4af09b824e7b08d75b. 2023-10-05 20:00:40,417 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,,1696536040379.7dea6e77f4b5fc4af09b824e7b08d75b. after waiting 0 ms 2023-10-05 20:00:40,417 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,,1696536040379.7dea6e77f4b5fc4af09b824e7b08d75b. 2023-10-05 20:00:40,418 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,,1696536040379.7dea6e77f4b5fc4af09b824e7b08d75b. 2023-10-05 20:00:40,418 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1558): Region close journal for 7dea6e77f4b5fc4af09b824e7b08d75b: 2023-10-05 20:00:40,420 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_ADD_TO_META 2023-10-05 20:00:40,421 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,1,1696536040379.b51e0a70eafb119fb7846b617d12594a.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1696536040421"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696536040421"}]},"ts":"1696536040421"} 2023-10-05 20:00:40,421 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,,1696536040379.7dea6e77f4b5fc4af09b824e7b08d75b.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1696536040421"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696536040421"}]},"ts":"1696536040421"} 2023-10-05 20:00:40,423 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-10-05 20:00:40,424 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-10-05 20:00:40,425 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696536040424"}]},"ts":"1696536040424"} 2023-10-05 20:00:40,426 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=ENABLING in hbase:meta 2023-10-05 20:00:40,430 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-10-05 20:00:40,431 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-10-05 20:00:40,431 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-10-05 20:00:40,431 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-10-05 20:00:40,431 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-10-05 20:00:40,431 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=43, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=7dea6e77f4b5fc4af09b824e7b08d75b, ASSIGN}, {pid=44, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=b51e0a70eafb119fb7846b617d12594a, ASSIGN}] 2023-10-05 20:00:40,434 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=44, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=b51e0a70eafb119fb7846b617d12594a, ASSIGN 2023-10-05 20:00:40,434 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=43, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=7dea6e77f4b5fc4af09b824e7b08d75b, ASSIGN 2023-10-05 20:00:40,435 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=44, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=b51e0a70eafb119fb7846b617d12594a, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,36369,1696535998737; forceNewPlan=false, retain=false 2023-10-05 20:00:40,435 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=43, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=7dea6e77f4b5fc4af09b824e7b08d75b, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,44821,1696535998698; forceNewPlan=false, retain=false 2023-10-05 20:00:40,485 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40857] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-10-05 20:00:40,585 INFO [jenkins-hbase4:40857] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-10-05 20:00:40,588 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=44 updating hbase:meta row=b51e0a70eafb119fb7846b617d12594a, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,36369,1696535998737 2023-10-05 20:00:40,588 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=43 updating hbase:meta row=7dea6e77f4b5fc4af09b824e7b08d75b, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,44821,1696535998698 2023-10-05 20:00:40,588 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,1,1696536040379.b51e0a70eafb119fb7846b617d12594a.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1696536040588"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696536040588"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696536040588"}]},"ts":"1696536040588"} 2023-10-05 20:00:40,588 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,,1696536040379.7dea6e77f4b5fc4af09b824e7b08d75b.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1696536040588"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696536040588"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696536040588"}]},"ts":"1696536040588"} 2023-10-05 20:00:40,590 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=45, ppid=44, state=RUNNABLE; OpenRegionProcedure b51e0a70eafb119fb7846b617d12594a, server=jenkins-hbase4.apache.org,36369,1696535998737}] 2023-10-05 20:00:40,591 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=46, ppid=43, state=RUNNABLE; OpenRegionProcedure 7dea6e77f4b5fc4af09b824e7b08d75b, server=jenkins-hbase4.apache.org,44821,1696535998698}] 2023-10-05 20:00:40,686 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40857] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-10-05 20:00:40,748 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testConsecutiveExports,1,1696536040379.b51e0a70eafb119fb7846b617d12594a. 2023-10-05 20:00:40,748 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => b51e0a70eafb119fb7846b617d12594a, NAME => 'testtb-testConsecutiveExports,1,1696536040379.b51e0a70eafb119fb7846b617d12594a.', STARTKEY => '1', ENDKEY => ''} 2023-10-05 20:00:40,748 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testConsecutiveExports,1,1696536040379.b51e0a70eafb119fb7846b617d12594a. service=AccessControlService 2023-10-05 20:00:40,748 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testConsecutiveExports,,1696536040379.7dea6e77f4b5fc4af09b824e7b08d75b. 2023-10-05 20:00:40,748 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-10-05 20:00:40,748 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 7dea6e77f4b5fc4af09b824e7b08d75b, NAME => 'testtb-testConsecutiveExports,,1696536040379.7dea6e77f4b5fc4af09b824e7b08d75b.', STARTKEY => '', ENDKEY => '1'} 2023-10-05 20:00:40,748 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testConsecutiveExports b51e0a70eafb119fb7846b617d12594a 2023-10-05 20:00:40,749 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,1,1696536040379.b51e0a70eafb119fb7846b617d12594a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-05 20:00:40,749 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testConsecutiveExports,,1696536040379.7dea6e77f4b5fc4af09b824e7b08d75b. service=AccessControlService 2023-10-05 20:00:40,749 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for b51e0a70eafb119fb7846b617d12594a 2023-10-05 20:00:40,749 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for b51e0a70eafb119fb7846b617d12594a 2023-10-05 20:00:40,749 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-10-05 20:00:40,749 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testConsecutiveExports 7dea6e77f4b5fc4af09b824e7b08d75b 2023-10-05 20:00:40,749 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,,1696536040379.7dea6e77f4b5fc4af09b824e7b08d75b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-05 20:00:40,749 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 7dea6e77f4b5fc4af09b824e7b08d75b 2023-10-05 20:00:40,749 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 7dea6e77f4b5fc4af09b824e7b08d75b 2023-10-05 20:00:40,750 INFO [StoreOpener-b51e0a70eafb119fb7846b617d12594a-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region b51e0a70eafb119fb7846b617d12594a 2023-10-05 20:00:40,750 INFO [StoreOpener-7dea6e77f4b5fc4af09b824e7b08d75b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 7dea6e77f4b5fc4af09b824e7b08d75b 2023-10-05 20:00:40,751 DEBUG [StoreOpener-b51e0a70eafb119fb7846b617d12594a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/data/default/testtb-testConsecutiveExports/b51e0a70eafb119fb7846b617d12594a/cf 2023-10-05 20:00:40,751 DEBUG [StoreOpener-b51e0a70eafb119fb7846b617d12594a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/data/default/testtb-testConsecutiveExports/b51e0a70eafb119fb7846b617d12594a/cf 2023-10-05 20:00:40,751 DEBUG [StoreOpener-7dea6e77f4b5fc4af09b824e7b08d75b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/data/default/testtb-testConsecutiveExports/7dea6e77f4b5fc4af09b824e7b08d75b/cf 2023-10-05 20:00:40,752 DEBUG [StoreOpener-7dea6e77f4b5fc4af09b824e7b08d75b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/data/default/testtb-testConsecutiveExports/7dea6e77f4b5fc4af09b824e7b08d75b/cf 2023-10-05 20:00:40,752 INFO [StoreOpener-b51e0a70eafb119fb7846b617d12594a-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region b51e0a70eafb119fb7846b617d12594a columnFamilyName cf 2023-10-05 20:00:40,752 INFO [StoreOpener-7dea6e77f4b5fc4af09b824e7b08d75b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 7dea6e77f4b5fc4af09b824e7b08d75b columnFamilyName cf 2023-10-05 20:00:40,753 INFO [StoreOpener-b51e0a70eafb119fb7846b617d12594a-1] regionserver.HStore(310): Store=b51e0a70eafb119fb7846b617d12594a/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-05 20:00:40,753 INFO [StoreOpener-7dea6e77f4b5fc4af09b824e7b08d75b-1] regionserver.HStore(310): Store=7dea6e77f4b5fc4af09b824e7b08d75b/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-05 20:00:40,754 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/data/default/testtb-testConsecutiveExports/b51e0a70eafb119fb7846b617d12594a 2023-10-05 20:00:40,754 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/data/default/testtb-testConsecutiveExports/7dea6e77f4b5fc4af09b824e7b08d75b 2023-10-05 20:00:40,755 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/data/default/testtb-testConsecutiveExports/b51e0a70eafb119fb7846b617d12594a 2023-10-05 20:00:40,755 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/data/default/testtb-testConsecutiveExports/7dea6e77f4b5fc4af09b824e7b08d75b 2023-10-05 20:00:40,757 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for b51e0a70eafb119fb7846b617d12594a 2023-10-05 20:00:40,758 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 7dea6e77f4b5fc4af09b824e7b08d75b 2023-10-05 20:00:40,759 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/data/default/testtb-testConsecutiveExports/b51e0a70eafb119fb7846b617d12594a/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-05 20:00:40,759 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened b51e0a70eafb119fb7846b617d12594a; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59829439, jitterRate=-0.10847188532352448}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-10-05 20:00:40,759 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/data/default/testtb-testConsecutiveExports/7dea6e77f4b5fc4af09b824e7b08d75b/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-05 20:00:40,759 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for b51e0a70eafb119fb7846b617d12594a: 2023-10-05 20:00:40,760 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 7dea6e77f4b5fc4af09b824e7b08d75b; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73413555, jitterRate=0.09394721686840057}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-10-05 20:00:40,760 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 7dea6e77f4b5fc4af09b824e7b08d75b: 2023-10-05 20:00:40,761 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testConsecutiveExports,1,1696536040379.b51e0a70eafb119fb7846b617d12594a., pid=45, masterSystemTime=1696536040742 2023-10-05 20:00:40,761 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testConsecutiveExports,,1696536040379.7dea6e77f4b5fc4af09b824e7b08d75b., pid=46, masterSystemTime=1696536040742 2023-10-05 20:00:40,762 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testConsecutiveExports,1,1696536040379.b51e0a70eafb119fb7846b617d12594a. 2023-10-05 20:00:40,762 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testConsecutiveExports,1,1696536040379.b51e0a70eafb119fb7846b617d12594a. 2023-10-05 20:00:40,763 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=44 updating hbase:meta row=b51e0a70eafb119fb7846b617d12594a, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,36369,1696535998737 2023-10-05 20:00:40,763 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testConsecutiveExports,1,1696536040379.b51e0a70eafb119fb7846b617d12594a.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1696536040763"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1696536040763"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1696536040763"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1696536040763"}]},"ts":"1696536040763"} 2023-10-05 20:00:40,763 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testConsecutiveExports,,1696536040379.7dea6e77f4b5fc4af09b824e7b08d75b. 2023-10-05 20:00:40,763 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testConsecutiveExports,,1696536040379.7dea6e77f4b5fc4af09b824e7b08d75b. 2023-10-05 20:00:40,764 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=43 updating hbase:meta row=7dea6e77f4b5fc4af09b824e7b08d75b, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,44821,1696535998698 2023-10-05 20:00:40,764 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testConsecutiveExports,,1696536040379.7dea6e77f4b5fc4af09b824e7b08d75b.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1696536040764"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1696536040764"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1696536040764"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1696536040764"}]},"ts":"1696536040764"} 2023-10-05 20:00:40,767 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=45, resume processing ppid=44 2023-10-05 20:00:40,767 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=45, ppid=44, state=SUCCESS; OpenRegionProcedure b51e0a70eafb119fb7846b617d12594a, server=jenkins-hbase4.apache.org,36369,1696535998737 in 175 msec 2023-10-05 20:00:40,768 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=46, resume processing ppid=43 2023-10-05 20:00:40,768 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=46, ppid=43, state=SUCCESS; OpenRegionProcedure 7dea6e77f4b5fc4af09b824e7b08d75b, server=jenkins-hbase4.apache.org,44821,1696535998698 in 175 msec 2023-10-05 20:00:40,768 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=44, ppid=42, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=b51e0a70eafb119fb7846b617d12594a, ASSIGN in 336 msec 2023-10-05 20:00:40,770 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=43, resume processing ppid=42 2023-10-05 20:00:40,770 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=43, ppid=42, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=7dea6e77f4b5fc4af09b824e7b08d75b, ASSIGN in 337 msec 2023-10-05 20:00:40,772 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-10-05 20:00:40,772 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696536040772"}]},"ts":"1696536040772"} 2023-10-05 20:00:40,773 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=ENABLED in hbase:meta 2023-10-05 20:00:40,776 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_POST_OPERATION 2023-10-05 20:00:40,776 DEBUG [PEWorker-5] access.PermissionStorage(175): Writing permission with rowKey testtb-testConsecutiveExports jenkins: RWXCA 2023-10-05 20:00:40,778 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=32861] access.PermissionStorage(611): Read acl: entry[testtb-testConsecutiveExports], kv [jenkins: RWXCA] 2023-10-05 20:00:40,779 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): regionserver:36369-0x101182c1f970003, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-05 20:00:40,779 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): master:40857-0x101182c1f970000, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-05 20:00:40,780 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): regionserver:44821-0x101182c1f970002, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-05 20:00:40,779 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): regionserver:32861-0x101182c1f970001, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-05 20:00:40,781 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-10-05 20:00:40,781 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-10-05 20:00:40,781 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-10-05 20:00:40,781 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-10-05 20:00:40,783 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=42, state=SUCCESS; CreateTableProcedure table=testtb-testConsecutiveExports in 402 msec 2023-10-05 20:00:40,987 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40857] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-10-05 20:00:40,988 INFO [Listener at jenkins-hbase4.apache.org/35067] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testConsecutiveExports, procId: 42 completed 2023-10-05 20:00:40,990 DEBUG [Listener at jenkins-hbase4.apache.org/35067] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testConsecutiveExports 2023-10-05 20:00:40,990 DEBUG [Listener at jenkins-hbase4.apache.org/35067] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testConsecutiveExports,,1696536040379.7dea6e77f4b5fc4af09b824e7b08d75b. 2023-10-05 20:00:40,993 INFO [Listener at jenkins-hbase4.apache.org/35067] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-10-05 20:00:41,004 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40857] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-10-05 20:00:41,004 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40857] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1696536041004 (current time:1696536041004). 2023-10-05 20:00:41,004 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40857] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-10-05 20:00:41,005 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40857] zookeeper.ReadOnlyZKClient(139): Connect 0x2b263ac5 to 127.0.0.1:57530 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-05 20:00:41,014 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40857] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6c15fb40, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-05 20:00:41,015 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40857] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-05 20:00:41,018 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:37680, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-05 20:00:41,019 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40857] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x2b263ac5 to 127.0.0.1:57530 2023-10-05 20:00:41,019 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40857] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-05 20:00:41,020 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40857] zookeeper.ReadOnlyZKClient(139): Connect 0x66a82adb to 127.0.0.1:57530 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-05 20:00:41,025 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40857] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7cc2c4d9, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-05 20:00:41,027 DEBUG [hconnection-0x3fceeffa-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-05 20:00:41,029 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:37694, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-05 20:00:41,033 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40857] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-05 20:00:41,035 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:35396, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-05 20:00:41,036 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40857] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x66a82adb to 127.0.0.1:57530 2023-10-05 20:00:41,036 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40857] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-05 20:00:41,036 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40857] access.PermissionStorage(611): Read acl: entry[testtb-testConsecutiveExports], kv [jenkins: RWXCA] 2023-10-05 20:00:41,037 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40857] snapshot.SnapshotManager(637): No existing snapshot, attempting snapshot... 2023-10-05 20:00:41,037 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40857] snapshot.SnapshotManager(684): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-10-05 20:00:41,040 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40857] snapshot.SnapshotManager(519): Unable to retrieve ACL status for path: hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/.hbase-snapshot, current working dir path: hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports org.apache.hadoop.hdfs.protocol.AclException: The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.ipc.RemoteException.instantiateException(RemoteException.java:121) at org.apache.hadoop.ipc.RemoteException.unwrapRemoteException(RemoteException.java:88) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2736) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2294) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2291) at org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81) at org.apache.hadoop.hdfs.DistributedFileSystem.getAclStatus(DistributedFileSystem.java:2291) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.updateWorkingDirAclsIfRequired(SnapshotManager.java:517) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.prepareToTakeSnapshot(SnapshotManager.java:490) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.snapshotEnabledTable(SnapshotManager.java:559) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshotInternal(SnapshotManager.java:687) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshot(SnapshotManager.java:623) at org.apache.hadoop.hbase.master.MasterRpcServices.snapshot(MasterRpcServices.java:1588) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) Caused by: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.hdfs.protocol.AclException): The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at org.apache.hadoop.ipc.Client.getRpcResponse(Client.java:1540) at org.apache.hadoop.ipc.Client.call(Client.java:1486) at org.apache.hadoop.ipc.Client.call(Client.java:1385) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:232) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:118) at com.sun.proxy.$Proxy32.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.getAclStatus(ClientNamenodeProtocolTranslatorPB.java:1385) at sun.reflect.GeneratedMethodAccessor62.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:422) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeMethod(RetryInvocationHandler.java:165) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invoke(RetryInvocationHandler.java:157) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeOnce(RetryInvocationHandler.java:95) at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:359) at com.sun.proxy.$Proxy35.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor62.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor62.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor62.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor62.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor62.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2734) ... 15 more 2023-10-05 20:00:41,041 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40857] procedure2.ProcedureExecutor(1028): Stored pid=47, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-10-05 20:00:41,042 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=47, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-10-05 20:00:41,043 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=47, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE; timeout=600000, timestamp=1696536641043 2023-10-05 20:00:41,043 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports 2023-10-05 20:00:41,043 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40857] snapshot.SnapshotManager(689): Started snapshot: { ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-10-05 20:00:41,044 DEBUG [Listener at jenkins-hbase4.apache.org/35067] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-10-05 20:00:41,044 DEBUG [Listener at jenkins-hbase4.apache.org/35067] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-10-05 20:00:41,044 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=48, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-10-05 20:00:41,045 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=47, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-10-05 20:00:41,046 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=47, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE in 5 msec 2023-10-05 20:00:41,047 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=48, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-10-05 20:00:41,048 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=48, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED; timeout=600000, timestamp=1696536641048 2023-10-05 20:00:41,062 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testConsecutiveExports 2023-10-05 20:00:41,063 INFO [(jenkins-hbase4.apache.org,40857,1696535997381)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testConsecutiveExports' 2023-10-05 20:00:41,063 DEBUG [(jenkins-hbase4.apache.org,40857,1696535997381)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-05 20:00:41,063 DEBUG [(jenkins-hbase4.apache.org,40857,1696535997381)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' 2023-10-05 20:00:41,063 DEBUG [(jenkins-hbase4.apache.org,40857,1696535997381)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testConsecutiveExports', kicking off acquire phase on members. 2023-10-05 20:00:41,064 DEBUG [(jenkins-hbase4.apache.org,40857,1696535997381)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40857-0x101182c1f970000, quorum=127.0.0.1:57530, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-10-05 20:00:41,064 DEBUG [(jenkins-hbase4.apache.org,40857,1696535997381)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-10-05 20:00:41,070 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): regionserver:44821-0x101182c1f970002, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-05 20:00:41,070 DEBUG [(jenkins-hbase4.apache.org,40857,1696535997381)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,44821,1696535998698 2023-10-05 20:00:41,070 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-05 20:00:41,070 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): regionserver:36369-0x101182c1f970003, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-05 20:00:41,070 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): regionserver:32861-0x101182c1f970001, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-05 20:00:41,071 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-05 20:00:41,071 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-05 20:00:41,071 DEBUG [(jenkins-hbase4.apache.org,40857,1696535997381)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40857-0x101182c1f970000, quorum=127.0.0.1:57530, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,44821,1696535998698 2023-10-05 20:00:41,071 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-05 20:00:41,071 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-05 20:00:41,071 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-05 20:00:41,071 DEBUG [(jenkins-hbase4.apache.org,40857,1696535997381)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,36369,1696535998737 2023-10-05 20:00:41,071 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-10-05 20:00:41,071 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-10-05 20:00:41,071 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-10-05 20:00:41,071 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44821-0x101182c1f970002, quorum=127.0.0.1:57530, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-10-05 20:00:41,072 DEBUG [(jenkins-hbase4.apache.org,40857,1696535997381)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40857-0x101182c1f970000, quorum=127.0.0.1:57530, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,36369,1696535998737 2023-10-05 20:00:41,072 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:32861-0x101182c1f970001, quorum=127.0.0.1:57530, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-10-05 20:00:41,072 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36369-0x101182c1f970003, quorum=127.0.0.1:57530, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-10-05 20:00:41,072 DEBUG [(jenkins-hbase4.apache.org,40857,1696535997381)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-05 20:00:41,072 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 165 2023-10-05 20:00:41,072 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 165 2023-10-05 20:00:41,072 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-10-05 20:00:41,072 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-10-05 20:00:41,072 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 165 2023-10-05 20:00:41,072 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-10-05 20:00:41,072 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-10-05 20:00:41,072 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-10-05 20:00:41,073 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testConsecutiveExports 2023-10-05 20:00:41,073 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testConsecutiveExports 2023-10-05 20:00:41,073 DEBUG [member: 'jenkins-hbase4.apache.org,36369,1696535998737' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testConsecutiveExports' with timeout 300000ms 2023-10-05 20:00:41,073 DEBUG [member: 'jenkins-hbase4.apache.org,36369,1696535998737' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-05 20:00:41,073 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-10-05 20:00:41,074 DEBUG [member: 'jenkins-hbase4.apache.org,36369,1696535998737' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' stage 2023-10-05 20:00:41,074 DEBUG [member: 'jenkins-hbase4.apache.org,36369,1696535998737' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally acquired 2023-10-05 20:00:41,074 DEBUG [member: 'jenkins-hbase4.apache.org,36369,1696535998737' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,36369,1696535998737' joining acquired barrier for procedure (emptySnaptb0-testConsecutiveExports) in zk 2023-10-05 20:00:41,073 DEBUG [member: 'jenkins-hbase4.apache.org,44821,1696535998698' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testConsecutiveExports' with timeout 300000ms 2023-10-05 20:00:41,074 DEBUG [member: 'jenkins-hbase4.apache.org,44821,1696535998698' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-05 20:00:41,075 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): master:40857-0x101182c1f970000, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,36369,1696535998737 2023-10-05 20:00:41,075 DEBUG [member: 'jenkins-hbase4.apache.org,36369,1696535998737' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-10-05 20:00:41,075 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,36369,1696535998737 2023-10-05 20:00:41,076 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-05 20:00:41,076 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-05 20:00:41,076 DEBUG [member: 'jenkins-hbase4.apache.org,36369,1696535998737' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36369-0x101182c1f970003, quorum=127.0.0.1:57530, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-10-05 20:00:41,076 DEBUG [member: 'jenkins-hbase4.apache.org,36369,1696535998737' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-05 20:00:41,076 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-05 20:00:41,076 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-05 20:00:41,076 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-10-05 20:00:41,077 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36369,1696535998737 2023-10-05 20:00:41,078 DEBUG [member: 'jenkins-hbase4.apache.org,44821,1696535998698' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' stage 2023-10-05 20:00:41,078 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testConsecutiveExports 2023-10-05 20:00:41,078 DEBUG [member: 'jenkins-hbase4.apache.org,44821,1696535998698' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally acquired 2023-10-05 20:00:41,078 DEBUG [member: 'jenkins-hbase4.apache.org,44821,1696535998698' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44821,1696535998698' joining acquired barrier for procedure (emptySnaptb0-testConsecutiveExports) in zk 2023-10-05 20:00:41,078 DEBUG [member: 'jenkins-hbase4.apache.org,32861,1696535998642' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testConsecutiveExports' with timeout 300000ms 2023-10-05 20:00:41,078 DEBUG [member: 'jenkins-hbase4.apache.org,32861,1696535998642' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-05 20:00:41,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-05 20:00:41,081 DEBUG [member: 'jenkins-hbase4.apache.org,32861,1696535998642' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' stage 2023-10-05 20:00:41,081 DEBUG [member: 'jenkins-hbase4.apache.org,32861,1696535998642' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally acquired 2023-10-05 20:00:41,081 DEBUG [member: 'jenkins-hbase4.apache.org,32861,1696535998642' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,32861,1696535998642' joining acquired barrier for procedure (emptySnaptb0-testConsecutiveExports) in zk 2023-10-05 20:00:41,081 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,36369,1696535998737' joining acquired barrier for procedure 'emptySnaptb0-testConsecutiveExports' on coordinator 2023-10-05 20:00:41,081 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@13954363[Count = 1] remaining members to acquire global barrier 2023-10-05 20:00:41,082 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): master:40857-0x101182c1f970000, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,44821,1696535998698 2023-10-05 20:00:41,082 DEBUG [member: 'jenkins-hbase4.apache.org,44821,1696535998698' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-10-05 20:00:41,082 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,44821,1696535998698 2023-10-05 20:00:41,083 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-05 20:00:41,083 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-05 20:00:41,083 DEBUG [member: 'jenkins-hbase4.apache.org,32861,1696535998642' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-10-05 20:00:41,083 DEBUG [member: 'jenkins-hbase4.apache.org,44821,1696535998698' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44821-0x101182c1f970002, quorum=127.0.0.1:57530, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-10-05 20:00:41,083 DEBUG [member: 'jenkins-hbase4.apache.org,44821,1696535998698' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-05 20:00:41,083 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-05 20:00:41,083 DEBUG [member: 'jenkins-hbase4.apache.org,32861,1696535998642' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:32861-0x101182c1f970001, quorum=127.0.0.1:57530, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-10-05 20:00:41,083 DEBUG [member: 'jenkins-hbase4.apache.org,32861,1696535998642' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-05 20:00:41,083 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-05 20:00:41,084 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-10-05 20:00:41,084 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32861,1696535998642 2023-10-05 20:00:41,084 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36369,1696535998737 2023-10-05 20:00:41,085 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44821,1696535998698 2023-10-05 20:00:41,085 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-05 20:00:41,085 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,44821,1696535998698' joining acquired barrier for procedure 'emptySnaptb0-testConsecutiveExports' on coordinator 2023-10-05 20:00:41,085 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@13954363[Count = 0] remaining members to acquire global barrier 2023-10-05 20:00:41,085 DEBUG [(jenkins-hbase4.apache.org,40857,1696535997381)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testConsecutiveExports' starting 'in-barrier' execution. 2023-10-05 20:00:41,085 DEBUG [(jenkins-hbase4.apache.org,40857,1696535997381)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-10-05 20:00:41,088 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): regionserver:44821-0x101182c1f970002, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-10-05 20:00:41,088 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): regionserver:32861-0x101182c1f970001, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-10-05 20:00:41,088 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-10-05 20:00:41,088 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-10-05 20:00:41,088 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-10-05 20:00:41,088 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): regionserver:36369-0x101182c1f970003, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-10-05 20:00:41,088 DEBUG [member: 'jenkins-hbase4.apache.org,44821,1696535998698' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-10-05 20:00:41,088 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-10-05 20:00:41,088 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-10-05 20:00:41,088 DEBUG [(jenkins-hbase4.apache.org,40857,1696535997381)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40857-0x101182c1f970000, quorum=127.0.0.1:57530, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,36369,1696535998737 2023-10-05 20:00:41,088 DEBUG [member: 'jenkins-hbase4.apache.org,36369,1696535998737' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-10-05 20:00:41,088 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-10-05 20:00:41,088 DEBUG [rs(jenkins-hbase4.apache.org,44821,1696535998698)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,,1696536040379.7dea6e77f4b5fc4af09b824e7b08d75b. 2023-10-05 20:00:41,088 DEBUG [member: 'jenkins-hbase4.apache.org,44821,1696535998698' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-05 20:00:41,088 DEBUG [rs(jenkins-hbase4.apache.org,44821,1696535998698)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,,1696536040379.7dea6e77f4b5fc4af09b824e7b08d75b. started... 2023-10-05 20:00:41,088 DEBUG [member: 'jenkins-hbase4.apache.org,32861,1696535998642' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-10-05 20:00:41,088 DEBUG [member: 'jenkins-hbase4.apache.org,32861,1696535998642' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally completed 2023-10-05 20:00:41,088 DEBUG [(jenkins-hbase4.apache.org,40857,1696535997381)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40857-0x101182c1f970000, quorum=127.0.0.1:57530, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,44821,1696535998698 2023-10-05 20:00:41,088 DEBUG [member: 'jenkins-hbase4.apache.org,44821,1696535998698' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-05 20:00:41,088 DEBUG [(jenkins-hbase4.apache.org,40857,1696535997381)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-05 20:00:41,088 DEBUG [member: 'jenkins-hbase4.apache.org,32861,1696535998642' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,32861,1696535998642' in zk 2023-10-05 20:00:41,089 DEBUG [rs(jenkins-hbase4.apache.org,44821,1696535998698)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 7dea6e77f4b5fc4af09b824e7b08d75b: 2023-10-05 20:00:41,089 DEBUG [rs(jenkins-hbase4.apache.org,44821,1696535998698)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,,1696536040379.7dea6e77f4b5fc4af09b824e7b08d75b.' region-info for snapshot=emptySnaptb0-testConsecutiveExports 2023-10-05 20:00:41,089 DEBUG [rs(jenkins-hbase4.apache.org,44821,1696535998698)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-05 20:00:41,089 DEBUG [rs(jenkins-hbase4.apache.org,44821,1696535998698)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-10-05 20:00:41,093 DEBUG [member: 'jenkins-hbase4.apache.org,36369,1696535998737' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-05 20:00:41,093 DEBUG [member: 'jenkins-hbase4.apache.org,36369,1696535998737' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-05 20:00:41,093 DEBUG [rs(jenkins-hbase4.apache.org,36369,1696535998737)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,1,1696536040379.b51e0a70eafb119fb7846b617d12594a. 2023-10-05 20:00:41,093 DEBUG [rs(jenkins-hbase4.apache.org,36369,1696535998737)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,1,1696536040379.b51e0a70eafb119fb7846b617d12594a. started... 2023-10-05 20:00:41,094 DEBUG [rs(jenkins-hbase4.apache.org,36369,1696535998737)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for b51e0a70eafb119fb7846b617d12594a: 2023-10-05 20:00:41,094 DEBUG [rs(jenkins-hbase4.apache.org,36369,1696535998737)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,1,1696536040379.b51e0a70eafb119fb7846b617d12594a.' region-info for snapshot=emptySnaptb0-testConsecutiveExports 2023-10-05 20:00:41,094 DEBUG [rs(jenkins-hbase4.apache.org,36369,1696535998737)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-05 20:00:41,094 DEBUG [rs(jenkins-hbase4.apache.org,36369,1696535998737)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-10-05 20:00:41,097 DEBUG [member: 'jenkins-hbase4.apache.org,32861,1696535998642' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testConsecutiveExports' has notified controller of completion 2023-10-05 20:00:41,097 DEBUG [member: 'jenkins-hbase4.apache.org,32861,1696535998642' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-05 20:00:41,098 DEBUG [member: 'jenkins-hbase4.apache.org,32861,1696535998642' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testConsecutiveExports' completed. 2023-10-05 20:00:41,118 DEBUG [rs(jenkins-hbase4.apache.org,44821,1696535998698)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,,1696536040379.7dea6e77f4b5fc4af09b824e7b08d75b. completed. 2023-10-05 20:00:41,118 DEBUG [rs(jenkins-hbase4.apache.org,44821,1696535998698)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,,1696536040379.7dea6e77f4b5fc4af09b824e7b08d75b. 2023-10-05 20:00:41,118 DEBUG [member: 'jenkins-hbase4.apache.org,44821,1696535998698' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-05 20:00:41,118 DEBUG [member: 'jenkins-hbase4.apache.org,44821,1696535998698' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-05 20:00:41,119 DEBUG [member: 'jenkins-hbase4.apache.org,44821,1696535998698' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,44821,1696535998698 2023-10-05 20:00:41,119 DEBUG [member: 'jenkins-hbase4.apache.org,44821,1696535998698' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally completed 2023-10-05 20:00:41,119 DEBUG [member: 'jenkins-hbase4.apache.org,44821,1696535998698' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,44821,1696535998698' in zk 2023-10-05 20:00:41,119 DEBUG [rs(jenkins-hbase4.apache.org,36369,1696535998737)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,1,1696536040379.b51e0a70eafb119fb7846b617d12594a. completed. 2023-10-05 20:00:41,119 DEBUG [rs(jenkins-hbase4.apache.org,36369,1696535998737)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,1,1696536040379.b51e0a70eafb119fb7846b617d12594a. 2023-10-05 20:00:41,119 DEBUG [member: 'jenkins-hbase4.apache.org,36369,1696535998737' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-05 20:00:41,119 DEBUG [member: 'jenkins-hbase4.apache.org,36369,1696535998737' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-05 20:00:41,119 DEBUG [member: 'jenkins-hbase4.apache.org,36369,1696535998737' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,36369,1696535998737 2023-10-05 20:00:41,119 DEBUG [member: 'jenkins-hbase4.apache.org,36369,1696535998737' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally completed 2023-10-05 20:00:41,119 DEBUG [member: 'jenkins-hbase4.apache.org,36369,1696535998737' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,36369,1696535998737' in zk 2023-10-05 20:00:41,120 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): master:40857-0x101182c1f970000, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,44821,1696535998698 2023-10-05 20:00:41,121 DEBUG [member: 'jenkins-hbase4.apache.org,44821,1696535998698' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testConsecutiveExports' has notified controller of completion 2023-10-05 20:00:41,121 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,44821,1696535998698 2023-10-05 20:00:41,122 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-05 20:00:41,122 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-05 20:00:41,122 DEBUG [member: 'jenkins-hbase4.apache.org,44821,1696535998698' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-05 20:00:41,122 DEBUG [member: 'jenkins-hbase4.apache.org,44821,1696535998698' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testConsecutiveExports' completed. 2023-10-05 20:00:41,123 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): master:40857-0x101182c1f970000, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,36369,1696535998737 2023-10-05 20:00:41,123 DEBUG [member: 'jenkins-hbase4.apache.org,36369,1696535998737' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testConsecutiveExports' has notified controller of completion 2023-10-05 20:00:41,124 DEBUG [member: 'jenkins-hbase4.apache.org,36369,1696535998737' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-05 20:00:41,124 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-05 20:00:41,124 DEBUG [member: 'jenkins-hbase4.apache.org,36369,1696535998737' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testConsecutiveExports' completed. 2023-10-05 20:00:41,125 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-05 20:00:41,125 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-10-05 20:00:41,125 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32861,1696535998642 2023-10-05 20:00:41,126 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36369,1696535998737 2023-10-05 20:00:41,126 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44821,1696535998698 2023-10-05 20:00:41,126 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-05 20:00:41,126 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-10-05 20:00:41,127 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32861,1696535998642 2023-10-05 20:00:41,127 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36369,1696535998737 2023-10-05 20:00:41,127 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44821,1696535998698 2023-10-05 20:00:41,127 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,44821,1696535998698': 2023-10-05 20:00:41,128 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,44821,1696535998698' released barrier for procedure'emptySnaptb0-testConsecutiveExports', counting down latch. Waiting for 1 more 2023-10-05 20:00:41,128 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,36369,1696535998737 2023-10-05 20:00:41,128 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-05 20:00:41,128 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-05 20:00:41,128 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-05 20:00:41,128 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-05 20:00:41,128 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-10-05 20:00:41,129 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32861,1696535998642 2023-10-05 20:00:41,129 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36369,1696535998737 2023-10-05 20:00:41,129 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44821,1696535998698 2023-10-05 20:00:41,129 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-05 20:00:41,130 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-10-05 20:00:41,130 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32861,1696535998642 2023-10-05 20:00:41,130 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36369,1696535998737 2023-10-05 20:00:41,130 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44821,1696535998698 2023-10-05 20:00:41,131 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,36369,1696535998737': 2023-10-05 20:00:41,131 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,36369,1696535998737' released barrier for procedure'emptySnaptb0-testConsecutiveExports', counting down latch. Waiting for 0 more 2023-10-05 20:00:41,131 INFO [(jenkins-hbase4.apache.org,40857,1696535997381)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testConsecutiveExports' execution completed 2023-10-05 20:00:41,131 DEBUG [(jenkins-hbase4.apache.org,40857,1696535997381)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-05 20:00:41,131 DEBUG [(jenkins-hbase4.apache.org,40857,1696535997381)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-05 20:00:41,131 DEBUG [(jenkins-hbase4.apache.org,40857,1696535997381)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testConsecutiveExports 2023-10-05 20:00:41,131 INFO [(jenkins-hbase4.apache.org,40857,1696535997381)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testConsecutiveExportsincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-10-05 20:00:41,133 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): master:40857-0x101182c1f970000, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-10-05 20:00:41,133 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): regionserver:32861-0x101182c1f970001, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-10-05 20:00:41,133 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): regionserver:36369-0x101182c1f970003, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-10-05 20:00:41,133 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): regionserver:32861-0x101182c1f970001, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-05 20:00:41,133 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): regionserver:36369-0x101182c1f970003, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-05 20:00:41,133 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-10-05 20:00:41,133 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-10-05 20:00:41,133 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-10-05 20:00:41,133 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-05 20:00:41,133 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-05 20:00:41,133 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): regionserver:44821-0x101182c1f970002, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-10-05 20:00:41,133 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-10-05 20:00:41,133 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-10-05 20:00:41,133 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-10-05 20:00:41,133 DEBUG [(jenkins-hbase4.apache.org,40857,1696535997381)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40857-0x101182c1f970000, quorum=127.0.0.1:57530, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,32861,1696535998642 2023-10-05 20:00:41,133 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): regionserver:44821-0x101182c1f970002, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-05 20:00:41,133 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-05 20:00:41,133 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-10-05 20:00:41,134 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-05 20:00:41,134 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-05 20:00:41,134 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-05 20:00:41,134 DEBUG [(jenkins-hbase4.apache.org,40857,1696535997381)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40857-0x101182c1f970000, quorum=127.0.0.1:57530, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,36369,1696535998737 2023-10-05 20:00:41,134 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-05 20:00:41,134 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-05 20:00:41,134 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-10-05 20:00:41,134 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-05 20:00:41,134 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-10-05 20:00:41,134 DEBUG [(jenkins-hbase4.apache.org,40857,1696535997381)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40857-0x101182c1f970000, quorum=127.0.0.1:57530, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,44821,1696535998698 2023-10-05 20:00:41,134 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-10-05 20:00:41,134 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-05 20:00:41,135 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-10-05 20:00:41,135 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-10-05 20:00:41,135 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32861,1696535998642 2023-10-05 20:00:41,135 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36369,1696535998737 2023-10-05 20:00:41,136 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44821,1696535998698 2023-10-05 20:00:41,136 DEBUG [(jenkins-hbase4.apache.org,40857,1696535997381)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40857-0x101182c1f970000, quorum=127.0.0.1:57530, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,32861,1696535998642 2023-10-05 20:00:41,136 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-05 20:00:41,136 DEBUG [(jenkins-hbase4.apache.org,40857,1696535997381)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40857-0x101182c1f970000, quorum=127.0.0.1:57530, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,36369,1696535998737 2023-10-05 20:00:41,136 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-10-05 20:00:41,137 DEBUG [(jenkins-hbase4.apache.org,40857,1696535997381)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40857-0x101182c1f970000, quorum=127.0.0.1:57530, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,44821,1696535998698 2023-10-05 20:00:41,137 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32861,1696535998642 2023-10-05 20:00:41,137 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36369,1696535998737 2023-10-05 20:00:41,137 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44821,1696535998698 2023-10-05 20:00:41,140 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): master:40857-0x101182c1f970000, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,44821,1696535998698 2023-10-05 20:00:41,140 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): master:40857-0x101182c1f970000, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-10-05 20:00:41,140 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): regionserver:36369-0x101182c1f970003, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-05 20:00:41,140 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): regionserver:44821-0x101182c1f970002, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-05 20:00:41,140 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-05 20:00:41,140 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-05 20:00:41,141 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): regionserver:44821-0x101182c1f970002, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-05 20:00:41,141 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testConsecutiveExports 2023-10-05 20:00:41,140 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): regionserver:36369-0x101182c1f970003, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-05 20:00:41,141 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testConsecutiveExports 2023-10-05 20:00:41,140 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): regionserver:32861-0x101182c1f970001, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-05 20:00:41,140 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): master:40857-0x101182c1f970000, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,36369,1696535998737 2023-10-05 20:00:41,141 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => c7b48a2e62736c517f8bfa7d64fc37ac, NAME => 'testtb-testConsecutiveExports,.mob,0.c7b48a2e62736c517f8bfa7d64fc37ac.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testConsecutiveExports 2023-10-05 20:00:41,141 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): master:40857-0x101182c1f970000, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,32861,1696535998642 2023-10-05 20:00:41,141 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-05 20:00:41,141 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): regionserver:32861-0x101182c1f970001, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-05 20:00:41,141 DEBUG [(jenkins-hbase4.apache.org,40857,1696535997381)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-05 20:00:41,141 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-05 20:00:41,141 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-05 20:00:41,141 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-10-05 20:00:41,141 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-05 20:00:41,141 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): master:40857-0x101182c1f970000, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-10-05 20:00:41,142 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): master:40857-0x101182c1f970000, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,44821,1696535998698 2023-10-05 20:00:41,143 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): master:40857-0x101182c1f970000, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-10-05 20:00:41,143 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): master:40857-0x101182c1f970000, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,36369,1696535998737 2023-10-05 20:00:41,143 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-05 20:00:41,143 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-05 20:00:41,143 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-05 20:00:41,143 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): master:40857-0x101182c1f970000, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,32861,1696535998642 2023-10-05 20:00:41,143 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-05 20:00:41,143 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-05 20:00:41,143 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): master:40857-0x101182c1f970000, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-10-05 20:00:41,143 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-05 20:00:41,143 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): master:40857-0x101182c1f970000, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-10-05 20:00:41,143 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-10-05 20:00:41,144 DEBUG [Listener at jenkins-hbase4.apache.org/35067] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-05 20:00:41,145 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40857] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-10-05 20:00:41,145 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40857] snapshot.SnapshotManager(406): Snapshoting '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' is still in progress! 2023-10-05 20:00:41,145 DEBUG [Listener at jenkins-hbase4.apache.org/35067] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-10-05 20:00:41,152 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testConsecutiveExports 2023-10-05 20:00:41,152 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports 2023-10-05 20:00:41,169 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports to hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/.hbase-snapshot/emptySnaptb0-testConsecutiveExports 2023-10-05 20:00:41,169 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed 2023-10-05 20:00:41,169 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports 2023-10-05 20:00:41,170 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports 2023-10-05 20:00:41,170 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports at 1696536041043Completed referencing HFiles for the mob region of table: testtb-testConsecutiveExports at 1696536041152 (+109 ms)Consolidate snapshot: emptySnaptb0-testConsecutiveExports at 1696536041152Loading Region manifests for emptySnaptb0-testConsecutiveExports at 1696536041152Writing data manifest for emptySnaptb0-testConsecutiveExports at 1696536041155 (+3 ms)Verifying snapshot: emptySnaptb0-testConsecutiveExports at 1696536041163 (+8 ms)Snapshot emptySnaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed at 1696536041169 (+6 ms) 2023-10-05 20:00:41,174 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=48, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-10-05 20:00:41,176 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=48, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED in 130 msec 2023-10-05 20:00:41,346 DEBUG [Listener at jenkins-hbase4.apache.org/35067] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-05 20:00:41,347 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40857] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-10-05 20:00:41,347 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40857] snapshot.SnapshotManager(403): Snapshot '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' has completed, notifying client. 2023-10-05 20:00:41,349 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44821] regionserver.HRegion(8805): writing data to region testtb-testConsecutiveExports,,1696536040379.7dea6e77f4b5fc4af09b824e7b08d75b. with WAL disabled. Data may be lost in the event of a crash. 2023-10-05 20:00:41,351 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36369] regionserver.HRegion(8805): writing data to region testtb-testConsecutiveExports,1,1696536040379.b51e0a70eafb119fb7846b617d12594a. with WAL disabled. Data may be lost in the event of a crash. 2023-10-05 20:00:41,354 DEBUG [Listener at jenkins-hbase4.apache.org/35067] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testConsecutiveExports 2023-10-05 20:00:41,354 DEBUG [Listener at jenkins-hbase4.apache.org/35067] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testConsecutiveExports,,1696536040379.7dea6e77f4b5fc4af09b824e7b08d75b. 2023-10-05 20:00:41,354 INFO [Listener at jenkins-hbase4.apache.org/35067] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-10-05 20:00:41,365 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40857] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-10-05 20:00:41,365 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40857] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1696536041365 (current time:1696536041365). 2023-10-05 20:00:41,365 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40857] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-10-05 20:00:41,367 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40857] zookeeper.ReadOnlyZKClient(139): Connect 0x7441714c to 127.0.0.1:57530 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-05 20:00:41,378 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40857] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@f123a48, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-05 20:00:41,380 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40857] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-05 20:00:41,381 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:37702, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-05 20:00:41,382 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40857] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7441714c to 127.0.0.1:57530 2023-10-05 20:00:41,382 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40857] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-05 20:00:41,383 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40857] zookeeper.ReadOnlyZKClient(139): Connect 0x519b4414 to 127.0.0.1:57530 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-05 20:00:41,389 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40857] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2e2f947a, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-05 20:00:41,392 DEBUG [hconnection-0x30f12b8d-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-05 20:00:41,395 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:37708, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-05 20:00:41,398 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40857] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-05 20:00:41,399 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:35404, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-05 20:00:41,400 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40857] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x519b4414 to 127.0.0.1:57530 2023-10-05 20:00:41,401 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40857] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-05 20:00:41,401 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40857] access.PermissionStorage(611): Read acl: entry[testtb-testConsecutiveExports], kv [jenkins: RWXCA] 2023-10-05 20:00:41,402 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40857] snapshot.SnapshotManager(637): No existing snapshot, attempting snapshot... 2023-10-05 20:00:41,402 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40857] snapshot.SnapshotManager(684): Table enabled, starting distributed snapshots for { ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-10-05 20:00:41,405 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40857] snapshot.SnapshotManager(519): Unable to retrieve ACL status for path: hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/.hbase-snapshot, current working dir path: hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports org.apache.hadoop.hdfs.protocol.AclException: The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.ipc.RemoteException.instantiateException(RemoteException.java:121) at org.apache.hadoop.ipc.RemoteException.unwrapRemoteException(RemoteException.java:88) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2736) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2294) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2291) at org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81) at org.apache.hadoop.hdfs.DistributedFileSystem.getAclStatus(DistributedFileSystem.java:2291) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.updateWorkingDirAclsIfRequired(SnapshotManager.java:517) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.prepareToTakeSnapshot(SnapshotManager.java:490) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.snapshotEnabledTable(SnapshotManager.java:559) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshotInternal(SnapshotManager.java:687) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshot(SnapshotManager.java:623) at org.apache.hadoop.hbase.master.MasterRpcServices.snapshot(MasterRpcServices.java:1588) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) Caused by: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.hdfs.protocol.AclException): The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at org.apache.hadoop.ipc.Client.getRpcResponse(Client.java:1540) at org.apache.hadoop.ipc.Client.call(Client.java:1486) at org.apache.hadoop.ipc.Client.call(Client.java:1385) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:232) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:118) at com.sun.proxy.$Proxy32.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.getAclStatus(ClientNamenodeProtocolTranslatorPB.java:1385) at sun.reflect.GeneratedMethodAccessor62.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:422) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeMethod(RetryInvocationHandler.java:165) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invoke(RetryInvocationHandler.java:157) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeOnce(RetryInvocationHandler.java:95) at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:359) at com.sun.proxy.$Proxy35.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor62.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor62.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor62.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor62.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor62.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2734) ... 15 more 2023-10-05 20:00:41,406 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40857] procedure2.ProcedureExecutor(1028): Stored pid=49, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-10-05 20:00:41,407 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=49, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-10-05 20:00:41,408 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=49, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE; timeout=600000, timestamp=1696536641408 2023-10-05 20:00:41,408 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports 2023-10-05 20:00:41,408 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40857] snapshot.SnapshotManager(689): Started snapshot: { ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-10-05 20:00:41,409 DEBUG [Listener at jenkins-hbase4.apache.org/35067] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-10-05 20:00:41,410 DEBUG [Listener at jenkins-hbase4.apache.org/35067] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-10-05 20:00:41,410 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=50, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-10-05 20:00:41,411 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=49, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-10-05 20:00:41,412 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=49, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE in 6 msec 2023-10-05 20:00:41,413 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=50, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-10-05 20:00:41,413 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=50, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED; timeout=600000, timestamp=1696536641413 2023-10-05 20:00:41,426 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testConsecutiveExports 2023-10-05 20:00:41,426 INFO [(jenkins-hbase4.apache.org,40857,1696535997381)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testConsecutiveExports' 2023-10-05 20:00:41,427 DEBUG [(jenkins-hbase4.apache.org,40857,1696535997381)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-05 20:00:41,428 DEBUG [(jenkins-hbase4.apache.org,40857,1696535997381)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testConsecutiveExports' starting 'acquire' 2023-10-05 20:00:41,428 DEBUG [(jenkins-hbase4.apache.org,40857,1696535997381)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testConsecutiveExports', kicking off acquire phase on members. 2023-10-05 20:00:41,428 DEBUG [(jenkins-hbase4.apache.org,40857,1696535997381)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40857-0x101182c1f970000, quorum=127.0.0.1:57530, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-10-05 20:00:41,428 DEBUG [(jenkins-hbase4.apache.org,40857,1696535997381)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-10-05 20:00:41,430 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): regionserver:44821-0x101182c1f970002, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-05 20:00:41,430 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): regionserver:36369-0x101182c1f970003, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-05 20:00:41,430 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-05 20:00:41,430 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-05 20:00:41,430 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-05 20:00:41,430 DEBUG [(jenkins-hbase4.apache.org,40857,1696535997381)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,44821,1696535998698 2023-10-05 20:00:41,430 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): regionserver:32861-0x101182c1f970001, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-05 20:00:41,430 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-05 20:00:41,430 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-05 20:00:41,430 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-05 20:00:41,430 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-10-05 20:00:41,431 DEBUG [(jenkins-hbase4.apache.org,40857,1696535997381)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40857-0x101182c1f970000, quorum=127.0.0.1:57530, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,44821,1696535998698 2023-10-05 20:00:41,431 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-10-05 20:00:41,431 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36369-0x101182c1f970003, quorum=127.0.0.1:57530, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-10-05 20:00:41,431 DEBUG [(jenkins-hbase4.apache.org,40857,1696535997381)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,36369,1696535998737 2023-10-05 20:00:41,431 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-10-05 20:00:41,431 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:32861-0x101182c1f970001, quorum=127.0.0.1:57530, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-10-05 20:00:41,431 DEBUG [(jenkins-hbase4.apache.org,40857,1696535997381)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40857-0x101182c1f970000, quorum=127.0.0.1:57530, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,36369,1696535998737 2023-10-05 20:00:41,431 DEBUG [(jenkins-hbase4.apache.org,40857,1696535997381)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-05 20:00:41,431 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44821-0x101182c1f970002, quorum=127.0.0.1:57530, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-10-05 20:00:41,431 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 160 2023-10-05 20:00:41,431 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-10-05 20:00:41,431 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 160 2023-10-05 20:00:41,432 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-10-05 20:00:41,432 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-10-05 20:00:41,432 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 160 2023-10-05 20:00:41,432 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-10-05 20:00:41,432 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-10-05 20:00:41,432 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testConsecutiveExports 2023-10-05 20:00:41,432 DEBUG [member: 'jenkins-hbase4.apache.org,36369,1696535998737' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testConsecutiveExports' with timeout 300000ms 2023-10-05 20:00:41,432 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testConsecutiveExports 2023-10-05 20:00:41,432 DEBUG [member: 'jenkins-hbase4.apache.org,36369,1696535998737' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-05 20:00:41,432 DEBUG [member: 'jenkins-hbase4.apache.org,32861,1696535998642' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testConsecutiveExports' with timeout 300000ms 2023-10-05 20:00:41,432 DEBUG [member: 'jenkins-hbase4.apache.org,32861,1696535998642' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-05 20:00:41,432 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-10-05 20:00:41,434 DEBUG [member: 'jenkins-hbase4.apache.org,32861,1696535998642' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testConsecutiveExports' starting 'acquire' stage 2023-10-05 20:00:41,434 DEBUG [member: 'jenkins-hbase4.apache.org,32861,1696535998642' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testConsecutiveExports' locally acquired 2023-10-05 20:00:41,433 DEBUG [member: 'jenkins-hbase4.apache.org,36369,1696535998737' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testConsecutiveExports' starting 'acquire' stage 2023-10-05 20:00:41,434 DEBUG [member: 'jenkins-hbase4.apache.org,32861,1696535998642' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,32861,1696535998642' joining acquired barrier for procedure (snaptb0-testConsecutiveExports) in zk 2023-10-05 20:00:41,434 DEBUG [member: 'jenkins-hbase4.apache.org,36369,1696535998737' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testConsecutiveExports' locally acquired 2023-10-05 20:00:41,435 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testConsecutiveExports 2023-10-05 20:00:41,435 DEBUG [member: 'jenkins-hbase4.apache.org,36369,1696535998737' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,36369,1696535998737' joining acquired barrier for procedure (snaptb0-testConsecutiveExports) in zk 2023-10-05 20:00:41,435 DEBUG [member: 'jenkins-hbase4.apache.org,44821,1696535998698' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testConsecutiveExports' with timeout 300000ms 2023-10-05 20:00:41,435 DEBUG [member: 'jenkins-hbase4.apache.org,44821,1696535998698' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-05 20:00:41,436 DEBUG [member: 'jenkins-hbase4.apache.org,44821,1696535998698' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testConsecutiveExports' starting 'acquire' stage 2023-10-05 20:00:41,436 DEBUG [member: 'jenkins-hbase4.apache.org,44821,1696535998698' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testConsecutiveExports' locally acquired 2023-10-05 20:00:41,436 DEBUG [member: 'jenkins-hbase4.apache.org,44821,1696535998698' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44821,1696535998698' joining acquired barrier for procedure (snaptb0-testConsecutiveExports) in zk 2023-10-05 20:00:41,437 DEBUG [member: 'jenkins-hbase4.apache.org,32861,1696535998642' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-10-05 20:00:41,438 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): master:40857-0x101182c1f970000, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,36369,1696535998737 2023-10-05 20:00:41,438 DEBUG [member: 'jenkins-hbase4.apache.org,36369,1696535998737' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-10-05 20:00:41,438 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,36369,1696535998737 2023-10-05 20:00:41,438 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-05 20:00:41,438 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-05 20:00:41,440 DEBUG [member: 'jenkins-hbase4.apache.org,44821,1696535998698' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-10-05 20:00:41,440 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-05 20:00:41,440 DEBUG [member: 'jenkins-hbase4.apache.org,36369,1696535998737' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36369-0x101182c1f970003, quorum=127.0.0.1:57530, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-10-05 20:00:41,440 DEBUG [member: 'jenkins-hbase4.apache.org,36369,1696535998737' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-05 20:00:41,440 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): master:40857-0x101182c1f970000, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,44821,1696535998698 2023-10-05 20:00:41,440 DEBUG [member: 'jenkins-hbase4.apache.org,32861,1696535998642' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:32861-0x101182c1f970001, quorum=127.0.0.1:57530, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-10-05 20:00:41,440 DEBUG [member: 'jenkins-hbase4.apache.org,32861,1696535998642' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-05 20:00:41,440 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-05 20:00:41,440 DEBUG [member: 'jenkins-hbase4.apache.org,44821,1696535998698' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44821-0x101182c1f970002, quorum=127.0.0.1:57530, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-10-05 20:00:41,440 DEBUG [member: 'jenkins-hbase4.apache.org,44821,1696535998698' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-05 20:00:41,440 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-10-05 20:00:41,440 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32861,1696535998642 2023-10-05 20:00:41,441 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36369,1696535998737 2023-10-05 20:00:41,441 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44821,1696535998698 2023-10-05 20:00:41,441 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-05 20:00:41,442 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,36369,1696535998737' joining acquired barrier for procedure 'snaptb0-testConsecutiveExports' on coordinator 2023-10-05 20:00:41,442 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@548ad169[Count = 1] remaining members to acquire global barrier 2023-10-05 20:00:41,442 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,44821,1696535998698 2023-10-05 20:00:41,442 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-05 20:00:41,442 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-05 20:00:41,442 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-05 20:00:41,442 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-05 20:00:41,443 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-10-05 20:00:41,443 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32861,1696535998642 2023-10-05 20:00:41,443 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36369,1696535998737 2023-10-05 20:00:41,443 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44821,1696535998698 2023-10-05 20:00:41,444 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-05 20:00:41,444 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,44821,1696535998698' joining acquired barrier for procedure 'snaptb0-testConsecutiveExports' on coordinator 2023-10-05 20:00:41,444 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@548ad169[Count = 0] remaining members to acquire global barrier 2023-10-05 20:00:41,444 DEBUG [(jenkins-hbase4.apache.org,40857,1696535997381)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testConsecutiveExports' starting 'in-barrier' execution. 2023-10-05 20:00:41,444 DEBUG [(jenkins-hbase4.apache.org,40857,1696535997381)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-10-05 20:00:41,445 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): regionserver:44821-0x101182c1f970002, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-10-05 20:00:41,445 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): regionserver:36369-0x101182c1f970003, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-10-05 20:00:41,445 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-10-05 20:00:41,445 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-10-05 20:00:41,446 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-10-05 20:00:41,445 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): regionserver:32861-0x101182c1f970001, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-10-05 20:00:41,446 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-10-05 20:00:41,446 DEBUG [(jenkins-hbase4.apache.org,40857,1696535997381)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40857-0x101182c1f970000, quorum=127.0.0.1:57530, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,36369,1696535998737 2023-10-05 20:00:41,446 DEBUG [member: 'jenkins-hbase4.apache.org,44821,1696535998698' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-10-05 20:00:41,446 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-10-05 20:00:41,446 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-10-05 20:00:41,446 DEBUG [member: 'jenkins-hbase4.apache.org,44821,1696535998698' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-05 20:00:41,446 DEBUG [member: 'jenkins-hbase4.apache.org,32861,1696535998642' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-10-05 20:00:41,446 DEBUG [member: 'jenkins-hbase4.apache.org,36369,1696535998737' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-10-05 20:00:41,446 DEBUG [member: 'jenkins-hbase4.apache.org,32861,1696535998642' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testConsecutiveExports' locally completed 2023-10-05 20:00:41,446 DEBUG [member: 'jenkins-hbase4.apache.org,44821,1696535998698' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-05 20:00:41,446 DEBUG [(jenkins-hbase4.apache.org,40857,1696535997381)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40857-0x101182c1f970000, quorum=127.0.0.1:57530, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,44821,1696535998698 2023-10-05 20:00:41,446 DEBUG [(jenkins-hbase4.apache.org,40857,1696535997381)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-05 20:00:41,446 DEBUG [member: 'jenkins-hbase4.apache.org,32861,1696535998642' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,32861,1696535998642' in zk 2023-10-05 20:00:41,446 DEBUG [rs(jenkins-hbase4.apache.org,44821,1696535998698)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,,1696536040379.7dea6e77f4b5fc4af09b824e7b08d75b. 2023-10-05 20:00:41,446 DEBUG [rs(jenkins-hbase4.apache.org,44821,1696535998698)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,,1696536040379.7dea6e77f4b5fc4af09b824e7b08d75b. started... 2023-10-05 20:00:41,447 INFO [rs(jenkins-hbase4.apache.org,44821,1696535998698)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 7dea6e77f4b5fc4af09b824e7b08d75b 1/1 column families, dataSize=65 B heapSize=400 B 2023-10-05 20:00:41,448 DEBUG [member: 'jenkins-hbase4.apache.org,32861,1696535998642' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testConsecutiveExports' has notified controller of completion 2023-10-05 20:00:41,448 DEBUG [member: 'jenkins-hbase4.apache.org,32861,1696535998642' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-05 20:00:41,448 DEBUG [member: 'jenkins-hbase4.apache.org,32861,1696535998642' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testConsecutiveExports' completed. 2023-10-05 20:00:41,450 DEBUG [member: 'jenkins-hbase4.apache.org,36369,1696535998737' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-05 20:00:41,450 DEBUG [rs(jenkins-hbase4.apache.org,36369,1696535998737)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,1,1696536040379.b51e0a70eafb119fb7846b617d12594a. 2023-10-05 20:00:41,450 DEBUG [member: 'jenkins-hbase4.apache.org,36369,1696535998737' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-05 20:00:41,450 DEBUG [rs(jenkins-hbase4.apache.org,36369,1696535998737)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,1,1696536040379.b51e0a70eafb119fb7846b617d12594a. started... 2023-10-05 20:00:41,450 INFO [rs(jenkins-hbase4.apache.org,36369,1696535998737)-snapshot-pool-0] regionserver.HRegion(2745): Flushing b51e0a70eafb119fb7846b617d12594a 1/1 column families, dataSize=3.19 KB heapSize=7.14 KB 2023-10-05 20:00:41,476 INFO [rs(jenkins-hbase4.apache.org,44821,1696535998698)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231005a8ed04879586402aad618cb79069faab to hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e20231005a8ed04879586402aad618cb79069faab 2023-10-05 20:00:41,479 INFO [rs(jenkins-hbase4.apache.org,36369,1696535998737)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20231005cdd98cab89534c9385ef1e9aa26dab9b to hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b20231005cdd98cab89534c9385ef1e9aa26dab9b 2023-10-05 20:00:41,497 INFO [rs(jenkins-hbase4.apache.org,44821,1696535998698)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=65, hasBloomFilter=true, into tmp file hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/data/default/testtb-testConsecutiveExports/7dea6e77f4b5fc4af09b824e7b08d75b/.tmp/cf/9ce2ff967259490ab789d2ad359c2639 2023-10-05 20:00:41,501 INFO [rs(jenkins-hbase4.apache.org,36369,1696535998737)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=3.2 K, hasBloomFilter=true, into tmp file hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/data/default/testtb-testConsecutiveExports/b51e0a70eafb119fb7846b617d12594a/.tmp/cf/079ba6079eb24ad6a3e18d20c37cacf5 2023-10-05 20:00:41,504 DEBUG [rs(jenkins-hbase4.apache.org,44821,1696535998698)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/data/default/testtb-testConsecutiveExports/7dea6e77f4b5fc4af09b824e7b08d75b/.tmp/cf/9ce2ff967259490ab789d2ad359c2639 as hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/data/default/testtb-testConsecutiveExports/7dea6e77f4b5fc4af09b824e7b08d75b/cf/9ce2ff967259490ab789d2ad359c2639 2023-10-05 20:00:41,508 DEBUG [rs(jenkins-hbase4.apache.org,36369,1696535998737)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/data/default/testtb-testConsecutiveExports/b51e0a70eafb119fb7846b617d12594a/.tmp/cf/079ba6079eb24ad6a3e18d20c37cacf5 as hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/data/default/testtb-testConsecutiveExports/b51e0a70eafb119fb7846b617d12594a/cf/079ba6079eb24ad6a3e18d20c37cacf5 2023-10-05 20:00:41,509 INFO [rs(jenkins-hbase4.apache.org,44821,1696535998698)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/data/default/testtb-testConsecutiveExports/7dea6e77f4b5fc4af09b824e7b08d75b/cf/9ce2ff967259490ab789d2ad359c2639, entries=1, sequenceid=6, filesize=5.1 K 2023-10-05 20:00:41,510 DEBUG [Listener at jenkins-hbase4.apache.org/35067] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-05 20:00:41,510 INFO [rs(jenkins-hbase4.apache.org,44821,1696535998698)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~65 B/65, heapSize ~384 B/384, currentSize=0 B/0 for 7dea6e77f4b5fc4af09b824e7b08d75b in 63ms, sequenceid=6, compaction requested=false 2023-10-05 20:00:41,510 DEBUG [rs(jenkins-hbase4.apache.org,44821,1696535998698)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testConsecutiveExports' 2023-10-05 20:00:41,511 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40857] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-10-05 20:00:41,511 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40857] snapshot.SnapshotManager(406): Snapshoting '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' is still in progress! 2023-10-05 20:00:41,511 DEBUG [rs(jenkins-hbase4.apache.org,44821,1696535998698)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 7dea6e77f4b5fc4af09b824e7b08d75b: 2023-10-05 20:00:41,511 DEBUG [rs(jenkins-hbase4.apache.org,44821,1696535998698)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,,1696536040379.7dea6e77f4b5fc4af09b824e7b08d75b.' region-info for snapshot=snaptb0-testConsecutiveExports 2023-10-05 20:00:41,511 DEBUG [Listener at jenkins-hbase4.apache.org/35067] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-10-05 20:00:41,511 DEBUG [rs(jenkins-hbase4.apache.org,44821,1696535998698)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-05 20:00:41,511 DEBUG [rs(jenkins-hbase4.apache.org,44821,1696535998698)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/data/default/testtb-testConsecutiveExports/7dea6e77f4b5fc4af09b824e7b08d75b/cf/9ce2ff967259490ab789d2ad359c2639] hfiles 2023-10-05 20:00:41,511 DEBUG [rs(jenkins-hbase4.apache.org,44821,1696535998698)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/data/default/testtb-testConsecutiveExports/7dea6e77f4b5fc4af09b824e7b08d75b/cf/9ce2ff967259490ab789d2ad359c2639 for snapshot=snaptb0-testConsecutiveExports 2023-10-05 20:00:41,513 INFO [rs(jenkins-hbase4.apache.org,36369,1696535998737)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/data/default/testtb-testConsecutiveExports/b51e0a70eafb119fb7846b617d12594a/cf/079ba6079eb24ad6a3e18d20c37cacf5, entries=49, sequenceid=6, filesize=13.0 K 2023-10-05 20:00:41,514 INFO [rs(jenkins-hbase4.apache.org,36369,1696535998737)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.19 KB/3271, heapSize ~7.13 KB/7296, currentSize=0 B/0 for b51e0a70eafb119fb7846b617d12594a in 64ms, sequenceid=6, compaction requested=false 2023-10-05 20:00:41,516 DEBUG [rs(jenkins-hbase4.apache.org,36369,1696535998737)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for b51e0a70eafb119fb7846b617d12594a: 2023-10-05 20:00:41,516 DEBUG [rs(jenkins-hbase4.apache.org,36369,1696535998737)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,1,1696536040379.b51e0a70eafb119fb7846b617d12594a.' region-info for snapshot=snaptb0-testConsecutiveExports 2023-10-05 20:00:41,516 DEBUG [rs(jenkins-hbase4.apache.org,36369,1696535998737)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-05 20:00:41,516 DEBUG [rs(jenkins-hbase4.apache.org,36369,1696535998737)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/data/default/testtb-testConsecutiveExports/b51e0a70eafb119fb7846b617d12594a/cf/079ba6079eb24ad6a3e18d20c37cacf5] hfiles 2023-10-05 20:00:41,516 DEBUG [rs(jenkins-hbase4.apache.org,36369,1696535998737)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/data/default/testtb-testConsecutiveExports/b51e0a70eafb119fb7846b617d12594a/cf/079ba6079eb24ad6a3e18d20c37cacf5 for snapshot=snaptb0-testConsecutiveExports 2023-10-05 20:00:41,521 DEBUG [rs(jenkins-hbase4.apache.org,44821,1696535998698)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,,1696536040379.7dea6e77f4b5fc4af09b824e7b08d75b. completed. 2023-10-05 20:00:41,521 DEBUG [rs(jenkins-hbase4.apache.org,44821,1696535998698)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,,1696536040379.7dea6e77f4b5fc4af09b824e7b08d75b. 2023-10-05 20:00:41,521 DEBUG [member: 'jenkins-hbase4.apache.org,44821,1696535998698' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-05 20:00:41,521 DEBUG [member: 'jenkins-hbase4.apache.org,44821,1696535998698' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-05 20:00:41,521 DEBUG [member: 'jenkins-hbase4.apache.org,44821,1696535998698' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,44821,1696535998698 2023-10-05 20:00:41,522 DEBUG [member: 'jenkins-hbase4.apache.org,44821,1696535998698' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testConsecutiveExports' locally completed 2023-10-05 20:00:41,522 DEBUG [member: 'jenkins-hbase4.apache.org,44821,1696535998698' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,44821,1696535998698' in zk 2023-10-05 20:00:41,524 DEBUG [member: 'jenkins-hbase4.apache.org,44821,1696535998698' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testConsecutiveExports' has notified controller of completion 2023-10-05 20:00:41,524 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): master:40857-0x101182c1f970000, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,44821,1696535998698 2023-10-05 20:00:41,524 DEBUG [member: 'jenkins-hbase4.apache.org,44821,1696535998698' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-05 20:00:41,524 DEBUG [member: 'jenkins-hbase4.apache.org,44821,1696535998698' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testConsecutiveExports' completed. 2023-10-05 20:00:41,524 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,44821,1696535998698 2023-10-05 20:00:41,526 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-05 20:00:41,526 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-05 20:00:41,526 DEBUG [rs(jenkins-hbase4.apache.org,36369,1696535998737)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,1,1696536040379.b51e0a70eafb119fb7846b617d12594a. completed. 2023-10-05 20:00:41,526 DEBUG [rs(jenkins-hbase4.apache.org,36369,1696535998737)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,1,1696536040379.b51e0a70eafb119fb7846b617d12594a. 2023-10-05 20:00:41,526 DEBUG [member: 'jenkins-hbase4.apache.org,36369,1696535998737' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-05 20:00:41,526 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-05 20:00:41,526 DEBUG [member: 'jenkins-hbase4.apache.org,36369,1696535998737' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-05 20:00:41,526 DEBUG [member: 'jenkins-hbase4.apache.org,36369,1696535998737' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,36369,1696535998737 2023-10-05 20:00:41,526 DEBUG [member: 'jenkins-hbase4.apache.org,36369,1696535998737' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testConsecutiveExports' locally completed 2023-10-05 20:00:41,526 DEBUG [member: 'jenkins-hbase4.apache.org,36369,1696535998737' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,36369,1696535998737' in zk 2023-10-05 20:00:41,526 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-05 20:00:41,527 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-10-05 20:00:41,529 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): master:40857-0x101182c1f970000, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,36369,1696535998737 2023-10-05 20:00:41,529 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32861,1696535998642 2023-10-05 20:00:41,529 DEBUG [member: 'jenkins-hbase4.apache.org,36369,1696535998737' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testConsecutiveExports' has notified controller of completion 2023-10-05 20:00:41,529 DEBUG [member: 'jenkins-hbase4.apache.org,36369,1696535998737' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-05 20:00:41,529 DEBUG [member: 'jenkins-hbase4.apache.org,36369,1696535998737' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testConsecutiveExports' completed. 2023-10-05 20:00:41,530 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36369,1696535998737 2023-10-05 20:00:41,531 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44821,1696535998698 2023-10-05 20:00:41,531 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-05 20:00:41,531 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-10-05 20:00:41,532 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32861,1696535998642 2023-10-05 20:00:41,532 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36369,1696535998737 2023-10-05 20:00:41,532 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44821,1696535998698 2023-10-05 20:00:41,533 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,44821,1696535998698': 2023-10-05 20:00:41,533 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,44821,1696535998698' released barrier for procedure'snaptb0-testConsecutiveExports', counting down latch. Waiting for 1 more 2023-10-05 20:00:41,533 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,36369,1696535998737 2023-10-05 20:00:41,533 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-05 20:00:41,533 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-05 20:00:41,533 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-05 20:00:41,534 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-05 20:00:41,534 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-10-05 20:00:41,534 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32861,1696535998642 2023-10-05 20:00:41,534 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36369,1696535998737 2023-10-05 20:00:41,535 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44821,1696535998698 2023-10-05 20:00:41,535 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-05 20:00:41,535 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-10-05 20:00:41,536 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32861,1696535998642 2023-10-05 20:00:41,536 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36369,1696535998737 2023-10-05 20:00:41,536 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44821,1696535998698 2023-10-05 20:00:41,537 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,36369,1696535998737': 2023-10-05 20:00:41,537 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,36369,1696535998737' released barrier for procedure'snaptb0-testConsecutiveExports', counting down latch. Waiting for 0 more 2023-10-05 20:00:41,537 INFO [(jenkins-hbase4.apache.org,40857,1696535997381)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testConsecutiveExports' execution completed 2023-10-05 20:00:41,537 DEBUG [(jenkins-hbase4.apache.org,40857,1696535997381)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-05 20:00:41,537 DEBUG [(jenkins-hbase4.apache.org,40857,1696535997381)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-05 20:00:41,537 DEBUG [(jenkins-hbase4.apache.org,40857,1696535997381)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testConsecutiveExports 2023-10-05 20:00:41,537 INFO [(jenkins-hbase4.apache.org,40857,1696535997381)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testConsecutiveExportsincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-10-05 20:00:41,539 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): regionserver:44821-0x101182c1f970002, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-10-05 20:00:41,539 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): regionserver:36369-0x101182c1f970003, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-10-05 20:00:41,539 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-10-05 20:00:41,539 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-10-05 20:00:41,539 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-10-05 20:00:41,539 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): regionserver:36369-0x101182c1f970003, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-05 20:00:41,539 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): regionserver:44821-0x101182c1f970002, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-05 20:00:41,539 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): regionserver:32861-0x101182c1f970001, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-10-05 20:00:41,539 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): master:40857-0x101182c1f970000, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-10-05 20:00:41,539 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-10-05 20:00:41,539 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): regionserver:32861-0x101182c1f970001, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-05 20:00:41,540 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-05 20:00:41,539 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-10-05 20:00:41,540 DEBUG [(jenkins-hbase4.apache.org,40857,1696535997381)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40857-0x101182c1f970000, quorum=127.0.0.1:57530, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,32861,1696535998642 2023-10-05 20:00:41,540 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-05 20:00:41,540 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-10-05 20:00:41,540 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-10-05 20:00:41,540 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-05 20:00:41,540 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-05 20:00:41,540 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-05 20:00:41,540 DEBUG [(jenkins-hbase4.apache.org,40857,1696535997381)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40857-0x101182c1f970000, quorum=127.0.0.1:57530, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,36369,1696535998737 2023-10-05 20:00:41,540 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-05 20:00:41,540 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-05 20:00:41,540 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-05 20:00:41,540 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-10-05 20:00:41,541 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-10-05 20:00:41,541 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-05 20:00:41,541 DEBUG [(jenkins-hbase4.apache.org,40857,1696535997381)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40857-0x101182c1f970000, quorum=127.0.0.1:57530, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,44821,1696535998698 2023-10-05 20:00:41,541 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-10-05 20:00:41,541 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-10-05 20:00:41,541 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-05 20:00:41,542 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-10-05 20:00:41,542 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32861,1696535998642 2023-10-05 20:00:41,543 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36369,1696535998737 2023-10-05 20:00:41,543 DEBUG [(jenkins-hbase4.apache.org,40857,1696535997381)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40857-0x101182c1f970000, quorum=127.0.0.1:57530, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,32861,1696535998642 2023-10-05 20:00:41,543 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44821,1696535998698 2023-10-05 20:00:41,543 DEBUG [(jenkins-hbase4.apache.org,40857,1696535997381)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40857-0x101182c1f970000, quorum=127.0.0.1:57530, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,36369,1696535998737 2023-10-05 20:00:41,544 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-05 20:00:41,544 DEBUG [(jenkins-hbase4.apache.org,40857,1696535997381)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40857-0x101182c1f970000, quorum=127.0.0.1:57530, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,44821,1696535998698 2023-10-05 20:00:41,544 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-10-05 20:00:41,544 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32861,1696535998642 2023-10-05 20:00:41,545 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36369,1696535998737 2023-10-05 20:00:41,545 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44821,1696535998698 2023-10-05 20:00:41,550 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): master:40857-0x101182c1f970000, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,44821,1696535998698 2023-10-05 20:00:41,550 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): master:40857-0x101182c1f970000, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-10-05 20:00:41,550 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): master:40857-0x101182c1f970000, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,36369,1696535998737 2023-10-05 20:00:41,550 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): regionserver:36369-0x101182c1f970003, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-05 20:00:41,550 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): regionserver:32861-0x101182c1f970001, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-05 20:00:41,551 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): regionserver:36369-0x101182c1f970003, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-05 20:00:41,551 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): regionserver:44821-0x101182c1f970002, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-05 20:00:41,551 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-05 20:00:41,551 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): master:40857-0x101182c1f970000, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,32861,1696535998642 2023-10-05 20:00:41,551 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): regionserver:32861-0x101182c1f970001, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-05 20:00:41,551 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-05 20:00:41,551 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-05 20:00:41,551 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): master:40857-0x101182c1f970000, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-10-05 20:00:41,551 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-05 20:00:41,551 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-05 20:00:41,551 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-05 20:00:41,551 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): regionserver:44821-0x101182c1f970002, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-05 20:00:41,551 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): master:40857-0x101182c1f970000, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,44821,1696535998698 2023-10-05 20:00:41,551 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): master:40857-0x101182c1f970000, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-10-05 20:00:41,551 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): master:40857-0x101182c1f970000, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,36369,1696535998737 2023-10-05 20:00:41,551 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): master:40857-0x101182c1f970000, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,32861,1696535998642 2023-10-05 20:00:41,551 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): master:40857-0x101182c1f970000, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-10-05 20:00:41,552 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): master:40857-0x101182c1f970000, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-10-05 20:00:41,551 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testConsecutiveExports 2023-10-05 20:00:41,551 DEBUG [(jenkins-hbase4.apache.org,40857,1696535997381)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-05 20:00:41,552 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testConsecutiveExports 2023-10-05 20:00:41,552 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-05 20:00:41,551 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-05 20:00:41,553 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-05 20:00:41,553 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-05 20:00:41,552 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => c7b48a2e62736c517f8bfa7d64fc37ac, NAME => 'testtb-testConsecutiveExports,.mob,0.c7b48a2e62736c517f8bfa7d64fc37ac.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testConsecutiveExports 2023-10-05 20:00:41,552 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-05 20:00:41,554 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-10-05 20:00:41,553 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-05 20:00:41,555 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b20231005cdd98cab89534c9385ef1e9aa26dab9b, hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e20231005a8ed04879586402aad618cb79069faab] mob files 2023-10-05 20:00:41,555 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b20231005cdd98cab89534c9385ef1e9aa26dab9b 2023-10-05 20:00:41,555 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e20231005a8ed04879586402aad618cb79069faab 2023-10-05 20:00:41,563 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testConsecutiveExports 2023-10-05 20:00:41,564 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-10-05 20:00:41,585 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports to hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-10-05 20:00:41,586 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed 2023-10-05 20:00:41,586 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-10-05 20:00:41,586 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-10-05 20:00:41,586 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports at 1696536041408Completed referencing HFiles for the mob region of table: testtb-testConsecutiveExports at 1696536041563 (+155 ms)Consolidate snapshot: snaptb0-testConsecutiveExports at 1696536041563Loading Region manifests for snaptb0-testConsecutiveExports at 1696536041563Writing data manifest for snaptb0-testConsecutiveExports at 1696536041567 (+4 ms)Verifying snapshot: snaptb0-testConsecutiveExports at 1696536041577 (+10 ms)Snapshot snaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed at 1696536041586 (+9 ms) 2023-10-05 20:00:41,589 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=50, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-10-05 20:00:41,591 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=50, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED in 180 msec 2023-10-05 20:00:41,711 DEBUG [Listener at jenkins-hbase4.apache.org/35067] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-05 20:00:41,712 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40857] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-10-05 20:00:41,712 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40857] snapshot.SnapshotManager(403): Snapshot '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' has completed, notifying client. 2023-10-05 20:00:41,713 INFO [Listener at jenkins-hbase4.apache.org/35067] snapshot.TestExportSnapshot(389): Local export destination path: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/190200ca-70b6-4852-ff08-4943c98578e6/local-export-1696536041713 2023-10-05 20:00:41,713 INFO [Listener at jenkins-hbase4.apache.org/35067] snapshot.TestExportSnapshot(255): tgtFsUri=file:///, tgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/190200ca-70b6-4852-ff08-4943c98578e6/local-export-1696536041713, rawTgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/190200ca-70b6-4852-ff08-4943c98578e6/local-export-1696536041713, srcFsUri=hdfs://localhost:45929, srcDir=hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2 2023-10-05 20:00:41,735 DEBUG [Listener at jenkins-hbase4.apache.org/35067] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:45929, inputRoot=hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2 2023-10-05 20:00:41,735 DEBUG [Listener at jenkins-hbase4.apache.org/35067] snapshot.ExportSnapshot(999): outputFs=org.apache.hadoop.fs.LocalFileSystem@62d8c6b, outputRoot=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/190200ca-70b6-4852-ff08-4943c98578e6/local-export-1696536041713, skipTmp=false, initialOutputSnapshotDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/190200ca-70b6-4852-ff08-4943c98578e6/local-export-1696536041713/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-10-05 20:00:41,735 INFO [Listener at jenkins-hbase4.apache.org/35067] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:45929, inputRoot=hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2, snapshotDir=hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/.hbase-snapshot/snaptb0-testConsecutiveExports. 2023-10-05 20:00:41,744 INFO [Listener at jenkins-hbase4.apache.org/35067] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/.hbase-snapshot/snaptb0-testConsecutiveExports to file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/190200ca-70b6-4852-ff08-4943c98578e6/local-export-1696536041713/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-10-05 20:00:41,756 DEBUG [Listener at jenkins-hbase4.apache.org/35067] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-10-05 20:00:41,756 DEBUG [Listener at jenkins-hbase4.apache.org/35067] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-10-05 20:00:41,756 DEBUG [Listener at jenkins-hbase4.apache.org/35067] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-10-05 20:00:41,757 DEBUG [Listener at jenkins-hbase4.apache.org/35067] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-10-05 20:00:42,632 DEBUG [Listener at jenkins-hbase4.apache.org/35067] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/190200ca-70b6-4852-ff08-4943c98578e6/hadoop-5751000882722940180.jar 2023-10-05 20:00:42,633 DEBUG [Listener at jenkins-hbase4.apache.org/35067] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-10-05 20:00:42,633 DEBUG [Listener at jenkins-hbase4.apache.org/35067] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-10-05 20:00:42,700 DEBUG [Listener at jenkins-hbase4.apache.org/35067] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/190200ca-70b6-4852-ff08-4943c98578e6/hadoop-4904755765449714847.jar 2023-10-05 20:00:42,700 DEBUG [Listener at jenkins-hbase4.apache.org/35067] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-10-05 20:00:42,700 DEBUG [Listener at jenkins-hbase4.apache.org/35067] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-10-05 20:00:42,701 DEBUG [Listener at jenkins-hbase4.apache.org/35067] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-10-05 20:00:42,701 DEBUG [Listener at jenkins-hbase4.apache.org/35067] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-10-05 20:00:42,702 DEBUG [Listener at jenkins-hbase4.apache.org/35067] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-10-05 20:00:42,702 DEBUG [Listener at jenkins-hbase4.apache.org/35067] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-10-05 20:00:42,702 DEBUG [Listener at jenkins-hbase4.apache.org/35067] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-10-05 20:00:42,703 DEBUG [Listener at jenkins-hbase4.apache.org/35067] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-10-05 20:00:42,703 DEBUG [Listener at jenkins-hbase4.apache.org/35067] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-10-05 20:00:42,704 DEBUG [Listener at jenkins-hbase4.apache.org/35067] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-10-05 20:00:42,704 DEBUG [Listener at jenkins-hbase4.apache.org/35067] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-10-05 20:00:42,705 DEBUG [Listener at jenkins-hbase4.apache.org/35067] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-10-05 20:00:42,706 DEBUG [Listener at jenkins-hbase4.apache.org/35067] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-10-05 20:00:42,706 DEBUG [Listener at jenkins-hbase4.apache.org/35067] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-10-05 20:00:42,707 DEBUG [Listener at jenkins-hbase4.apache.org/35067] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-10-05 20:00:42,708 DEBUG [Listener at jenkins-hbase4.apache.org/35067] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-10-05 20:00:42,709 DEBUG [Listener at jenkins-hbase4.apache.org/35067] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-05 20:00:42,709 DEBUG [Listener at jenkins-hbase4.apache.org/35067] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-05 20:00:42,710 DEBUG [Listener at jenkins-hbase4.apache.org/35067] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-10-05 20:00:42,710 DEBUG [Listener at jenkins-hbase4.apache.org/35067] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-05 20:00:42,711 DEBUG [Listener at jenkins-hbase4.apache.org/35067] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-05 20:00:42,712 DEBUG [Listener at jenkins-hbase4.apache.org/35067] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-10-05 20:00:42,713 DEBUG [Listener at jenkins-hbase4.apache.org/35067] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-10-05 20:00:43,073 WARN [Listener at jenkins-hbase4.apache.org/35067] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-10-05 20:00:43,075 INFO [Listener at jenkins-hbase4.apache.org/35067] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testConsecutiveExports' hfile list 2023-10-05 20:00:43,077 DEBUG [Listener at jenkins-hbase4.apache.org/35067] snapshot.ExportSnapshot(671): export split=0 size=30.8 K 2023-10-05 20:00:44,794 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-10-05 20:00:44,794 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-10-05 20:00:44,796 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696536006875_0002_000001 (auth:SIMPLE) 2023-10-05 20:00:45,190 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696536006875_0003_000001 (auth:SIMPLE) 2023-10-05 20:00:45,645 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-10-05 20:00:48,833 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696536006875_0003_000001 (auth:SIMPLE) 2023-10-05 20:00:51,053 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696536006875_0003_000001 (auth:SIMPLE) 2023-10-05 20:00:53,347 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696536006875_0003_000001 (auth:SIMPLE) 2023-10-05 20:00:55,236 INFO [Listener at jenkins-hbase4.apache.org/35067] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-10-05 20:00:55,236 INFO [Listener at jenkins-hbase4.apache.org/35067] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-10-05 20:00:55,241 INFO [Listener at jenkins-hbase4.apache.org/35067] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testConsecutiveExports 2023-10-05 20:00:55,241 INFO [Listener at jenkins-hbase4.apache.org/35067] snapshot.TestExportSnapshot(279): Exported snapshot 2023-10-05 20:00:55,242 INFO [Listener at jenkins-hbase4.apache.org/35067] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-10-05 20:00:55,242 DEBUG [Listener at jenkins-hbase4.apache.org/35067] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-2070727397_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/.hbase-snapshot/snaptb0-testConsecutiveExports at hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-10-05 20:00:55,245 DEBUG [Listener at jenkins-hbase4.apache.org/35067] snapshot.TestExportSnapshot(367): hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-10-05 20:00:55,245 DEBUG [Listener at jenkins-hbase4.apache.org/35067] snapshot.TestExportSnapshot(367): hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-10-05 20:00:55,245 DEBUG [Listener at jenkins-hbase4.apache.org/35067] snapshot.TestExportSnapshot(362): List files in org.apache.hadoop.fs.LocalFileSystem@dc3c953 in root file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/190200ca-70b6-4852-ff08-4943c98578e6/local-export-1696536041713/.hbase-snapshot/snaptb0-testConsecutiveExports at file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/190200ca-70b6-4852-ff08-4943c98578e6/local-export-1696536041713/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-10-05 20:00:55,245 DEBUG [Listener at jenkins-hbase4.apache.org/35067] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/190200ca-70b6-4852-ff08-4943c98578e6/local-export-1696536041713/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-10-05 20:00:55,245 DEBUG [Listener at jenkins-hbase4.apache.org/35067] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/190200ca-70b6-4852-ff08-4943c98578e6/local-export-1696536041713/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-10-05 20:00:55,246 INFO [Listener at jenkins-hbase4.apache.org/35067] snapshot.TestExportSnapshot(255): tgtFsUri=file:///, tgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/190200ca-70b6-4852-ff08-4943c98578e6/local-export-1696536041713, rawTgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/190200ca-70b6-4852-ff08-4943c98578e6/local-export-1696536041713, srcFsUri=hdfs://localhost:45929, srcDir=hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2 2023-10-05 20:00:55,268 DEBUG [Listener at jenkins-hbase4.apache.org/35067] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:45929, inputRoot=hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2 2023-10-05 20:00:55,268 DEBUG [Listener at jenkins-hbase4.apache.org/35067] snapshot.ExportSnapshot(999): outputFs=org.apache.hadoop.fs.LocalFileSystem@73115f4b, outputRoot=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/190200ca-70b6-4852-ff08-4943c98578e6/local-export-1696536041713, skipTmp=false, initialOutputSnapshotDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/190200ca-70b6-4852-ff08-4943c98578e6/local-export-1696536041713/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-10-05 20:00:55,268 INFO [Listener at jenkins-hbase4.apache.org/35067] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:45929, inputRoot=hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2, snapshotDir=hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/.hbase-snapshot/snaptb0-testConsecutiveExports. 2023-10-05 20:00:55,279 INFO [Listener at jenkins-hbase4.apache.org/35067] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/.hbase-snapshot/snaptb0-testConsecutiveExports to file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/190200ca-70b6-4852-ff08-4943c98578e6/local-export-1696536041713/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-10-05 20:00:55,290 DEBUG [Listener at jenkins-hbase4.apache.org/35067] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-10-05 20:00:55,291 DEBUG [Listener at jenkins-hbase4.apache.org/35067] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-10-05 20:00:55,291 DEBUG [Listener at jenkins-hbase4.apache.org/35067] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-10-05 20:00:55,292 DEBUG [Listener at jenkins-hbase4.apache.org/35067] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-10-05 20:00:56,167 DEBUG [Listener at jenkins-hbase4.apache.org/35067] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/190200ca-70b6-4852-ff08-4943c98578e6/hadoop-2157272853625011710.jar 2023-10-05 20:00:56,168 DEBUG [Listener at jenkins-hbase4.apache.org/35067] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-10-05 20:00:56,168 DEBUG [Listener at jenkins-hbase4.apache.org/35067] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-10-05 20:00:56,235 DEBUG [Listener at jenkins-hbase4.apache.org/35067] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/190200ca-70b6-4852-ff08-4943c98578e6/hadoop-3399797802216073677.jar 2023-10-05 20:00:56,236 DEBUG [Listener at jenkins-hbase4.apache.org/35067] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-10-05 20:00:56,236 DEBUG [Listener at jenkins-hbase4.apache.org/35067] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-10-05 20:00:56,237 DEBUG [Listener at jenkins-hbase4.apache.org/35067] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-10-05 20:00:56,238 DEBUG [Listener at jenkins-hbase4.apache.org/35067] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-10-05 20:00:56,238 DEBUG [Listener at jenkins-hbase4.apache.org/35067] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-10-05 20:00:56,239 DEBUG [Listener at jenkins-hbase4.apache.org/35067] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-10-05 20:00:56,239 DEBUG [Listener at jenkins-hbase4.apache.org/35067] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-10-05 20:00:56,240 DEBUG [Listener at jenkins-hbase4.apache.org/35067] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-10-05 20:00:56,240 DEBUG [Listener at jenkins-hbase4.apache.org/35067] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-10-05 20:00:56,241 DEBUG [Listener at jenkins-hbase4.apache.org/35067] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-10-05 20:00:56,241 DEBUG [Listener at jenkins-hbase4.apache.org/35067] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-10-05 20:00:56,242 DEBUG [Listener at jenkins-hbase4.apache.org/35067] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-10-05 20:00:56,242 DEBUG [Listener at jenkins-hbase4.apache.org/35067] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-10-05 20:00:56,242 DEBUG [Listener at jenkins-hbase4.apache.org/35067] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-10-05 20:00:56,243 DEBUG [Listener at jenkins-hbase4.apache.org/35067] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-10-05 20:00:56,243 DEBUG [Listener at jenkins-hbase4.apache.org/35067] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-10-05 20:00:56,244 DEBUG [Listener at jenkins-hbase4.apache.org/35067] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-05 20:00:56,244 DEBUG [Listener at jenkins-hbase4.apache.org/35067] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-05 20:00:56,245 DEBUG [Listener at jenkins-hbase4.apache.org/35067] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-10-05 20:00:56,245 DEBUG [Listener at jenkins-hbase4.apache.org/35067] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-05 20:00:56,245 DEBUG [Listener at jenkins-hbase4.apache.org/35067] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-05 20:00:56,246 DEBUG [Listener at jenkins-hbase4.apache.org/35067] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-10-05 20:00:56,246 DEBUG [Listener at jenkins-hbase4.apache.org/35067] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-10-05 20:00:56,642 WARN [Listener at jenkins-hbase4.apache.org/35067] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-10-05 20:00:56,645 INFO [Listener at jenkins-hbase4.apache.org/35067] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testConsecutiveExports' hfile list 2023-10-05 20:00:56,647 DEBUG [Listener at jenkins-hbase4.apache.org/35067] snapshot.ExportSnapshot(671): export split=0 size=30.8 K 2023-10-05 20:00:59,529 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-10-05 20:00:59,529 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-10-05 20:00:59,531 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696536006875_0003_000001 (auth:SIMPLE) 2023-10-05 20:00:59,805 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696536006875_0004_000001 (auth:SIMPLE) 2023-10-05 20:01:03,547 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696536006875_0004_000001 (auth:SIMPLE) 2023-10-05 20:01:05,753 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696536006875_0004_000001 (auth:SIMPLE) 2023-10-05 20:01:07,924 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696536006875_0004_000001 (auth:SIMPLE) 2023-10-05 20:01:09,809 INFO [Listener at jenkins-hbase4.apache.org/35067] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-10-05 20:01:09,809 INFO [Listener at jenkins-hbase4.apache.org/35067] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-10-05 20:01:09,813 INFO [Listener at jenkins-hbase4.apache.org/35067] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testConsecutiveExports 2023-10-05 20:01:09,813 INFO [Listener at jenkins-hbase4.apache.org/35067] snapshot.TestExportSnapshot(279): Exported snapshot 2023-10-05 20:01:09,813 INFO [Listener at jenkins-hbase4.apache.org/35067] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-10-05 20:01:09,813 DEBUG [Listener at jenkins-hbase4.apache.org/35067] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-2070727397_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/.hbase-snapshot/snaptb0-testConsecutiveExports at hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-10-05 20:01:09,817 DEBUG [Listener at jenkins-hbase4.apache.org/35067] snapshot.TestExportSnapshot(367): hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-10-05 20:01:09,817 DEBUG [Listener at jenkins-hbase4.apache.org/35067] snapshot.TestExportSnapshot(367): hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-10-05 20:01:09,817 DEBUG [Listener at jenkins-hbase4.apache.org/35067] snapshot.TestExportSnapshot(362): List files in org.apache.hadoop.fs.LocalFileSystem@dc3c953 in root file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/190200ca-70b6-4852-ff08-4943c98578e6/local-export-1696536041713/.hbase-snapshot/snaptb0-testConsecutiveExports at file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/190200ca-70b6-4852-ff08-4943c98578e6/local-export-1696536041713/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-10-05 20:01:09,817 DEBUG [Listener at jenkins-hbase4.apache.org/35067] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/190200ca-70b6-4852-ff08-4943c98578e6/local-export-1696536041713/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-10-05 20:01:09,817 DEBUG [Listener at jenkins-hbase4.apache.org/35067] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/190200ca-70b6-4852-ff08-4943c98578e6/local-export-1696536041713/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-10-05 20:01:09,830 INFO [Listener at jenkins-hbase4.apache.org/35067] client.HBaseAdmin$15(890): Started disable of testtb-testConsecutiveExports 2023-10-05 20:01:09,830 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40857] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testConsecutiveExports 2023-10-05 20:01:09,831 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40857] procedure2.ProcedureExecutor(1028): Stored pid=51, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testConsecutiveExports 2023-10-05 20:01:09,834 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40857] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-10-05 20:01:09,835 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696536069835"}]},"ts":"1696536069835"} 2023-10-05 20:01:09,837 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=DISABLING in hbase:meta 2023-10-05 20:01:09,839 INFO [PEWorker-2] procedure.DisableTableProcedure(293): Set testtb-testConsecutiveExports to state=DISABLING 2023-10-05 20:01:09,839 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=52, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=7dea6e77f4b5fc4af09b824e7b08d75b, UNASSIGN}, {pid=53, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=b51e0a70eafb119fb7846b617d12594a, UNASSIGN}] 2023-10-05 20:01:09,841 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=52, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=7dea6e77f4b5fc4af09b824e7b08d75b, UNASSIGN 2023-10-05 20:01:09,841 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=53, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=b51e0a70eafb119fb7846b617d12594a, UNASSIGN 2023-10-05 20:01:09,842 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=52 updating hbase:meta row=7dea6e77f4b5fc4af09b824e7b08d75b, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,44821,1696535998698 2023-10-05 20:01:09,842 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=53 updating hbase:meta row=b51e0a70eafb119fb7846b617d12594a, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,36369,1696535998737 2023-10-05 20:01:09,842 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,,1696536040379.7dea6e77f4b5fc4af09b824e7b08d75b.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1696536069842"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696536069842"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696536069842"}]},"ts":"1696536069842"} 2023-10-05 20:01:09,842 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,1,1696536040379.b51e0a70eafb119fb7846b617d12594a.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1696536069842"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696536069842"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696536069842"}]},"ts":"1696536069842"} 2023-10-05 20:01:09,844 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=54, ppid=52, state=RUNNABLE; CloseRegionProcedure 7dea6e77f4b5fc4af09b824e7b08d75b, server=jenkins-hbase4.apache.org,44821,1696535998698}] 2023-10-05 20:01:09,844 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=55, ppid=53, state=RUNNABLE; CloseRegionProcedure b51e0a70eafb119fb7846b617d12594a, server=jenkins-hbase4.apache.org,36369,1696535998737}] 2023-10-05 20:01:09,936 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40857] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-10-05 20:01:09,996 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 7dea6e77f4b5fc4af09b824e7b08d75b 2023-10-05 20:01:09,996 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 7dea6e77f4b5fc4af09b824e7b08d75b, disabling compactions & flushes 2023-10-05 20:01:09,996 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,,1696536040379.7dea6e77f4b5fc4af09b824e7b08d75b. 2023-10-05 20:01:09,996 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,,1696536040379.7dea6e77f4b5fc4af09b824e7b08d75b. 2023-10-05 20:01:09,996 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,,1696536040379.7dea6e77f4b5fc4af09b824e7b08d75b. after waiting 0 ms 2023-10-05 20:01:09,996 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,,1696536040379.7dea6e77f4b5fc4af09b824e7b08d75b. 2023-10-05 20:01:09,998 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close b51e0a70eafb119fb7846b617d12594a 2023-10-05 20:01:10,000 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing b51e0a70eafb119fb7846b617d12594a, disabling compactions & flushes 2023-10-05 20:01:10,000 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,1,1696536040379.b51e0a70eafb119fb7846b617d12594a. 2023-10-05 20:01:10,000 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,1,1696536040379.b51e0a70eafb119fb7846b617d12594a. 2023-10-05 20:01:10,000 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,1,1696536040379.b51e0a70eafb119fb7846b617d12594a. after waiting 0 ms 2023-10-05 20:01:10,000 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,1,1696536040379.b51e0a70eafb119fb7846b617d12594a. 2023-10-05 20:01:10,011 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/data/default/testtb-testConsecutiveExports/7dea6e77f4b5fc4af09b824e7b08d75b/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-10-05 20:01:10,012 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/data/default/testtb-testConsecutiveExports/b51e0a70eafb119fb7846b617d12594a/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-10-05 20:01:10,012 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-10-05 20:01:10,013 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,,1696536040379.7dea6e77f4b5fc4af09b824e7b08d75b. 2023-10-05 20:01:10,013 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 7dea6e77f4b5fc4af09b824e7b08d75b: 2023-10-05 20:01:10,014 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-10-05 20:01:10,015 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,1,1696536040379.b51e0a70eafb119fb7846b617d12594a. 2023-10-05 20:01:10,015 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for b51e0a70eafb119fb7846b617d12594a: 2023-10-05 20:01:10,016 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 7dea6e77f4b5fc4af09b824e7b08d75b 2023-10-05 20:01:10,016 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=52 updating hbase:meta row=7dea6e77f4b5fc4af09b824e7b08d75b, regionState=CLOSED 2023-10-05 20:01:10,016 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,,1696536040379.7dea6e77f4b5fc4af09b824e7b08d75b.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1696536070016"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696536070016"}]},"ts":"1696536070016"} 2023-10-05 20:01:10,017 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed b51e0a70eafb119fb7846b617d12594a 2023-10-05 20:01:10,017 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=53 updating hbase:meta row=b51e0a70eafb119fb7846b617d12594a, regionState=CLOSED 2023-10-05 20:01:10,017 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,1,1696536040379.b51e0a70eafb119fb7846b617d12594a.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1696536070017"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696536070017"}]},"ts":"1696536070017"} 2023-10-05 20:01:10,019 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=54, resume processing ppid=52 2023-10-05 20:01:10,019 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=54, ppid=52, state=SUCCESS; CloseRegionProcedure 7dea6e77f4b5fc4af09b824e7b08d75b, server=jenkins-hbase4.apache.org,44821,1696535998698 in 174 msec 2023-10-05 20:01:10,020 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=55, resume processing ppid=53 2023-10-05 20:01:10,020 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=55, ppid=53, state=SUCCESS; CloseRegionProcedure b51e0a70eafb119fb7846b617d12594a, server=jenkins-hbase4.apache.org,36369,1696535998737 in 175 msec 2023-10-05 20:01:10,021 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=52, ppid=51, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=7dea6e77f4b5fc4af09b824e7b08d75b, UNASSIGN in 180 msec 2023-10-05 20:01:10,022 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=53, resume processing ppid=51 2023-10-05 20:01:10,022 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=53, ppid=51, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=b51e0a70eafb119fb7846b617d12594a, UNASSIGN in 181 msec 2023-10-05 20:01:10,023 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696536070023"}]},"ts":"1696536070023"} 2023-10-05 20:01:10,024 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=DISABLED in hbase:meta 2023-10-05 20:01:10,026 INFO [PEWorker-1] procedure.DisableTableProcedure(305): Set testtb-testConsecutiveExports to state=DISABLED 2023-10-05 20:01:10,027 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=51, state=SUCCESS; DisableTableProcedure table=testtb-testConsecutiveExports in 195 msec 2023-10-05 20:01:10,137 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40857] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-10-05 20:01:10,137 INFO [Listener at jenkins-hbase4.apache.org/35067] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testConsecutiveExports, procId: 51 completed 2023-10-05 20:01:10,138 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40857] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testConsecutiveExports 2023-10-05 20:01:10,139 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40857] procedure2.ProcedureExecutor(1028): Stored pid=56, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-10-05 20:01:10,141 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=56, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-10-05 20:01:10,141 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40857] access.PermissionStorage(259): Removing permissions of removed table testtb-testConsecutiveExports 2023-10-05 20:01:10,142 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=56, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-10-05 20:01:10,144 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=32861] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testConsecutiveExports 2023-10-05 20:01:10,148 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): master:40857-0x101182c1f970000, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-10-05 20:01:10,148 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): regionserver:36369-0x101182c1f970003, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-10-05 20:01:10,148 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): regionserver:44821-0x101182c1f970002, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-10-05 20:01:10,148 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): regionserver:32861-0x101182c1f970001, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-10-05 20:01:10,149 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-10-05 20:01:10,149 DEBUG [HFileArchiver-14] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/.tmp/data/default/testtb-testConsecutiveExports/b51e0a70eafb119fb7846b617d12594a 2023-10-05 20:01:10,149 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-10-05 20:01:10,149 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/.tmp/data/default/testtb-testConsecutiveExports/7dea6e77f4b5fc4af09b824e7b08d75b 2023-10-05 20:01:10,150 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): regionserver:36369-0x101182c1f970003, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-10-05 20:01:10,150 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): regionserver:32861-0x101182c1f970001, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-05 20:01:10,150 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data null 2023-10-05 20:01:10,150 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-10-05 20:01:10,150 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): master:40857-0x101182c1f970000, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-10-05 20:01:10,150 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data null 2023-10-05 20:01:10,150 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-10-05 20:01:10,150 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): regionserver:36369-0x101182c1f970003, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-05 20:01:10,150 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): master:40857-0x101182c1f970000, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-05 20:01:10,150 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): regionserver:44821-0x101182c1f970002, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-05 20:01:10,151 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40857] master.MasterRpcServices(1230): Checking to see if procedure is done pid=56 2023-10-05 20:01:10,152 DEBUG [HFileArchiver-14] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/.tmp/data/default/testtb-testConsecutiveExports/b51e0a70eafb119fb7846b617d12594a/cf, FileablePath, hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/.tmp/data/default/testtb-testConsecutiveExports/b51e0a70eafb119fb7846b617d12594a/recovered.edits] 2023-10-05 20:01:10,152 DEBUG [HFileArchiver-13] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/.tmp/data/default/testtb-testConsecutiveExports/7dea6e77f4b5fc4af09b824e7b08d75b/cf, FileablePath, hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/.tmp/data/default/testtb-testConsecutiveExports/7dea6e77f4b5fc4af09b824e7b08d75b/recovered.edits] 2023-10-05 20:01:10,157 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/.tmp/data/default/testtb-testConsecutiveExports/b51e0a70eafb119fb7846b617d12594a/cf/079ba6079eb24ad6a3e18d20c37cacf5 to hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/archive/data/default/testtb-testConsecutiveExports/b51e0a70eafb119fb7846b617d12594a/cf/079ba6079eb24ad6a3e18d20c37cacf5 2023-10-05 20:01:10,157 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/.tmp/data/default/testtb-testConsecutiveExports/7dea6e77f4b5fc4af09b824e7b08d75b/cf/9ce2ff967259490ab789d2ad359c2639 to hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/archive/data/default/testtb-testConsecutiveExports/7dea6e77f4b5fc4af09b824e7b08d75b/cf/9ce2ff967259490ab789d2ad359c2639 2023-10-05 20:01:10,163 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/.tmp/data/default/testtb-testConsecutiveExports/b51e0a70eafb119fb7846b617d12594a/recovered.edits/9.seqid to hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/archive/data/default/testtb-testConsecutiveExports/b51e0a70eafb119fb7846b617d12594a/recovered.edits/9.seqid 2023-10-05 20:01:10,164 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/.tmp/data/default/testtb-testConsecutiveExports/7dea6e77f4b5fc4af09b824e7b08d75b/recovered.edits/9.seqid to hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/archive/data/default/testtb-testConsecutiveExports/7dea6e77f4b5fc4af09b824e7b08d75b/recovered.edits/9.seqid 2023-10-05 20:01:10,164 DEBUG [HFileArchiver-14] backup.HFileArchiver(596): Deleted hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/.tmp/data/default/testtb-testConsecutiveExports/b51e0a70eafb119fb7846b617d12594a 2023-10-05 20:01:10,164 DEBUG [HFileArchiver-13] backup.HFileArchiver(596): Deleted hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/.tmp/data/default/testtb-testConsecutiveExports/7dea6e77f4b5fc4af09b824e7b08d75b 2023-10-05 20:01:10,164 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testtb-testConsecutiveExports regions 2023-10-05 20:01:10,165 DEBUG [PEWorker-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac 2023-10-05 20:01:10,166 DEBUG [PEWorker-3] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf] 2023-10-05 20:01:10,169 DEBUG [PEWorker-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b20231005cdd98cab89534c9385ef1e9aa26dab9b to hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/archive/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b20231005cdd98cab89534c9385ef1e9aa26dab9b 2023-10-05 20:01:10,171 DEBUG [PEWorker-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e20231005a8ed04879586402aad618cb79069faab to hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/archive/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e20231005a8ed04879586402aad618cb79069faab 2023-10-05 20:01:10,171 DEBUG [PEWorker-3] backup.HFileArchiver(596): Deleted hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac 2023-10-05 20:01:10,173 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=56, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-10-05 20:01:10,176 WARN [PEWorker-3] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testConsecutiveExports from hbase:meta 2023-10-05 20:01:10,178 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(421): Removing 'testtb-testConsecutiveExports' descriptor. 2023-10-05 20:01:10,179 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=56, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-10-05 20:01:10,179 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(411): Removing 'testtb-testConsecutiveExports' from region states. 2023-10-05 20:01:10,179 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testConsecutiveExports,,1696536040379.7dea6e77f4b5fc4af09b824e7b08d75b.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1696536070179"}]},"ts":"9223372036854775807"} 2023-10-05 20:01:10,179 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testConsecutiveExports,1,1696536040379.b51e0a70eafb119fb7846b617d12594a.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1696536070179"}]},"ts":"9223372036854775807"} 2023-10-05 20:01:10,181 INFO [PEWorker-3] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-10-05 20:01:10,181 DEBUG [PEWorker-3] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 7dea6e77f4b5fc4af09b824e7b08d75b, NAME => 'testtb-testConsecutiveExports,,1696536040379.7dea6e77f4b5fc4af09b824e7b08d75b.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => b51e0a70eafb119fb7846b617d12594a, NAME => 'testtb-testConsecutiveExports,1,1696536040379.b51e0a70eafb119fb7846b617d12594a.', STARTKEY => '1', ENDKEY => ''}] 2023-10-05 20:01:10,181 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(415): Marking 'testtb-testConsecutiveExports' as deleted. 2023-10-05 20:01:10,181 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1696536070181"}]},"ts":"9223372036854775807"} 2023-10-05 20:01:10,183 INFO [PEWorker-3] hbase.MetaTableAccessor(1658): Deleted table testtb-testConsecutiveExports state from META 2023-10-05 20:01:10,185 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(130): Finished pid=56, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-10-05 20:01:10,186 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=56, state=SUCCESS; DeleteTableProcedure table=testtb-testConsecutiveExports in 47 msec 2023-10-05 20:01:10,252 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40857] master.MasterRpcServices(1230): Checking to see if procedure is done pid=56 2023-10-05 20:01:10,253 INFO [Listener at jenkins-hbase4.apache.org/35067] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testConsecutiveExports, procId: 56 completed 2023-10-05 20:01:10,260 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40857] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testConsecutiveExports" 2023-10-05 20:01:10,261 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40857] snapshot.SnapshotManager(335): Deleting snapshot: emptySnaptb0-testConsecutiveExports 2023-10-05 20:01:10,263 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40857] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testConsecutiveExports" 2023-10-05 20:01:10,265 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40857] snapshot.SnapshotManager(335): Deleting snapshot: snaptb0-testConsecutiveExports 2023-10-05 20:01:10,288 INFO [Listener at jenkins-hbase4.apache.org/35067] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testConsecutiveExports Thread=748 (was 766), OpenFileDescriptor=905 (was 932), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=218 (was 273), ProcessCount=168 (was 168), AvailableMemoryMB=5980 (was 6089) 2023-10-05 20:01:10,288 WARN [Listener at jenkins-hbase4.apache.org/35067] hbase.ResourceChecker(130): Thread=748 is superior to 500 2023-10-05 20:01:10,307 INFO [Listener at jenkins-hbase4.apache.org/35067] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testExportFileSystemStateWithMergeRegion Thread=748, OpenFileDescriptor=905, MaxFileDescriptor=60000, SystemLoadAverage=218, ProcessCount=168, AvailableMemoryMB=5979 2023-10-05 20:01:10,307 WARN [Listener at jenkins-hbase4.apache.org/35067] hbase.ResourceChecker(130): Thread=748 is superior to 500 2023-10-05 20:01:10,309 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40857] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemStateWithMergeRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-10-05 20:01:10,310 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40857] procedure2.ProcedureExecutor(1028): Stored pid=57, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-10-05 20:01:10,312 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_PRE_OPERATION 2023-10-05 20:01:10,312 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40857] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemStateWithMergeRegion" procId is: 57 2023-10-05 20:01:10,313 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-10-05 20:01:10,313 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40857] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-10-05 20:01:10,315 DEBUG [HFileArchiver-15] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/31d859f310183233a5ec880dbf54d8b9 2023-10-05 20:01:10,315 DEBUG [HFileArchiver-16] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/d321f1710d50c228c088de7ff0d8ca4c 2023-10-05 20:01:10,316 DEBUG [HFileArchiver-15] backup.HFileArchiver(153): Directory hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/31d859f310183233a5ec880dbf54d8b9 empty. 2023-10-05 20:01:10,316 DEBUG [HFileArchiver-16] backup.HFileArchiver(153): Directory hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/d321f1710d50c228c088de7ff0d8ca4c empty. 2023-10-05 20:01:10,316 DEBUG [HFileArchiver-15] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/31d859f310183233a5ec880dbf54d8b9 2023-10-05 20:01:10,316 DEBUG [HFileArchiver-16] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/d321f1710d50c228c088de7ff0d8ca4c 2023-10-05 20:01:10,317 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion regions 2023-10-05 20:01:10,327 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/.tabledesc/.tableinfo.0000000001 2023-10-05 20:01:10,328 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(7675): creating {ENCODED => 31d859f310183233a5ec880dbf54d8b9, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,,1696536070308.31d859f310183233a5ec880dbf54d8b9.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/.tmp 2023-10-05 20:01:10,333 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(7675): creating {ENCODED => d321f1710d50c228c088de7ff0d8ca4c, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,1,1696536070308.d321f1710d50c228c088de7ff0d8ca4c.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/.tmp 2023-10-05 20:01:10,349 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,,1696536070308.31d859f310183233a5ec880dbf54d8b9.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-05 20:01:10,350 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,1,1696536070308.d321f1710d50c228c088de7ff0d8ca4c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-05 20:01:10,350 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1604): Closing 31d859f310183233a5ec880dbf54d8b9, disabling compactions & flushes 2023-10-05 20:01:10,350 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1604): Closing d321f1710d50c228c088de7ff0d8ca4c, disabling compactions & flushes 2023-10-05 20:01:10,350 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,,1696536070308.31d859f310183233a5ec880dbf54d8b9. 2023-10-05 20:01:10,350 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,1,1696536070308.d321f1710d50c228c088de7ff0d8ca4c. 2023-10-05 20:01:10,350 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,,1696536070308.31d859f310183233a5ec880dbf54d8b9. 2023-10-05 20:01:10,350 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1696536070308.d321f1710d50c228c088de7ff0d8ca4c. 2023-10-05 20:01:10,350 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,,1696536070308.31d859f310183233a5ec880dbf54d8b9. after waiting 0 ms 2023-10-05 20:01:10,350 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,,1696536070308.31d859f310183233a5ec880dbf54d8b9. 2023-10-05 20:01:10,350 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1696536070308.d321f1710d50c228c088de7ff0d8ca4c. after waiting 0 ms 2023-10-05 20:01:10,350 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,,1696536070308.31d859f310183233a5ec880dbf54d8b9. 2023-10-05 20:01:10,350 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,1,1696536070308.d321f1710d50c228c088de7ff0d8ca4c. 2023-10-05 20:01:10,350 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1558): Region close journal for 31d859f310183233a5ec880dbf54d8b9: 2023-10-05 20:01:10,350 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,1,1696536070308.d321f1710d50c228c088de7ff0d8ca4c. 2023-10-05 20:01:10,350 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1558): Region close journal for d321f1710d50c228c088de7ff0d8ca4c: 2023-10-05 20:01:10,353 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_ADD_TO_META 2023-10-05 20:01:10,354 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1696536070308.31d859f310183233a5ec880dbf54d8b9.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1696536070354"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696536070354"}]},"ts":"1696536070354"} 2023-10-05 20:01:10,354 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1696536070308.d321f1710d50c228c088de7ff0d8ca4c.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1696536070354"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696536070354"}]},"ts":"1696536070354"} 2023-10-05 20:01:10,361 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-10-05 20:01:10,362 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-10-05 20:01:10,362 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696536070362"}]},"ts":"1696536070362"} 2023-10-05 20:01:10,363 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=ENABLING in hbase:meta 2023-10-05 20:01:10,366 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-10-05 20:01:10,367 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-10-05 20:01:10,368 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-10-05 20:01:10,368 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-10-05 20:01:10,368 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-10-05 20:01:10,368 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=58, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=31d859f310183233a5ec880dbf54d8b9, ASSIGN}, {pid=59, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=d321f1710d50c228c088de7ff0d8ca4c, ASSIGN}] 2023-10-05 20:01:10,370 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=59, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=d321f1710d50c228c088de7ff0d8ca4c, ASSIGN 2023-10-05 20:01:10,370 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=58, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=31d859f310183233a5ec880dbf54d8b9, ASSIGN 2023-10-05 20:01:10,371 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=59, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=d321f1710d50c228c088de7ff0d8ca4c, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,36369,1696535998737; forceNewPlan=false, retain=false 2023-10-05 20:01:10,371 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=58, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=31d859f310183233a5ec880dbf54d8b9, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,32861,1696535998642; forceNewPlan=false, retain=false 2023-10-05 20:01:10,414 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40857] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-10-05 20:01:10,521 INFO [jenkins-hbase4:40857] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-10-05 20:01:10,523 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=58 updating hbase:meta row=31d859f310183233a5ec880dbf54d8b9, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,32861,1696535998642 2023-10-05 20:01:10,523 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=59 updating hbase:meta row=d321f1710d50c228c088de7ff0d8ca4c, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,36369,1696535998737 2023-10-05 20:01:10,524 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1696536070308.31d859f310183233a5ec880dbf54d8b9.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1696536070523"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696536070523"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696536070523"}]},"ts":"1696536070523"} 2023-10-05 20:01:10,524 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1696536070308.d321f1710d50c228c088de7ff0d8ca4c.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1696536070523"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696536070523"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696536070523"}]},"ts":"1696536070523"} 2023-10-05 20:01:10,525 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=60, ppid=58, state=RUNNABLE; OpenRegionProcedure 31d859f310183233a5ec880dbf54d8b9, server=jenkins-hbase4.apache.org,32861,1696535998642}] 2023-10-05 20:01:10,526 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=61, ppid=59, state=RUNNABLE; OpenRegionProcedure d321f1710d50c228c088de7ff0d8ca4c, server=jenkins-hbase4.apache.org,36369,1696535998737}] 2023-10-05 20:01:10,615 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40857] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-10-05 20:01:10,683 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion,,1696536070308.31d859f310183233a5ec880dbf54d8b9. 2023-10-05 20:01:10,683 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion,1,1696536070308.d321f1710d50c228c088de7ff0d8ca4c. 2023-10-05 20:01:10,684 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 31d859f310183233a5ec880dbf54d8b9, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,,1696536070308.31d859f310183233a5ec880dbf54d8b9.', STARTKEY => '', ENDKEY => '1'} 2023-10-05 20:01:10,684 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => d321f1710d50c228c088de7ff0d8ca4c, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,1,1696536070308.d321f1710d50c228c088de7ff0d8ca4c.', STARTKEY => '1', ENDKEY => ''} 2023-10-05 20:01:10,684 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion,1,1696536070308.d321f1710d50c228c088de7ff0d8ca4c. service=AccessControlService 2023-10-05 20:01:10,684 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion,,1696536070308.31d859f310183233a5ec880dbf54d8b9. service=AccessControlService 2023-10-05 20:01:10,684 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-10-05 20:01:10,684 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion d321f1710d50c228c088de7ff0d8ca4c 2023-10-05 20:01:10,684 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-10-05 20:01:10,684 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,1,1696536070308.d321f1710d50c228c088de7ff0d8ca4c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-05 20:01:10,684 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for d321f1710d50c228c088de7ff0d8ca4c 2023-10-05 20:01:10,684 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion 31d859f310183233a5ec880dbf54d8b9 2023-10-05 20:01:10,684 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for d321f1710d50c228c088de7ff0d8ca4c 2023-10-05 20:01:10,685 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,,1696536070308.31d859f310183233a5ec880dbf54d8b9.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-05 20:01:10,685 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 31d859f310183233a5ec880dbf54d8b9 2023-10-05 20:01:10,685 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 31d859f310183233a5ec880dbf54d8b9 2023-10-05 20:01:10,686 INFO [StoreOpener-d321f1710d50c228c088de7ff0d8ca4c-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region d321f1710d50c228c088de7ff0d8ca4c 2023-10-05 20:01:10,686 INFO [StoreOpener-31d859f310183233a5ec880dbf54d8b9-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 31d859f310183233a5ec880dbf54d8b9 2023-10-05 20:01:10,687 DEBUG [StoreOpener-d321f1710d50c228c088de7ff0d8ca4c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/data/default/testtb-testExportFileSystemStateWithMergeRegion/d321f1710d50c228c088de7ff0d8ca4c/cf 2023-10-05 20:01:10,687 DEBUG [StoreOpener-d321f1710d50c228c088de7ff0d8ca4c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/data/default/testtb-testExportFileSystemStateWithMergeRegion/d321f1710d50c228c088de7ff0d8ca4c/cf 2023-10-05 20:01:10,687 DEBUG [StoreOpener-31d859f310183233a5ec880dbf54d8b9-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/data/default/testtb-testExportFileSystemStateWithMergeRegion/31d859f310183233a5ec880dbf54d8b9/cf 2023-10-05 20:01:10,687 DEBUG [StoreOpener-31d859f310183233a5ec880dbf54d8b9-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/data/default/testtb-testExportFileSystemStateWithMergeRegion/31d859f310183233a5ec880dbf54d8b9/cf 2023-10-05 20:01:10,688 INFO [StoreOpener-d321f1710d50c228c088de7ff0d8ca4c-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region d321f1710d50c228c088de7ff0d8ca4c columnFamilyName cf 2023-10-05 20:01:10,688 INFO [StoreOpener-31d859f310183233a5ec880dbf54d8b9-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 31d859f310183233a5ec880dbf54d8b9 columnFamilyName cf 2023-10-05 20:01:10,690 INFO [StoreOpener-31d859f310183233a5ec880dbf54d8b9-1] regionserver.HStore(310): Store=31d859f310183233a5ec880dbf54d8b9/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-05 20:01:10,690 INFO [StoreOpener-d321f1710d50c228c088de7ff0d8ca4c-1] regionserver.HStore(310): Store=d321f1710d50c228c088de7ff0d8ca4c/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-05 20:01:10,691 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/data/default/testtb-testExportFileSystemStateWithMergeRegion/31d859f310183233a5ec880dbf54d8b9 2023-10-05 20:01:10,691 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/data/default/testtb-testExportFileSystemStateWithMergeRegion/d321f1710d50c228c088de7ff0d8ca4c 2023-10-05 20:01:10,691 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/data/default/testtb-testExportFileSystemStateWithMergeRegion/31d859f310183233a5ec880dbf54d8b9 2023-10-05 20:01:10,691 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/data/default/testtb-testExportFileSystemStateWithMergeRegion/d321f1710d50c228c088de7ff0d8ca4c 2023-10-05 20:01:10,694 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for d321f1710d50c228c088de7ff0d8ca4c 2023-10-05 20:01:10,694 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 31d859f310183233a5ec880dbf54d8b9 2023-10-05 20:01:10,696 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/data/default/testtb-testExportFileSystemStateWithMergeRegion/d321f1710d50c228c088de7ff0d8ca4c/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-05 20:01:10,696 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/data/default/testtb-testExportFileSystemStateWithMergeRegion/31d859f310183233a5ec880dbf54d8b9/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-05 20:01:10,696 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened d321f1710d50c228c088de7ff0d8ca4c; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66783227, jitterRate=-0.004852369427680969}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-10-05 20:01:10,696 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 31d859f310183233a5ec880dbf54d8b9; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66734682, jitterRate=-0.005575746297836304}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-10-05 20:01:10,696 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for d321f1710d50c228c088de7ff0d8ca4c: 2023-10-05 20:01:10,696 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 31d859f310183233a5ec880dbf54d8b9: 2023-10-05 20:01:10,697 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion,,1696536070308.31d859f310183233a5ec880dbf54d8b9., pid=60, masterSystemTime=1696536070677 2023-10-05 20:01:10,697 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion,1,1696536070308.d321f1710d50c228c088de7ff0d8ca4c., pid=61, masterSystemTime=1696536070678 2023-10-05 20:01:10,699 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion,1,1696536070308.d321f1710d50c228c088de7ff0d8ca4c. 2023-10-05 20:01:10,699 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion,1,1696536070308.d321f1710d50c228c088de7ff0d8ca4c. 2023-10-05 20:01:10,699 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=59 updating hbase:meta row=d321f1710d50c228c088de7ff0d8ca4c, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,36369,1696535998737 2023-10-05 20:01:10,700 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion,,1696536070308.31d859f310183233a5ec880dbf54d8b9. 2023-10-05 20:01:10,700 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1696536070308.d321f1710d50c228c088de7ff0d8ca4c.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1696536070699"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1696536070699"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1696536070699"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1696536070699"}]},"ts":"1696536070699"} 2023-10-05 20:01:10,700 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion,,1696536070308.31d859f310183233a5ec880dbf54d8b9. 2023-10-05 20:01:10,700 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=58 updating hbase:meta row=31d859f310183233a5ec880dbf54d8b9, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,32861,1696535998642 2023-10-05 20:01:10,700 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1696536070308.31d859f310183233a5ec880dbf54d8b9.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1696536070700"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1696536070700"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1696536070700"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1696536070700"}]},"ts":"1696536070700"} 2023-10-05 20:01:10,703 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=61, resume processing ppid=59 2023-10-05 20:01:10,703 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=61, ppid=59, state=SUCCESS; OpenRegionProcedure d321f1710d50c228c088de7ff0d8ca4c, server=jenkins-hbase4.apache.org,36369,1696535998737 in 175 msec 2023-10-05 20:01:10,704 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=60, resume processing ppid=58 2023-10-05 20:01:10,704 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=60, ppid=58, state=SUCCESS; OpenRegionProcedure 31d859f310183233a5ec880dbf54d8b9, server=jenkins-hbase4.apache.org,32861,1696535998642 in 177 msec 2023-10-05 20:01:10,704 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=59, ppid=57, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=d321f1710d50c228c088de7ff0d8ca4c, ASSIGN in 335 msec 2023-10-05 20:01:10,706 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=58, resume processing ppid=57 2023-10-05 20:01:10,706 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=58, ppid=57, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=31d859f310183233a5ec880dbf54d8b9, ASSIGN in 336 msec 2023-10-05 20:01:10,706 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-10-05 20:01:10,707 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696536070706"}]},"ts":"1696536070706"} 2023-10-05 20:01:10,708 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=ENABLED in hbase:meta 2023-10-05 20:01:10,711 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_POST_OPERATION 2023-10-05 20:01:10,711 DEBUG [PEWorker-5] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemStateWithMergeRegion jenkins: RWXCA 2023-10-05 20:01:10,713 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=32861] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion], kv [jenkins: RWXCA] 2023-10-05 20:01:10,714 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): master:40857-0x101182c1f970000, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-05 20:01:10,714 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): regionserver:44821-0x101182c1f970002, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-05 20:01:10,715 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): regionserver:36369-0x101182c1f970003, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-05 20:01:10,714 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): regionserver:32861-0x101182c1f970001, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-05 20:01:10,716 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-10-05 20:01:10,716 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-10-05 20:01:10,716 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-10-05 20:01:10,716 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-10-05 20:01:10,717 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=57, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion in 407 msec 2023-10-05 20:01:10,916 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40857] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-10-05 20:01:10,916 INFO [Listener at jenkins-hbase4.apache.org/35067] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion, procId: 57 completed 2023-10-05 20:01:10,918 DEBUG [Listener at jenkins-hbase4.apache.org/35067] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithMergeRegion 2023-10-05 20:01:10,918 DEBUG [Listener at jenkins-hbase4.apache.org/35067] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithMergeRegion,,1696536070308.31d859f310183233a5ec880dbf54d8b9. 2023-10-05 20:01:10,920 INFO [Listener at jenkins-hbase4.apache.org/35067] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-10-05 20:01:10,932 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40857] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-10-05 20:01:10,932 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40857] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1696536070932 (current time:1696536070932). 2023-10-05 20:01:10,932 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40857] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-10-05 20:01:10,933 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40857] zookeeper.ReadOnlyZKClient(139): Connect 0x29bdacf3 to 127.0.0.1:57530 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-05 20:01:10,939 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40857] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@66f89ed2, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-05 20:01:10,940 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40857] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-05 20:01:10,943 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:58230, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-05 20:01:10,944 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40857] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x29bdacf3 to 127.0.0.1:57530 2023-10-05 20:01:10,944 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40857] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-05 20:01:10,945 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40857] zookeeper.ReadOnlyZKClient(139): Connect 0x00684acf to 127.0.0.1:57530 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-05 20:01:10,950 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40857] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4476b405, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-05 20:01:10,951 DEBUG [hconnection-0x665abc57-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-05 20:01:10,952 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:58242, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-05 20:01:10,955 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40857] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-05 20:01:10,958 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:32854, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-05 20:01:10,959 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40857] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x00684acf to 127.0.0.1:57530 2023-10-05 20:01:10,959 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40857] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-05 20:01:10,959 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40857] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion], kv [jenkins: RWXCA] 2023-10-05 20:01:10,961 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40857] snapshot.SnapshotManager(637): No existing snapshot, attempting snapshot... 2023-10-05 20:01:10,961 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40857] snapshot.SnapshotManager(684): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-10-05 20:01:10,967 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40857] snapshot.SnapshotManager(519): Unable to retrieve ACL status for path: hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/.hbase-snapshot, current working dir path: hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion org.apache.hadoop.hdfs.protocol.AclException: The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.ipc.RemoteException.instantiateException(RemoteException.java:121) at org.apache.hadoop.ipc.RemoteException.unwrapRemoteException(RemoteException.java:88) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2736) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2294) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2291) at org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81) at org.apache.hadoop.hdfs.DistributedFileSystem.getAclStatus(DistributedFileSystem.java:2291) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.updateWorkingDirAclsIfRequired(SnapshotManager.java:517) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.prepareToTakeSnapshot(SnapshotManager.java:490) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.snapshotEnabledTable(SnapshotManager.java:559) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshotInternal(SnapshotManager.java:687) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshot(SnapshotManager.java:623) at org.apache.hadoop.hbase.master.MasterRpcServices.snapshot(MasterRpcServices.java:1588) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) Caused by: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.hdfs.protocol.AclException): The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at org.apache.hadoop.ipc.Client.getRpcResponse(Client.java:1540) at org.apache.hadoop.ipc.Client.call(Client.java:1486) at org.apache.hadoop.ipc.Client.call(Client.java:1385) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:232) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:118) at com.sun.proxy.$Proxy32.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.getAclStatus(ClientNamenodeProtocolTranslatorPB.java:1385) at sun.reflect.GeneratedMethodAccessor62.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:422) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeMethod(RetryInvocationHandler.java:165) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invoke(RetryInvocationHandler.java:157) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeOnce(RetryInvocationHandler.java:95) at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:359) at com.sun.proxy.$Proxy35.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor62.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor62.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor62.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor62.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor62.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2734) ... 15 more 2023-10-05 20:01:10,968 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40857] procedure2.ProcedureExecutor(1028): Stored pid=62, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-10-05 20:01:10,969 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=62, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-10-05 20:01:10,969 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=62, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE; timeout=600000, timestamp=1696536670969 2023-10-05 20:01:10,969 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion 2023-10-05 20:01:10,969 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40857] snapshot.SnapshotManager(689): Started snapshot: { ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-10-05 20:01:10,971 DEBUG [Listener at jenkins-hbase4.apache.org/35067] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-10-05 20:01:10,971 DEBUG [Listener at jenkins-hbase4.apache.org/35067] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-10-05 20:01:10,971 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=63, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-10-05 20:01:10,972 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=62, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-10-05 20:01:10,973 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=62, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE in 5 msec 2023-10-05 20:01:10,974 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=63, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-10-05 20:01:10,974 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=63, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED; timeout=600000, timestamp=1696536670974 2023-10-05 20:01:10,983 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 20:01:10,983 INFO [(jenkins-hbase4.apache.org,40857,1696535997381)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' 2023-10-05 20:01:10,983 DEBUG [(jenkins-hbase4.apache.org,40857,1696535997381)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-05 20:01:10,984 DEBUG [(jenkins-hbase4.apache.org,40857,1696535997381)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' 2023-10-05 20:01:10,984 DEBUG [(jenkins-hbase4.apache.org,40857,1696535997381)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion', kicking off acquire phase on members. 2023-10-05 20:01:10,984 DEBUG [(jenkins-hbase4.apache.org,40857,1696535997381)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40857-0x101182c1f970000, quorum=127.0.0.1:57530, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 20:01:10,984 DEBUG [(jenkins-hbase4.apache.org,40857,1696535997381)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 20:01:10,986 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): regionserver:36369-0x101182c1f970003, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-05 20:01:10,986 DEBUG [(jenkins-hbase4.apache.org,40857,1696535997381)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,32861,1696535998642 2023-10-05 20:01:10,986 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-05 20:01:10,986 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-05 20:01:10,986 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): regionserver:44821-0x101182c1f970002, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-05 20:01:10,986 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): regionserver:32861-0x101182c1f970001, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-05 20:01:10,986 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-05 20:01:10,986 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-05 20:01:10,986 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-05 20:01:10,986 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-05 20:01:10,986 DEBUG [(jenkins-hbase4.apache.org,40857,1696535997381)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40857-0x101182c1f970000, quorum=127.0.0.1:57530, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,32861,1696535998642 2023-10-05 20:01:10,986 DEBUG [(jenkins-hbase4.apache.org,40857,1696535997381)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,36369,1696535998737 2023-10-05 20:01:10,986 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 20:01:10,987 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 20:01:10,987 DEBUG [(jenkins-hbase4.apache.org,40857,1696535997381)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40857-0x101182c1f970000, quorum=127.0.0.1:57530, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,36369,1696535998737 2023-10-05 20:01:10,987 DEBUG [(jenkins-hbase4.apache.org,40857,1696535997381)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-05 20:01:10,987 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36369-0x101182c1f970003, quorum=127.0.0.1:57530, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 20:01:10,987 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 20:01:10,987 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:32861-0x101182c1f970001, quorum=127.0.0.1:57530, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 20:01:10,987 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 219 2023-10-05 20:01:10,987 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 20:01:10,987 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44821-0x101182c1f970002, quorum=127.0.0.1:57530, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 20:01:10,987 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 219 2023-10-05 20:01:10,987 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 20:01:10,987 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-10-05 20:01:10,988 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-10-05 20:01:10,988 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 219 2023-10-05 20:01:10,988 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 20:01:10,988 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 20:01:10,988 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 20:01:10,988 DEBUG [member: 'jenkins-hbase4.apache.org,36369,1696535998737' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-10-05 20:01:10,988 DEBUG [member: 'jenkins-hbase4.apache.org,32861,1696535998642' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-10-05 20:01:10,988 DEBUG [member: 'jenkins-hbase4.apache.org,32861,1696535998642' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-05 20:01:10,988 DEBUG [member: 'jenkins-hbase4.apache.org,36369,1696535998737' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-05 20:01:10,989 DEBUG [member: 'jenkins-hbase4.apache.org,32861,1696535998642' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-10-05 20:01:10,990 DEBUG [member: 'jenkins-hbase4.apache.org,36369,1696535998737' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-10-05 20:01:10,990 DEBUG [member: 'jenkins-hbase4.apache.org,36369,1696535998737' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-10-05 20:01:10,988 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-10-05 20:01:10,990 DEBUG [member: 'jenkins-hbase4.apache.org,36369,1696535998737' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,36369,1696535998737' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-10-05 20:01:10,990 DEBUG [member: 'jenkins-hbase4.apache.org,32861,1696535998642' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-10-05 20:01:10,990 DEBUG [member: 'jenkins-hbase4.apache.org,32861,1696535998642' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,32861,1696535998642' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-10-05 20:01:10,990 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 20:01:10,990 DEBUG [member: 'jenkins-hbase4.apache.org,44821,1696535998698' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-10-05 20:01:10,990 DEBUG [member: 'jenkins-hbase4.apache.org,44821,1696535998698' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-05 20:01:10,991 DEBUG [member: 'jenkins-hbase4.apache.org,44821,1696535998698' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-10-05 20:01:10,991 DEBUG [member: 'jenkins-hbase4.apache.org,44821,1696535998698' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-10-05 20:01:10,991 DEBUG [member: 'jenkins-hbase4.apache.org,44821,1696535998698' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44821,1696535998698' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-10-05 20:01:10,993 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): master:40857-0x101182c1f970000, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,36369,1696535998737 2023-10-05 20:01:10,993 DEBUG [member: 'jenkins-hbase4.apache.org,36369,1696535998737' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 20:01:10,993 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,36369,1696535998737 2023-10-05 20:01:10,993 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-05 20:01:10,993 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-05 20:01:10,993 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): master:40857-0x101182c1f970000, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,32861,1696535998642 2023-10-05 20:01:10,993 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-05 20:01:10,993 DEBUG [member: 'jenkins-hbase4.apache.org,36369,1696535998737' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36369-0x101182c1f970003, quorum=127.0.0.1:57530, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 20:01:10,993 DEBUG [member: 'jenkins-hbase4.apache.org,36369,1696535998737' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-05 20:01:10,994 DEBUG [member: 'jenkins-hbase4.apache.org,32861,1696535998642' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 20:01:10,994 DEBUG [member: 'jenkins-hbase4.apache.org,44821,1696535998698' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 20:01:10,994 DEBUG [member: 'jenkins-hbase4.apache.org,32861,1696535998642' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:32861-0x101182c1f970001, quorum=127.0.0.1:57530, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 20:01:10,995 DEBUG [member: 'jenkins-hbase4.apache.org,32861,1696535998642' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-05 20:01:10,994 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-05 20:01:10,995 DEBUG [member: 'jenkins-hbase4.apache.org,44821,1696535998698' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44821-0x101182c1f970002, quorum=127.0.0.1:57530, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 20:01:10,995 DEBUG [member: 'jenkins-hbase4.apache.org,44821,1696535998698' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-05 20:01:10,995 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 20:01:10,995 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32861,1696535998642 2023-10-05 20:01:10,995 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36369,1696535998737 2023-10-05 20:01:10,996 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44821,1696535998698 2023-10-05 20:01:10,996 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-05 20:01:10,996 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,36369,1696535998737' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-10-05 20:01:10,996 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@64ec559f[Count = 1] remaining members to acquire global barrier 2023-10-05 20:01:10,996 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,32861,1696535998642 2023-10-05 20:01:10,996 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-05 20:01:10,996 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-05 20:01:10,997 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-05 20:01:10,997 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-05 20:01:10,997 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 20:01:10,997 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32861,1696535998642 2023-10-05 20:01:10,998 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36369,1696535998737 2023-10-05 20:01:10,998 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44821,1696535998698 2023-10-05 20:01:10,998 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-05 20:01:10,999 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,32861,1696535998642' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-10-05 20:01:10,999 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@64ec559f[Count = 0] remaining members to acquire global barrier 2023-10-05 20:01:10,999 DEBUG [(jenkins-hbase4.apache.org,40857,1696535997381)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'in-barrier' execution. 2023-10-05 20:01:10,999 DEBUG [(jenkins-hbase4.apache.org,40857,1696535997381)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 20:01:11,000 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): regionserver:36369-0x101182c1f970003, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 20:01:11,000 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): regionserver:32861-0x101182c1f970001, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 20:01:11,000 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 20:01:11,000 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 20:01:11,000 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 20:01:11,000 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): regionserver:44821-0x101182c1f970002, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 20:01:11,000 DEBUG [member: 'jenkins-hbase4.apache.org,36369,1696535998737' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-10-05 20:01:11,000 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 20:01:11,000 DEBUG [(jenkins-hbase4.apache.org,40857,1696535997381)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40857-0x101182c1f970000, quorum=127.0.0.1:57530, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,36369,1696535998737 2023-10-05 20:01:11,000 DEBUG [member: 'jenkins-hbase4.apache.org,36369,1696535998737' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-05 20:01:11,000 DEBUG [member: 'jenkins-hbase4.apache.org,36369,1696535998737' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-05 20:01:11,000 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 20:01:11,000 DEBUG [rs(jenkins-hbase4.apache.org,36369,1696535998737)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1696536070308.d321f1710d50c228c088de7ff0d8ca4c. 2023-10-05 20:01:11,000 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 20:01:11,001 DEBUG [rs(jenkins-hbase4.apache.org,36369,1696535998737)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1696536070308.d321f1710d50c228c088de7ff0d8ca4c. started... 2023-10-05 20:01:11,001 DEBUG [member: 'jenkins-hbase4.apache.org,32861,1696535998642' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-10-05 20:01:11,001 DEBUG [(jenkins-hbase4.apache.org,40857,1696535997381)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40857-0x101182c1f970000, quorum=127.0.0.1:57530, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,32861,1696535998642 2023-10-05 20:01:11,001 DEBUG [(jenkins-hbase4.apache.org,40857,1696535997381)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-05 20:01:11,001 DEBUG [member: 'jenkins-hbase4.apache.org,44821,1696535998698' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-10-05 20:01:11,002 DEBUG [member: 'jenkins-hbase4.apache.org,32861,1696535998642' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-05 20:01:11,002 DEBUG [member: 'jenkins-hbase4.apache.org,32861,1696535998642' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-05 20:01:11,002 DEBUG [rs(jenkins-hbase4.apache.org,32861,1696535998642)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1696536070308.31d859f310183233a5ec880dbf54d8b9. 2023-10-05 20:01:11,002 DEBUG [rs(jenkins-hbase4.apache.org,36369,1696535998737)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for d321f1710d50c228c088de7ff0d8ca4c: 2023-10-05 20:01:11,002 DEBUG [member: 'jenkins-hbase4.apache.org,44821,1696535998698' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-10-05 20:01:11,002 DEBUG [rs(jenkins-hbase4.apache.org,32861,1696535998642)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1696536070308.31d859f310183233a5ec880dbf54d8b9. started... 2023-10-05 20:01:11,002 DEBUG [member: 'jenkins-hbase4.apache.org,44821,1696535998698' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,44821,1696535998698' in zk 2023-10-05 20:01:11,002 DEBUG [rs(jenkins-hbase4.apache.org,36369,1696535998737)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,1,1696536070308.d321f1710d50c228c088de7ff0d8ca4c.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 20:01:11,002 DEBUG [rs(jenkins-hbase4.apache.org,32861,1696535998642)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 31d859f310183233a5ec880dbf54d8b9: 2023-10-05 20:01:11,002 DEBUG [rs(jenkins-hbase4.apache.org,36369,1696535998737)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-05 20:01:11,002 DEBUG [rs(jenkins-hbase4.apache.org,36369,1696535998737)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-10-05 20:01:11,002 DEBUG [rs(jenkins-hbase4.apache.org,32861,1696535998642)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,,1696536070308.31d859f310183233a5ec880dbf54d8b9.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 20:01:11,002 DEBUG [rs(jenkins-hbase4.apache.org,32861,1696535998642)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-05 20:01:11,002 DEBUG [rs(jenkins-hbase4.apache.org,32861,1696535998642)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-10-05 20:01:11,014 DEBUG [member: 'jenkins-hbase4.apache.org,44821,1696535998698' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-10-05 20:01:11,014 DEBUG [member: 'jenkins-hbase4.apache.org,44821,1696535998698' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-05 20:01:11,015 DEBUG [member: 'jenkins-hbase4.apache.org,44821,1696535998698' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-10-05 20:01:11,020 DEBUG [rs(jenkins-hbase4.apache.org,32861,1696535998642)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1696536070308.31d859f310183233a5ec880dbf54d8b9. completed. 2023-10-05 20:01:11,020 DEBUG [rs(jenkins-hbase4.apache.org,32861,1696535998642)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1696536070308.31d859f310183233a5ec880dbf54d8b9. 2023-10-05 20:01:11,021 DEBUG [member: 'jenkins-hbase4.apache.org,32861,1696535998642' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-05 20:01:11,021 DEBUG [member: 'jenkins-hbase4.apache.org,32861,1696535998642' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-05 20:01:11,021 DEBUG [member: 'jenkins-hbase4.apache.org,32861,1696535998642' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,32861,1696535998642 2023-10-05 20:01:11,021 DEBUG [member: 'jenkins-hbase4.apache.org,32861,1696535998642' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-10-05 20:01:11,021 DEBUG [member: 'jenkins-hbase4.apache.org,32861,1696535998642' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,32861,1696535998642' in zk 2023-10-05 20:01:11,022 DEBUG [member: 'jenkins-hbase4.apache.org,32861,1696535998642' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-10-05 20:01:11,023 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): master:40857-0x101182c1f970000, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,32861,1696535998642 2023-10-05 20:01:11,023 DEBUG [rs(jenkins-hbase4.apache.org,36369,1696535998737)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1696536070308.d321f1710d50c228c088de7ff0d8ca4c. completed. 2023-10-05 20:01:11,023 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,32861,1696535998642 2023-10-05 20:01:11,023 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-05 20:01:11,023 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-05 20:01:11,023 DEBUG [rs(jenkins-hbase4.apache.org,36369,1696535998737)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1696536070308.d321f1710d50c228c088de7ff0d8ca4c. 2023-10-05 20:01:11,023 DEBUG [member: 'jenkins-hbase4.apache.org,32861,1696535998642' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-05 20:01:11,023 DEBUG [member: 'jenkins-hbase4.apache.org,36369,1696535998737' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-05 20:01:11,023 DEBUG [member: 'jenkins-hbase4.apache.org,32861,1696535998642' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-10-05 20:01:11,024 DEBUG [member: 'jenkins-hbase4.apache.org,36369,1696535998737' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-05 20:01:11,024 DEBUG [member: 'jenkins-hbase4.apache.org,36369,1696535998737' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,36369,1696535998737 2023-10-05 20:01:11,024 DEBUG [member: 'jenkins-hbase4.apache.org,36369,1696535998737' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-10-05 20:01:11,024 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-05 20:01:11,024 DEBUG [member: 'jenkins-hbase4.apache.org,36369,1696535998737' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,36369,1696535998737' in zk 2023-10-05 20:01:11,024 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-05 20:01:11,025 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 20:01:11,026 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): master:40857-0x101182c1f970000, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,36369,1696535998737 2023-10-05 20:01:11,026 DEBUG [member: 'jenkins-hbase4.apache.org,36369,1696535998737' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-10-05 20:01:11,026 DEBUG [member: 'jenkins-hbase4.apache.org,36369,1696535998737' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-05 20:01:11,026 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32861,1696535998642 2023-10-05 20:01:11,026 DEBUG [member: 'jenkins-hbase4.apache.org,36369,1696535998737' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-10-05 20:01:11,027 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36369,1696535998737 2023-10-05 20:01:11,027 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44821,1696535998698 2023-10-05 20:01:11,027 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-05 20:01:11,028 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 20:01:11,028 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32861,1696535998642 2023-10-05 20:01:11,028 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36369,1696535998737 2023-10-05 20:01:11,028 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44821,1696535998698 2023-10-05 20:01:11,029 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,32861,1696535998642': 2023-10-05 20:01:11,029 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,32861,1696535998642' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 1 more 2023-10-05 20:01:11,029 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,36369,1696535998737 2023-10-05 20:01:11,029 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-05 20:01:11,029 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-05 20:01:11,029 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-05 20:01:11,030 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-05 20:01:11,030 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 20:01:11,030 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32861,1696535998642 2023-10-05 20:01:11,030 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36369,1696535998737 2023-10-05 20:01:11,031 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44821,1696535998698 2023-10-05 20:01:11,031 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-05 20:01:11,031 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 20:01:11,031 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32861,1696535998642 2023-10-05 20:01:11,032 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36369,1696535998737 2023-10-05 20:01:11,032 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44821,1696535998698 2023-10-05 20:01:11,032 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,36369,1696535998737': 2023-10-05 20:01:11,032 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,36369,1696535998737' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 0 more 2023-10-05 20:01:11,032 INFO [(jenkins-hbase4.apache.org,40857,1696535997381)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' execution completed 2023-10-05 20:01:11,032 DEBUG [(jenkins-hbase4.apache.org,40857,1696535997381)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-05 20:01:11,032 DEBUG [(jenkins-hbase4.apache.org,40857,1696535997381)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-05 20:01:11,033 DEBUG [(jenkins-hbase4.apache.org,40857,1696535997381)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 20:01:11,033 INFO [(jenkins-hbase4.apache.org,40857,1696535997381)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportFileSystemStateWithMergeRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-10-05 20:01:11,035 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): regionserver:44821-0x101182c1f970002, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 20:01:11,035 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): regionserver:32861-0x101182c1f970001, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 20:01:11,035 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): master:40857-0x101182c1f970000, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 20:01:11,035 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): regionserver:44821-0x101182c1f970002, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-05 20:01:11,035 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 20:01:11,035 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-05 20:01:11,035 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-05 20:01:11,035 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): regionserver:36369-0x101182c1f970003, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 20:01:11,035 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 20:01:11,035 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 20:01:11,035 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): regionserver:32861-0x101182c1f970001, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-05 20:01:11,036 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 20:01:11,036 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-05 20:01:11,036 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 20:01:11,036 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 20:01:11,036 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 20:01:11,036 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): regionserver:36369-0x101182c1f970003, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-05 20:01:11,036 DEBUG [(jenkins-hbase4.apache.org,40857,1696535997381)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40857-0x101182c1f970000, quorum=127.0.0.1:57530, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,32861,1696535998642 2023-10-05 20:01:11,036 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 20:01:11,036 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-05 20:01:11,036 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-05 20:01:11,036 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-05 20:01:11,036 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-05 20:01:11,036 DEBUG [(jenkins-hbase4.apache.org,40857,1696535997381)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40857-0x101182c1f970000, quorum=127.0.0.1:57530, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,36369,1696535998737 2023-10-05 20:01:11,036 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-05 20:01:11,037 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 20:01:11,037 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-05 20:01:11,037 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-05 20:01:11,037 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 20:01:11,037 DEBUG [(jenkins-hbase4.apache.org,40857,1696535997381)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40857-0x101182c1f970000, quorum=127.0.0.1:57530, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,44821,1696535998698 2023-10-05 20:01:11,037 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 20:01:11,037 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 20:01:11,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32861,1696535998642 2023-10-05 20:01:11,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36369,1696535998737 2023-10-05 20:01:11,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44821,1696535998698 2023-10-05 20:01:11,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-05 20:01:11,039 DEBUG [(jenkins-hbase4.apache.org,40857,1696535997381)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40857-0x101182c1f970000, quorum=127.0.0.1:57530, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,32861,1696535998642 2023-10-05 20:01:11,039 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 20:01:11,039 DEBUG [(jenkins-hbase4.apache.org,40857,1696535997381)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40857-0x101182c1f970000, quorum=127.0.0.1:57530, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,36369,1696535998737 2023-10-05 20:01:11,039 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32861,1696535998642 2023-10-05 20:01:11,039 DEBUG [(jenkins-hbase4.apache.org,40857,1696535997381)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40857-0x101182c1f970000, quorum=127.0.0.1:57530, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,44821,1696535998698 2023-10-05 20:01:11,039 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36369,1696535998737 2023-10-05 20:01:11,040 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44821,1696535998698 2023-10-05 20:01:11,042 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): regionserver:36369-0x101182c1f970003, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-05 20:01:11,042 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): master:40857-0x101182c1f970000, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,44821,1696535998698 2023-10-05 20:01:11,043 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): regionserver:32861-0x101182c1f970001, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-05 20:01:11,042 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): regionserver:44821-0x101182c1f970002, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-05 20:01:11,043 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-05 20:01:11,043 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): regionserver:44821-0x101182c1f970002, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-05 20:01:11,043 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): regionserver:32861-0x101182c1f970001, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-05 20:01:11,043 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 20:01:11,043 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): master:40857-0x101182c1f970000, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 20:01:11,043 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemStateWithMergeRegion 2023-10-05 20:01:11,043 DEBUG [(jenkins-hbase4.apache.org,40857,1696535997381)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-05 20:01:11,043 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => aaca68e56e63a701f5c1ec9dc2f0511c, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,.mob,0.aaca68e56e63a701f5c1ec9dc2f0511c.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 20:01:11,043 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-05 20:01:11,043 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): regionserver:36369-0x101182c1f970003, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-05 20:01:11,044 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-05 20:01:11,044 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-10-05 20:01:11,043 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): master:40857-0x101182c1f970000, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,36369,1696535998737 2023-10-05 20:01:11,043 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-05 20:01:11,043 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-05 20:01:11,044 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-05 20:01:11,044 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): master:40857-0x101182c1f970000, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,32861,1696535998642 2023-10-05 20:01:11,045 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): master:40857-0x101182c1f970000, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 20:01:11,045 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): master:40857-0x101182c1f970000, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,44821,1696535998698 2023-10-05 20:01:11,045 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): master:40857-0x101182c1f970000, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 20:01:11,045 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): master:40857-0x101182c1f970000, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,36369,1696535998737 2023-10-05 20:01:11,045 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): master:40857-0x101182c1f970000, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,32861,1696535998642 2023-10-05 20:01:11,045 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): master:40857-0x101182c1f970000, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 20:01:11,045 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): master:40857-0x101182c1f970000, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 20:01:11,045 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-05 20:01:11,045 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-05 20:01:11,045 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-05 20:01:11,045 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-05 20:01:11,045 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-10-05 20:01:11,046 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-05 20:01:11,046 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-05 20:01:11,058 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 20:01:11,059 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 20:01:11,071 DEBUG [Listener at jenkins-hbase4.apache.org/35067] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-05 20:01:11,072 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40857] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-10-05 20:01:11,072 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40857] snapshot.SnapshotManager(406): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-10-05 20:01:11,072 DEBUG [Listener at jenkins-hbase4.apache.org/35067] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-10-05 20:01:11,079 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion to hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/.hbase-snapshot/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 20:01:11,079 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed 2023-10-05 20:01:11,079 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 20:01:11,080 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 20:01:11,080 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion at 1696536070970Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemStateWithMergeRegion at 1696536071058 (+88 ms)Consolidate snapshot: emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1696536071058Loading Region manifests for emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1696536071058Writing data manifest for emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1696536071062 (+4 ms)Verifying snapshot: emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1696536071073 (+11 ms)Snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed at 1696536071079 (+6 ms) 2023-10-05 20:01:11,082 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=63, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-10-05 20:01:11,084 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=63, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED in 113 msec 2023-10-05 20:01:11,272 DEBUG [Listener at jenkins-hbase4.apache.org/35067] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-05 20:01:11,273 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40857] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-10-05 20:01:11,273 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40857] snapshot.SnapshotManager(403): Snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' has completed, notifying client. 2023-10-05 20:01:11,276 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32861] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithMergeRegion,,1696536070308.31d859f310183233a5ec880dbf54d8b9. with WAL disabled. Data may be lost in the event of a crash. 2023-10-05 20:01:11,277 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36369] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithMergeRegion,1,1696536070308.d321f1710d50c228c088de7ff0d8ca4c. with WAL disabled. Data may be lost in the event of a crash. 2023-10-05 20:01:11,280 DEBUG [Listener at jenkins-hbase4.apache.org/35067] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithMergeRegion 2023-10-05 20:01:11,280 DEBUG [Listener at jenkins-hbase4.apache.org/35067] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithMergeRegion,,1696536070308.31d859f310183233a5ec880dbf54d8b9. 2023-10-05 20:01:11,281 INFO [Listener at jenkins-hbase4.apache.org/35067] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-10-05 20:01:11,290 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40857] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-10-05 20:01:11,290 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40857] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1696536071290 (current time:1696536071290). 2023-10-05 20:01:11,290 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40857] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-10-05 20:01:11,291 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40857] zookeeper.ReadOnlyZKClient(139): Connect 0x447d173e to 127.0.0.1:57530 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-05 20:01:11,298 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40857] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5f9a91e4, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-05 20:01:11,299 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40857] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-05 20:01:11,301 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:58250, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-05 20:01:11,302 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40857] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x447d173e to 127.0.0.1:57530 2023-10-05 20:01:11,302 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40857] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-05 20:01:11,303 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40857] zookeeper.ReadOnlyZKClient(139): Connect 0x0c9c8420 to 127.0.0.1:57530 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-05 20:01:11,308 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40857] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@20f4b66a, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-05 20:01:11,309 DEBUG [hconnection-0x2bea1621-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-05 20:01:11,312 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:58266, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-05 20:01:11,315 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40857] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-05 20:01:11,317 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:32866, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-05 20:01:11,318 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40857] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x0c9c8420 to 127.0.0.1:57530 2023-10-05 20:01:11,318 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40857] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-05 20:01:11,318 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40857] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion], kv [jenkins: RWXCA] 2023-10-05 20:01:11,319 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40857] snapshot.SnapshotManager(637): No existing snapshot, attempting snapshot... 2023-10-05 20:01:11,319 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40857] snapshot.SnapshotManager(684): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-10-05 20:01:11,321 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40857] snapshot.SnapshotManager(519): Unable to retrieve ACL status for path: hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/.hbase-snapshot, current working dir path: hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion org.apache.hadoop.hdfs.protocol.AclException: The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.ipc.RemoteException.instantiateException(RemoteException.java:121) at org.apache.hadoop.ipc.RemoteException.unwrapRemoteException(RemoteException.java:88) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2736) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2294) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2291) at org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81) at org.apache.hadoop.hdfs.DistributedFileSystem.getAclStatus(DistributedFileSystem.java:2291) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.updateWorkingDirAclsIfRequired(SnapshotManager.java:517) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.prepareToTakeSnapshot(SnapshotManager.java:490) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.snapshotEnabledTable(SnapshotManager.java:559) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshotInternal(SnapshotManager.java:687) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshot(SnapshotManager.java:623) at org.apache.hadoop.hbase.master.MasterRpcServices.snapshot(MasterRpcServices.java:1588) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) Caused by: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.hdfs.protocol.AclException): The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at org.apache.hadoop.ipc.Client.getRpcResponse(Client.java:1540) at org.apache.hadoop.ipc.Client.call(Client.java:1486) at org.apache.hadoop.ipc.Client.call(Client.java:1385) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:232) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:118) at com.sun.proxy.$Proxy32.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.getAclStatus(ClientNamenodeProtocolTranslatorPB.java:1385) at sun.reflect.GeneratedMethodAccessor62.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:422) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeMethod(RetryInvocationHandler.java:165) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invoke(RetryInvocationHandler.java:157) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeOnce(RetryInvocationHandler.java:95) at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:359) at com.sun.proxy.$Proxy35.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor62.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor62.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor62.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor62.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor62.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2734) ... 15 more 2023-10-05 20:01:11,323 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40857] procedure2.ProcedureExecutor(1028): Stored pid=64, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-10-05 20:01:11,323 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=64, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-10-05 20:01:11,324 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=64, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE; timeout=600000, timestamp=1696536671324 2023-10-05 20:01:11,324 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion 2023-10-05 20:01:11,324 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40857] snapshot.SnapshotManager(689): Started snapshot: { ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-10-05 20:01:11,325 DEBUG [Listener at jenkins-hbase4.apache.org/35067] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-10-05 20:01:11,325 DEBUG [Listener at jenkins-hbase4.apache.org/35067] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-10-05 20:01:11,326 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=65, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-10-05 20:01:11,327 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=64, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-10-05 20:01:11,328 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=64, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE in 5 msec 2023-10-05 20:01:11,328 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=65, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-10-05 20:01:11,329 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=65, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED; timeout=600000, timestamp=1696536671329 2023-10-05 20:01:11,337 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 20:01:11,338 INFO [(jenkins-hbase4.apache.org,40857,1696535997381)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' 2023-10-05 20:01:11,338 DEBUG [(jenkins-hbase4.apache.org,40857,1696535997381)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-05 20:01:11,339 DEBUG [(jenkins-hbase4.apache.org,40857,1696535997381)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' 2023-10-05 20:01:11,339 DEBUG [(jenkins-hbase4.apache.org,40857,1696535997381)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion', kicking off acquire phase on members. 2023-10-05 20:01:11,339 DEBUG [(jenkins-hbase4.apache.org,40857,1696535997381)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40857-0x101182c1f970000, quorum=127.0.0.1:57530, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 20:01:11,339 DEBUG [(jenkins-hbase4.apache.org,40857,1696535997381)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 20:01:11,341 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): regionserver:44821-0x101182c1f970002, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-05 20:01:11,341 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): regionserver:32861-0x101182c1f970001, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-05 20:01:11,341 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-05 20:01:11,341 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-05 20:01:11,341 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-05 20:01:11,341 DEBUG [(jenkins-hbase4.apache.org,40857,1696535997381)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,32861,1696535998642 2023-10-05 20:01:11,341 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): regionserver:36369-0x101182c1f970003, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-05 20:01:11,341 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-05 20:01:11,341 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-05 20:01:11,341 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-05 20:01:11,341 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 20:01:11,341 DEBUG [(jenkins-hbase4.apache.org,40857,1696535997381)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40857-0x101182c1f970000, quorum=127.0.0.1:57530, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,32861,1696535998642 2023-10-05 20:01:11,342 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 20:01:11,342 DEBUG [(jenkins-hbase4.apache.org,40857,1696535997381)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,36369,1696535998737 2023-10-05 20:01:11,342 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 20:01:11,342 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:32861-0x101182c1f970001, quorum=127.0.0.1:57530, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 20:01:11,342 DEBUG [(jenkins-hbase4.apache.org,40857,1696535997381)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40857-0x101182c1f970000, quorum=127.0.0.1:57530, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,36369,1696535998737 2023-10-05 20:01:11,342 DEBUG [(jenkins-hbase4.apache.org,40857,1696535997381)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-05 20:01:11,342 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36369-0x101182c1f970003, quorum=127.0.0.1:57530, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 20:01:11,342 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44821-0x101182c1f970002, quorum=127.0.0.1:57530, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 20:01:11,342 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 214 2023-10-05 20:01:11,342 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 20:01:11,342 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 214 2023-10-05 20:01:11,342 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 20:01:11,343 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-10-05 20:01:11,343 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 214 2023-10-05 20:01:11,343 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 20:01:11,343 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-10-05 20:01:11,343 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-10-05 20:01:11,343 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 20:01:11,343 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 20:01:11,343 DEBUG [member: 'jenkins-hbase4.apache.org,32861,1696535998642' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-10-05 20:01:11,343 DEBUG [member: 'jenkins-hbase4.apache.org,32861,1696535998642' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-05 20:01:11,343 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 20:01:11,343 DEBUG [member: 'jenkins-hbase4.apache.org,44821,1696535998698' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-10-05 20:01:11,344 DEBUG [member: 'jenkins-hbase4.apache.org,36369,1696535998737' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-10-05 20:01:11,344 DEBUG [member: 'jenkins-hbase4.apache.org,44821,1696535998698' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-05 20:01:11,344 DEBUG [member: 'jenkins-hbase4.apache.org,32861,1696535998642' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-10-05 20:01:11,345 DEBUG [member: 'jenkins-hbase4.apache.org,44821,1696535998698' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-10-05 20:01:11,345 DEBUG [member: 'jenkins-hbase4.apache.org,44821,1696535998698' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-10-05 20:01:11,345 DEBUG [member: 'jenkins-hbase4.apache.org,44821,1696535998698' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44821,1696535998698' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-10-05 20:01:11,344 DEBUG [member: 'jenkins-hbase4.apache.org,36369,1696535998737' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-05 20:01:11,345 DEBUG [member: 'jenkins-hbase4.apache.org,32861,1696535998642' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-10-05 20:01:11,345 DEBUG [member: 'jenkins-hbase4.apache.org,32861,1696535998642' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,32861,1696535998642' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-10-05 20:01:11,346 DEBUG [member: 'jenkins-hbase4.apache.org,36369,1696535998737' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-10-05 20:01:11,346 DEBUG [member: 'jenkins-hbase4.apache.org,36369,1696535998737' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-10-05 20:01:11,346 DEBUG [member: 'jenkins-hbase4.apache.org,36369,1696535998737' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,36369,1696535998737' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-10-05 20:01:11,348 DEBUG [member: 'jenkins-hbase4.apache.org,44821,1696535998698' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 20:01:11,350 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): master:40857-0x101182c1f970000, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,32861,1696535998642 2023-10-05 20:01:11,350 DEBUG [member: 'jenkins-hbase4.apache.org,32861,1696535998642' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 20:01:11,350 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,32861,1696535998642 2023-10-05 20:01:11,350 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-05 20:01:11,351 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-05 20:01:11,351 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): master:40857-0x101182c1f970000, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,36369,1696535998737 2023-10-05 20:01:11,351 DEBUG [member: 'jenkins-hbase4.apache.org,44821,1696535998698' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44821-0x101182c1f970002, quorum=127.0.0.1:57530, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 20:01:11,351 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-05 20:01:11,351 DEBUG [member: 'jenkins-hbase4.apache.org,44821,1696535998698' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-05 20:01:11,351 DEBUG [member: 'jenkins-hbase4.apache.org,32861,1696535998642' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:32861-0x101182c1f970001, quorum=127.0.0.1:57530, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 20:01:11,351 DEBUG [member: 'jenkins-hbase4.apache.org,32861,1696535998642' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-05 20:01:11,351 DEBUG [member: 'jenkins-hbase4.apache.org,36369,1696535998737' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 20:01:11,352 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-05 20:01:11,352 DEBUG [member: 'jenkins-hbase4.apache.org,36369,1696535998737' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36369-0x101182c1f970003, quorum=127.0.0.1:57530, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 20:01:11,352 DEBUG [member: 'jenkins-hbase4.apache.org,36369,1696535998737' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-05 20:01:11,352 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 20:01:11,352 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32861,1696535998642 2023-10-05 20:01:11,352 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36369,1696535998737 2023-10-05 20:01:11,353 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44821,1696535998698 2023-10-05 20:01:11,353 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-05 20:01:11,353 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,32861,1696535998642' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-10-05 20:01:11,353 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@683257d4[Count = 1] remaining members to acquire global barrier 2023-10-05 20:01:11,353 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,36369,1696535998737 2023-10-05 20:01:11,353 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-05 20:01:11,353 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-05 20:01:11,353 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-05 20:01:11,354 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-05 20:01:11,354 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 20:01:11,354 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32861,1696535998642 2023-10-05 20:01:11,354 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36369,1696535998737 2023-10-05 20:01:11,355 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44821,1696535998698 2023-10-05 20:01:11,355 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-05 20:01:11,355 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,36369,1696535998737' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-10-05 20:01:11,355 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@683257d4[Count = 0] remaining members to acquire global barrier 2023-10-05 20:01:11,355 DEBUG [(jenkins-hbase4.apache.org,40857,1696535997381)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'in-barrier' execution. 2023-10-05 20:01:11,355 DEBUG [(jenkins-hbase4.apache.org,40857,1696535997381)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 20:01:11,356 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): regionserver:44821-0x101182c1f970002, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 20:01:11,356 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): regionserver:36369-0x101182c1f970003, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 20:01:11,356 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 20:01:11,356 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 20:01:11,356 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): regionserver:32861-0x101182c1f970001, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 20:01:11,357 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 20:01:11,357 DEBUG [(jenkins-hbase4.apache.org,40857,1696535997381)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40857-0x101182c1f970000, quorum=127.0.0.1:57530, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,32861,1696535998642 2023-10-05 20:01:11,357 DEBUG [member: 'jenkins-hbase4.apache.org,36369,1696535998737' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-10-05 20:01:11,356 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 20:01:11,357 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 20:01:11,357 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 20:01:11,357 DEBUG [member: 'jenkins-hbase4.apache.org,44821,1696535998698' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-10-05 20:01:11,357 DEBUG [rs(jenkins-hbase4.apache.org,36369,1696535998737)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1696536070308.d321f1710d50c228c088de7ff0d8ca4c. 2023-10-05 20:01:11,357 DEBUG [(jenkins-hbase4.apache.org,40857,1696535997381)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40857-0x101182c1f970000, quorum=127.0.0.1:57530, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,36369,1696535998737 2023-10-05 20:01:11,357 DEBUG [(jenkins-hbase4.apache.org,40857,1696535997381)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-05 20:01:11,357 DEBUG [member: 'jenkins-hbase4.apache.org,44821,1696535998698' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-10-05 20:01:11,357 DEBUG [member: 'jenkins-hbase4.apache.org,32861,1696535998642' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-10-05 20:01:11,357 DEBUG [member: 'jenkins-hbase4.apache.org,36369,1696535998737' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-05 20:01:11,357 DEBUG [member: 'jenkins-hbase4.apache.org,36369,1696535998737' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-05 20:01:11,357 DEBUG [member: 'jenkins-hbase4.apache.org,44821,1696535998698' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,44821,1696535998698' in zk 2023-10-05 20:01:11,357 DEBUG [member: 'jenkins-hbase4.apache.org,32861,1696535998642' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-05 20:01:11,357 DEBUG [member: 'jenkins-hbase4.apache.org,32861,1696535998642' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-05 20:01:11,357 DEBUG [rs(jenkins-hbase4.apache.org,32861,1696535998642)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1696536070308.31d859f310183233a5ec880dbf54d8b9. 2023-10-05 20:01:11,357 DEBUG [rs(jenkins-hbase4.apache.org,36369,1696535998737)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1696536070308.d321f1710d50c228c088de7ff0d8ca4c. started... 2023-10-05 20:01:11,357 DEBUG [rs(jenkins-hbase4.apache.org,32861,1696535998642)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1696536070308.31d859f310183233a5ec880dbf54d8b9. started... 2023-10-05 20:01:11,358 INFO [rs(jenkins-hbase4.apache.org,32861,1696535998642)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 31d859f310183233a5ec880dbf54d8b9 1/1 column families, dataSize=266 B heapSize=832 B 2023-10-05 20:01:11,358 INFO [rs(jenkins-hbase4.apache.org,36369,1696535998737)-snapshot-pool-0] regionserver.HRegion(2745): Flushing d321f1710d50c228c088de7ff0d8ca4c 1/1 column families, dataSize=3.00 KB heapSize=6.72 KB 2023-10-05 20:01:11,359 DEBUG [member: 'jenkins-hbase4.apache.org,44821,1696535998698' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-10-05 20:01:11,359 DEBUG [member: 'jenkins-hbase4.apache.org,44821,1696535998698' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-05 20:01:11,359 DEBUG [member: 'jenkins-hbase4.apache.org,44821,1696535998698' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-10-05 20:01:11,384 INFO [rs(jenkins-hbase4.apache.org,32861,1696535998642)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202310053972585601704a989785659c99958235 to hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e202310053972585601704a989785659c99958235 2023-10-05 20:01:11,384 INFO [rs(jenkins-hbase4.apache.org,36369,1696535998737)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202310056f5c65e28efc4b28aa76ff26485d5894 to hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b202310056f5c65e28efc4b28aa76ff26485d5894 2023-10-05 20:01:11,391 INFO [rs(jenkins-hbase4.apache.org,36369,1696535998737)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=3.0 K, hasBloomFilter=true, into tmp file hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/data/default/testtb-testExportFileSystemStateWithMergeRegion/d321f1710d50c228c088de7ff0d8ca4c/.tmp/cf/9dd33d6fb6ff4106b74aaf4ed96e0dc1 2023-10-05 20:01:11,391 INFO [rs(jenkins-hbase4.apache.org,32861,1696535998642)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=266, hasBloomFilter=true, into tmp file hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/data/default/testtb-testExportFileSystemStateWithMergeRegion/31d859f310183233a5ec880dbf54d8b9/.tmp/cf/9b9372bc9f8c4faaa77dd8df3edf1e18 2023-10-05 20:01:11,396 DEBUG [rs(jenkins-hbase4.apache.org,36369,1696535998737)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/data/default/testtb-testExportFileSystemStateWithMergeRegion/d321f1710d50c228c088de7ff0d8ca4c/.tmp/cf/9dd33d6fb6ff4106b74aaf4ed96e0dc1 as hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/data/default/testtb-testExportFileSystemStateWithMergeRegion/d321f1710d50c228c088de7ff0d8ca4c/cf/9dd33d6fb6ff4106b74aaf4ed96e0dc1 2023-10-05 20:01:11,396 DEBUG [rs(jenkins-hbase4.apache.org,32861,1696535998642)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/data/default/testtb-testExportFileSystemStateWithMergeRegion/31d859f310183233a5ec880dbf54d8b9/.tmp/cf/9b9372bc9f8c4faaa77dd8df3edf1e18 as hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/data/default/testtb-testExportFileSystemStateWithMergeRegion/31d859f310183233a5ec880dbf54d8b9/cf/9b9372bc9f8c4faaa77dd8df3edf1e18 2023-10-05 20:01:11,401 INFO [rs(jenkins-hbase4.apache.org,32861,1696535998642)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/data/default/testtb-testExportFileSystemStateWithMergeRegion/31d859f310183233a5ec880dbf54d8b9/cf/9b9372bc9f8c4faaa77dd8df3edf1e18, entries=4, sequenceid=6, filesize=5.6 K 2023-10-05 20:01:11,402 INFO [rs(jenkins-hbase4.apache.org,32861,1696535998642)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~266 B/266, heapSize ~816 B/816, currentSize=0 B/0 for 31d859f310183233a5ec880dbf54d8b9 in 44ms, sequenceid=6, compaction requested=false 2023-10-05 20:01:11,402 DEBUG [rs(jenkins-hbase4.apache.org,32861,1696535998642)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithMergeRegion' 2023-10-05 20:01:11,402 DEBUG [rs(jenkins-hbase4.apache.org,32861,1696535998642)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 31d859f310183233a5ec880dbf54d8b9: 2023-10-05 20:01:11,402 DEBUG [rs(jenkins-hbase4.apache.org,32861,1696535998642)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,,1696536070308.31d859f310183233a5ec880dbf54d8b9.' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 20:01:11,402 DEBUG [rs(jenkins-hbase4.apache.org,32861,1696535998642)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-05 20:01:11,402 DEBUG [rs(jenkins-hbase4.apache.org,32861,1696535998642)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/data/default/testtb-testExportFileSystemStateWithMergeRegion/31d859f310183233a5ec880dbf54d8b9/cf/9b9372bc9f8c4faaa77dd8df3edf1e18] hfiles 2023-10-05 20:01:11,402 DEBUG [rs(jenkins-hbase4.apache.org,32861,1696535998642)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/data/default/testtb-testExportFileSystemStateWithMergeRegion/31d859f310183233a5ec880dbf54d8b9/cf/9b9372bc9f8c4faaa77dd8df3edf1e18 for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 20:01:11,403 INFO [rs(jenkins-hbase4.apache.org,36369,1696535998737)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/data/default/testtb-testExportFileSystemStateWithMergeRegion/d321f1710d50c228c088de7ff0d8ca4c/cf/9dd33d6fb6ff4106b74aaf4ed96e0dc1, entries=46, sequenceid=6, filesize=13.4 K 2023-10-05 20:01:11,405 INFO [rs(jenkins-hbase4.apache.org,36369,1696535998737)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.00 KB/3070, heapSize ~6.70 KB/6864, currentSize=0 B/0 for d321f1710d50c228c088de7ff0d8ca4c in 47ms, sequenceid=6, compaction requested=false 2023-10-05 20:01:11,406 DEBUG [rs(jenkins-hbase4.apache.org,36369,1696535998737)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for d321f1710d50c228c088de7ff0d8ca4c: 2023-10-05 20:01:11,406 DEBUG [rs(jenkins-hbase4.apache.org,36369,1696535998737)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,1,1696536070308.d321f1710d50c228c088de7ff0d8ca4c.' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 20:01:11,406 DEBUG [rs(jenkins-hbase4.apache.org,36369,1696535998737)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-05 20:01:11,406 DEBUG [rs(jenkins-hbase4.apache.org,36369,1696535998737)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/data/default/testtb-testExportFileSystemStateWithMergeRegion/d321f1710d50c228c088de7ff0d8ca4c/cf/9dd33d6fb6ff4106b74aaf4ed96e0dc1] hfiles 2023-10-05 20:01:11,406 DEBUG [rs(jenkins-hbase4.apache.org,36369,1696535998737)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/data/default/testtb-testExportFileSystemStateWithMergeRegion/d321f1710d50c228c088de7ff0d8ca4c/cf/9dd33d6fb6ff4106b74aaf4ed96e0dc1 for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 20:01:11,411 DEBUG [rs(jenkins-hbase4.apache.org,32861,1696535998642)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1696536070308.31d859f310183233a5ec880dbf54d8b9. completed. 2023-10-05 20:01:11,411 DEBUG [rs(jenkins-hbase4.apache.org,32861,1696535998642)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1696536070308.31d859f310183233a5ec880dbf54d8b9. 2023-10-05 20:01:11,411 DEBUG [member: 'jenkins-hbase4.apache.org,32861,1696535998642' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-05 20:01:11,412 DEBUG [member: 'jenkins-hbase4.apache.org,32861,1696535998642' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-05 20:01:11,412 DEBUG [member: 'jenkins-hbase4.apache.org,32861,1696535998642' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,32861,1696535998642 2023-10-05 20:01:11,412 DEBUG [member: 'jenkins-hbase4.apache.org,32861,1696535998642' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-10-05 20:01:11,412 DEBUG [member: 'jenkins-hbase4.apache.org,32861,1696535998642' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,32861,1696535998642' in zk 2023-10-05 20:01:11,413 DEBUG [rs(jenkins-hbase4.apache.org,36369,1696535998737)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1696536070308.d321f1710d50c228c088de7ff0d8ca4c. completed. 2023-10-05 20:01:11,413 DEBUG [rs(jenkins-hbase4.apache.org,36369,1696535998737)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1696536070308.d321f1710d50c228c088de7ff0d8ca4c. 2023-10-05 20:01:11,413 DEBUG [member: 'jenkins-hbase4.apache.org,36369,1696535998737' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-05 20:01:11,413 DEBUG [member: 'jenkins-hbase4.apache.org,36369,1696535998737' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-05 20:01:11,413 DEBUG [member: 'jenkins-hbase4.apache.org,36369,1696535998737' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,36369,1696535998737 2023-10-05 20:01:11,413 DEBUG [member: 'jenkins-hbase4.apache.org,36369,1696535998737' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-10-05 20:01:11,413 DEBUG [member: 'jenkins-hbase4.apache.org,36369,1696535998737' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,36369,1696535998737' in zk 2023-10-05 20:01:11,415 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): master:40857-0x101182c1f970000, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,32861,1696535998642 2023-10-05 20:01:11,415 DEBUG [member: 'jenkins-hbase4.apache.org,32861,1696535998642' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-10-05 20:01:11,415 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,32861,1696535998642 2023-10-05 20:01:11,415 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-05 20:01:11,415 DEBUG [member: 'jenkins-hbase4.apache.org,32861,1696535998642' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-05 20:01:11,415 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-05 20:01:11,415 DEBUG [member: 'jenkins-hbase4.apache.org,32861,1696535998642' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-10-05 20:01:11,416 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): master:40857-0x101182c1f970000, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,36369,1696535998737 2023-10-05 20:01:11,416 DEBUG [member: 'jenkins-hbase4.apache.org,36369,1696535998737' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-10-05 20:01:11,416 DEBUG [member: 'jenkins-hbase4.apache.org,36369,1696535998737' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-05 20:01:11,416 DEBUG [member: 'jenkins-hbase4.apache.org,36369,1696535998737' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-10-05 20:01:11,417 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-05 20:01:11,417 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-05 20:01:11,418 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 20:01:11,418 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32861,1696535998642 2023-10-05 20:01:11,418 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36369,1696535998737 2023-10-05 20:01:11,418 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44821,1696535998698 2023-10-05 20:01:11,418 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-05 20:01:11,419 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 20:01:11,419 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32861,1696535998642 2023-10-05 20:01:11,419 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36369,1696535998737 2023-10-05 20:01:11,419 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44821,1696535998698 2023-10-05 20:01:11,420 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,32861,1696535998642': 2023-10-05 20:01:11,420 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,32861,1696535998642' released barrier for procedure'snaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 1 more 2023-10-05 20:01:11,420 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,36369,1696535998737 2023-10-05 20:01:11,420 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-05 20:01:11,420 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-05 20:01:11,420 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-05 20:01:11,420 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-05 20:01:11,420 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 20:01:11,421 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32861,1696535998642 2023-10-05 20:01:11,421 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36369,1696535998737 2023-10-05 20:01:11,421 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44821,1696535998698 2023-10-05 20:01:11,421 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-05 20:01:11,422 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 20:01:11,422 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32861,1696535998642 2023-10-05 20:01:11,422 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36369,1696535998737 2023-10-05 20:01:11,422 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44821,1696535998698 2023-10-05 20:01:11,423 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,36369,1696535998737': 2023-10-05 20:01:11,423 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,36369,1696535998737' released barrier for procedure'snaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 0 more 2023-10-05 20:01:11,423 INFO [(jenkins-hbase4.apache.org,40857,1696535997381)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' execution completed 2023-10-05 20:01:11,423 DEBUG [(jenkins-hbase4.apache.org,40857,1696535997381)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-05 20:01:11,423 DEBUG [(jenkins-hbase4.apache.org,40857,1696535997381)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-05 20:01:11,423 DEBUG [(jenkins-hbase4.apache.org,40857,1696535997381)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 20:01:11,423 INFO [(jenkins-hbase4.apache.org,40857,1696535997381)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateWithMergeRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-10-05 20:01:11,426 DEBUG [Listener at jenkins-hbase4.apache.org/35067] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-05 20:01:11,427 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40857] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-10-05 20:01:11,427 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40857] snapshot.SnapshotManager(406): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-10-05 20:01:11,427 DEBUG [Listener at jenkins-hbase4.apache.org/35067] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-10-05 20:01:11,427 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): regionserver:36369-0x101182c1f970003, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 20:01:11,427 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): master:40857-0x101182c1f970000, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 20:01:11,427 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 20:01:11,427 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): regionserver:44821-0x101182c1f970002, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 20:01:11,427 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): regionserver:32861-0x101182c1f970001, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 20:01:11,428 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 20:01:11,428 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): regionserver:44821-0x101182c1f970002, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-05 20:01:11,428 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 20:01:11,428 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 20:01:11,428 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-05 20:01:11,428 DEBUG [(jenkins-hbase4.apache.org,40857,1696535997381)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40857-0x101182c1f970000, quorum=127.0.0.1:57530, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,32861,1696535998642 2023-10-05 20:01:11,427 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): regionserver:36369-0x101182c1f970003, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-05 20:01:11,428 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-05 20:01:11,428 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 20:01:11,428 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-05 20:01:11,428 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-05 20:01:11,428 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 20:01:11,428 DEBUG [(jenkins-hbase4.apache.org,40857,1696535997381)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40857-0x101182c1f970000, quorum=127.0.0.1:57530, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,36369,1696535998737 2023-10-05 20:01:11,428 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): regionserver:32861-0x101182c1f970001, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-05 20:01:11,428 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-05 20:01:11,428 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-05 20:01:11,428 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 20:01:11,428 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 20:01:11,428 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-05 20:01:11,429 DEBUG [(jenkins-hbase4.apache.org,40857,1696535997381)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40857-0x101182c1f970000, quorum=127.0.0.1:57530, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,44821,1696535998698 2023-10-05 20:01:11,429 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 20:01:11,429 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-05 20:01:11,429 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-05 20:01:11,429 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 20:01:11,429 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-05 20:01:11,429 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 20:01:11,429 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 20:01:11,430 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32861,1696535998642 2023-10-05 20:01:11,430 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36369,1696535998737 2023-10-05 20:01:11,430 DEBUG [(jenkins-hbase4.apache.org,40857,1696535997381)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40857-0x101182c1f970000, quorum=127.0.0.1:57530, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,32861,1696535998642 2023-10-05 20:01:11,430 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44821,1696535998698 2023-10-05 20:01:11,431 DEBUG [(jenkins-hbase4.apache.org,40857,1696535997381)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40857-0x101182c1f970000, quorum=127.0.0.1:57530, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,36369,1696535998737 2023-10-05 20:01:11,431 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-05 20:01:11,431 DEBUG [(jenkins-hbase4.apache.org,40857,1696535997381)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40857-0x101182c1f970000, quorum=127.0.0.1:57530, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,44821,1696535998698 2023-10-05 20:01:11,431 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 20:01:11,431 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32861,1696535998642 2023-10-05 20:01:11,431 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36369,1696535998737 2023-10-05 20:01:11,432 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44821,1696535998698 2023-10-05 20:01:11,433 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): master:40857-0x101182c1f970000, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,44821,1696535998698 2023-10-05 20:01:11,433 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): master:40857-0x101182c1f970000, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 20:01:11,433 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): regionserver:44821-0x101182c1f970002, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-05 20:01:11,433 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): regionserver:32861-0x101182c1f970001, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-05 20:01:11,433 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-05 20:01:11,433 DEBUG [(jenkins-hbase4.apache.org,40857,1696535997381)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-05 20:01:11,433 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-05 20:01:11,433 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): regionserver:32861-0x101182c1f970001, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-05 20:01:11,434 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-05 20:01:11,433 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): regionserver:44821-0x101182c1f970002, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-05 20:01:11,433 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): master:40857-0x101182c1f970000, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,36369,1696535998737 2023-10-05 20:01:11,433 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): regionserver:36369-0x101182c1f970003, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-05 20:01:11,435 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): master:40857-0x101182c1f970000, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,32861,1696535998642 2023-10-05 20:01:11,435 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-05 20:01:11,435 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-05 20:01:11,433 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-05 20:01:11,433 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 20:01:11,435 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-05 20:01:11,435 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): master:40857-0x101182c1f970000, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 20:01:11,435 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): regionserver:36369-0x101182c1f970003, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-05 20:01:11,435 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): master:40857-0x101182c1f970000, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,44821,1696535998698 2023-10-05 20:01:11,435 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-05 20:01:11,435 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-05 20:01:11,435 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemStateWithMergeRegion 2023-10-05 20:01:11,435 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-05 20:01:11,435 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => aaca68e56e63a701f5c1ec9dc2f0511c, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,.mob,0.aaca68e56e63a701f5c1ec9dc2f0511c.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 20:01:11,435 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-05 20:01:11,435 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): master:40857-0x101182c1f970000, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 20:01:11,435 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-10-05 20:01:11,435 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-05 20:01:11,435 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): master:40857-0x101182c1f970000, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,36369,1696535998737 2023-10-05 20:01:11,436 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): master:40857-0x101182c1f970000, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,32861,1696535998642 2023-10-05 20:01:11,436 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): master:40857-0x101182c1f970000, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 20:01:11,436 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): master:40857-0x101182c1f970000, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 20:01:11,436 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b202310056f5c65e28efc4b28aa76ff26485d5894, hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e202310053972585601704a989785659c99958235] mob files 2023-10-05 20:01:11,437 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b202310056f5c65e28efc4b28aa76ff26485d5894 2023-10-05 20:01:11,437 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e202310053972585601704a989785659c99958235 2023-10-05 20:01:11,445 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 20:01:11,445 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 20:01:11,461 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion to hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 20:01:11,461 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed 2023-10-05 20:01:11,461 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 20:01:11,462 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 20:01:11,462 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion at 1696536071324Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemStateWithMergeRegion at 1696536071445 (+121 ms)Consolidate snapshot: snaptb0-testExportFileSystemStateWithMergeRegion at 1696536071445Loading Region manifests for snaptb0-testExportFileSystemStateWithMergeRegion at 1696536071445Writing data manifest for snaptb0-testExportFileSystemStateWithMergeRegion at 1696536071448 (+3 ms)Verifying snapshot: snaptb0-testExportFileSystemStateWithMergeRegion at 1696536071454 (+6 ms)Snapshot snaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed at 1696536071461 (+7 ms) 2023-10-05 20:01:11,464 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=65, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-10-05 20:01:11,466 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=65, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED in 139 msec 2023-10-05 20:01:11,627 DEBUG [Listener at jenkins-hbase4.apache.org/35067] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-05 20:01:11,628 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40857] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-10-05 20:01:11,628 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40857] snapshot.SnapshotManager(403): Snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' has completed, notifying client. 2023-10-05 20:01:11,656 DEBUG [Listener at jenkins-hbase4.apache.org/35067] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-10-05 20:01:11,659 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:32876, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-10-05 20:01:11,660 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32861] regionserver.CompactSplit(310): Interrupting running compactions because user switched off compactions 2023-10-05 20:01:11,661 DEBUG [Listener at jenkins-hbase4.apache.org/35067] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-10-05 20:01:11,663 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:35956, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-10-05 20:01:11,663 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36369] regionserver.CompactSplit(310): Interrupting running compactions because user switched off compactions 2023-10-05 20:01:11,664 DEBUG [Listener at jenkins-hbase4.apache.org/35067] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-10-05 20:01:11,666 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:58276, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-10-05 20:01:11,666 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44821] regionserver.CompactSplit(310): Interrupting running compactions because user switched off compactions 2023-10-05 20:01:11,668 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40857] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemStateWithMergeRegion-1', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-10-05 20:01:11,669 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40857] procedure2.ProcedureExecutor(1028): Stored pid=66, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-10-05 20:01:11,671 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_PRE_OPERATION 2023-10-05 20:01:11,671 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40857] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemStateWithMergeRegion-1" procId is: 66 2023-10-05 20:01:11,672 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-10-05 20:01:11,672 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40857] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-10-05 20:01:11,674 DEBUG [HFileArchiver-17] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/488944e13159e5912610520e20c38f82 2023-10-05 20:01:11,674 DEBUG [HFileArchiver-18] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/051e4799b213d4e2520d4adb5ea63956 2023-10-05 20:01:11,674 DEBUG [HFileArchiver-17] backup.HFileArchiver(153): Directory hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/488944e13159e5912610520e20c38f82 empty. 2023-10-05 20:01:11,675 DEBUG [HFileArchiver-18] backup.HFileArchiver(153): Directory hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/051e4799b213d4e2520d4adb5ea63956 empty. 2023-10-05 20:01:11,675 DEBUG [HFileArchiver-17] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/488944e13159e5912610520e20c38f82 2023-10-05 20:01:11,675 DEBUG [HFileArchiver-18] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/051e4799b213d4e2520d4adb5ea63956 2023-10-05 20:01:11,675 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion-1 regions 2023-10-05 20:01:11,684 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/.tabledesc/.tableinfo.0000000001 2023-10-05 20:01:11,685 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(7675): creating {ENCODED => 488944e13159e5912610520e20c38f82, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1696536071668.488944e13159e5912610520e20c38f82.', STARTKEY => '', ENDKEY => '2'}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion-1', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/.tmp 2023-10-05 20:01:11,685 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(7675): creating {ENCODED => 051e4799b213d4e2520d4adb5ea63956, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,2,1696536071668.051e4799b213d4e2520d4adb5ea63956.', STARTKEY => '2', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion-1', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/.tmp 2023-10-05 20:01:11,696 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,,1696536071668.488944e13159e5912610520e20c38f82.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-05 20:01:11,696 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1604): Closing 488944e13159e5912610520e20c38f82, disabling compactions & flushes 2023-10-05 20:01:11,696 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,,1696536071668.488944e13159e5912610520e20c38f82. 2023-10-05 20:01:11,696 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1696536071668.488944e13159e5912610520e20c38f82. 2023-10-05 20:01:11,696 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1696536071668.488944e13159e5912610520e20c38f82. after waiting 0 ms 2023-10-05 20:01:11,696 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,,1696536071668.488944e13159e5912610520e20c38f82. 2023-10-05 20:01:11,696 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,,1696536071668.488944e13159e5912610520e20c38f82. 2023-10-05 20:01:11,696 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1558): Region close journal for 488944e13159e5912610520e20c38f82: 2023-10-05 20:01:11,696 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,2,1696536071668.051e4799b213d4e2520d4adb5ea63956.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-05 20:01:11,697 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1604): Closing 051e4799b213d4e2520d4adb5ea63956, disabling compactions & flushes 2023-10-05 20:01:11,697 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,2,1696536071668.051e4799b213d4e2520d4adb5ea63956. 2023-10-05 20:01:11,697 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1696536071668.051e4799b213d4e2520d4adb5ea63956. 2023-10-05 20:01:11,697 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1696536071668.051e4799b213d4e2520d4adb5ea63956. after waiting 0 ms 2023-10-05 20:01:11,697 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,2,1696536071668.051e4799b213d4e2520d4adb5ea63956. 2023-10-05 20:01:11,697 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,2,1696536071668.051e4799b213d4e2520d4adb5ea63956. 2023-10-05 20:01:11,697 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1558): Region close journal for 051e4799b213d4e2520d4adb5ea63956: 2023-10-05 20:01:11,699 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_ADD_TO_META 2023-10-05 20:01:11,700 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1696536071668.488944e13159e5912610520e20c38f82.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1696536071700"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696536071700"}]},"ts":"1696536071700"} 2023-10-05 20:01:11,700 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1696536071668.051e4799b213d4e2520d4adb5ea63956.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1696536071700"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696536071700"}]},"ts":"1696536071700"} 2023-10-05 20:01:11,702 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-10-05 20:01:11,703 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-10-05 20:01:11,703 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696536071703"}]},"ts":"1696536071703"} 2023-10-05 20:01:11,704 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=ENABLING in hbase:meta 2023-10-05 20:01:11,708 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-10-05 20:01:11,709 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-10-05 20:01:11,709 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-10-05 20:01:11,709 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-10-05 20:01:11,709 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-10-05 20:01:11,709 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=488944e13159e5912610520e20c38f82, ASSIGN}, {pid=68, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=051e4799b213d4e2520d4adb5ea63956, ASSIGN}] 2023-10-05 20:01:11,712 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=68, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=051e4799b213d4e2520d4adb5ea63956, ASSIGN 2023-10-05 20:01:11,712 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=488944e13159e5912610520e20c38f82, ASSIGN 2023-10-05 20:01:11,713 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=68, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=051e4799b213d4e2520d4adb5ea63956, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,44821,1696535998698; forceNewPlan=false, retain=false 2023-10-05 20:01:11,713 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=488944e13159e5912610520e20c38f82, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,36369,1696535998737; forceNewPlan=false, retain=false 2023-10-05 20:01:11,773 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40857] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-10-05 20:01:11,863 INFO [jenkins-hbase4:40857] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-10-05 20:01:11,865 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=68 updating hbase:meta row=051e4799b213d4e2520d4adb5ea63956, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,44821,1696535998698 2023-10-05 20:01:11,865 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=488944e13159e5912610520e20c38f82, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,36369,1696535998737 2023-10-05 20:01:11,865 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1696536071668.051e4799b213d4e2520d4adb5ea63956.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1696536071865"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696536071865"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696536071865"}]},"ts":"1696536071865"} 2023-10-05 20:01:11,865 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1696536071668.488944e13159e5912610520e20c38f82.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1696536071865"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696536071865"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696536071865"}]},"ts":"1696536071865"} 2023-10-05 20:01:11,867 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=69, ppid=68, state=RUNNABLE; OpenRegionProcedure 051e4799b213d4e2520d4adb5ea63956, server=jenkins-hbase4.apache.org,44821,1696535998698}] 2023-10-05 20:01:11,868 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=70, ppid=67, state=RUNNABLE; OpenRegionProcedure 488944e13159e5912610520e20c38f82, server=jenkins-hbase4.apache.org,36369,1696535998737}] 2023-10-05 20:01:11,974 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40857] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-10-05 20:01:12,022 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion-1,,1696536071668.488944e13159e5912610520e20c38f82. 2023-10-05 20:01:12,022 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion-1,2,1696536071668.051e4799b213d4e2520d4adb5ea63956. 2023-10-05 20:01:12,022 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 488944e13159e5912610520e20c38f82, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1696536071668.488944e13159e5912610520e20c38f82.', STARTKEY => '', ENDKEY => '2'} 2023-10-05 20:01:12,022 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 051e4799b213d4e2520d4adb5ea63956, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,2,1696536071668.051e4799b213d4e2520d4adb5ea63956.', STARTKEY => '2', ENDKEY => ''} 2023-10-05 20:01:12,023 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion-1,,1696536071668.488944e13159e5912610520e20c38f82. service=AccessControlService 2023-10-05 20:01:12,023 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion-1,2,1696536071668.051e4799b213d4e2520d4adb5ea63956. service=AccessControlService 2023-10-05 20:01:12,023 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-10-05 20:01:12,023 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-10-05 20:01:12,023 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion-1 488944e13159e5912610520e20c38f82 2023-10-05 20:01:12,023 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion-1 051e4799b213d4e2520d4adb5ea63956 2023-10-05 20:01:12,023 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,,1696536071668.488944e13159e5912610520e20c38f82.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-05 20:01:12,023 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,2,1696536071668.051e4799b213d4e2520d4adb5ea63956.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-05 20:01:12,023 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 488944e13159e5912610520e20c38f82 2023-10-05 20:01:12,023 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 051e4799b213d4e2520d4adb5ea63956 2023-10-05 20:01:12,023 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 051e4799b213d4e2520d4adb5ea63956 2023-10-05 20:01:12,023 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 488944e13159e5912610520e20c38f82 2023-10-05 20:01:12,025 INFO [StoreOpener-051e4799b213d4e2520d4adb5ea63956-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 051e4799b213d4e2520d4adb5ea63956 2023-10-05 20:01:12,025 INFO [StoreOpener-488944e13159e5912610520e20c38f82-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 488944e13159e5912610520e20c38f82 2023-10-05 20:01:12,026 DEBUG [StoreOpener-051e4799b213d4e2520d4adb5ea63956-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/051e4799b213d4e2520d4adb5ea63956/cf 2023-10-05 20:01:12,026 DEBUG [StoreOpener-488944e13159e5912610520e20c38f82-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/488944e13159e5912610520e20c38f82/cf 2023-10-05 20:01:12,026 DEBUG [StoreOpener-051e4799b213d4e2520d4adb5ea63956-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/051e4799b213d4e2520d4adb5ea63956/cf 2023-10-05 20:01:12,026 DEBUG [StoreOpener-488944e13159e5912610520e20c38f82-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/488944e13159e5912610520e20c38f82/cf 2023-10-05 20:01:12,026 INFO [StoreOpener-051e4799b213d4e2520d4adb5ea63956-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 051e4799b213d4e2520d4adb5ea63956 columnFamilyName cf 2023-10-05 20:01:12,027 INFO [StoreOpener-488944e13159e5912610520e20c38f82-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 488944e13159e5912610520e20c38f82 columnFamilyName cf 2023-10-05 20:01:12,027 INFO [StoreOpener-051e4799b213d4e2520d4adb5ea63956-1] regionserver.HStore(310): Store=051e4799b213d4e2520d4adb5ea63956/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-05 20:01:12,027 INFO [StoreOpener-488944e13159e5912610520e20c38f82-1] regionserver.HStore(310): Store=488944e13159e5912610520e20c38f82/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-05 20:01:12,028 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/051e4799b213d4e2520d4adb5ea63956 2023-10-05 20:01:12,028 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/488944e13159e5912610520e20c38f82 2023-10-05 20:01:12,028 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/051e4799b213d4e2520d4adb5ea63956 2023-10-05 20:01:12,028 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/488944e13159e5912610520e20c38f82 2023-10-05 20:01:12,031 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 488944e13159e5912610520e20c38f82 2023-10-05 20:01:12,031 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 051e4799b213d4e2520d4adb5ea63956 2023-10-05 20:01:12,033 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/051e4799b213d4e2520d4adb5ea63956/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-05 20:01:12,033 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/488944e13159e5912610520e20c38f82/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-05 20:01:12,033 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 051e4799b213d4e2520d4adb5ea63956; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74431505, jitterRate=0.1091158539056778}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-10-05 20:01:12,034 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 488944e13159e5912610520e20c38f82; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=58769599, jitterRate=-0.12426473200321198}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-10-05 20:01:12,034 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 051e4799b213d4e2520d4adb5ea63956: 2023-10-05 20:01:12,034 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 488944e13159e5912610520e20c38f82: 2023-10-05 20:01:12,034 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion-1,2,1696536071668.051e4799b213d4e2520d4adb5ea63956., pid=69, masterSystemTime=1696536072019 2023-10-05 20:01:12,034 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion-1,,1696536071668.488944e13159e5912610520e20c38f82., pid=70, masterSystemTime=1696536072019 2023-10-05 20:01:12,036 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion-1,,1696536071668.488944e13159e5912610520e20c38f82. 2023-10-05 20:01:12,036 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion-1,,1696536071668.488944e13159e5912610520e20c38f82. 2023-10-05 20:01:12,036 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=488944e13159e5912610520e20c38f82, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,36369,1696535998737 2023-10-05 20:01:12,036 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion-1,2,1696536071668.051e4799b213d4e2520d4adb5ea63956. 2023-10-05 20:01:12,036 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion-1,2,1696536071668.051e4799b213d4e2520d4adb5ea63956. 2023-10-05 20:01:12,036 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1696536071668.488944e13159e5912610520e20c38f82.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1696536072036"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1696536072036"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1696536072036"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1696536072036"}]},"ts":"1696536072036"} 2023-10-05 20:01:12,037 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=68 updating hbase:meta row=051e4799b213d4e2520d4adb5ea63956, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,44821,1696535998698 2023-10-05 20:01:12,037 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1696536071668.051e4799b213d4e2520d4adb5ea63956.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1696536072037"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1696536072037"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1696536072037"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1696536072037"}]},"ts":"1696536072037"} 2023-10-05 20:01:12,040 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=70, resume processing ppid=67 2023-10-05 20:01:12,040 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=70, ppid=67, state=SUCCESS; OpenRegionProcedure 488944e13159e5912610520e20c38f82, server=jenkins-hbase4.apache.org,36369,1696535998737 in 170 msec 2023-10-05 20:01:12,040 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=69, resume processing ppid=68 2023-10-05 20:01:12,040 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=69, ppid=68, state=SUCCESS; OpenRegionProcedure 051e4799b213d4e2520d4adb5ea63956, server=jenkins-hbase4.apache.org,44821,1696535998698 in 172 msec 2023-10-05 20:01:12,041 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=67, ppid=66, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=488944e13159e5912610520e20c38f82, ASSIGN in 331 msec 2023-10-05 20:01:12,042 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=68, resume processing ppid=66 2023-10-05 20:01:12,042 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=68, ppid=66, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=051e4799b213d4e2520d4adb5ea63956, ASSIGN in 331 msec 2023-10-05 20:01:12,043 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-10-05 20:01:12,043 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696536072043"}]},"ts":"1696536072043"} 2023-10-05 20:01:12,044 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=ENABLED in hbase:meta 2023-10-05 20:01:12,046 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_POST_OPERATION 2023-10-05 20:01:12,047 DEBUG [PEWorker-5] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemStateWithMergeRegion-1 jenkins: RWXCA 2023-10-05 20:01:12,048 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=32861] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion-1], kv [jenkins: RWXCA] 2023-10-05 20:01:12,050 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): master:40857-0x101182c1f970000, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-05 20:01:12,050 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): regionserver:36369-0x101182c1f970003, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-05 20:01:12,050 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): regionserver:44821-0x101182c1f970002, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-05 20:01:12,050 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): regionserver:32861-0x101182c1f970001, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-05 20:01:12,051 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-10-05 20:01:12,051 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-10-05 20:01:12,051 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-10-05 20:01:12,052 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-10-05 20:01:12,052 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-10-05 20:01:12,052 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-10-05 20:01:12,052 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-10-05 20:01:12,052 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-10-05 20:01:12,053 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=66, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 in 383 msec 2023-10-05 20:01:12,275 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40857] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-10-05 20:01:12,275 INFO [Listener at jenkins-hbase4.apache.org/35067] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 66 completed 2023-10-05 20:01:12,297 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40857] master.HMaster$2(1952): Client=jenkins//172.31.14.131 merge regions 488944e13159e5912610520e20c38f82, 051e4799b213d4e2520d4adb5ea63956 2023-10-05 20:01:12,306 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40857] procedure2.ProcedureExecutor(1028): Stored pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[488944e13159e5912610520e20c38f82, 051e4799b213d4e2520d4adb5ea63956], force=true 2023-10-05 20:01:12,307 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[488944e13159e5912610520e20c38f82, 051e4799b213d4e2520d4adb5ea63956], force=true 2023-10-05 20:01:12,307 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[488944e13159e5912610520e20c38f82, 051e4799b213d4e2520d4adb5ea63956], force=true 2023-10-05 20:01:12,307 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[488944e13159e5912610520e20c38f82, 051e4799b213d4e2520d4adb5ea63956], force=true 2023-10-05 20:01:12,309 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithMergeRegion-1' 2023-10-05 20:01:12,310 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40857] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-10-05 20:01:12,329 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=72, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=488944e13159e5912610520e20c38f82, UNASSIGN}, {pid=73, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=051e4799b213d4e2520d4adb5ea63956, UNASSIGN}] 2023-10-05 20:01:12,331 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=72, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=488944e13159e5912610520e20c38f82, UNASSIGN 2023-10-05 20:01:12,331 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=73, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=051e4799b213d4e2520d4adb5ea63956, UNASSIGN 2023-10-05 20:01:12,332 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=72 updating hbase:meta row=488944e13159e5912610520e20c38f82, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,36369,1696535998737 2023-10-05 20:01:12,332 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=73 updating hbase:meta row=051e4799b213d4e2520d4adb5ea63956, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,44821,1696535998698 2023-10-05 20:01:12,332 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1696536071668.488944e13159e5912610520e20c38f82.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1696536072332"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696536072332"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696536072332"}]},"ts":"1696536072332"} 2023-10-05 20:01:12,332 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1696536071668.051e4799b213d4e2520d4adb5ea63956.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1696536072332"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696536072332"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696536072332"}]},"ts":"1696536072332"} 2023-10-05 20:01:12,333 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=74, ppid=72, state=RUNNABLE; CloseRegionProcedure 488944e13159e5912610520e20c38f82, server=jenkins-hbase4.apache.org,36369,1696535998737}] 2023-10-05 20:01:12,334 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=75, ppid=73, state=RUNNABLE; CloseRegionProcedure 051e4799b213d4e2520d4adb5ea63956, server=jenkins-hbase4.apache.org,44821,1696535998698}] 2023-10-05 20:01:12,411 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40857] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-10-05 20:01:12,486 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 488944e13159e5912610520e20c38f82 2023-10-05 20:01:12,487 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 488944e13159e5912610520e20c38f82, disabling compactions & flushes 2023-10-05 20:01:12,487 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,,1696536071668.488944e13159e5912610520e20c38f82. 2023-10-05 20:01:12,487 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1696536071668.488944e13159e5912610520e20c38f82. 2023-10-05 20:01:12,487 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1696536071668.488944e13159e5912610520e20c38f82. after waiting 0 ms 2023-10-05 20:01:12,488 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,,1696536071668.488944e13159e5912610520e20c38f82. 2023-10-05 20:01:12,488 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 488944e13159e5912610520e20c38f82 1/1 column families, dataSize=24 B heapSize=352 B 2023-10-05 20:01:12,488 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 051e4799b213d4e2520d4adb5ea63956 2023-10-05 20:01:12,489 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 051e4799b213d4e2520d4adb5ea63956, disabling compactions & flushes 2023-10-05 20:01:12,489 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,2,1696536071668.051e4799b213d4e2520d4adb5ea63956. 2023-10-05 20:01:12,489 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1696536071668.051e4799b213d4e2520d4adb5ea63956. 2023-10-05 20:01:12,489 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1696536071668.051e4799b213d4e2520d4adb5ea63956. after waiting 0 ms 2023-10-05 20:01:12,489 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,2,1696536071668.051e4799b213d4e2520d4adb5ea63956. 2023-10-05 20:01:12,489 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 051e4799b213d4e2520d4adb5ea63956 1/1 column families, dataSize=24 B heapSize=352 B 2023-10-05 20:01:12,503 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=24 B at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/051e4799b213d4e2520d4adb5ea63956/.tmp/cf/dd832236b4ed4fa681117984d3a579e2 2023-10-05 20:01:12,503 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=24 B at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/488944e13159e5912610520e20c38f82/.tmp/cf/933f8479b7534b6d8e3343332eef5cb8 2023-10-05 20:01:12,510 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/051e4799b213d4e2520d4adb5ea63956/.tmp/cf/dd832236b4ed4fa681117984d3a579e2 as hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/051e4799b213d4e2520d4adb5ea63956/cf/dd832236b4ed4fa681117984d3a579e2 2023-10-05 20:01:12,510 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/488944e13159e5912610520e20c38f82/.tmp/cf/933f8479b7534b6d8e3343332eef5cb8 as hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/488944e13159e5912610520e20c38f82/cf/933f8479b7534b6d8e3343332eef5cb8 2023-10-05 20:01:12,515 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/488944e13159e5912610520e20c38f82/cf/933f8479b7534b6d8e3343332eef5cb8, entries=1, sequenceid=5, filesize=4.7 K 2023-10-05 20:01:12,515 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/051e4799b213d4e2520d4adb5ea63956/cf/dd832236b4ed4fa681117984d3a579e2, entries=1, sequenceid=5, filesize=4.7 K 2023-10-05 20:01:12,516 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~24 B/24, heapSize ~336 B/336, currentSize=0 B/0 for 051e4799b213d4e2520d4adb5ea63956 in 27ms, sequenceid=5, compaction requested=false 2023-10-05 20:01:12,516 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~24 B/24, heapSize ~336 B/336, currentSize=0 B/0 for 488944e13159e5912610520e20c38f82 in 28ms, sequenceid=5, compaction requested=false 2023-10-05 20:01:12,524 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/051e4799b213d4e2520d4adb5ea63956/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=1 2023-10-05 20:01:12,524 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/488944e13159e5912610520e20c38f82/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=1 2023-10-05 20:01:12,524 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-10-05 20:01:12,524 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-10-05 20:01:12,524 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,2,1696536071668.051e4799b213d4e2520d4adb5ea63956. 2023-10-05 20:01:12,524 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,,1696536071668.488944e13159e5912610520e20c38f82. 2023-10-05 20:01:12,524 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 051e4799b213d4e2520d4adb5ea63956: 2023-10-05 20:01:12,524 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 488944e13159e5912610520e20c38f82: 2023-10-05 20:01:12,526 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 488944e13159e5912610520e20c38f82 2023-10-05 20:01:12,526 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=72 updating hbase:meta row=488944e13159e5912610520e20c38f82, regionState=CLOSED 2023-10-05 20:01:12,526 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1696536071668.488944e13159e5912610520e20c38f82.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1696536072526"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696536072526"}]},"ts":"1696536072526"} 2023-10-05 20:01:12,526 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 051e4799b213d4e2520d4adb5ea63956 2023-10-05 20:01:12,527 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=73 updating hbase:meta row=051e4799b213d4e2520d4adb5ea63956, regionState=CLOSED 2023-10-05 20:01:12,527 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1696536071668.051e4799b213d4e2520d4adb5ea63956.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1696536072527"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696536072527"}]},"ts":"1696536072527"} 2023-10-05 20:01:12,529 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=74, resume processing ppid=72 2023-10-05 20:01:12,529 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=74, ppid=72, state=SUCCESS; CloseRegionProcedure 488944e13159e5912610520e20c38f82, server=jenkins-hbase4.apache.org,36369,1696535998737 in 195 msec 2023-10-05 20:01:12,530 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=75, resume processing ppid=73 2023-10-05 20:01:12,530 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=75, ppid=73, state=SUCCESS; CloseRegionProcedure 051e4799b213d4e2520d4adb5ea63956, server=jenkins-hbase4.apache.org,44821,1696535998698 in 194 msec 2023-10-05 20:01:12,531 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=72, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=488944e13159e5912610520e20c38f82, UNASSIGN in 202 msec 2023-10-05 20:01:12,532 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=73, resume processing ppid=71 2023-10-05 20:01:12,532 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=73, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=051e4799b213d4e2520d4adb5ea63956, UNASSIGN in 201 msec 2023-10-05 20:01:12,573 DEBUG [PEWorker-5] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/c245277211bcce0f0e94518a49db2126/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=-1 2023-10-05 20:01:12,575 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1696536071668.488944e13159e5912610520e20c38f82.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"9223372036854775807"}]},"ts":"9223372036854775807"} 2023-10-05 20:01:12,575 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1696536071668.051e4799b213d4e2520d4adb5ea63956.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"9223372036854775807"}]},"ts":"9223372036854775807"} 2023-10-05 20:01:12,575 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":7,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1696536071669.c245277211bcce0f0e94518a49db2126.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"9223372036854775807"},{"qualifier":"merge0000","vlen":84,"tag":[],"timestamp":"9223372036854775807"},{"qualifier":"merge0001","vlen":84,"tag":[],"timestamp":"9223372036854775807"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"9223372036854775807"}]},"ts":"9223372036854775807"} 2023-10-05 20:01:12,612 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40857] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-10-05 20:01:12,622 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=76, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=c245277211bcce0f0e94518a49db2126, ASSIGN}] 2023-10-05 20:01:12,623 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=76, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=c245277211bcce0f0e94518a49db2126, ASSIGN 2023-10-05 20:01:12,624 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=76, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=c245277211bcce0f0e94518a49db2126, ASSIGN; state=MERGED, location=jenkins-hbase4.apache.org,36369,1696535998737; forceNewPlan=false, retain=false 2023-10-05 20:01:12,774 INFO [jenkins-hbase4:40857] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-10-05 20:01:12,776 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=76 updating hbase:meta row=c245277211bcce0f0e94518a49db2126, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,36369,1696535998737 2023-10-05 20:01:12,776 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1696536071669.c245277211bcce0f0e94518a49db2126.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1696536072776"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696536072776"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696536072776"}]},"ts":"1696536072776"} 2023-10-05 20:01:12,778 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=77, ppid=76, state=RUNNABLE; OpenRegionProcedure c245277211bcce0f0e94518a49db2126, server=jenkins-hbase4.apache.org,36369,1696535998737}] 2023-10-05 20:01:12,913 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40857] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-10-05 20:01:12,932 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion-1,,1696536071669.c245277211bcce0f0e94518a49db2126. 2023-10-05 20:01:12,932 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => c245277211bcce0f0e94518a49db2126, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1696536071669.c245277211bcce0f0e94518a49db2126.', STARTKEY => '', ENDKEY => ''} 2023-10-05 20:01:12,932 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion-1,,1696536071669.c245277211bcce0f0e94518a49db2126. service=AccessControlService 2023-10-05 20:01:12,933 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-10-05 20:01:12,933 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion-1 c245277211bcce0f0e94518a49db2126 2023-10-05 20:01:12,933 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,,1696536071669.c245277211bcce0f0e94518a49db2126.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-05 20:01:12,933 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for c245277211bcce0f0e94518a49db2126 2023-10-05 20:01:12,933 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for c245277211bcce0f0e94518a49db2126 2023-10-05 20:01:12,934 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(950): Rewriting .regioninfo file at: hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/c245277211bcce0f0e94518a49db2126/.regioninfo 2023-10-05 20:01:12,942 INFO [StoreOpener-c245277211bcce0f0e94518a49db2126-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region c245277211bcce0f0e94518a49db2126 2023-10-05 20:01:12,943 DEBUG [StoreOpener-c245277211bcce0f0e94518a49db2126-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/c245277211bcce0f0e94518a49db2126/cf 2023-10-05 20:01:12,943 DEBUG [StoreOpener-c245277211bcce0f0e94518a49db2126-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/c245277211bcce0f0e94518a49db2126/cf 2023-10-05 20:01:12,943 INFO [StoreOpener-c245277211bcce0f0e94518a49db2126-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region c245277211bcce0f0e94518a49db2126 columnFamilyName cf 2023-10-05 20:01:12,970 DEBUG [StoreOpener-c245277211bcce0f0e94518a49db2126-1] regionserver.HStore(539): loaded hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/c245277211bcce0f0e94518a49db2126/cf/933f8479b7534b6d8e3343332eef5cb8.488944e13159e5912610520e20c38f82->hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/488944e13159e5912610520e20c38f82/cf/933f8479b7534b6d8e3343332eef5cb8-top 2023-10-05 20:01:12,975 DEBUG [StoreOpener-c245277211bcce0f0e94518a49db2126-1] regionserver.HStore(539): loaded hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/c245277211bcce0f0e94518a49db2126/cf/dd832236b4ed4fa681117984d3a579e2.051e4799b213d4e2520d4adb5ea63956->hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/051e4799b213d4e2520d4adb5ea63956/cf/dd832236b4ed4fa681117984d3a579e2-top 2023-10-05 20:01:12,975 INFO [StoreOpener-c245277211bcce0f0e94518a49db2126-1] regionserver.HStore(310): Store=c245277211bcce0f0e94518a49db2126/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-05 20:01:12,976 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/c245277211bcce0f0e94518a49db2126 2023-10-05 20:01:12,977 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/c245277211bcce0f0e94518a49db2126 2023-10-05 20:01:12,980 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for c245277211bcce0f0e94518a49db2126 2023-10-05 20:01:12,981 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened c245277211bcce0f0e94518a49db2126; next sequenceid=9; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65127957, jitterRate=-0.02951781451702118}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-10-05 20:01:12,981 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for c245277211bcce0f0e94518a49db2126: 2023-10-05 20:01:12,981 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion-1,,1696536071669.c245277211bcce0f0e94518a49db2126., pid=77, masterSystemTime=1696536072929 2023-10-05 20:01:12,982 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.CompactSplit(328): Ignoring compaction request for testtb-testExportFileSystemStateWithMergeRegion-1,,1696536071669.c245277211bcce0f0e94518a49db2126.,because compaction is disabled. 2023-10-05 20:01:12,983 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion-1,,1696536071669.c245277211bcce0f0e94518a49db2126. 2023-10-05 20:01:12,983 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion-1,,1696536071669.c245277211bcce0f0e94518a49db2126. 2023-10-05 20:01:12,984 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=76 updating hbase:meta row=c245277211bcce0f0e94518a49db2126, regionState=OPEN, openSeqNum=9, regionLocation=jenkins-hbase4.apache.org,36369,1696535998737 2023-10-05 20:01:12,984 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1696536071669.c245277211bcce0f0e94518a49db2126.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1696536072984"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1696536072984"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1696536072984"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1696536072984"}]},"ts":"1696536072984"} 2023-10-05 20:01:12,987 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=77, resume processing ppid=76 2023-10-05 20:01:12,987 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=77, ppid=76, state=SUCCESS; OpenRegionProcedure c245277211bcce0f0e94518a49db2126, server=jenkins-hbase4.apache.org,36369,1696535998737 in 207 msec 2023-10-05 20:01:12,988 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=76, resume processing ppid=71 2023-10-05 20:01:12,988 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=76, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=c245277211bcce0f0e94518a49db2126, ASSIGN in 365 msec 2023-10-05 20:01:12,990 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=71, state=SUCCESS; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[488944e13159e5912610520e20c38f82, 051e4799b213d4e2520d4adb5ea63956], force=true in 688 msec 2023-10-05 20:01:13,414 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40857] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-10-05 20:01:13,414 INFO [Listener at jenkins-hbase4.apache.org/35067] client.HBaseAdmin$TableFuture(3541): Operation: MERGE_REGIONS, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 71 completed 2023-10-05 20:01:13,415 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40857] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } 2023-10-05 20:01:13,415 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40857] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1696536073415 (current time:1696536073415). 2023-10-05 20:01:13,415 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40857] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-10-05 20:01:13,415 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40857] zookeeper.ReadOnlyZKClient(139): Connect 0x3d4d60b3 to 127.0.0.1:57530 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-05 20:01:13,423 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40857] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@213eee0, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-05 20:01:13,424 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40857] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-05 20:01:13,427 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:58282, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-05 20:01:13,428 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40857] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x3d4d60b3 to 127.0.0.1:57530 2023-10-05 20:01:13,428 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40857] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-05 20:01:13,429 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40857] zookeeper.ReadOnlyZKClient(139): Connect 0x70db8519 to 127.0.0.1:57530 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-05 20:01:13,434 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40857] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@26c53b49, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-05 20:01:13,435 DEBUG [hconnection-0x3bbcb59f-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-05 20:01:13,437 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:58298, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-05 20:01:13,441 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40857] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-05 20:01:13,443 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:32886, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-05 20:01:13,444 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40857] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x70db8519 to 127.0.0.1:57530 2023-10-05 20:01:13,444 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40857] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-05 20:01:13,444 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40857] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion-1], kv [jenkins: RWXCA] 2023-10-05 20:01:13,445 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40857] snapshot.SnapshotManager(637): No existing snapshot, attempting snapshot... 2023-10-05 20:01:13,445 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40857] snapshot.SnapshotManager(684): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } 2023-10-05 20:01:13,447 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40857] snapshot.SnapshotManager(519): Unable to retrieve ACL status for path: hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/.hbase-snapshot, current working dir path: hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 org.apache.hadoop.hdfs.protocol.AclException: The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.ipc.RemoteException.instantiateException(RemoteException.java:121) at org.apache.hadoop.ipc.RemoteException.unwrapRemoteException(RemoteException.java:88) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2736) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2294) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2291) at org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81) at org.apache.hadoop.hdfs.DistributedFileSystem.getAclStatus(DistributedFileSystem.java:2291) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.updateWorkingDirAclsIfRequired(SnapshotManager.java:517) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.prepareToTakeSnapshot(SnapshotManager.java:490) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.snapshotEnabledTable(SnapshotManager.java:559) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshotInternal(SnapshotManager.java:687) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshot(SnapshotManager.java:623) at org.apache.hadoop.hbase.master.MasterRpcServices.snapshot(MasterRpcServices.java:1588) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) Caused by: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.hdfs.protocol.AclException): The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at org.apache.hadoop.ipc.Client.getRpcResponse(Client.java:1540) at org.apache.hadoop.ipc.Client.call(Client.java:1486) at org.apache.hadoop.ipc.Client.call(Client.java:1385) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:232) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:118) at com.sun.proxy.$Proxy32.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.getAclStatus(ClientNamenodeProtocolTranslatorPB.java:1385) at sun.reflect.GeneratedMethodAccessor62.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:422) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeMethod(RetryInvocationHandler.java:165) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invoke(RetryInvocationHandler.java:157) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeOnce(RetryInvocationHandler.java:95) at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:359) at com.sun.proxy.$Proxy35.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor62.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor62.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor62.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor62.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor62.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2734) ... 15 more 2023-10-05 20:01:13,449 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40857] procedure2.ProcedureExecutor(1028): Stored pid=78, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE 2023-10-05 20:01:13,450 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=78, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE 2023-10-05 20:01:13,450 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=78, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE; timeout=600000, timestamp=1696536673450 2023-10-05 20:01:13,450 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion-1 2023-10-05 20:01:13,450 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40857] snapshot.SnapshotManager(689): Started snapshot: { ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } 2023-10-05 20:01:13,454 DEBUG [Listener at jenkins-hbase4.apache.org/35067] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-10-05 20:01:13,454 DEBUG [Listener at jenkins-hbase4.apache.org/35067] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-10-05 20:01:13,455 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=78, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE 2023-10-05 20:01:13,455 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=79, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED 2023-10-05 20:01:13,456 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=78, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE in 7 msec 2023-10-05 20:01:13,456 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=79, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED 2023-10-05 20:01:13,457 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=79, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED; timeout=600000, timestamp=1696536673457 2023-10-05 20:01:13,466 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-05 20:01:13,466 INFO [(jenkins-hbase4.apache.org,40857,1696535997381)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' 2023-10-05 20:01:13,466 DEBUG [(jenkins-hbase4.apache.org,40857,1696535997381)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-05 20:01:13,467 DEBUG [(jenkins-hbase4.apache.org,40857,1696535997381)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' 2023-10-05 20:01:13,467 DEBUG [(jenkins-hbase4.apache.org,40857,1696535997381)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1', kicking off acquire phase on members. 2023-10-05 20:01:13,467 DEBUG [(jenkins-hbase4.apache.org,40857,1696535997381)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40857-0x101182c1f970000, quorum=127.0.0.1:57530, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-05 20:01:13,467 DEBUG [(jenkins-hbase4.apache.org,40857,1696535997381)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-05 20:01:13,470 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): regionserver:44821-0x101182c1f970002, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-05 20:01:13,470 DEBUG [(jenkins-hbase4.apache.org,40857,1696535997381)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,36369,1696535998737 2023-10-05 20:01:13,470 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-05 20:01:13,470 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-05 20:01:13,470 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): regionserver:32861-0x101182c1f970001, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-05 20:01:13,470 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): regionserver:36369-0x101182c1f970003, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-05 20:01:13,470 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-05 20:01:13,470 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-05 20:01:13,471 DEBUG [(jenkins-hbase4.apache.org,40857,1696535997381)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40857-0x101182c1f970000, quorum=127.0.0.1:57530, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,36369,1696535998737 2023-10-05 20:01:13,471 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-05 20:01:13,470 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-05 20:01:13,471 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-05 20:01:13,471 DEBUG [(jenkins-hbase4.apache.org,40857,1696535997381)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-05 20:01:13,471 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-05 20:01:13,471 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44821-0x101182c1f970002, quorum=127.0.0.1:57530, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-05 20:01:13,471 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-05 20:01:13,471 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:32861-0x101182c1f970001, quorum=127.0.0.1:57530, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-05 20:01:13,471 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 220 2023-10-05 20:01:13,471 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-05 20:01:13,471 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36369-0x101182c1f970003, quorum=127.0.0.1:57530, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-05 20:01:13,472 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 from table testtb-testExportFileSystemStateWithMergeRegion-1 type FLUSH 2023-10-05 20:01:13,472 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 220 2023-10-05 20:01:13,472 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-05 20:01:13,472 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 from table testtb-testExportFileSystemStateWithMergeRegion-1 type FLUSH 2023-10-05 20:01:13,472 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 220 2023-10-05 20:01:13,472 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-05 20:01:13,472 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-05 20:01:13,472 DEBUG [member: 'jenkins-hbase4.apache.org,44821,1696535998698' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' with timeout 300000ms 2023-10-05 20:01:13,472 DEBUG [member: 'jenkins-hbase4.apache.org,44821,1696535998698' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-05 20:01:13,472 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 from table testtb-testExportFileSystemStateWithMergeRegion-1 type FLUSH 2023-10-05 20:01:13,473 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-05 20:01:13,474 DEBUG [member: 'jenkins-hbase4.apache.org,44821,1696535998698' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' stage 2023-10-05 20:01:13,474 DEBUG [member: 'jenkins-hbase4.apache.org,32861,1696535998642' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' with timeout 300000ms 2023-10-05 20:01:13,474 DEBUG [member: 'jenkins-hbase4.apache.org,32861,1696535998642' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-05 20:01:13,474 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-05 20:01:13,475 DEBUG [member: 'jenkins-hbase4.apache.org,32861,1696535998642' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' stage 2023-10-05 20:01:13,475 DEBUG [member: 'jenkins-hbase4.apache.org,36369,1696535998737' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' with timeout 300000ms 2023-10-05 20:01:13,475 DEBUG [member: 'jenkins-hbase4.apache.org,32861,1696535998642' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally acquired 2023-10-05 20:01:13,475 DEBUG [member: 'jenkins-hbase4.apache.org,36369,1696535998737' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-05 20:01:13,475 DEBUG [member: 'jenkins-hbase4.apache.org,32861,1696535998642' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,32861,1696535998642' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion-1) in zk 2023-10-05 20:01:13,476 DEBUG [member: 'jenkins-hbase4.apache.org,36369,1696535998737' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' stage 2023-10-05 20:01:13,476 DEBUG [member: 'jenkins-hbase4.apache.org,36369,1696535998737' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally acquired 2023-10-05 20:01:13,474 DEBUG [member: 'jenkins-hbase4.apache.org,44821,1696535998698' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally acquired 2023-10-05 20:01:13,476 DEBUG [member: 'jenkins-hbase4.apache.org,36369,1696535998737' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,36369,1696535998737' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion-1) in zk 2023-10-05 20:01:13,476 DEBUG [member: 'jenkins-hbase4.apache.org,44821,1696535998698' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44821,1696535998698' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion-1) in zk 2023-10-05 20:01:13,478 DEBUG [member: 'jenkins-hbase4.apache.org,32861,1696535998642' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-05 20:01:13,479 DEBUG [member: 'jenkins-hbase4.apache.org,36369,1696535998737' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-05 20:01:13,479 DEBUG [member: 'jenkins-hbase4.apache.org,44821,1696535998698' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-05 20:01:13,479 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): master:40857-0x101182c1f970000, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,36369,1696535998737 2023-10-05 20:01:13,479 DEBUG [member: 'jenkins-hbase4.apache.org,32861,1696535998642' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:32861-0x101182c1f970001, quorum=127.0.0.1:57530, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-05 20:01:13,479 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,36369,1696535998737 2023-10-05 20:01:13,479 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-05 20:01:13,479 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-05 20:01:13,479 DEBUG [member: 'jenkins-hbase4.apache.org,32861,1696535998642' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-05 20:01:13,479 DEBUG [member: 'jenkins-hbase4.apache.org,44821,1696535998698' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44821-0x101182c1f970002, quorum=127.0.0.1:57530, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-05 20:01:13,479 DEBUG [member: 'jenkins-hbase4.apache.org,36369,1696535998737' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36369-0x101182c1f970003, quorum=127.0.0.1:57530, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-05 20:01:13,479 DEBUG [member: 'jenkins-hbase4.apache.org,36369,1696535998737' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-05 20:01:13,479 DEBUG [member: 'jenkins-hbase4.apache.org,44821,1696535998698' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-05 20:01:13,480 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-05 20:01:13,480 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-05 20:01:13,480 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-05 20:01:13,480 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32861,1696535998642 2023-10-05 20:01:13,481 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36369,1696535998737 2023-10-05 20:01:13,481 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44821,1696535998698 2023-10-05 20:01:13,481 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-05 20:01:13,481 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,36369,1696535998737' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' on coordinator 2023-10-05 20:01:13,481 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@51058fea[Count = 0] remaining members to acquire global barrier 2023-10-05 20:01:13,481 DEBUG [(jenkins-hbase4.apache.org,40857,1696535997381)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'in-barrier' execution. 2023-10-05 20:01:13,482 DEBUG [(jenkins-hbase4.apache.org,40857,1696535997381)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-05 20:01:13,483 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): regionserver:44821-0x101182c1f970002, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-05 20:01:13,483 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): regionserver:32861-0x101182c1f970001, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-05 20:01:13,483 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): regionserver:36369-0x101182c1f970003, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-05 20:01:13,483 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-05 20:01:13,483 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-05 20:01:13,483 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-05 20:01:13,483 DEBUG [(jenkins-hbase4.apache.org,40857,1696535997381)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40857-0x101182c1f970000, quorum=127.0.0.1:57530, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,36369,1696535998737 2023-10-05 20:01:13,483 DEBUG [(jenkins-hbase4.apache.org,40857,1696535997381)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-05 20:01:13,483 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-05 20:01:13,483 DEBUG [member: 'jenkins-hbase4.apache.org,32861,1696535998642' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' received 'reached' from coordinator. 2023-10-05 20:01:13,483 DEBUG [member: 'jenkins-hbase4.apache.org,44821,1696535998698' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' received 'reached' from coordinator. 2023-10-05 20:01:13,484 DEBUG [member: 'jenkins-hbase4.apache.org,44821,1696535998698' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally completed 2023-10-05 20:01:13,484 DEBUG [member: 'jenkins-hbase4.apache.org,44821,1696535998698' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed for member 'jenkins-hbase4.apache.org,44821,1696535998698' in zk 2023-10-05 20:01:13,483 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-05 20:01:13,483 DEBUG [member: 'jenkins-hbase4.apache.org,32861,1696535998642' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally completed 2023-10-05 20:01:13,484 DEBUG [member: 'jenkins-hbase4.apache.org,32861,1696535998642' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed for member 'jenkins-hbase4.apache.org,32861,1696535998642' in zk 2023-10-05 20:01:13,484 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-05 20:01:13,484 DEBUG [member: 'jenkins-hbase4.apache.org,36369,1696535998737' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' received 'reached' from coordinator. 2023-10-05 20:01:13,484 DEBUG [member: 'jenkins-hbase4.apache.org,36369,1696535998737' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-05 20:01:13,484 DEBUG [member: 'jenkins-hbase4.apache.org,36369,1696535998737' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-05 20:01:13,484 DEBUG [rs(jenkins-hbase4.apache.org,36369,1696535998737)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion-1,,1696536071669.c245277211bcce0f0e94518a49db2126. 2023-10-05 20:01:13,484 DEBUG [rs(jenkins-hbase4.apache.org,36369,1696535998737)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion-1,,1696536071669.c245277211bcce0f0e94518a49db2126. started... 2023-10-05 20:01:13,485 DEBUG [rs(jenkins-hbase4.apache.org,36369,1696535998737)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for c245277211bcce0f0e94518a49db2126: 2023-10-05 20:01:13,486 DEBUG [rs(jenkins-hbase4.apache.org,36369,1696535998737)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion-1,,1696536071669.c245277211bcce0f0e94518a49db2126.' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-05 20:01:13,486 DEBUG [rs(jenkins-hbase4.apache.org,36369,1696535998737)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-05 20:01:13,486 DEBUG [rs(jenkins-hbase4.apache.org,36369,1696535998737)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/c245277211bcce0f0e94518a49db2126/cf/933f8479b7534b6d8e3343332eef5cb8.488944e13159e5912610520e20c38f82->hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/488944e13159e5912610520e20c38f82/cf/933f8479b7534b6d8e3343332eef5cb8-top, hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/c245277211bcce0f0e94518a49db2126/cf/dd832236b4ed4fa681117984d3a579e2.051e4799b213d4e2520d4adb5ea63956->hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/051e4799b213d4e2520d4adb5ea63956/cf/dd832236b4ed4fa681117984d3a579e2-top] hfiles 2023-10-05 20:01:13,486 DEBUG [rs(jenkins-hbase4.apache.org,36369,1696535998737)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/2): hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/c245277211bcce0f0e94518a49db2126/cf/933f8479b7534b6d8e3343332eef5cb8.488944e13159e5912610520e20c38f82 for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-05 20:01:13,487 DEBUG [member: 'jenkins-hbase4.apache.org,44821,1696535998698' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' has notified controller of completion 2023-10-05 20:01:13,487 DEBUG [member: 'jenkins-hbase4.apache.org,44821,1696535998698' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-05 20:01:13,487 DEBUG [member: 'jenkins-hbase4.apache.org,44821,1696535998698' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed. 2023-10-05 20:01:13,488 DEBUG [member: 'jenkins-hbase4.apache.org,32861,1696535998642' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' has notified controller of completion 2023-10-05 20:01:13,488 DEBUG [rs(jenkins-hbase4.apache.org,36369,1696535998737)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (2/2): hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/c245277211bcce0f0e94518a49db2126/cf/dd832236b4ed4fa681117984d3a579e2.051e4799b213d4e2520d4adb5ea63956 for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-05 20:01:13,488 DEBUG [member: 'jenkins-hbase4.apache.org,32861,1696535998642' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-05 20:01:13,488 DEBUG [member: 'jenkins-hbase4.apache.org,32861,1696535998642' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed. 2023-10-05 20:01:13,499 DEBUG [rs(jenkins-hbase4.apache.org,36369,1696535998737)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion-1,,1696536071669.c245277211bcce0f0e94518a49db2126. completed. 2023-10-05 20:01:13,499 DEBUG [rs(jenkins-hbase4.apache.org,36369,1696535998737)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion-1,,1696536071669.c245277211bcce0f0e94518a49db2126. 2023-10-05 20:01:13,499 DEBUG [member: 'jenkins-hbase4.apache.org,36369,1696535998737' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-05 20:01:13,499 DEBUG [member: 'jenkins-hbase4.apache.org,36369,1696535998737' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-05 20:01:13,499 DEBUG [member: 'jenkins-hbase4.apache.org,36369,1696535998737' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,36369,1696535998737 2023-10-05 20:01:13,499 DEBUG [member: 'jenkins-hbase4.apache.org,36369,1696535998737' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally completed 2023-10-05 20:01:13,499 DEBUG [member: 'jenkins-hbase4.apache.org,36369,1696535998737' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed for member 'jenkins-hbase4.apache.org,36369,1696535998737' in zk 2023-10-05 20:01:13,507 DEBUG [member: 'jenkins-hbase4.apache.org,36369,1696535998737' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' has notified controller of completion 2023-10-05 20:01:13,507 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): master:40857-0x101182c1f970000, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,36369,1696535998737 2023-10-05 20:01:13,507 DEBUG [member: 'jenkins-hbase4.apache.org,36369,1696535998737' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-05 20:01:13,507 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,36369,1696535998737 2023-10-05 20:01:13,507 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-05 20:01:13,507 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-05 20:01:13,507 DEBUG [member: 'jenkins-hbase4.apache.org,36369,1696535998737' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed. 2023-10-05 20:01:13,507 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-05 20:01:13,508 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-05 20:01:13,508 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-05 20:01:13,508 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32861,1696535998642 2023-10-05 20:01:13,508 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36369,1696535998737 2023-10-05 20:01:13,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44821,1696535998698 2023-10-05 20:01:13,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-05 20:01:13,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-05 20:01:13,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32861,1696535998642 2023-10-05 20:01:13,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36369,1696535998737 2023-10-05 20:01:13,510 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44821,1696535998698 2023-10-05 20:01:13,510 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' member 'jenkins-hbase4.apache.org,36369,1696535998737': 2023-10-05 20:01:13,510 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,36369,1696535998737' released barrier for procedure'snaptb0-testExportFileSystemStateWithMergeRegion-1', counting down latch. Waiting for 0 more 2023-10-05 20:01:13,510 INFO [(jenkins-hbase4.apache.org,40857,1696535997381)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' execution completed 2023-10-05 20:01:13,510 DEBUG [(jenkins-hbase4.apache.org,40857,1696535997381)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-05 20:01:13,510 DEBUG [(jenkins-hbase4.apache.org,40857,1696535997381)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-05 20:01:13,510 DEBUG [(jenkins-hbase4.apache.org,40857,1696535997381)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-05 20:01:13,510 INFO [(jenkins-hbase4.apache.org,40857,1696535997381)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateWithMergeRegion-1including nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-10-05 20:01:13,512 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): regionserver:44821-0x101182c1f970002, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-05 20:01:13,512 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): regionserver:32861-0x101182c1f970001, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-05 20:01:13,512 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): master:40857-0x101182c1f970000, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-05 20:01:13,512 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-05 20:01:13,512 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-05 20:01:13,512 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-05 20:01:13,512 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-05 20:01:13,512 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-05 20:01:13,512 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): regionserver:32861-0x101182c1f970001, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-05 20:01:13,512 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-05 20:01:13,512 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-05 20:01:13,512 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): regionserver:44821-0x101182c1f970002, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-05 20:01:13,512 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): regionserver:36369-0x101182c1f970003, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-05 20:01:13,512 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): regionserver:36369-0x101182c1f970003, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-05 20:01:13,513 DEBUG [(jenkins-hbase4.apache.org,40857,1696535997381)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40857-0x101182c1f970000, quorum=127.0.0.1:57530, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,32861,1696535998642 2023-10-05 20:01:13,513 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-05 20:01:13,513 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-05 20:01:13,513 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-05 20:01:13,513 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-05 20:01:13,513 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-05 20:01:13,513 DEBUG [(jenkins-hbase4.apache.org,40857,1696535997381)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40857-0x101182c1f970000, quorum=127.0.0.1:57530, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,36369,1696535998737 2023-10-05 20:01:13,513 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-05 20:01:13,513 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-05 20:01:13,513 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-05 20:01:13,513 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-05 20:01:13,513 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-05 20:01:13,513 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-05 20:01:13,514 DEBUG [(jenkins-hbase4.apache.org,40857,1696535997381)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40857-0x101182c1f970000, quorum=127.0.0.1:57530, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,44821,1696535998698 2023-10-05 20:01:13,514 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-05 20:01:13,514 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-05 20:01:13,514 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-05 20:01:13,514 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-05 20:01:13,514 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32861,1696535998642 2023-10-05 20:01:13,515 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36369,1696535998737 2023-10-05 20:01:13,515 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44821,1696535998698 2023-10-05 20:01:13,515 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-05 20:01:13,515 DEBUG [(jenkins-hbase4.apache.org,40857,1696535997381)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40857-0x101182c1f970000, quorum=127.0.0.1:57530, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,32861,1696535998642 2023-10-05 20:01:13,515 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-05 20:01:13,516 DEBUG [(jenkins-hbase4.apache.org,40857,1696535997381)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40857-0x101182c1f970000, quorum=127.0.0.1:57530, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,36369,1696535998737 2023-10-05 20:01:13,516 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32861,1696535998642 2023-10-05 20:01:13,516 DEBUG [(jenkins-hbase4.apache.org,40857,1696535997381)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40857-0x101182c1f970000, quorum=127.0.0.1:57530, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,44821,1696535998698 2023-10-05 20:01:13,516 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36369,1696535998737 2023-10-05 20:01:13,516 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44821,1696535998698 2023-10-05 20:01:13,519 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): master:40857-0x101182c1f970000, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,44821,1696535998698 2023-10-05 20:01:13,519 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): regionserver:44821-0x101182c1f970002, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-05 20:01:13,519 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): regionserver:32861-0x101182c1f970001, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-05 20:01:13,519 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): master:40857-0x101182c1f970000, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-05 20:01:13,519 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): regionserver:44821-0x101182c1f970002, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-05 20:01:13,519 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): regionserver:36369-0x101182c1f970003, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-05 20:01:13,519 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): master:40857-0x101182c1f970000, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,36369,1696535998737 2023-10-05 20:01:13,519 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-05 20:01:13,519 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-05 20:01:13,519 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): regionserver:32861-0x101182c1f970001, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-05 20:01:13,519 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-05 20:01:13,519 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-05 20:01:13,519 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-05 20:01:13,519 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-05 20:01:13,519 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-05 20:01:13,519 DEBUG [(jenkins-hbase4.apache.org,40857,1696535997381)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-05 20:01:13,519 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): master:40857-0x101182c1f970000, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,32861,1696535998642 2023-10-05 20:01:13,519 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): regionserver:36369-0x101182c1f970003, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-05 20:01:13,519 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): master:40857-0x101182c1f970000, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-05 20:01:13,519 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-05 20:01:13,520 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): master:40857-0x101182c1f970000, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,44821,1696535998698 2023-10-05 20:01:13,520 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): master:40857-0x101182c1f970000, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-05 20:01:13,520 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): master:40857-0x101182c1f970000, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,36369,1696535998737 2023-10-05 20:01:13,520 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): master:40857-0x101182c1f970000, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,32861,1696535998642 2023-10-05 20:01:13,520 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): master:40857-0x101182c1f970000, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-05 20:01:13,520 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): master:40857-0x101182c1f970000, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-05 20:01:13,520 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-05 20:01:13,521 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-05 20:01:13,521 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-05 20:01:13,521 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-05 20:01:13,521 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-05 20:01:13,521 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-05 20:01:13,521 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-05 20:01:13,541 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 to hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-05 20:01:13,541 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 of table testtb-testExportFileSystemStateWithMergeRegion-1 completed 2023-10-05 20:01:13,542 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-05 20:01:13,542 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-05 20:01:13,542 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion-1 at 1696536073450Consolidate snapshot: snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1696536073519 (+69 ms)Loading Region manifests for snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1696536073520 (+1 ms)Writing data manifest for snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1696536073523 (+3 ms)Verifying snapshot: snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1696536073533 (+10 ms)Snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 of table testtb-testExportFileSystemStateWithMergeRegion-1 completed at 1696536073541 (+8 ms) 2023-10-05 20:01:13,545 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=79, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED 2023-10-05 20:01:13,546 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=79, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED in 92 msec 2023-10-05 20:01:13,555 DEBUG [Listener at jenkins-hbase4.apache.org/35067] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-05 20:01:13,556 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40857] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } is done 2023-10-05 20:01:13,556 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40857] snapshot.SnapshotManager(403): Snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }' has completed, notifying client. 2023-10-05 20:01:13,556 INFO [Listener at jenkins-hbase4.apache.org/35067] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/export-test/export-1696536073556 2023-10-05 20:01:13,556 INFO [Listener at jenkins-hbase4.apache.org/35067] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:45929, tgtDir=hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/export-test/export-1696536073556, rawTgtDir=hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/export-test/export-1696536073556, srcFsUri=hdfs://localhost:45929, srcDir=hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2 2023-10-05 20:01:13,578 DEBUG [Listener at jenkins-hbase4.apache.org/35067] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:45929, inputRoot=hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2 2023-10-05 20:01:13,578 DEBUG [Listener at jenkins-hbase4.apache.org/35067] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-292443360_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/export-test/export-1696536073556, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/export-test/export-1696536073556/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-05 20:01:13,578 INFO [Listener at jenkins-hbase4.apache.org/35067] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:45929, inputRoot=hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2, snapshotDir=hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1. 2023-10-05 20:01:13,586 INFO [Listener at jenkins-hbase4.apache.org/35067] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 to hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/export-test/export-1696536073556/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-05 20:01:13,607 DEBUG [Listener at jenkins-hbase4.apache.org/35067] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-10-05 20:01:13,608 DEBUG [Listener at jenkins-hbase4.apache.org/35067] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-10-05 20:01:13,608 DEBUG [Listener at jenkins-hbase4.apache.org/35067] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-10-05 20:01:13,609 DEBUG [Listener at jenkins-hbase4.apache.org/35067] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-10-05 20:01:14,114 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696536006875_0004_000001 (auth:SIMPLE) 2023-10-05 20:01:14,499 DEBUG [Listener at jenkins-hbase4.apache.org/35067] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/190200ca-70b6-4852-ff08-4943c98578e6/hadoop-2815533099418313849.jar 2023-10-05 20:01:14,500 DEBUG [Listener at jenkins-hbase4.apache.org/35067] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-10-05 20:01:14,500 DEBUG [Listener at jenkins-hbase4.apache.org/35067] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-10-05 20:01:14,566 DEBUG [Listener at jenkins-hbase4.apache.org/35067] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/190200ca-70b6-4852-ff08-4943c98578e6/hadoop-6275939158810774626.jar 2023-10-05 20:01:14,567 DEBUG [Listener at jenkins-hbase4.apache.org/35067] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-10-05 20:01:14,567 DEBUG [Listener at jenkins-hbase4.apache.org/35067] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-10-05 20:01:14,568 DEBUG [Listener at jenkins-hbase4.apache.org/35067] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-10-05 20:01:14,568 DEBUG [Listener at jenkins-hbase4.apache.org/35067] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-10-05 20:01:14,568 DEBUG [Listener at jenkins-hbase4.apache.org/35067] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-10-05 20:01:14,569 DEBUG [Listener at jenkins-hbase4.apache.org/35067] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-10-05 20:01:14,569 DEBUG [Listener at jenkins-hbase4.apache.org/35067] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-10-05 20:01:14,569 DEBUG [Listener at jenkins-hbase4.apache.org/35067] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-10-05 20:01:14,570 DEBUG [Listener at jenkins-hbase4.apache.org/35067] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-10-05 20:01:14,570 DEBUG [Listener at jenkins-hbase4.apache.org/35067] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-10-05 20:01:14,570 DEBUG [Listener at jenkins-hbase4.apache.org/35067] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-10-05 20:01:14,571 DEBUG [Listener at jenkins-hbase4.apache.org/35067] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-10-05 20:01:14,571 DEBUG [Listener at jenkins-hbase4.apache.org/35067] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-10-05 20:01:14,572 DEBUG [Listener at jenkins-hbase4.apache.org/35067] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-10-05 20:01:14,572 DEBUG [Listener at jenkins-hbase4.apache.org/35067] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-10-05 20:01:14,572 DEBUG [Listener at jenkins-hbase4.apache.org/35067] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-10-05 20:01:14,573 DEBUG [Listener at jenkins-hbase4.apache.org/35067] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-05 20:01:14,573 DEBUG [Listener at jenkins-hbase4.apache.org/35067] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-05 20:01:14,574 DEBUG [Listener at jenkins-hbase4.apache.org/35067] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-10-05 20:01:14,574 DEBUG [Listener at jenkins-hbase4.apache.org/35067] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-05 20:01:14,574 DEBUG [Listener at jenkins-hbase4.apache.org/35067] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-05 20:01:14,575 DEBUG [Listener at jenkins-hbase4.apache.org/35067] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-10-05 20:01:14,575 DEBUG [Listener at jenkins-hbase4.apache.org/35067] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-10-05 20:01:14,903 WARN [Listener at jenkins-hbase4.apache.org/35067] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-10-05 20:01:14,905 INFO [Listener at jenkins-hbase4.apache.org/35067] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportFileSystemStateWithMergeRegion-1' hfile list 2023-10-05 20:01:14,907 DEBUG [Listener at jenkins-hbase4.apache.org/35067] snapshot.ExportSnapshot(671): export split=0 size=9.5 K 2023-10-05 20:01:14,963 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-10-05 20:01:14,963 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-10-05 20:01:15,117 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696536006875_0005_000001 (auth:SIMPLE) 2023-10-05 20:01:15,586 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-10-05 20:01:18,736 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696536006875_0005_000001 (auth:SIMPLE) 2023-10-05 20:01:20,945 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696536006875_0005_000001 (auth:SIMPLE) 2023-10-05 20:01:23,228 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696536006875_0005_000001 (auth:SIMPLE) 2023-10-05 20:01:25,075 INFO [Listener at jenkins-hbase4.apache.org/35067] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-10-05 20:01:25,078 INFO [Listener at jenkins-hbase4.apache.org/35067] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-10-05 20:01:25,086 INFO [Listener at jenkins-hbase4.apache.org/35067] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-05 20:01:25,086 INFO [Listener at jenkins-hbase4.apache.org/35067] snapshot.TestExportSnapshot(279): Exported snapshot 2023-10-05 20:01:25,086 INFO [Listener at jenkins-hbase4.apache.org/35067] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-10-05 20:01:25,087 DEBUG [Listener at jenkins-hbase4.apache.org/35067] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-2070727397_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 at hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-05 20:01:25,087 DEBUG [Listener at jenkins-hbase4.apache.org/35067] snapshot.TestExportSnapshot(367): hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/.snapshotinfo 2023-10-05 20:01:25,087 DEBUG [Listener at jenkins-hbase4.apache.org/35067] snapshot.TestExportSnapshot(367): hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/data.manifest 2023-10-05 20:01:25,087 DEBUG [Listener at jenkins-hbase4.apache.org/35067] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-2070727397_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/export-test/export-1696536073556/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 at hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/export-test/export-1696536073556/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-05 20:01:25,088 DEBUG [Listener at jenkins-hbase4.apache.org/35067] snapshot.TestExportSnapshot(367): hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/export-test/export-1696536073556/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/.snapshotinfo 2023-10-05 20:01:25,088 DEBUG [Listener at jenkins-hbase4.apache.org/35067] snapshot.TestExportSnapshot(367): hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/export-test/export-1696536073556/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/data.manifest 2023-10-05 20:01:25,093 INFO [Listener at jenkins-hbase4.apache.org/35067] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemStateWithMergeRegion-1 2023-10-05 20:01:25,094 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40857] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemStateWithMergeRegion-1 2023-10-05 20:01:25,095 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40857] procedure2.ProcedureExecutor(1028): Stored pid=80, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-10-05 20:01:25,097 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40857] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-10-05 20:01:25,098 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696536085097"}]},"ts":"1696536085097"} 2023-10-05 20:01:25,099 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=DISABLING in hbase:meta 2023-10-05 20:01:25,101 INFO [PEWorker-3] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemStateWithMergeRegion-1 to state=DISABLING 2023-10-05 20:01:25,101 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=81, ppid=80, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=c245277211bcce0f0e94518a49db2126, UNASSIGN}] 2023-10-05 20:01:25,103 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=81, ppid=80, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=c245277211bcce0f0e94518a49db2126, UNASSIGN 2023-10-05 20:01:25,103 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=81 updating hbase:meta row=c245277211bcce0f0e94518a49db2126, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,36369,1696535998737 2023-10-05 20:01:25,104 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1696536071669.c245277211bcce0f0e94518a49db2126.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1696536085103"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696536085103"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696536085103"}]},"ts":"1696536085103"} 2023-10-05 20:01:25,105 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=82, ppid=81, state=RUNNABLE; CloseRegionProcedure c245277211bcce0f0e94518a49db2126, server=jenkins-hbase4.apache.org,36369,1696535998737}] 2023-10-05 20:01:25,198 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40857] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-10-05 20:01:25,257 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close c245277211bcce0f0e94518a49db2126 2023-10-05 20:01:25,257 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing c245277211bcce0f0e94518a49db2126, disabling compactions & flushes 2023-10-05 20:01:25,257 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,,1696536071669.c245277211bcce0f0e94518a49db2126. 2023-10-05 20:01:25,257 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1696536071669.c245277211bcce0f0e94518a49db2126. 2023-10-05 20:01:25,257 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1696536071669.c245277211bcce0f0e94518a49db2126. after waiting 0 ms 2023-10-05 20:01:25,257 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,,1696536071669.c245277211bcce0f0e94518a49db2126. 2023-10-05 20:01:25,268 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/c245277211bcce0f0e94518a49db2126/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=8 2023-10-05 20:01:25,268 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-10-05 20:01:25,269 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,,1696536071669.c245277211bcce0f0e94518a49db2126. 2023-10-05 20:01:25,269 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for c245277211bcce0f0e94518a49db2126: 2023-10-05 20:01:25,270 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed c245277211bcce0f0e94518a49db2126 2023-10-05 20:01:25,271 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=81 updating hbase:meta row=c245277211bcce0f0e94518a49db2126, regionState=CLOSED 2023-10-05 20:01:25,271 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1696536071669.c245277211bcce0f0e94518a49db2126.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1696536085271"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696536085271"}]},"ts":"1696536085271"} 2023-10-05 20:01:25,274 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=82, resume processing ppid=81 2023-10-05 20:01:25,274 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=82, ppid=81, state=SUCCESS; CloseRegionProcedure c245277211bcce0f0e94518a49db2126, server=jenkins-hbase4.apache.org,36369,1696535998737 in 167 msec 2023-10-05 20:01:25,275 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=81, resume processing ppid=80 2023-10-05 20:01:25,275 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=81, ppid=80, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=c245277211bcce0f0e94518a49db2126, UNASSIGN in 173 msec 2023-10-05 20:01:25,276 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696536085276"}]},"ts":"1696536085276"} 2023-10-05 20:01:25,277 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=DISABLED in hbase:meta 2023-10-05 20:01:25,278 INFO [PEWorker-3] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemStateWithMergeRegion-1 to state=DISABLED 2023-10-05 20:01:25,280 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=80, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 in 185 msec 2023-10-05 20:01:25,400 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40857] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-10-05 20:01:25,400 INFO [Listener at jenkins-hbase4.apache.org/35067] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 80 completed 2023-10-05 20:01:25,401 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40857] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemStateWithMergeRegion-1 2023-10-05 20:01:25,401 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40857] procedure2.ProcedureExecutor(1028): Stored pid=83, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-10-05 20:01:25,404 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=83, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-10-05 20:01:25,404 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40857] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemStateWithMergeRegion-1 2023-10-05 20:01:25,404 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=83, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-10-05 20:01:25,406 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=32861] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemStateWithMergeRegion-1 2023-10-05 20:01:25,409 DEBUG [HFileArchiver-14] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/051e4799b213d4e2520d4adb5ea63956 2023-10-05 20:01:25,409 DEBUG [HFileArchiver-20] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/488944e13159e5912610520e20c38f82 2023-10-05 20:01:25,409 DEBUG [HFileArchiver-19] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/c245277211bcce0f0e94518a49db2126 2023-10-05 20:01:25,410 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): regionserver:36369-0x101182c1f970003, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-10-05 20:01:25,410 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): regionserver:44821-0x101182c1f970002, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-10-05 20:01:25,410 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): master:40857-0x101182c1f970000, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-10-05 20:01:25,410 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): regionserver:32861-0x101182c1f970001, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-10-05 20:01:25,410 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-10-05 20:01:25,410 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-10-05 20:01:25,411 DEBUG [HFileArchiver-19] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/c245277211bcce0f0e94518a49db2126/cf, FileablePath, hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/c245277211bcce0f0e94518a49db2126/recovered.edits] 2023-10-05 20:01:25,411 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-10-05 20:01:25,411 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-10-05 20:01:25,411 DEBUG [HFileArchiver-14] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/051e4799b213d4e2520d4adb5ea63956/cf, FileablePath, hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/051e4799b213d4e2520d4adb5ea63956/recovered.edits] 2023-10-05 20:01:25,412 DEBUG [HFileArchiver-20] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/488944e13159e5912610520e20c38f82/cf, FileablePath, hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/488944e13159e5912610520e20c38f82/recovered.edits] 2023-10-05 20:01:25,412 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): regionserver:36369-0x101182c1f970003, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-10-05 20:01:25,412 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): regionserver:32861-0x101182c1f970001, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-10-05 20:01:25,412 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): master:40857-0x101182c1f970000, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-10-05 20:01:25,412 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): regionserver:44821-0x101182c1f970002, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-10-05 20:01:25,412 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): master:40857-0x101182c1f970000, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-05 20:01:25,412 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): regionserver:32861-0x101182c1f970001, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-05 20:01:25,412 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): regionserver:36369-0x101182c1f970003, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-05 20:01:25,412 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): regionserver:44821-0x101182c1f970002, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-05 20:01:25,413 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40857] master.MasterRpcServices(1230): Checking to see if procedure is done pid=83 2023-10-05 20:01:25,413 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-10-05 20:01:25,413 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-10-05 20:01:25,414 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-10-05 20:01:25,414 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-10-05 20:01:25,417 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/051e4799b213d4e2520d4adb5ea63956/cf/dd832236b4ed4fa681117984d3a579e2 to hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/051e4799b213d4e2520d4adb5ea63956/cf/dd832236b4ed4fa681117984d3a579e2 2023-10-05 20:01:25,418 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/c245277211bcce0f0e94518a49db2126/cf/933f8479b7534b6d8e3343332eef5cb8.488944e13159e5912610520e20c38f82 to hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/c245277211bcce0f0e94518a49db2126/cf/933f8479b7534b6d8e3343332eef5cb8.488944e13159e5912610520e20c38f82 2023-10-05 20:01:25,418 DEBUG [HFileArchiver-20] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/488944e13159e5912610520e20c38f82/cf/933f8479b7534b6d8e3343332eef5cb8 to hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/488944e13159e5912610520e20c38f82/cf/933f8479b7534b6d8e3343332eef5cb8 2023-10-05 20:01:25,420 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/c245277211bcce0f0e94518a49db2126/cf/dd832236b4ed4fa681117984d3a579e2.051e4799b213d4e2520d4adb5ea63956 to hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/c245277211bcce0f0e94518a49db2126/cf/dd832236b4ed4fa681117984d3a579e2.051e4799b213d4e2520d4adb5ea63956 2023-10-05 20:01:25,421 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/051e4799b213d4e2520d4adb5ea63956/recovered.edits/8.seqid to hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/051e4799b213d4e2520d4adb5ea63956/recovered.edits/8.seqid 2023-10-05 20:01:25,422 DEBUG [HFileArchiver-14] backup.HFileArchiver(596): Deleted hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/051e4799b213d4e2520d4adb5ea63956 2023-10-05 20:01:25,423 DEBUG [HFileArchiver-20] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/488944e13159e5912610520e20c38f82/recovered.edits/8.seqid to hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/488944e13159e5912610520e20c38f82/recovered.edits/8.seqid 2023-10-05 20:01:25,423 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/c245277211bcce0f0e94518a49db2126/recovered.edits/12.seqid to hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/c245277211bcce0f0e94518a49db2126/recovered.edits/12.seqid 2023-10-05 20:01:25,423 DEBUG [HFileArchiver-20] backup.HFileArchiver(596): Deleted hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/488944e13159e5912610520e20c38f82 2023-10-05 20:01:25,423 DEBUG [HFileArchiver-19] backup.HFileArchiver(596): Deleted hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/c245277211bcce0f0e94518a49db2126 2023-10-05 20:01:25,424 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion-1 regions 2023-10-05 20:01:25,425 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=83, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-10-05 20:01:25,428 WARN [PEWorker-1] procedure.DeleteTableProcedure(384): Deleting some vestigial 1 rows of testtb-testExportFileSystemStateWithMergeRegion-1 from hbase:meta 2023-10-05 20:01:25,429 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemStateWithMergeRegion-1' descriptor. 2023-10-05 20:01:25,430 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=83, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-10-05 20:01:25,430 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemStateWithMergeRegion-1' from region states. 2023-10-05 20:01:25,431 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1696536071669.c245277211bcce0f0e94518a49db2126.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1696536085430"}]},"ts":"9223372036854775807"} 2023-10-05 20:01:25,432 INFO [PEWorker-1] hbase.MetaTableAccessor(1788): Deleted 1 regions from META 2023-10-05 20:01:25,432 DEBUG [PEWorker-1] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => c245277211bcce0f0e94518a49db2126, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1696536071669.c245277211bcce0f0e94518a49db2126.', STARTKEY => '', ENDKEY => ''}] 2023-10-05 20:01:25,432 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemStateWithMergeRegion-1' as deleted. 2023-10-05 20:01:25,432 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1696536085432"}]},"ts":"9223372036854775807"} 2023-10-05 20:01:25,434 INFO [PEWorker-1] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemStateWithMergeRegion-1 state from META 2023-10-05 20:01:25,435 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(130): Finished pid=83, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-10-05 20:01:25,437 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=83, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 in 34 msec 2023-10-05 20:01:25,514 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40857] master.MasterRpcServices(1230): Checking to see if procedure is done pid=83 2023-10-05 20:01:25,515 INFO [Listener at jenkins-hbase4.apache.org/35067] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 83 completed 2023-10-05 20:01:25,515 INFO [Listener at jenkins-hbase4.apache.org/35067] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemStateWithMergeRegion 2023-10-05 20:01:25,515 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40857] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemStateWithMergeRegion 2023-10-05 20:01:25,516 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40857] procedure2.ProcedureExecutor(1028): Stored pid=84, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-10-05 20:01:25,519 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40857] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-10-05 20:01:25,520 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696536085519"}]},"ts":"1696536085519"} 2023-10-05 20:01:25,521 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=DISABLING in hbase:meta 2023-10-05 20:01:25,524 INFO [PEWorker-2] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemStateWithMergeRegion to state=DISABLING 2023-10-05 20:01:25,525 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=85, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=31d859f310183233a5ec880dbf54d8b9, UNASSIGN}, {pid=86, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=d321f1710d50c228c088de7ff0d8ca4c, UNASSIGN}] 2023-10-05 20:01:25,526 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=85, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=31d859f310183233a5ec880dbf54d8b9, UNASSIGN 2023-10-05 20:01:25,527 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=86, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=d321f1710d50c228c088de7ff0d8ca4c, UNASSIGN 2023-10-05 20:01:25,527 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=86 updating hbase:meta row=d321f1710d50c228c088de7ff0d8ca4c, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,36369,1696535998737 2023-10-05 20:01:25,527 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=85 updating hbase:meta row=31d859f310183233a5ec880dbf54d8b9, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,32861,1696535998642 2023-10-05 20:01:25,527 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1696536070308.31d859f310183233a5ec880dbf54d8b9.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1696536085527"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696536085527"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696536085527"}]},"ts":"1696536085527"} 2023-10-05 20:01:25,527 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1696536070308.d321f1710d50c228c088de7ff0d8ca4c.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1696536085527"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696536085527"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696536085527"}]},"ts":"1696536085527"} 2023-10-05 20:01:25,529 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=87, ppid=86, state=RUNNABLE; CloseRegionProcedure d321f1710d50c228c088de7ff0d8ca4c, server=jenkins-hbase4.apache.org,36369,1696535998737}] 2023-10-05 20:01:25,530 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=88, ppid=85, state=RUNNABLE; CloseRegionProcedure 31d859f310183233a5ec880dbf54d8b9, server=jenkins-hbase4.apache.org,32861,1696535998642}] 2023-10-05 20:01:25,620 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40857] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-10-05 20:01:25,680 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close d321f1710d50c228c088de7ff0d8ca4c 2023-10-05 20:01:25,680 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing d321f1710d50c228c088de7ff0d8ca4c, disabling compactions & flushes 2023-10-05 20:01:25,681 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,1,1696536070308.d321f1710d50c228c088de7ff0d8ca4c. 2023-10-05 20:01:25,681 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1696536070308.d321f1710d50c228c088de7ff0d8ca4c. 2023-10-05 20:01:25,681 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1696536070308.d321f1710d50c228c088de7ff0d8ca4c. after waiting 0 ms 2023-10-05 20:01:25,681 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,1,1696536070308.d321f1710d50c228c088de7ff0d8ca4c. 2023-10-05 20:01:25,684 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 31d859f310183233a5ec880dbf54d8b9 2023-10-05 20:01:25,684 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 31d859f310183233a5ec880dbf54d8b9, disabling compactions & flushes 2023-10-05 20:01:25,685 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,,1696536070308.31d859f310183233a5ec880dbf54d8b9. 2023-10-05 20:01:25,685 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,,1696536070308.31d859f310183233a5ec880dbf54d8b9. 2023-10-05 20:01:25,685 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,,1696536070308.31d859f310183233a5ec880dbf54d8b9. after waiting 0 ms 2023-10-05 20:01:25,685 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,,1696536070308.31d859f310183233a5ec880dbf54d8b9. 2023-10-05 20:01:25,694 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/data/default/testtb-testExportFileSystemStateWithMergeRegion/d321f1710d50c228c088de7ff0d8ca4c/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-10-05 20:01:25,695 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-10-05 20:01:25,695 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,1,1696536070308.d321f1710d50c228c088de7ff0d8ca4c. 2023-10-05 20:01:25,695 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for d321f1710d50c228c088de7ff0d8ca4c: 2023-10-05 20:01:25,695 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/data/default/testtb-testExportFileSystemStateWithMergeRegion/31d859f310183233a5ec880dbf54d8b9/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-10-05 20:01:25,696 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-10-05 20:01:25,697 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,,1696536070308.31d859f310183233a5ec880dbf54d8b9. 2023-10-05 20:01:25,697 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 31d859f310183233a5ec880dbf54d8b9: 2023-10-05 20:01:25,698 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed d321f1710d50c228c088de7ff0d8ca4c 2023-10-05 20:01:25,698 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=86 updating hbase:meta row=d321f1710d50c228c088de7ff0d8ca4c, regionState=CLOSED 2023-10-05 20:01:25,698 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 31d859f310183233a5ec880dbf54d8b9 2023-10-05 20:01:25,698 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1696536070308.d321f1710d50c228c088de7ff0d8ca4c.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1696536085698"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696536085698"}]},"ts":"1696536085698"} 2023-10-05 20:01:25,699 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=85 updating hbase:meta row=31d859f310183233a5ec880dbf54d8b9, regionState=CLOSED 2023-10-05 20:01:25,699 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1696536070308.31d859f310183233a5ec880dbf54d8b9.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1696536085698"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696536085698"}]},"ts":"1696536085698"} 2023-10-05 20:01:25,701 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=87, resume processing ppid=86 2023-10-05 20:01:25,701 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=87, ppid=86, state=SUCCESS; CloseRegionProcedure d321f1710d50c228c088de7ff0d8ca4c, server=jenkins-hbase4.apache.org,36369,1696535998737 in 170 msec 2023-10-05 20:01:25,702 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=88, resume processing ppid=85 2023-10-05 20:01:25,702 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=88, ppid=85, state=SUCCESS; CloseRegionProcedure 31d859f310183233a5ec880dbf54d8b9, server=jenkins-hbase4.apache.org,32861,1696535998642 in 170 msec 2023-10-05 20:01:25,702 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=86, ppid=84, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=d321f1710d50c228c088de7ff0d8ca4c, UNASSIGN in 176 msec 2023-10-05 20:01:25,703 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=85, resume processing ppid=84 2023-10-05 20:01:25,703 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=85, ppid=84, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=31d859f310183233a5ec880dbf54d8b9, UNASSIGN in 177 msec 2023-10-05 20:01:25,704 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696536085704"}]},"ts":"1696536085704"} 2023-10-05 20:01:25,705 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=DISABLED in hbase:meta 2023-10-05 20:01:25,706 INFO [PEWorker-1] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemStateWithMergeRegion to state=DISABLED 2023-10-05 20:01:25,707 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=84, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion in 191 msec 2023-10-05 20:01:25,821 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40857] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-10-05 20:01:25,821 INFO [Listener at jenkins-hbase4.apache.org/35067] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion, procId: 84 completed 2023-10-05 20:01:25,822 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40857] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemStateWithMergeRegion 2023-10-05 20:01:25,823 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40857] procedure2.ProcedureExecutor(1028): Stored pid=89, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-10-05 20:01:25,825 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=89, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-10-05 20:01:25,825 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40857] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemStateWithMergeRegion 2023-10-05 20:01:25,826 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=89, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-10-05 20:01:25,827 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=32861] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemStateWithMergeRegion 2023-10-05 20:01:25,829 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): regionserver:36369-0x101182c1f970003, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-10-05 20:01:25,829 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): master:40857-0x101182c1f970000, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-10-05 20:01:25,829 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): regionserver:32861-0x101182c1f970001, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-10-05 20:01:25,829 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): regionserver:44821-0x101182c1f970002, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-10-05 20:01:25,830 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/31d859f310183233a5ec880dbf54d8b9 2023-10-05 20:01:25,830 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-10-05 20:01:25,830 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-10-05 20:01:25,830 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-10-05 20:01:25,830 DEBUG [HFileArchiver-15] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/d321f1710d50c228c088de7ff0d8ca4c 2023-10-05 20:01:25,832 DEBUG [HFileArchiver-13] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/31d859f310183233a5ec880dbf54d8b9/cf, FileablePath, hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/31d859f310183233a5ec880dbf54d8b9/recovered.edits] 2023-10-05 20:01:25,832 DEBUG [HFileArchiver-15] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/d321f1710d50c228c088de7ff0d8ca4c/cf, FileablePath, hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/d321f1710d50c228c088de7ff0d8ca4c/recovered.edits] 2023-10-05 20:01:25,832 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): master:40857-0x101182c1f970000, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-10-05 20:01:25,832 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): regionserver:44821-0x101182c1f970002, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-05 20:01:25,832 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data null 2023-10-05 20:01:25,832 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): master:40857-0x101182c1f970000, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-05 20:01:25,832 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): regionserver:36369-0x101182c1f970003, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-10-05 20:01:25,832 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): regionserver:36369-0x101182c1f970003, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-05 20:01:25,832 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): regionserver:32861-0x101182c1f970001, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-10-05 20:01:25,832 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): regionserver:32861-0x101182c1f970001, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-05 20:01:25,832 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-10-05 20:01:25,833 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40857] master.MasterRpcServices(1230): Checking to see if procedure is done pid=89 2023-10-05 20:01:25,836 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/31d859f310183233a5ec880dbf54d8b9/cf/9b9372bc9f8c4faaa77dd8df3edf1e18 to hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/31d859f310183233a5ec880dbf54d8b9/cf/9b9372bc9f8c4faaa77dd8df3edf1e18 2023-10-05 20:01:25,836 DEBUG [HFileArchiver-15] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/d321f1710d50c228c088de7ff0d8ca4c/cf/9dd33d6fb6ff4106b74aaf4ed96e0dc1 to hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/d321f1710d50c228c088de7ff0d8ca4c/cf/9dd33d6fb6ff4106b74aaf4ed96e0dc1 2023-10-05 20:01:25,839 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/31d859f310183233a5ec880dbf54d8b9/recovered.edits/9.seqid to hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/31d859f310183233a5ec880dbf54d8b9/recovered.edits/9.seqid 2023-10-05 20:01:25,839 DEBUG [HFileArchiver-15] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/d321f1710d50c228c088de7ff0d8ca4c/recovered.edits/9.seqid to hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/d321f1710d50c228c088de7ff0d8ca4c/recovered.edits/9.seqid 2023-10-05 20:01:25,839 DEBUG [HFileArchiver-13] backup.HFileArchiver(596): Deleted hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/31d859f310183233a5ec880dbf54d8b9 2023-10-05 20:01:25,839 DEBUG [HFileArchiver-15] backup.HFileArchiver(596): Deleted hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/d321f1710d50c228c088de7ff0d8ca4c 2023-10-05 20:01:25,839 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion regions 2023-10-05 20:01:25,840 DEBUG [PEWorker-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c 2023-10-05 20:01:25,841 DEBUG [PEWorker-5] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf] 2023-10-05 20:01:25,844 DEBUG [PEWorker-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b202310056f5c65e28efc4b28aa76ff26485d5894 to hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b202310056f5c65e28efc4b28aa76ff26485d5894 2023-10-05 20:01:25,845 DEBUG [PEWorker-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e202310053972585601704a989785659c99958235 to hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e202310053972585601704a989785659c99958235 2023-10-05 20:01:25,846 DEBUG [PEWorker-5] backup.HFileArchiver(596): Deleted hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c 2023-10-05 20:01:25,848 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=89, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-10-05 20:01:25,850 WARN [PEWorker-5] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportFileSystemStateWithMergeRegion from hbase:meta 2023-10-05 20:01:25,851 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemStateWithMergeRegion' descriptor. 2023-10-05 20:01:25,852 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=89, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-10-05 20:01:25,852 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemStateWithMergeRegion' from region states. 2023-10-05 20:01:25,853 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1696536070308.31d859f310183233a5ec880dbf54d8b9.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1696536085852"}]},"ts":"9223372036854775807"} 2023-10-05 20:01:25,853 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1696536070308.d321f1710d50c228c088de7ff0d8ca4c.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1696536085852"}]},"ts":"9223372036854775807"} 2023-10-05 20:01:25,854 INFO [PEWorker-5] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-10-05 20:01:25,854 DEBUG [PEWorker-5] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 31d859f310183233a5ec880dbf54d8b9, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,,1696536070308.31d859f310183233a5ec880dbf54d8b9.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => d321f1710d50c228c088de7ff0d8ca4c, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,1,1696536070308.d321f1710d50c228c088de7ff0d8ca4c.', STARTKEY => '1', ENDKEY => ''}] 2023-10-05 20:01:25,854 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemStateWithMergeRegion' as deleted. 2023-10-05 20:01:25,854 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1696536085854"}]},"ts":"9223372036854775807"} 2023-10-05 20:01:25,856 INFO [PEWorker-5] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemStateWithMergeRegion state from META 2023-10-05 20:01:25,857 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(130): Finished pid=89, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-10-05 20:01:25,859 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=89, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion in 36 msec 2023-10-05 20:01:25,934 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40857] master.MasterRpcServices(1230): Checking to see if procedure is done pid=89 2023-10-05 20:01:25,934 INFO [Listener at jenkins-hbase4.apache.org/35067] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion, procId: 89 completed 2023-10-05 20:01:25,943 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40857] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportFileSystemStateWithMergeRegion" 2023-10-05 20:01:25,946 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40857] snapshot.SnapshotManager(335): Deleting snapshot: emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 20:01:25,947 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40857] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemStateWithMergeRegion" 2023-10-05 20:01:25,949 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40857] snapshot.SnapshotManager(335): Deleting snapshot: snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 20:01:25,950 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40857] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemStateWithMergeRegion-1" 2023-10-05 20:01:25,952 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40857] snapshot.SnapshotManager(335): Deleting snapshot: snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-05 20:01:25,979 INFO [Listener at jenkins-hbase4.apache.org/35067] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testExportFileSystemStateWithMergeRegion Thread=758 (was 748) Potentially hanging thread: HFileArchiver-20 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x13ec5c25-shared-pool-32 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x13ec5c25-shared-pool-27 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (638145229) connection to jenkins-hbase4.apache.org/172.31.14.131:46313 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-2070727397_17 at /127.0.0.1:44812 [Waiting for operation #6] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-570815806_1 at /127.0.0.1:44792 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LogDeleter #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1088) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #7 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-2070727397_17 at /127.0.0.1:41238 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-17 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-15 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x13ec5c25-shared-pool-29 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-7 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-570815806_1 at /127.0.0.1:38596 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x13ec5c25-shared-pool-30 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-6 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x13ec5c25-shared-pool-28 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #8 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-16 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-19 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-2070727397_17 at /127.0.0.1:41088 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-5 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-2070727397_17 at /127.0.0.1:33914 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x13ec5c25-shared-pool-31 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-18 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-3955 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) - Thread LEAK? -, OpenFileDescriptor=912 (was 905) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=225 (was 218) - SystemLoadAverage LEAK? -, ProcessCount=168 (was 168), AvailableMemoryMB=6024 (was 5979) - AvailableMemoryMB LEAK? - 2023-10-05 20:01:25,979 WARN [Listener at jenkins-hbase4.apache.org/35067] hbase.ResourceChecker(130): Thread=758 is superior to 500 2023-10-05 20:01:26,000 INFO [Listener at jenkins-hbase4.apache.org/35067] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testEmptyExportFileSystemState Thread=758, OpenFileDescriptor=912, MaxFileDescriptor=60000, SystemLoadAverage=225, ProcessCount=168, AvailableMemoryMB=6023 2023-10-05 20:01:26,001 WARN [Listener at jenkins-hbase4.apache.org/35067] hbase.ResourceChecker(130): Thread=758 is superior to 500 2023-10-05 20:01:26,002 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40857] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testEmptyExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-10-05 20:01:26,003 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40857] procedure2.ProcedureExecutor(1028): Stored pid=90, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testEmptyExportFileSystemState 2023-10-05 20:01:26,006 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_PRE_OPERATION 2023-10-05 20:01:26,006 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40857] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testEmptyExportFileSystemState" procId is: 90 2023-10-05 20:01:26,006 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-10-05 20:01:26,007 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40857] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-10-05 20:01:26,008 DEBUG [HFileArchiver-17] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/.tmp/data/default/testtb-testEmptyExportFileSystemState/2181c668f20cc320434bc68f718d676e 2023-10-05 20:01:26,008 DEBUG [HFileArchiver-16] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/.tmp/data/default/testtb-testEmptyExportFileSystemState/3c44e9f2082b4b948b4622d8058d43c2 2023-10-05 20:01:26,009 DEBUG [HFileArchiver-17] backup.HFileArchiver(153): Directory hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/.tmp/data/default/testtb-testEmptyExportFileSystemState/2181c668f20cc320434bc68f718d676e empty. 2023-10-05 20:01:26,009 DEBUG [HFileArchiver-16] backup.HFileArchiver(153): Directory hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/.tmp/data/default/testtb-testEmptyExportFileSystemState/3c44e9f2082b4b948b4622d8058d43c2 empty. 2023-10-05 20:01:26,009 DEBUG [HFileArchiver-17] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/.tmp/data/default/testtb-testEmptyExportFileSystemState/2181c668f20cc320434bc68f718d676e 2023-10-05 20:01:26,009 DEBUG [HFileArchiver-16] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/.tmp/data/default/testtb-testEmptyExportFileSystemState/3c44e9f2082b4b948b4622d8058d43c2 2023-10-05 20:01:26,010 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testEmptyExportFileSystemState regions 2023-10-05 20:01:26,019 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/.tmp/data/default/testtb-testEmptyExportFileSystemState/.tabledesc/.tableinfo.0000000001 2023-10-05 20:01:26,020 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(7675): creating {ENCODED => 3c44e9f2082b4b948b4622d8058d43c2, NAME => 'testtb-testEmptyExportFileSystemState,,1696536086002.3c44e9f2082b4b948b4622d8058d43c2.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testEmptyExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/.tmp 2023-10-05 20:01:26,020 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(7675): creating {ENCODED => 2181c668f20cc320434bc68f718d676e, NAME => 'testtb-testEmptyExportFileSystemState,1,1696536086002.2181c668f20cc320434bc68f718d676e.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testEmptyExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/.tmp 2023-10-05 20:01:26,041 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,,1696536086002.3c44e9f2082b4b948b4622d8058d43c2.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-05 20:01:26,041 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,1,1696536086002.2181c668f20cc320434bc68f718d676e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-05 20:01:26,041 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1604): Closing 3c44e9f2082b4b948b4622d8058d43c2, disabling compactions & flushes 2023-10-05 20:01:26,041 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1604): Closing 2181c668f20cc320434bc68f718d676e, disabling compactions & flushes 2023-10-05 20:01:26,041 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,,1696536086002.3c44e9f2082b4b948b4622d8058d43c2. 2023-10-05 20:01:26,041 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,1,1696536086002.2181c668f20cc320434bc68f718d676e. 2023-10-05 20:01:26,041 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,1,1696536086002.2181c668f20cc320434bc68f718d676e. 2023-10-05 20:01:26,041 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,,1696536086002.3c44e9f2082b4b948b4622d8058d43c2. 2023-10-05 20:01:26,041 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,1,1696536086002.2181c668f20cc320434bc68f718d676e. after waiting 0 ms 2023-10-05 20:01:26,041 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,1,1696536086002.2181c668f20cc320434bc68f718d676e. 2023-10-05 20:01:26,041 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,,1696536086002.3c44e9f2082b4b948b4622d8058d43c2. after waiting 0 ms 2023-10-05 20:01:26,041 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,,1696536086002.3c44e9f2082b4b948b4622d8058d43c2. 2023-10-05 20:01:26,041 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,1,1696536086002.2181c668f20cc320434bc68f718d676e. 2023-10-05 20:01:26,041 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,,1696536086002.3c44e9f2082b4b948b4622d8058d43c2. 2023-10-05 20:01:26,041 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1558): Region close journal for 2181c668f20cc320434bc68f718d676e: 2023-10-05 20:01:26,041 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1558): Region close journal for 3c44e9f2082b4b948b4622d8058d43c2: 2023-10-05 20:01:26,043 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_ADD_TO_META 2023-10-05 20:01:26,044 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,1,1696536086002.2181c668f20cc320434bc68f718d676e.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1696536086044"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696536086044"}]},"ts":"1696536086044"} 2023-10-05 20:01:26,044 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,,1696536086002.3c44e9f2082b4b948b4622d8058d43c2.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1696536086044"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696536086044"}]},"ts":"1696536086044"} 2023-10-05 20:01:26,046 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-10-05 20:01:26,047 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-10-05 20:01:26,047 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696536086047"}]},"ts":"1696536086047"} 2023-10-05 20:01:26,049 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=ENABLING in hbase:meta 2023-10-05 20:01:26,052 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-10-05 20:01:26,053 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-10-05 20:01:26,053 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-10-05 20:01:26,054 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-10-05 20:01:26,054 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-10-05 20:01:26,054 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=91, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=3c44e9f2082b4b948b4622d8058d43c2, ASSIGN}, {pid=92, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=2181c668f20cc320434bc68f718d676e, ASSIGN}] 2023-10-05 20:01:26,056 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=92, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=2181c668f20cc320434bc68f718d676e, ASSIGN 2023-10-05 20:01:26,056 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=91, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=3c44e9f2082b4b948b4622d8058d43c2, ASSIGN 2023-10-05 20:01:26,057 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=92, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=2181c668f20cc320434bc68f718d676e, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,44821,1696535998698; forceNewPlan=false, retain=false 2023-10-05 20:01:26,057 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=91, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=3c44e9f2082b4b948b4622d8058d43c2, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,32861,1696535998642; forceNewPlan=false, retain=false 2023-10-05 20:01:26,108 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40857] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-10-05 20:01:26,207 INFO [jenkins-hbase4:40857] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-10-05 20:01:26,209 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=92 updating hbase:meta row=2181c668f20cc320434bc68f718d676e, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,44821,1696535998698 2023-10-05 20:01:26,209 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=91 updating hbase:meta row=3c44e9f2082b4b948b4622d8058d43c2, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,32861,1696535998642 2023-10-05 20:01:26,210 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,1,1696536086002.2181c668f20cc320434bc68f718d676e.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1696536086209"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696536086209"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696536086209"}]},"ts":"1696536086209"} 2023-10-05 20:01:26,210 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,,1696536086002.3c44e9f2082b4b948b4622d8058d43c2.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1696536086209"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696536086209"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696536086209"}]},"ts":"1696536086209"} 2023-10-05 20:01:26,211 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=93, ppid=92, state=RUNNABLE; OpenRegionProcedure 2181c668f20cc320434bc68f718d676e, server=jenkins-hbase4.apache.org,44821,1696535998698}] 2023-10-05 20:01:26,212 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=94, ppid=91, state=RUNNABLE; OpenRegionProcedure 3c44e9f2082b4b948b4622d8058d43c2, server=jenkins-hbase4.apache.org,32861,1696535998642}] 2023-10-05 20:01:26,309 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40857] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-10-05 20:01:26,368 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testEmptyExportFileSystemState,,1696536086002.3c44e9f2082b4b948b4622d8058d43c2. 2023-10-05 20:01:26,368 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 3c44e9f2082b4b948b4622d8058d43c2, NAME => 'testtb-testEmptyExportFileSystemState,,1696536086002.3c44e9f2082b4b948b4622d8058d43c2.', STARTKEY => '', ENDKEY => '1'} 2023-10-05 20:01:26,368 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testEmptyExportFileSystemState,1,1696536086002.2181c668f20cc320434bc68f718d676e. 2023-10-05 20:01:26,368 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 2181c668f20cc320434bc68f718d676e, NAME => 'testtb-testEmptyExportFileSystemState,1,1696536086002.2181c668f20cc320434bc68f718d676e.', STARTKEY => '1', ENDKEY => ''} 2023-10-05 20:01:26,368 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testEmptyExportFileSystemState,,1696536086002.3c44e9f2082b4b948b4622d8058d43c2. service=AccessControlService 2023-10-05 20:01:26,369 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testEmptyExportFileSystemState,1,1696536086002.2181c668f20cc320434bc68f718d676e. service=AccessControlService 2023-10-05 20:01:26,369 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-10-05 20:01:26,369 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-10-05 20:01:26,369 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testEmptyExportFileSystemState 3c44e9f2082b4b948b4622d8058d43c2 2023-10-05 20:01:26,369 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testEmptyExportFileSystemState 2181c668f20cc320434bc68f718d676e 2023-10-05 20:01:26,369 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,,1696536086002.3c44e9f2082b4b948b4622d8058d43c2.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-05 20:01:26,369 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,1,1696536086002.2181c668f20cc320434bc68f718d676e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-05 20:01:26,369 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 3c44e9f2082b4b948b4622d8058d43c2 2023-10-05 20:01:26,369 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 2181c668f20cc320434bc68f718d676e 2023-10-05 20:01:26,369 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 2181c668f20cc320434bc68f718d676e 2023-10-05 20:01:26,369 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 3c44e9f2082b4b948b4622d8058d43c2 2023-10-05 20:01:26,370 INFO [StoreOpener-3c44e9f2082b4b948b4622d8058d43c2-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 3c44e9f2082b4b948b4622d8058d43c2 2023-10-05 20:01:26,370 INFO [StoreOpener-2181c668f20cc320434bc68f718d676e-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 2181c668f20cc320434bc68f718d676e 2023-10-05 20:01:26,371 DEBUG [StoreOpener-3c44e9f2082b4b948b4622d8058d43c2-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/data/default/testtb-testEmptyExportFileSystemState/3c44e9f2082b4b948b4622d8058d43c2/cf 2023-10-05 20:01:26,372 DEBUG [StoreOpener-3c44e9f2082b4b948b4622d8058d43c2-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/data/default/testtb-testEmptyExportFileSystemState/3c44e9f2082b4b948b4622d8058d43c2/cf 2023-10-05 20:01:26,372 DEBUG [StoreOpener-2181c668f20cc320434bc68f718d676e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/data/default/testtb-testEmptyExportFileSystemState/2181c668f20cc320434bc68f718d676e/cf 2023-10-05 20:01:26,372 DEBUG [StoreOpener-2181c668f20cc320434bc68f718d676e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/data/default/testtb-testEmptyExportFileSystemState/2181c668f20cc320434bc68f718d676e/cf 2023-10-05 20:01:26,372 INFO [StoreOpener-3c44e9f2082b4b948b4622d8058d43c2-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 3c44e9f2082b4b948b4622d8058d43c2 columnFamilyName cf 2023-10-05 20:01:26,372 INFO [StoreOpener-2181c668f20cc320434bc68f718d676e-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 2181c668f20cc320434bc68f718d676e columnFamilyName cf 2023-10-05 20:01:26,374 INFO [StoreOpener-3c44e9f2082b4b948b4622d8058d43c2-1] regionserver.HStore(310): Store=3c44e9f2082b4b948b4622d8058d43c2/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-05 20:01:26,374 INFO [StoreOpener-2181c668f20cc320434bc68f718d676e-1] regionserver.HStore(310): Store=2181c668f20cc320434bc68f718d676e/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-05 20:01:26,397 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/data/default/testtb-testEmptyExportFileSystemState/2181c668f20cc320434bc68f718d676e 2023-10-05 20:01:26,397 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/data/default/testtb-testEmptyExportFileSystemState/3c44e9f2082b4b948b4622d8058d43c2 2023-10-05 20:01:26,397 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/data/default/testtb-testEmptyExportFileSystemState/3c44e9f2082b4b948b4622d8058d43c2 2023-10-05 20:01:26,397 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/data/default/testtb-testEmptyExportFileSystemState/2181c668f20cc320434bc68f718d676e 2023-10-05 20:01:26,405 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 3c44e9f2082b4b948b4622d8058d43c2 2023-10-05 20:01:26,405 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 2181c668f20cc320434bc68f718d676e 2023-10-05 20:01:26,406 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/data/default/testtb-testEmptyExportFileSystemState/3c44e9f2082b4b948b4622d8058d43c2/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-05 20:01:26,407 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/data/default/testtb-testEmptyExportFileSystemState/2181c668f20cc320434bc68f718d676e/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-05 20:01:26,407 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 3c44e9f2082b4b948b4622d8058d43c2; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66921693, jitterRate=-0.0027890652418136597}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-10-05 20:01:26,407 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 2181c668f20cc320434bc68f718d676e; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62478184, jitterRate=-0.06900250911712646}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-10-05 20:01:26,407 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 3c44e9f2082b4b948b4622d8058d43c2: 2023-10-05 20:01:26,407 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 2181c668f20cc320434bc68f718d676e: 2023-10-05 20:01:26,408 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testEmptyExportFileSystemState,,1696536086002.3c44e9f2082b4b948b4622d8058d43c2., pid=94, masterSystemTime=1696536086363 2023-10-05 20:01:26,408 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testEmptyExportFileSystemState,1,1696536086002.2181c668f20cc320434bc68f718d676e., pid=93, masterSystemTime=1696536086363 2023-10-05 20:01:26,409 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testEmptyExportFileSystemState,,1696536086002.3c44e9f2082b4b948b4622d8058d43c2. 2023-10-05 20:01:26,409 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testEmptyExportFileSystemState,,1696536086002.3c44e9f2082b4b948b4622d8058d43c2. 2023-10-05 20:01:26,410 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=91 updating hbase:meta row=3c44e9f2082b4b948b4622d8058d43c2, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,32861,1696535998642 2023-10-05 20:01:26,410 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testEmptyExportFileSystemState,,1696536086002.3c44e9f2082b4b948b4622d8058d43c2.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1696536086410"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1696536086410"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1696536086410"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1696536086410"}]},"ts":"1696536086410"} 2023-10-05 20:01:26,410 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testEmptyExportFileSystemState,1,1696536086002.2181c668f20cc320434bc68f718d676e. 2023-10-05 20:01:26,410 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testEmptyExportFileSystemState,1,1696536086002.2181c668f20cc320434bc68f718d676e. 2023-10-05 20:01:26,410 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=92 updating hbase:meta row=2181c668f20cc320434bc68f718d676e, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,44821,1696535998698 2023-10-05 20:01:26,410 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testEmptyExportFileSystemState,1,1696536086002.2181c668f20cc320434bc68f718d676e.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1696536086410"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1696536086410"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1696536086410"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1696536086410"}]},"ts":"1696536086410"} 2023-10-05 20:01:26,413 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=94, resume processing ppid=91 2023-10-05 20:01:26,413 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=94, ppid=91, state=SUCCESS; OpenRegionProcedure 3c44e9f2082b4b948b4622d8058d43c2, server=jenkins-hbase4.apache.org,32861,1696535998642 in 199 msec 2023-10-05 20:01:26,413 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=93, resume processing ppid=92 2023-10-05 20:01:26,413 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=93, ppid=92, state=SUCCESS; OpenRegionProcedure 2181c668f20cc320434bc68f718d676e, server=jenkins-hbase4.apache.org,44821,1696535998698 in 201 msec 2023-10-05 20:01:26,414 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=91, ppid=90, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=3c44e9f2082b4b948b4622d8058d43c2, ASSIGN in 359 msec 2023-10-05 20:01:26,415 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=92, resume processing ppid=90 2023-10-05 20:01:26,415 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=92, ppid=90, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=2181c668f20cc320434bc68f718d676e, ASSIGN in 359 msec 2023-10-05 20:01:26,415 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-10-05 20:01:26,415 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696536086415"}]},"ts":"1696536086415"} 2023-10-05 20:01:26,416 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=ENABLED in hbase:meta 2023-10-05 20:01:26,419 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_POST_OPERATION 2023-10-05 20:01:26,420 DEBUG [PEWorker-2] access.PermissionStorage(175): Writing permission with rowKey testtb-testEmptyExportFileSystemState jenkins: RWXCA 2023-10-05 20:01:26,421 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=32861] access.PermissionStorage(611): Read acl: entry[testtb-testEmptyExportFileSystemState], kv [jenkins: RWXCA] 2023-10-05 20:01:26,422 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): regionserver:32861-0x101182c1f970001, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-05 20:01:26,422 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): regionserver:44821-0x101182c1f970002, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-05 20:01:26,422 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): regionserver:36369-0x101182c1f970003, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-05 20:01:26,422 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): master:40857-0x101182c1f970000, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-05 20:01:26,424 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-10-05 20:01:26,424 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-10-05 20:01:26,424 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-10-05 20:01:26,424 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-10-05 20:01:26,425 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=90, state=SUCCESS; CreateTableProcedure table=testtb-testEmptyExportFileSystemState in 422 msec 2023-10-05 20:01:26,610 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40857] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-10-05 20:01:26,610 INFO [Listener at jenkins-hbase4.apache.org/35067] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testEmptyExportFileSystemState, procId: 90 completed 2023-10-05 20:01:26,612 DEBUG [Listener at jenkins-hbase4.apache.org/35067] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testEmptyExportFileSystemState 2023-10-05 20:01:26,612 DEBUG [Listener at jenkins-hbase4.apache.org/35067] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testEmptyExportFileSystemState,,1696536086002.3c44e9f2082b4b948b4622d8058d43c2. 2023-10-05 20:01:26,614 INFO [Listener at jenkins-hbase4.apache.org/35067] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-10-05 20:01:26,624 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40857] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-10-05 20:01:26,624 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40857] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1696536086624 (current time:1696536086624). 2023-10-05 20:01:26,625 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40857] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-10-05 20:01:26,625 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40857] zookeeper.ReadOnlyZKClient(139): Connect 0x2831ec5a to 127.0.0.1:57530 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-05 20:01:26,631 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40857] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@723c66af, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-05 20:01:26,635 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40857] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-05 20:01:26,635 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:57072, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-05 20:01:26,636 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40857] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x2831ec5a to 127.0.0.1:57530 2023-10-05 20:01:26,636 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40857] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-05 20:01:26,637 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40857] zookeeper.ReadOnlyZKClient(139): Connect 0x785612c5 to 127.0.0.1:57530 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-05 20:01:26,642 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40857] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5fa272a9, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-05 20:01:26,643 DEBUG [hconnection-0x4eba7eec-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-05 20:01:26,646 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:57078, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-05 20:01:26,649 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40857] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-05 20:01:26,651 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:40564, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-05 20:01:26,652 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40857] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x785612c5 to 127.0.0.1:57530 2023-10-05 20:01:26,652 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40857] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-05 20:01:26,652 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40857] access.PermissionStorage(611): Read acl: entry[testtb-testEmptyExportFileSystemState], kv [jenkins: RWXCA] 2023-10-05 20:01:26,653 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40857] snapshot.SnapshotManager(637): No existing snapshot, attempting snapshot... 2023-10-05 20:01:26,653 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40857] snapshot.SnapshotManager(684): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-10-05 20:01:26,655 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40857] snapshot.SnapshotManager(519): Unable to retrieve ACL status for path: hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/.hbase-snapshot, current working dir path: hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState org.apache.hadoop.hdfs.protocol.AclException: The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.ipc.RemoteException.instantiateException(RemoteException.java:121) at org.apache.hadoop.ipc.RemoteException.unwrapRemoteException(RemoteException.java:88) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2736) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2294) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2291) at org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81) at org.apache.hadoop.hdfs.DistributedFileSystem.getAclStatus(DistributedFileSystem.java:2291) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.updateWorkingDirAclsIfRequired(SnapshotManager.java:517) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.prepareToTakeSnapshot(SnapshotManager.java:490) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.snapshotEnabledTable(SnapshotManager.java:559) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshotInternal(SnapshotManager.java:687) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshot(SnapshotManager.java:623) at org.apache.hadoop.hbase.master.MasterRpcServices.snapshot(MasterRpcServices.java:1588) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) Caused by: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.hdfs.protocol.AclException): The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at org.apache.hadoop.ipc.Client.getRpcResponse(Client.java:1540) at org.apache.hadoop.ipc.Client.call(Client.java:1486) at org.apache.hadoop.ipc.Client.call(Client.java:1385) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:232) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:118) at com.sun.proxy.$Proxy32.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.getAclStatus(ClientNamenodeProtocolTranslatorPB.java:1385) at sun.reflect.GeneratedMethodAccessor62.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:422) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeMethod(RetryInvocationHandler.java:165) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invoke(RetryInvocationHandler.java:157) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeOnce(RetryInvocationHandler.java:95) at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:359) at com.sun.proxy.$Proxy35.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor62.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor62.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor62.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor62.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor62.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2734) ... 15 more 2023-10-05 20:01:26,659 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40857] procedure2.ProcedureExecutor(1028): Stored pid=95, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-10-05 20:01:26,660 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=95, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-10-05 20:01:26,660 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=95, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1696536686660 2023-10-05 20:01:26,660 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState 2023-10-05 20:01:26,660 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40857] snapshot.SnapshotManager(689): Started snapshot: { ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-10-05 20:01:26,662 DEBUG [Listener at jenkins-hbase4.apache.org/35067] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-10-05 20:01:26,662 DEBUG [Listener at jenkins-hbase4.apache.org/35067] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-10-05 20:01:26,662 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=96, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-10-05 20:01:26,663 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=95, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-10-05 20:01:26,663 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=95, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE in 5 msec 2023-10-05 20:01:26,666 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=96, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-10-05 20:01:26,667 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=96, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED; timeout=600000, timestamp=1696536686667 2023-10-05 20:01:26,675 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testEmptyExportFileSystemState 2023-10-05 20:01:26,675 INFO [(jenkins-hbase4.apache.org,40857,1696535997381)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testEmptyExportFileSystemState' 2023-10-05 20:01:26,675 DEBUG [(jenkins-hbase4.apache.org,40857,1696535997381)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-05 20:01:26,676 DEBUG [(jenkins-hbase4.apache.org,40857,1696535997381)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' 2023-10-05 20:01:26,676 DEBUG [(jenkins-hbase4.apache.org,40857,1696535997381)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testEmptyExportFileSystemState', kicking off acquire phase on members. 2023-10-05 20:01:26,677 DEBUG [(jenkins-hbase4.apache.org,40857,1696535997381)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40857-0x101182c1f970000, quorum=127.0.0.1:57530, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-10-05 20:01:26,677 DEBUG [(jenkins-hbase4.apache.org,40857,1696535997381)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-10-05 20:01:26,684 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): regionserver:36369-0x101182c1f970003, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-05 20:01:26,684 DEBUG [(jenkins-hbase4.apache.org,40857,1696535997381)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,44821,1696535998698 2023-10-05 20:01:26,684 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-05 20:01:26,684 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): regionserver:32861-0x101182c1f970001, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-05 20:01:26,684 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): regionserver:44821-0x101182c1f970002, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-05 20:01:26,684 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-05 20:01:26,684 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-05 20:01:26,684 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-05 20:01:26,684 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-05 20:01:26,684 DEBUG [(jenkins-hbase4.apache.org,40857,1696535997381)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40857-0x101182c1f970000, quorum=127.0.0.1:57530, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,44821,1696535998698 2023-10-05 20:01:26,684 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-05 20:01:26,684 DEBUG [(jenkins-hbase4.apache.org,40857,1696535997381)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,32861,1696535998642 2023-10-05 20:01:26,684 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-10-05 20:01:26,684 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-10-05 20:01:26,684 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-10-05 20:01:26,685 DEBUG [(jenkins-hbase4.apache.org,40857,1696535997381)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40857-0x101182c1f970000, quorum=127.0.0.1:57530, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,32861,1696535998642 2023-10-05 20:01:26,685 DEBUG [(jenkins-hbase4.apache.org,40857,1696535997381)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-05 20:01:26,685 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44821-0x101182c1f970002, quorum=127.0.0.1:57530, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-10-05 20:01:26,685 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36369-0x101182c1f970003, quorum=127.0.0.1:57530, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-10-05 20:01:26,685 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:32861-0x101182c1f970001, quorum=127.0.0.1:57530, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-10-05 20:01:26,685 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 189 2023-10-05 20:01:26,685 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-10-05 20:01:26,685 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 189 2023-10-05 20:01:26,685 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-10-05 20:01:26,685 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-10-05 20:01:26,685 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 189 2023-10-05 20:01:26,685 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-10-05 20:01:26,685 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-10-05 20:01:26,685 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-10-05 20:01:26,685 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testEmptyExportFileSystemState 2023-10-05 20:01:26,686 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testEmptyExportFileSystemState 2023-10-05 20:01:26,686 DEBUG [member: 'jenkins-hbase4.apache.org,36369,1696535998737' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-10-05 20:01:26,686 DEBUG [member: 'jenkins-hbase4.apache.org,36369,1696535998737' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-05 20:01:26,686 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testEmptyExportFileSystemState 2023-10-05 20:01:26,687 DEBUG [member: 'jenkins-hbase4.apache.org,36369,1696535998737' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-10-05 20:01:26,687 DEBUG [member: 'jenkins-hbase4.apache.org,32861,1696535998642' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-10-05 20:01:26,687 DEBUG [member: 'jenkins-hbase4.apache.org,36369,1696535998737' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally acquired 2023-10-05 20:01:26,686 DEBUG [member: 'jenkins-hbase4.apache.org,44821,1696535998698' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-10-05 20:01:26,687 DEBUG [member: 'jenkins-hbase4.apache.org,44821,1696535998698' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-05 20:01:26,687 DEBUG [member: 'jenkins-hbase4.apache.org,36369,1696535998737' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,36369,1696535998737' joining acquired barrier for procedure (emptySnaptb0-testEmptyExportFileSystemState) in zk 2023-10-05 20:01:26,687 DEBUG [member: 'jenkins-hbase4.apache.org,32861,1696535998642' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-05 20:01:26,688 DEBUG [member: 'jenkins-hbase4.apache.org,44821,1696535998698' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-10-05 20:01:26,689 DEBUG [member: 'jenkins-hbase4.apache.org,44821,1696535998698' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally acquired 2023-10-05 20:01:26,689 DEBUG [member: 'jenkins-hbase4.apache.org,44821,1696535998698' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44821,1696535998698' joining acquired barrier for procedure (emptySnaptb0-testEmptyExportFileSystemState) in zk 2023-10-05 20:01:26,689 DEBUG [member: 'jenkins-hbase4.apache.org,32861,1696535998642' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-10-05 20:01:26,689 DEBUG [member: 'jenkins-hbase4.apache.org,32861,1696535998642' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally acquired 2023-10-05 20:01:26,689 DEBUG [member: 'jenkins-hbase4.apache.org,32861,1696535998642' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,32861,1696535998642' joining acquired barrier for procedure (emptySnaptb0-testEmptyExportFileSystemState) in zk 2023-10-05 20:01:26,690 DEBUG [member: 'jenkins-hbase4.apache.org,36369,1696535998737' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-10-05 20:01:26,691 DEBUG [member: 'jenkins-hbase4.apache.org,36369,1696535998737' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36369-0x101182c1f970003, quorum=127.0.0.1:57530, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-10-05 20:01:26,691 DEBUG [member: 'jenkins-hbase4.apache.org,36369,1696535998737' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-05 20:01:26,691 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): master:40857-0x101182c1f970000, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,44821,1696535998698 2023-10-05 20:01:26,691 DEBUG [member: 'jenkins-hbase4.apache.org,44821,1696535998698' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-10-05 20:01:26,692 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,44821,1696535998698 2023-10-05 20:01:26,692 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-05 20:01:26,692 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-05 20:01:26,693 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): master:40857-0x101182c1f970000, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,32861,1696535998642 2023-10-05 20:01:26,693 DEBUG [member: 'jenkins-hbase4.apache.org,44821,1696535998698' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44821-0x101182c1f970002, quorum=127.0.0.1:57530, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-10-05 20:01:26,693 DEBUG [member: 'jenkins-hbase4.apache.org,44821,1696535998698' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-05 20:01:26,693 DEBUG [member: 'jenkins-hbase4.apache.org,32861,1696535998642' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-10-05 20:01:26,693 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-05 20:01:26,693 DEBUG [member: 'jenkins-hbase4.apache.org,32861,1696535998642' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:32861-0x101182c1f970001, quorum=127.0.0.1:57530, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-10-05 20:01:26,693 DEBUG [member: 'jenkins-hbase4.apache.org,32861,1696535998642' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-05 20:01:26,693 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-05 20:01:26,693 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-10-05 20:01:26,694 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32861,1696535998642 2023-10-05 20:01:26,694 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36369,1696535998737 2023-10-05 20:01:26,694 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44821,1696535998698 2023-10-05 20:01:26,695 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-05 20:01:26,695 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,44821,1696535998698' joining acquired barrier for procedure 'emptySnaptb0-testEmptyExportFileSystemState' on coordinator 2023-10-05 20:01:26,695 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@53860d3a[Count = 1] remaining members to acquire global barrier 2023-10-05 20:01:26,695 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,32861,1696535998642 2023-10-05 20:01:26,695 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-05 20:01:26,695 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-05 20:01:26,695 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-05 20:01:26,696 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-05 20:01:26,696 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-10-05 20:01:26,696 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32861,1696535998642 2023-10-05 20:01:26,697 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36369,1696535998737 2023-10-05 20:01:26,697 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44821,1696535998698 2023-10-05 20:01:26,697 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-05 20:01:26,698 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,32861,1696535998642' joining acquired barrier for procedure 'emptySnaptb0-testEmptyExportFileSystemState' on coordinator 2023-10-05 20:01:26,698 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@53860d3a[Count = 0] remaining members to acquire global barrier 2023-10-05 20:01:26,698 DEBUG [(jenkins-hbase4.apache.org,40857,1696535997381)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'in-barrier' execution. 2023-10-05 20:01:26,698 DEBUG [(jenkins-hbase4.apache.org,40857,1696535997381)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-10-05 20:01:26,705 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): regionserver:44821-0x101182c1f970002, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-10-05 20:01:26,705 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): regionserver:36369-0x101182c1f970003, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-10-05 20:01:26,705 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-10-05 20:01:26,705 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-10-05 20:01:26,705 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): regionserver:32861-0x101182c1f970001, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-10-05 20:01:26,705 DEBUG [member: 'jenkins-hbase4.apache.org,44821,1696535998698' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-10-05 20:01:26,705 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-10-05 20:01:26,705 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-10-05 20:01:26,705 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-10-05 20:01:26,705 DEBUG [member: 'jenkins-hbase4.apache.org,32861,1696535998642' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-10-05 20:01:26,705 DEBUG [member: 'jenkins-hbase4.apache.org,44821,1696535998698' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-05 20:01:26,705 DEBUG [member: 'jenkins-hbase4.apache.org,44821,1696535998698' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-05 20:01:26,705 DEBUG [(jenkins-hbase4.apache.org,40857,1696535997381)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40857-0x101182c1f970000, quorum=127.0.0.1:57530, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,44821,1696535998698 2023-10-05 20:01:26,706 DEBUG [rs(jenkins-hbase4.apache.org,44821,1696535998698)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,1,1696536086002.2181c668f20cc320434bc68f718d676e. 2023-10-05 20:01:26,705 DEBUG [member: 'jenkins-hbase4.apache.org,32861,1696535998642' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-05 20:01:26,706 DEBUG [rs(jenkins-hbase4.apache.org,44821,1696535998698)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1696536086002.2181c668f20cc320434bc68f718d676e. started... 2023-10-05 20:01:26,705 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-10-05 20:01:26,706 DEBUG [member: 'jenkins-hbase4.apache.org,32861,1696535998642' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-05 20:01:26,706 DEBUG [member: 'jenkins-hbase4.apache.org,36369,1696535998737' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-10-05 20:01:26,706 DEBUG [rs(jenkins-hbase4.apache.org,32861,1696535998642)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,,1696536086002.3c44e9f2082b4b948b4622d8058d43c2. 2023-10-05 20:01:26,707 DEBUG [rs(jenkins-hbase4.apache.org,44821,1696535998698)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 2181c668f20cc320434bc68f718d676e: 2023-10-05 20:01:26,707 DEBUG [rs(jenkins-hbase4.apache.org,32861,1696535998642)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1696536086002.3c44e9f2082b4b948b4622d8058d43c2. started... 2023-10-05 20:01:26,707 DEBUG [(jenkins-hbase4.apache.org,40857,1696535997381)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40857-0x101182c1f970000, quorum=127.0.0.1:57530, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,32861,1696535998642 2023-10-05 20:01:26,707 DEBUG [(jenkins-hbase4.apache.org,40857,1696535997381)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-05 20:01:26,707 DEBUG [member: 'jenkins-hbase4.apache.org,36369,1696535998737' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally completed 2023-10-05 20:01:26,707 DEBUG [rs(jenkins-hbase4.apache.org,44821,1696535998698)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,1,1696536086002.2181c668f20cc320434bc68f718d676e.' region-info for snapshot=emptySnaptb0-testEmptyExportFileSystemState 2023-10-05 20:01:26,707 DEBUG [member: 'jenkins-hbase4.apache.org,36369,1696535998737' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,36369,1696535998737' in zk 2023-10-05 20:01:26,707 DEBUG [rs(jenkins-hbase4.apache.org,32861,1696535998642)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 3c44e9f2082b4b948b4622d8058d43c2: 2023-10-05 20:01:26,707 DEBUG [rs(jenkins-hbase4.apache.org,44821,1696535998698)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-05 20:01:26,707 DEBUG [rs(jenkins-hbase4.apache.org,44821,1696535998698)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-10-05 20:01:26,707 DEBUG [rs(jenkins-hbase4.apache.org,32861,1696535998642)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,,1696536086002.3c44e9f2082b4b948b4622d8058d43c2.' region-info for snapshot=emptySnaptb0-testEmptyExportFileSystemState 2023-10-05 20:01:26,707 DEBUG [rs(jenkins-hbase4.apache.org,32861,1696535998642)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-05 20:01:26,707 DEBUG [rs(jenkins-hbase4.apache.org,32861,1696535998642)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-10-05 20:01:26,708 DEBUG [member: 'jenkins-hbase4.apache.org,36369,1696535998737' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-10-05 20:01:26,709 DEBUG [member: 'jenkins-hbase4.apache.org,36369,1696535998737' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-05 20:01:26,709 DEBUG [member: 'jenkins-hbase4.apache.org,36369,1696535998737' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' completed. 2023-10-05 20:01:26,717 DEBUG [rs(jenkins-hbase4.apache.org,32861,1696535998642)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1696536086002.3c44e9f2082b4b948b4622d8058d43c2. completed. 2023-10-05 20:01:26,717 DEBUG [rs(jenkins-hbase4.apache.org,32861,1696535998642)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,,1696536086002.3c44e9f2082b4b948b4622d8058d43c2. 2023-10-05 20:01:26,717 DEBUG [member: 'jenkins-hbase4.apache.org,32861,1696535998642' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-05 20:01:26,717 DEBUG [rs(jenkins-hbase4.apache.org,44821,1696535998698)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1696536086002.2181c668f20cc320434bc68f718d676e. completed. 2023-10-05 20:01:26,717 DEBUG [rs(jenkins-hbase4.apache.org,44821,1696535998698)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,1,1696536086002.2181c668f20cc320434bc68f718d676e. 2023-10-05 20:01:26,717 DEBUG [member: 'jenkins-hbase4.apache.org,32861,1696535998642' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-05 20:01:26,717 DEBUG [member: 'jenkins-hbase4.apache.org,44821,1696535998698' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-05 20:01:26,717 DEBUG [member: 'jenkins-hbase4.apache.org,44821,1696535998698' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-05 20:01:26,718 DEBUG [member: 'jenkins-hbase4.apache.org,44821,1696535998698' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,44821,1696535998698 2023-10-05 20:01:26,717 DEBUG [member: 'jenkins-hbase4.apache.org,32861,1696535998642' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,32861,1696535998642 2023-10-05 20:01:26,718 DEBUG [member: 'jenkins-hbase4.apache.org,44821,1696535998698' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally completed 2023-10-05 20:01:26,718 DEBUG [member: 'jenkins-hbase4.apache.org,32861,1696535998642' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally completed 2023-10-05 20:01:26,718 DEBUG [member: 'jenkins-hbase4.apache.org,44821,1696535998698' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,44821,1696535998698' in zk 2023-10-05 20:01:26,718 DEBUG [member: 'jenkins-hbase4.apache.org,32861,1696535998642' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,32861,1696535998642' in zk 2023-10-05 20:01:26,719 DEBUG [member: 'jenkins-hbase4.apache.org,32861,1696535998642' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-10-05 20:01:26,719 DEBUG [member: 'jenkins-hbase4.apache.org,44821,1696535998698' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-10-05 20:01:26,719 DEBUG [member: 'jenkins-hbase4.apache.org,32861,1696535998642' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-05 20:01:26,719 DEBUG [member: 'jenkins-hbase4.apache.org,44821,1696535998698' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-05 20:01:26,719 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): master:40857-0x101182c1f970000, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,32861,1696535998642 2023-10-05 20:01:26,720 DEBUG [member: 'jenkins-hbase4.apache.org,44821,1696535998698' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' completed. 2023-10-05 20:01:26,719 DEBUG [member: 'jenkins-hbase4.apache.org,32861,1696535998642' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' completed. 2023-10-05 20:01:26,721 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,32861,1696535998642 2023-10-05 20:01:26,721 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-05 20:01:26,721 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-05 20:01:26,721 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): master:40857-0x101182c1f970000, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,44821,1696535998698 2023-10-05 20:01:26,722 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-05 20:01:26,722 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-05 20:01:26,722 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-10-05 20:01:26,722 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32861,1696535998642 2023-10-05 20:01:26,722 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36369,1696535998737 2023-10-05 20:01:26,723 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44821,1696535998698 2023-10-05 20:01:26,723 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-05 20:01:26,723 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-10-05 20:01:26,723 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32861,1696535998642 2023-10-05 20:01:26,724 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36369,1696535998737 2023-10-05 20:01:26,724 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44821,1696535998698 2023-10-05 20:01:26,724 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,32861,1696535998642': 2023-10-05 20:01:26,724 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,32861,1696535998642' released barrier for procedure'emptySnaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 1 more 2023-10-05 20:01:26,724 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,44821,1696535998698 2023-10-05 20:01:26,724 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-05 20:01:26,724 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-05 20:01:26,725 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-05 20:01:26,725 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-05 20:01:26,725 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-10-05 20:01:26,725 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32861,1696535998642 2023-10-05 20:01:26,725 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36369,1696535998737 2023-10-05 20:01:26,726 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44821,1696535998698 2023-10-05 20:01:26,726 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-05 20:01:26,726 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-10-05 20:01:26,726 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32861,1696535998642 2023-10-05 20:01:26,726 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36369,1696535998737 2023-10-05 20:01:26,727 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44821,1696535998698 2023-10-05 20:01:26,727 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,44821,1696535998698': 2023-10-05 20:01:26,727 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,44821,1696535998698' released barrier for procedure'emptySnaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 0 more 2023-10-05 20:01:26,727 INFO [(jenkins-hbase4.apache.org,40857,1696535997381)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testEmptyExportFileSystemState' execution completed 2023-10-05 20:01:26,727 DEBUG [(jenkins-hbase4.apache.org,40857,1696535997381)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-05 20:01:26,727 DEBUG [(jenkins-hbase4.apache.org,40857,1696535997381)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-05 20:01:26,727 DEBUG [(jenkins-hbase4.apache.org,40857,1696535997381)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testEmptyExportFileSystemState 2023-10-05 20:01:26,727 INFO [(jenkins-hbase4.apache.org,40857,1696535997381)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testEmptyExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-10-05 20:01:26,729 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): regionserver:44821-0x101182c1f970002, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-10-05 20:01:26,729 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): regionserver:32861-0x101182c1f970001, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-10-05 20:01:26,729 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): master:40857-0x101182c1f970000, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-10-05 20:01:26,729 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-10-05 20:01:26,729 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): regionserver:32861-0x101182c1f970001, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-05 20:01:26,729 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-10-05 20:01:26,729 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-10-05 20:01:26,729 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): regionserver:44821-0x101182c1f970002, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-05 20:01:26,729 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): regionserver:36369-0x101182c1f970003, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-10-05 20:01:26,729 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-10-05 20:01:26,729 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-10-05 20:01:26,729 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-05 20:01:26,729 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-05 20:01:26,729 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-05 20:01:26,729 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-10-05 20:01:26,729 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): regionserver:36369-0x101182c1f970003, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-05 20:01:26,729 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-10-05 20:01:26,729 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-05 20:01:26,729 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-05 20:01:26,729 DEBUG [(jenkins-hbase4.apache.org,40857,1696535997381)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40857-0x101182c1f970000, quorum=127.0.0.1:57530, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,32861,1696535998642 2023-10-05 20:01:26,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-05 20:01:26,729 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-05 20:01:26,730 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-05 20:01:26,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-05 20:01:26,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-10-05 20:01:26,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-10-05 20:01:26,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-10-05 20:01:26,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-10-05 20:01:26,730 DEBUG [(jenkins-hbase4.apache.org,40857,1696535997381)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40857-0x101182c1f970000, quorum=127.0.0.1:57530, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,36369,1696535998737 2023-10-05 20:01:26,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-05 20:01:26,730 DEBUG [(jenkins-hbase4.apache.org,40857,1696535997381)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40857-0x101182c1f970000, quorum=127.0.0.1:57530, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,44821,1696535998698 2023-10-05 20:01:26,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-10-05 20:01:26,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32861,1696535998642 2023-10-05 20:01:26,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36369,1696535998737 2023-10-05 20:01:26,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44821,1696535998698 2023-10-05 20:01:26,732 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-05 20:01:26,732 DEBUG [(jenkins-hbase4.apache.org,40857,1696535997381)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40857-0x101182c1f970000, quorum=127.0.0.1:57530, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,32861,1696535998642 2023-10-05 20:01:26,732 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-10-05 20:01:26,732 DEBUG [(jenkins-hbase4.apache.org,40857,1696535997381)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40857-0x101182c1f970000, quorum=127.0.0.1:57530, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,36369,1696535998737 2023-10-05 20:01:26,732 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32861,1696535998642 2023-10-05 20:01:26,732 DEBUG [(jenkins-hbase4.apache.org,40857,1696535997381)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40857-0x101182c1f970000, quorum=127.0.0.1:57530, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,44821,1696535998698 2023-10-05 20:01:26,732 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36369,1696535998737 2023-10-05 20:01:26,733 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44821,1696535998698 2023-10-05 20:01:26,736 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): regionserver:44821-0x101182c1f970002, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-05 20:01:26,736 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): master:40857-0x101182c1f970000, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,44821,1696535998698 2023-10-05 20:01:26,736 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): regionserver:44821-0x101182c1f970002, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-05 20:01:26,736 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): regionserver:32861-0x101182c1f970001, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-05 20:01:26,736 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): regionserver:36369-0x101182c1f970003, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-05 20:01:26,736 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-05 20:01:26,736 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testEmptyExportFileSystemState 2023-10-05 20:01:26,736 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): regionserver:32861-0x101182c1f970001, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-05 20:01:26,736 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-05 20:01:26,736 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): master:40857-0x101182c1f970000, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-10-05 20:01:26,736 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-05 20:01:26,736 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testEmptyExportFileSystemState 2023-10-05 20:01:26,736 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-05 20:01:26,736 DEBUG [(jenkins-hbase4.apache.org,40857,1696535997381)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-05 20:01:26,736 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-05 20:01:26,736 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-05 20:01:26,736 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): regionserver:36369-0x101182c1f970003, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-05 20:01:26,736 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 37e3865d2ff7e5e2da33a03e3f723df0, NAME => 'testtb-testEmptyExportFileSystemState,.mob,0.37e3865d2ff7e5e2da33a03e3f723df0.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testEmptyExportFileSystemState 2023-10-05 20:01:26,736 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): master:40857-0x101182c1f970000, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,36369,1696535998737 2023-10-05 20:01:26,737 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-05 20:01:26,737 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-05 20:01:26,737 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-05 20:01:26,737 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-05 20:01:26,738 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-05 20:01:26,738 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-05 20:01:26,737 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): master:40857-0x101182c1f970000, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,32861,1696535998642 2023-10-05 20:01:26,737 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-10-05 20:01:26,738 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): master:40857-0x101182c1f970000, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-10-05 20:01:26,738 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): master:40857-0x101182c1f970000, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,44821,1696535998698 2023-10-05 20:01:26,738 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): master:40857-0x101182c1f970000, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-10-05 20:01:26,738 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): master:40857-0x101182c1f970000, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,36369,1696535998737 2023-10-05 20:01:26,738 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): master:40857-0x101182c1f970000, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,32861,1696535998642 2023-10-05 20:01:26,738 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): master:40857-0x101182c1f970000, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-10-05 20:01:26,738 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): master:40857-0x101182c1f970000, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-10-05 20:01:26,738 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-10-05 20:01:26,746 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testEmptyExportFileSystemState 2023-10-05 20:01:26,746 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-10-05 20:01:26,762 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState to hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState 2023-10-05 20:01:26,762 DEBUG [Listener at jenkins-hbase4.apache.org/35067] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-05 20:01:26,762 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed 2023-10-05 20:01:26,762 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-10-05 20:01:26,763 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-10-05 20:01:26,763 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState at 1696536086661Completed referencing HFiles for the mob region of table: testtb-testEmptyExportFileSystemState at 1696536086746 (+85 ms)Consolidate snapshot: emptySnaptb0-testEmptyExportFileSystemState at 1696536086746Loading Region manifests for emptySnaptb0-testEmptyExportFileSystemState at 1696536086746Writing data manifest for emptySnaptb0-testEmptyExportFileSystemState at 1696536086750 (+4 ms)Verifying snapshot: emptySnaptb0-testEmptyExportFileSystemState at 1696536086757 (+7 ms)Snapshot emptySnaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed at 1696536086762 (+5 ms) 2023-10-05 20:01:26,766 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=96, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-10-05 20:01:26,766 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40857] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-10-05 20:01:26,766 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40857] snapshot.SnapshotManager(403): Snapshot '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-10-05 20:01:26,768 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32861] regionserver.HRegion(8805): writing data to region testtb-testEmptyExportFileSystemState,,1696536086002.3c44e9f2082b4b948b4622d8058d43c2. with WAL disabled. Data may be lost in the event of a crash. 2023-10-05 20:01:26,769 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=96, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED in 105 msec 2023-10-05 20:01:26,770 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44821] regionserver.HRegion(8805): writing data to region testtb-testEmptyExportFileSystemState,1,1696536086002.2181c668f20cc320434bc68f718d676e. with WAL disabled. Data may be lost in the event of a crash. 2023-10-05 20:01:26,772 DEBUG [Listener at jenkins-hbase4.apache.org/35067] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testEmptyExportFileSystemState 2023-10-05 20:01:26,772 DEBUG [Listener at jenkins-hbase4.apache.org/35067] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testEmptyExportFileSystemState,,1696536086002.3c44e9f2082b4b948b4622d8058d43c2. 2023-10-05 20:01:26,772 INFO [Listener at jenkins-hbase4.apache.org/35067] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-10-05 20:01:26,781 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40857] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-10-05 20:01:26,781 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40857] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1696536086781 (current time:1696536086781). 2023-10-05 20:01:26,781 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40857] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-10-05 20:01:26,781 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40857] zookeeper.ReadOnlyZKClient(139): Connect 0x5afc889a to 127.0.0.1:57530 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-05 20:01:26,787 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40857] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7419e19a, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-05 20:01:26,788 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40857] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-05 20:01:26,790 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:57088, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-05 20:01:26,791 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40857] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x5afc889a to 127.0.0.1:57530 2023-10-05 20:01:26,791 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40857] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-05 20:01:26,792 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40857] zookeeper.ReadOnlyZKClient(139): Connect 0x6b2fe849 to 127.0.0.1:57530 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-05 20:01:26,797 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40857] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@552905ee, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-05 20:01:26,798 DEBUG [hconnection-0x6e073be0-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-05 20:01:26,799 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:57094, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-05 20:01:26,802 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40857] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-05 20:01:26,803 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:40576, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-05 20:01:26,804 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40857] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6b2fe849 to 127.0.0.1:57530 2023-10-05 20:01:26,804 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40857] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-05 20:01:26,804 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40857] access.PermissionStorage(611): Read acl: entry[testtb-testEmptyExportFileSystemState], kv [jenkins: RWXCA] 2023-10-05 20:01:26,805 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40857] snapshot.SnapshotManager(637): No existing snapshot, attempting snapshot... 2023-10-05 20:01:26,805 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40857] snapshot.SnapshotManager(684): Table enabled, starting distributed snapshots for { ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-10-05 20:01:26,807 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40857] snapshot.SnapshotManager(519): Unable to retrieve ACL status for path: hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/.hbase-snapshot, current working dir path: hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState org.apache.hadoop.hdfs.protocol.AclException: The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.ipc.RemoteException.instantiateException(RemoteException.java:121) at org.apache.hadoop.ipc.RemoteException.unwrapRemoteException(RemoteException.java:88) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2736) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2294) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2291) at org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81) at org.apache.hadoop.hdfs.DistributedFileSystem.getAclStatus(DistributedFileSystem.java:2291) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.updateWorkingDirAclsIfRequired(SnapshotManager.java:517) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.prepareToTakeSnapshot(SnapshotManager.java:490) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.snapshotEnabledTable(SnapshotManager.java:559) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshotInternal(SnapshotManager.java:687) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshot(SnapshotManager.java:623) at org.apache.hadoop.hbase.master.MasterRpcServices.snapshot(MasterRpcServices.java:1588) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) Caused by: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.hdfs.protocol.AclException): The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at org.apache.hadoop.ipc.Client.getRpcResponse(Client.java:1540) at org.apache.hadoop.ipc.Client.call(Client.java:1486) at org.apache.hadoop.ipc.Client.call(Client.java:1385) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:232) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:118) at com.sun.proxy.$Proxy32.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.getAclStatus(ClientNamenodeProtocolTranslatorPB.java:1385) at sun.reflect.GeneratedMethodAccessor62.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:422) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeMethod(RetryInvocationHandler.java:165) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invoke(RetryInvocationHandler.java:157) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeOnce(RetryInvocationHandler.java:95) at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:359) at com.sun.proxy.$Proxy35.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor62.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor62.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor62.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor62.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor62.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2734) ... 15 more 2023-10-05 20:01:26,808 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40857] procedure2.ProcedureExecutor(1028): Stored pid=97, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-10-05 20:01:26,809 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=97, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-10-05 20:01:26,810 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=97, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1696536686810 2023-10-05 20:01:26,810 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40857] snapshot.SnapshotManager(689): Started snapshot: { ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-10-05 20:01:26,810 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState 2023-10-05 20:01:26,811 DEBUG [Listener at jenkins-hbase4.apache.org/35067] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-10-05 20:01:26,811 DEBUG [Listener at jenkins-hbase4.apache.org/35067] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-10-05 20:01:26,812 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=97, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-10-05 20:01:26,812 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=98, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-10-05 20:01:26,813 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=97, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE in 5 msec 2023-10-05 20:01:26,813 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=98, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-10-05 20:01:26,814 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=98, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED; timeout=600000, timestamp=1696536686814 2023-10-05 20:01:26,821 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testEmptyExportFileSystemState 2023-10-05 20:01:26,821 INFO [(jenkins-hbase4.apache.org,40857,1696535997381)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testEmptyExportFileSystemState' 2023-10-05 20:01:26,821 DEBUG [(jenkins-hbase4.apache.org,40857,1696535997381)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-05 20:01:26,822 DEBUG [(jenkins-hbase4.apache.org,40857,1696535997381)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' 2023-10-05 20:01:26,822 DEBUG [(jenkins-hbase4.apache.org,40857,1696535997381)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testEmptyExportFileSystemState', kicking off acquire phase on members. 2023-10-05 20:01:26,823 DEBUG [(jenkins-hbase4.apache.org,40857,1696535997381)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40857-0x101182c1f970000, quorum=127.0.0.1:57530, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-10-05 20:01:26,823 DEBUG [(jenkins-hbase4.apache.org,40857,1696535997381)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-10-05 20:01:26,824 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): regionserver:44821-0x101182c1f970002, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-05 20:01:26,824 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): regionserver:36369-0x101182c1f970003, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-05 20:01:26,824 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-05 20:01:26,824 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-05 20:01:26,824 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-05 20:01:26,824 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-05 20:01:26,824 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): regionserver:32861-0x101182c1f970001, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-05 20:01:26,824 DEBUG [(jenkins-hbase4.apache.org,40857,1696535997381)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,44821,1696535998698 2023-10-05 20:01:26,824 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-05 20:01:26,824 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-05 20:01:26,825 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-10-05 20:01:26,825 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-10-05 20:01:26,825 DEBUG [(jenkins-hbase4.apache.org,40857,1696535997381)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40857-0x101182c1f970000, quorum=127.0.0.1:57530, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,44821,1696535998698 2023-10-05 20:01:26,825 DEBUG [(jenkins-hbase4.apache.org,40857,1696535997381)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,32861,1696535998642 2023-10-05 20:01:26,825 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-10-05 20:01:26,825 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44821-0x101182c1f970002, quorum=127.0.0.1:57530, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-10-05 20:01:26,825 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36369-0x101182c1f970003, quorum=127.0.0.1:57530, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-10-05 20:01:26,825 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:32861-0x101182c1f970001, quorum=127.0.0.1:57530, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-10-05 20:01:26,825 DEBUG [(jenkins-hbase4.apache.org,40857,1696535997381)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40857-0x101182c1f970000, quorum=127.0.0.1:57530, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,32861,1696535998642 2023-10-05 20:01:26,825 DEBUG [(jenkins-hbase4.apache.org,40857,1696535997381)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-05 20:01:26,825 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 184 2023-10-05 20:01:26,825 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-10-05 20:01:26,825 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 184 2023-10-05 20:01:26,825 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-10-05 20:01:26,825 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-10-05 20:01:26,825 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 184 2023-10-05 20:01:26,826 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-10-05 20:01:26,826 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-10-05 20:01:26,826 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-10-05 20:01:26,826 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testEmptyExportFileSystemState 2023-10-05 20:01:26,826 DEBUG [member: 'jenkins-hbase4.apache.org,44821,1696535998698' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-10-05 20:01:26,826 DEBUG [member: 'jenkins-hbase4.apache.org,44821,1696535998698' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-05 20:01:26,827 DEBUG [member: 'jenkins-hbase4.apache.org,44821,1696535998698' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-10-05 20:01:26,827 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testEmptyExportFileSystemState 2023-10-05 20:01:26,827 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testEmptyExportFileSystemState 2023-10-05 20:01:26,827 DEBUG [member: 'jenkins-hbase4.apache.org,36369,1696535998737' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-10-05 20:01:26,827 DEBUG [member: 'jenkins-hbase4.apache.org,32861,1696535998642' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-10-05 20:01:26,827 DEBUG [member: 'jenkins-hbase4.apache.org,32861,1696535998642' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-05 20:01:26,827 DEBUG [member: 'jenkins-hbase4.apache.org,44821,1696535998698' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally acquired 2023-10-05 20:01:26,827 DEBUG [member: 'jenkins-hbase4.apache.org,36369,1696535998737' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-05 20:01:26,828 DEBUG [member: 'jenkins-hbase4.apache.org,32861,1696535998642' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-10-05 20:01:26,827 DEBUG [member: 'jenkins-hbase4.apache.org,44821,1696535998698' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44821,1696535998698' joining acquired barrier for procedure (snaptb0-testEmptyExportFileSystemState) in zk 2023-10-05 20:01:26,831 DEBUG [member: 'jenkins-hbase4.apache.org,32861,1696535998642' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally acquired 2023-10-05 20:01:26,831 DEBUG [member: 'jenkins-hbase4.apache.org,36369,1696535998737' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-10-05 20:01:26,831 DEBUG [member: 'jenkins-hbase4.apache.org,36369,1696535998737' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally acquired 2023-10-05 20:01:26,831 DEBUG [member: 'jenkins-hbase4.apache.org,32861,1696535998642' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,32861,1696535998642' joining acquired barrier for procedure (snaptb0-testEmptyExportFileSystemState) in zk 2023-10-05 20:01:26,831 DEBUG [member: 'jenkins-hbase4.apache.org,36369,1696535998737' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,36369,1696535998737' joining acquired barrier for procedure (snaptb0-testEmptyExportFileSystemState) in zk 2023-10-05 20:01:26,833 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): master:40857-0x101182c1f970000, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,44821,1696535998698 2023-10-05 20:01:26,833 DEBUG [member: 'jenkins-hbase4.apache.org,44821,1696535998698' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-10-05 20:01:26,833 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,44821,1696535998698 2023-10-05 20:01:26,833 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-05 20:01:26,833 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-05 20:01:26,833 DEBUG [member: 'jenkins-hbase4.apache.org,36369,1696535998737' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-10-05 20:01:26,833 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): master:40857-0x101182c1f970000, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,32861,1696535998642 2023-10-05 20:01:26,834 DEBUG [member: 'jenkins-hbase4.apache.org,32861,1696535998642' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-10-05 20:01:26,833 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-05 20:01:26,833 DEBUG [member: 'jenkins-hbase4.apache.org,44821,1696535998698' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44821-0x101182c1f970002, quorum=127.0.0.1:57530, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-10-05 20:01:26,834 DEBUG [member: 'jenkins-hbase4.apache.org,44821,1696535998698' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-05 20:01:26,834 DEBUG [member: 'jenkins-hbase4.apache.org,36369,1696535998737' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36369-0x101182c1f970003, quorum=127.0.0.1:57530, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-10-05 20:01:26,834 DEBUG [member: 'jenkins-hbase4.apache.org,36369,1696535998737' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-05 20:01:26,834 DEBUG [member: 'jenkins-hbase4.apache.org,32861,1696535998642' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:32861-0x101182c1f970001, quorum=127.0.0.1:57530, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-10-05 20:01:26,834 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-05 20:01:26,834 DEBUG [member: 'jenkins-hbase4.apache.org,32861,1696535998642' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-05 20:01:26,834 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-10-05 20:01:26,834 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32861,1696535998642 2023-10-05 20:01:26,835 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36369,1696535998737 2023-10-05 20:01:26,835 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44821,1696535998698 2023-10-05 20:01:26,835 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-05 20:01:26,835 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,44821,1696535998698' joining acquired barrier for procedure 'snaptb0-testEmptyExportFileSystemState' on coordinator 2023-10-05 20:01:26,835 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@55c0ea78[Count = 1] remaining members to acquire global barrier 2023-10-05 20:01:26,835 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,32861,1696535998642 2023-10-05 20:01:26,835 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-05 20:01:26,835 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-05 20:01:26,836 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-05 20:01:26,836 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-05 20:01:26,836 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-10-05 20:01:26,836 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32861,1696535998642 2023-10-05 20:01:26,836 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36369,1696535998737 2023-10-05 20:01:26,837 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44821,1696535998698 2023-10-05 20:01:26,837 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-05 20:01:26,837 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,32861,1696535998642' joining acquired barrier for procedure 'snaptb0-testEmptyExportFileSystemState' on coordinator 2023-10-05 20:01:26,837 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@55c0ea78[Count = 0] remaining members to acquire global barrier 2023-10-05 20:01:26,837 DEBUG [(jenkins-hbase4.apache.org,40857,1696535997381)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testEmptyExportFileSystemState' starting 'in-barrier' execution. 2023-10-05 20:01:26,837 DEBUG [(jenkins-hbase4.apache.org,40857,1696535997381)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-10-05 20:01:26,845 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): regionserver:32861-0x101182c1f970001, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-10-05 20:01:26,845 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): regionserver:44821-0x101182c1f970002, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-10-05 20:01:26,845 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-10-05 20:01:26,845 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-10-05 20:01:26,845 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): regionserver:36369-0x101182c1f970003, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-10-05 20:01:26,845 DEBUG [member: 'jenkins-hbase4.apache.org,32861,1696535998642' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-10-05 20:01:26,845 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-10-05 20:01:26,845 DEBUG [(jenkins-hbase4.apache.org,40857,1696535997381)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40857-0x101182c1f970000, quorum=127.0.0.1:57530, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,44821,1696535998698 2023-10-05 20:01:26,845 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-10-05 20:01:26,846 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-10-05 20:01:26,846 DEBUG [member: 'jenkins-hbase4.apache.org,32861,1696535998642' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-05 20:01:26,846 DEBUG [member: 'jenkins-hbase4.apache.org,44821,1696535998698' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-10-05 20:01:26,846 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-10-05 20:01:26,846 DEBUG [member: 'jenkins-hbase4.apache.org,32861,1696535998642' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-05 20:01:26,846 DEBUG [(jenkins-hbase4.apache.org,40857,1696535997381)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40857-0x101182c1f970000, quorum=127.0.0.1:57530, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,32861,1696535998642 2023-10-05 20:01:26,846 DEBUG [(jenkins-hbase4.apache.org,40857,1696535997381)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-05 20:01:26,846 DEBUG [rs(jenkins-hbase4.apache.org,32861,1696535998642)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,,1696536086002.3c44e9f2082b4b948b4622d8058d43c2. 2023-10-05 20:01:26,846 DEBUG [rs(jenkins-hbase4.apache.org,44821,1696535998698)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,1,1696536086002.2181c668f20cc320434bc68f718d676e. 2023-10-05 20:01:26,846 DEBUG [member: 'jenkins-hbase4.apache.org,44821,1696535998698' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-05 20:01:26,846 DEBUG [member: 'jenkins-hbase4.apache.org,44821,1696535998698' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-05 20:01:26,846 DEBUG [member: 'jenkins-hbase4.apache.org,36369,1696535998737' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-10-05 20:01:26,846 DEBUG [rs(jenkins-hbase4.apache.org,44821,1696535998698)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1696536086002.2181c668f20cc320434bc68f718d676e. started... 2023-10-05 20:01:26,846 DEBUG [rs(jenkins-hbase4.apache.org,32861,1696535998642)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1696536086002.3c44e9f2082b4b948b4622d8058d43c2. started... 2023-10-05 20:01:26,846 DEBUG [member: 'jenkins-hbase4.apache.org,36369,1696535998737' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally completed 2023-10-05 20:01:26,846 DEBUG [member: 'jenkins-hbase4.apache.org,36369,1696535998737' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,36369,1696535998737' in zk 2023-10-05 20:01:26,846 INFO [rs(jenkins-hbase4.apache.org,32861,1696535998642)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 3c44e9f2082b4b948b4622d8058d43c2 1/1 column families, dataSize=400 B heapSize=1.09 KB 2023-10-05 20:01:26,846 INFO [rs(jenkins-hbase4.apache.org,44821,1696535998698)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 2181c668f20cc320434bc68f718d676e 1/1 column families, dataSize=2.87 KB heapSize=6.44 KB 2023-10-05 20:01:26,848 DEBUG [member: 'jenkins-hbase4.apache.org,36369,1696535998737' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-10-05 20:01:26,848 DEBUG [member: 'jenkins-hbase4.apache.org,36369,1696535998737' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-05 20:01:26,848 DEBUG [member: 'jenkins-hbase4.apache.org,36369,1696535998737' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testEmptyExportFileSystemState' completed. 2023-10-05 20:01:26,863 INFO [rs(jenkins-hbase4.apache.org,32861,1696535998642)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231005fc276167d2414eca97d7ec944759f1d1 to hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e20231005fc276167d2414eca97d7ec944759f1d1 2023-10-05 20:01:26,863 INFO [rs(jenkins-hbase4.apache.org,44821,1696535998698)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20231005ee0ceda737674b00b7d64a56bac4fc2a to hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b20231005ee0ceda737674b00b7d64a56bac4fc2a 2023-10-05 20:01:26,873 INFO [rs(jenkins-hbase4.apache.org,32861,1696535998642)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=400, hasBloomFilter=true, into tmp file hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/data/default/testtb-testEmptyExportFileSystemState/3c44e9f2082b4b948b4622d8058d43c2/.tmp/cf/79312ef965e1458a84911d79a20d117d 2023-10-05 20:01:26,876 INFO [rs(jenkins-hbase4.apache.org,44821,1696535998698)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=2.9 K, hasBloomFilter=true, into tmp file hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/data/default/testtb-testEmptyExportFileSystemState/2181c668f20cc320434bc68f718d676e/.tmp/cf/593887169c8749c386df16daac11c8aa 2023-10-05 20:01:26,879 DEBUG [rs(jenkins-hbase4.apache.org,32861,1696535998642)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/data/default/testtb-testEmptyExportFileSystemState/3c44e9f2082b4b948b4622d8058d43c2/.tmp/cf/79312ef965e1458a84911d79a20d117d as hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/data/default/testtb-testEmptyExportFileSystemState/3c44e9f2082b4b948b4622d8058d43c2/cf/79312ef965e1458a84911d79a20d117d 2023-10-05 20:01:26,881 DEBUG [rs(jenkins-hbase4.apache.org,44821,1696535998698)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/data/default/testtb-testEmptyExportFileSystemState/2181c668f20cc320434bc68f718d676e/.tmp/cf/593887169c8749c386df16daac11c8aa as hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/data/default/testtb-testEmptyExportFileSystemState/2181c668f20cc320434bc68f718d676e/cf/593887169c8749c386df16daac11c8aa 2023-10-05 20:01:26,884 INFO [rs(jenkins-hbase4.apache.org,32861,1696535998642)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/data/default/testtb-testEmptyExportFileSystemState/3c44e9f2082b4b948b4622d8058d43c2/cf/79312ef965e1458a84911d79a20d117d, entries=6, sequenceid=6, filesize=5.9 K 2023-10-05 20:01:26,885 INFO [rs(jenkins-hbase4.apache.org,32861,1696535998642)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~400 B/400, heapSize ~1.08 KB/1104, currentSize=0 B/0 for 3c44e9f2082b4b948b4622d8058d43c2 in 39ms, sequenceid=6, compaction requested=false 2023-10-05 20:01:26,885 DEBUG [rs(jenkins-hbase4.apache.org,32861,1696535998642)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testEmptyExportFileSystemState' 2023-10-05 20:01:26,885 DEBUG [rs(jenkins-hbase4.apache.org,32861,1696535998642)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 3c44e9f2082b4b948b4622d8058d43c2: 2023-10-05 20:01:26,885 INFO [rs(jenkins-hbase4.apache.org,44821,1696535998698)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/data/default/testtb-testEmptyExportFileSystemState/2181c668f20cc320434bc68f718d676e/cf/593887169c8749c386df16daac11c8aa, entries=44, sequenceid=6, filesize=12.6 K 2023-10-05 20:01:26,885 DEBUG [rs(jenkins-hbase4.apache.org,32861,1696535998642)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,,1696536086002.3c44e9f2082b4b948b4622d8058d43c2.' region-info for snapshot=snaptb0-testEmptyExportFileSystemState 2023-10-05 20:01:26,885 DEBUG [rs(jenkins-hbase4.apache.org,32861,1696535998642)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-05 20:01:26,885 DEBUG [rs(jenkins-hbase4.apache.org,32861,1696535998642)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/data/default/testtb-testEmptyExportFileSystemState/3c44e9f2082b4b948b4622d8058d43c2/cf/79312ef965e1458a84911d79a20d117d] hfiles 2023-10-05 20:01:26,885 DEBUG [rs(jenkins-hbase4.apache.org,32861,1696535998642)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/data/default/testtb-testEmptyExportFileSystemState/3c44e9f2082b4b948b4622d8058d43c2/cf/79312ef965e1458a84911d79a20d117d for snapshot=snaptb0-testEmptyExportFileSystemState 2023-10-05 20:01:26,886 INFO [rs(jenkins-hbase4.apache.org,44821,1696535998698)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~2.87 KB/2936, heapSize ~6.42 KB/6576, currentSize=0 B/0 for 2181c668f20cc320434bc68f718d676e in 40ms, sequenceid=6, compaction requested=false 2023-10-05 20:01:26,888 DEBUG [rs(jenkins-hbase4.apache.org,44821,1696535998698)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 2181c668f20cc320434bc68f718d676e: 2023-10-05 20:01:26,888 DEBUG [rs(jenkins-hbase4.apache.org,44821,1696535998698)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,1,1696536086002.2181c668f20cc320434bc68f718d676e.' region-info for snapshot=snaptb0-testEmptyExportFileSystemState 2023-10-05 20:01:26,888 DEBUG [rs(jenkins-hbase4.apache.org,44821,1696535998698)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-05 20:01:26,888 DEBUG [rs(jenkins-hbase4.apache.org,44821,1696535998698)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/data/default/testtb-testEmptyExportFileSystemState/2181c668f20cc320434bc68f718d676e/cf/593887169c8749c386df16daac11c8aa] hfiles 2023-10-05 20:01:26,888 DEBUG [rs(jenkins-hbase4.apache.org,44821,1696535998698)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/data/default/testtb-testEmptyExportFileSystemState/2181c668f20cc320434bc68f718d676e/cf/593887169c8749c386df16daac11c8aa for snapshot=snaptb0-testEmptyExportFileSystemState 2023-10-05 20:01:26,899 DEBUG [rs(jenkins-hbase4.apache.org,32861,1696535998642)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1696536086002.3c44e9f2082b4b948b4622d8058d43c2. completed. 2023-10-05 20:01:26,899 DEBUG [rs(jenkins-hbase4.apache.org,32861,1696535998642)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,,1696536086002.3c44e9f2082b4b948b4622d8058d43c2. 2023-10-05 20:01:26,899 DEBUG [member: 'jenkins-hbase4.apache.org,32861,1696535998642' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-05 20:01:26,899 DEBUG [member: 'jenkins-hbase4.apache.org,32861,1696535998642' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-05 20:01:26,899 DEBUG [member: 'jenkins-hbase4.apache.org,32861,1696535998642' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,32861,1696535998642 2023-10-05 20:01:26,899 DEBUG [member: 'jenkins-hbase4.apache.org,32861,1696535998642' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally completed 2023-10-05 20:01:26,899 DEBUG [member: 'jenkins-hbase4.apache.org,32861,1696535998642' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,32861,1696535998642' in zk 2023-10-05 20:01:26,900 DEBUG [rs(jenkins-hbase4.apache.org,44821,1696535998698)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1696536086002.2181c668f20cc320434bc68f718d676e. completed. 2023-10-05 20:01:26,900 DEBUG [rs(jenkins-hbase4.apache.org,44821,1696535998698)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,1,1696536086002.2181c668f20cc320434bc68f718d676e. 2023-10-05 20:01:26,900 DEBUG [member: 'jenkins-hbase4.apache.org,44821,1696535998698' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-05 20:01:26,900 DEBUG [member: 'jenkins-hbase4.apache.org,44821,1696535998698' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-05 20:01:26,900 DEBUG [member: 'jenkins-hbase4.apache.org,44821,1696535998698' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,44821,1696535998698 2023-10-05 20:01:26,900 DEBUG [member: 'jenkins-hbase4.apache.org,44821,1696535998698' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally completed 2023-10-05 20:01:26,900 DEBUG [member: 'jenkins-hbase4.apache.org,44821,1696535998698' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,44821,1696535998698' in zk 2023-10-05 20:01:26,901 DEBUG [member: 'jenkins-hbase4.apache.org,32861,1696535998642' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-10-05 20:01:26,901 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): master:40857-0x101182c1f970000, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,32861,1696535998642 2023-10-05 20:01:26,901 DEBUG [member: 'jenkins-hbase4.apache.org,32861,1696535998642' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-05 20:01:26,901 DEBUG [member: 'jenkins-hbase4.apache.org,32861,1696535998642' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testEmptyExportFileSystemState' completed. 2023-10-05 20:01:26,901 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,32861,1696535998642 2023-10-05 20:01:26,902 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-05 20:01:26,903 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-05 20:01:26,904 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): master:40857-0x101182c1f970000, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,44821,1696535998698 2023-10-05 20:01:26,904 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-05 20:01:26,904 DEBUG [member: 'jenkins-hbase4.apache.org,44821,1696535998698' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-10-05 20:01:26,904 DEBUG [member: 'jenkins-hbase4.apache.org,44821,1696535998698' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-05 20:01:26,904 DEBUG [member: 'jenkins-hbase4.apache.org,44821,1696535998698' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testEmptyExportFileSystemState' completed. 2023-10-05 20:01:26,905 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-05 20:01:26,906 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-10-05 20:01:26,906 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32861,1696535998642 2023-10-05 20:01:26,906 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36369,1696535998737 2023-10-05 20:01:26,906 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44821,1696535998698 2023-10-05 20:01:26,907 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-05 20:01:26,907 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-10-05 20:01:26,907 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32861,1696535998642 2023-10-05 20:01:26,907 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36369,1696535998737 2023-10-05 20:01:26,908 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44821,1696535998698 2023-10-05 20:01:26,908 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,32861,1696535998642': 2023-10-05 20:01:26,908 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,32861,1696535998642' released barrier for procedure'snaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 1 more 2023-10-05 20:01:26,908 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,44821,1696535998698 2023-10-05 20:01:26,908 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-05 20:01:26,908 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-05 20:01:26,908 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-05 20:01:26,909 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-05 20:01:26,909 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-10-05 20:01:26,909 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32861,1696535998642 2023-10-05 20:01:26,909 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36369,1696535998737 2023-10-05 20:01:26,910 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44821,1696535998698 2023-10-05 20:01:26,910 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-05 20:01:26,910 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-10-05 20:01:26,910 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32861,1696535998642 2023-10-05 20:01:26,911 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36369,1696535998737 2023-10-05 20:01:26,911 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44821,1696535998698 2023-10-05 20:01:26,911 DEBUG [Listener at jenkins-hbase4.apache.org/35067] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-05 20:01:26,911 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,44821,1696535998698': 2023-10-05 20:01:26,911 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,44821,1696535998698' released barrier for procedure'snaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 0 more 2023-10-05 20:01:26,911 INFO [(jenkins-hbase4.apache.org,40857,1696535997381)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testEmptyExportFileSystemState' execution completed 2023-10-05 20:01:26,912 DEBUG [(jenkins-hbase4.apache.org,40857,1696535997381)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-05 20:01:26,912 DEBUG [(jenkins-hbase4.apache.org,40857,1696535997381)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-05 20:01:26,912 DEBUG [(jenkins-hbase4.apache.org,40857,1696535997381)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testEmptyExportFileSystemState 2023-10-05 20:01:26,912 INFO [(jenkins-hbase4.apache.org,40857,1696535997381)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testEmptyExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-10-05 20:01:26,912 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40857] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-10-05 20:01:26,912 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40857] snapshot.SnapshotManager(406): Snapshoting '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-10-05 20:01:26,912 DEBUG [Listener at jenkins-hbase4.apache.org/35067] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-10-05 20:01:26,914 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): master:40857-0x101182c1f970000, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-10-05 20:01:26,914 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): regionserver:36369-0x101182c1f970003, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-10-05 20:01:26,914 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-10-05 20:01:26,914 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-10-05 20:01:26,914 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-05 20:01:26,914 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): regionserver:36369-0x101182c1f970003, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-05 20:01:26,914 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): regionserver:32861-0x101182c1f970001, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-10-05 20:01:26,914 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): regionserver:44821-0x101182c1f970002, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-10-05 20:01:26,915 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-10-05 20:01:26,915 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-10-05 20:01:26,915 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-10-05 20:01:26,915 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): regionserver:44821-0x101182c1f970002, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-05 20:01:26,915 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): regionserver:32861-0x101182c1f970001, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-05 20:01:26,915 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-05 20:01:26,915 DEBUG [(jenkins-hbase4.apache.org,40857,1696535997381)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40857-0x101182c1f970000, quorum=127.0.0.1:57530, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,32861,1696535998642 2023-10-05 20:01:26,915 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-10-05 20:01:26,915 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-10-05 20:01:26,915 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-05 20:01:26,915 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-05 20:01:26,915 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-05 20:01:26,915 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-05 20:01:26,915 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-05 20:01:26,915 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-05 20:01:26,916 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-05 20:01:26,916 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-10-05 20:01:26,916 DEBUG [(jenkins-hbase4.apache.org,40857,1696535997381)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40857-0x101182c1f970000, quorum=127.0.0.1:57530, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,36369,1696535998737 2023-10-05 20:01:26,916 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-10-05 20:01:26,916 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-10-05 20:01:26,916 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-10-05 20:01:26,916 DEBUG [(jenkins-hbase4.apache.org,40857,1696535997381)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40857-0x101182c1f970000, quorum=127.0.0.1:57530, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,44821,1696535998698 2023-10-05 20:01:26,916 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-05 20:01:26,917 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-10-05 20:01:26,917 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32861,1696535998642 2023-10-05 20:01:26,917 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36369,1696535998737 2023-10-05 20:01:26,918 DEBUG [(jenkins-hbase4.apache.org,40857,1696535997381)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40857-0x101182c1f970000, quorum=127.0.0.1:57530, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,32861,1696535998642 2023-10-05 20:01:26,918 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44821,1696535998698 2023-10-05 20:01:26,918 DEBUG [(jenkins-hbase4.apache.org,40857,1696535997381)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40857-0x101182c1f970000, quorum=127.0.0.1:57530, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,36369,1696535998737 2023-10-05 20:01:26,918 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-05 20:01:26,918 DEBUG [(jenkins-hbase4.apache.org,40857,1696535997381)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40857-0x101182c1f970000, quorum=127.0.0.1:57530, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,44821,1696535998698 2023-10-05 20:01:26,918 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-10-05 20:01:26,919 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32861,1696535998642 2023-10-05 20:01:26,919 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36369,1696535998737 2023-10-05 20:01:26,919 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44821,1696535998698 2023-10-05 20:01:26,921 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): regionserver:44821-0x101182c1f970002, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-05 20:01:26,921 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): regionserver:44821-0x101182c1f970002, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-05 20:01:26,921 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-05 20:01:26,921 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testEmptyExportFileSystemState 2023-10-05 20:01:26,921 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): regionserver:32861-0x101182c1f970001, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-05 20:01:26,921 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-05 20:01:26,921 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-05 20:01:26,921 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-05 20:01:26,921 DEBUG [(jenkins-hbase4.apache.org,40857,1696535997381)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-05 20:01:26,921 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): master:40857-0x101182c1f970000, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,44821,1696535998698 2023-10-05 20:01:26,921 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): regionserver:36369-0x101182c1f970003, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-05 20:01:26,921 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): master:40857-0x101182c1f970000, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-10-05 20:01:26,921 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): regionserver:32861-0x101182c1f970001, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-05 20:01:26,921 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testEmptyExportFileSystemState 2023-10-05 20:01:26,923 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): master:40857-0x101182c1f970000, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,36369,1696535998737 2023-10-05 20:01:26,923 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 37e3865d2ff7e5e2da33a03e3f723df0, NAME => 'testtb-testEmptyExportFileSystemState,.mob,0.37e3865d2ff7e5e2da33a03e3f723df0.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testEmptyExportFileSystemState 2023-10-05 20:01:26,923 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-10-05 20:01:26,921 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-05 20:01:26,921 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): regionserver:36369-0x101182c1f970003, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-05 20:01:26,923 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-05 20:01:26,923 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-05 20:01:26,923 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-05 20:01:26,923 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-05 20:01:26,923 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): master:40857-0x101182c1f970000, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,32861,1696535998642 2023-10-05 20:01:26,924 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): master:40857-0x101182c1f970000, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-10-05 20:01:26,924 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): master:40857-0x101182c1f970000, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,44821,1696535998698 2023-10-05 20:01:26,924 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): master:40857-0x101182c1f970000, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-10-05 20:01:26,924 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): master:40857-0x101182c1f970000, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,36369,1696535998737 2023-10-05 20:01:26,924 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): master:40857-0x101182c1f970000, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,32861,1696535998642 2023-10-05 20:01:26,924 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): master:40857-0x101182c1f970000, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-10-05 20:01:26,924 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): master:40857-0x101182c1f970000, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-10-05 20:01:26,923 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-05 20:01:26,924 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b20231005ee0ceda737674b00b7d64a56bac4fc2a, hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e20231005fc276167d2414eca97d7ec944759f1d1] mob files 2023-10-05 20:01:26,924 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b20231005ee0ceda737674b00b7d64a56bac4fc2a 2023-10-05 20:01:26,924 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e20231005fc276167d2414eca97d7ec944759f1d1 2023-10-05 20:01:26,925 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-05 20:01:26,925 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-05 20:01:26,931 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testEmptyExportFileSystemState 2023-10-05 20:01:26,932 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState 2023-10-05 20:01:26,954 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState to hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/.hbase-snapshot/snaptb0-testEmptyExportFileSystemState 2023-10-05 20:01:26,955 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed 2023-10-05 20:01:26,955 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState 2023-10-05 20:01:26,955 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState 2023-10-05 20:01:26,955 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState at 1696536086810Completed referencing HFiles for the mob region of table: testtb-testEmptyExportFileSystemState at 1696536086931 (+121 ms)Consolidate snapshot: snaptb0-testEmptyExportFileSystemState at 1696536086931Loading Region manifests for snaptb0-testEmptyExportFileSystemState at 1696536086931Writing data manifest for snaptb0-testEmptyExportFileSystemState at 1696536086934 (+3 ms)Verifying snapshot: snaptb0-testEmptyExportFileSystemState at 1696536086947 (+13 ms)Snapshot snaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed at 1696536086955 (+8 ms) 2023-10-05 20:01:26,960 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=98, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-10-05 20:01:26,962 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=98, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED in 149 msec 2023-10-05 20:01:27,113 DEBUG [Listener at jenkins-hbase4.apache.org/35067] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-05 20:01:27,114 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40857] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-10-05 20:01:27,114 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40857] snapshot.SnapshotManager(403): Snapshot '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-10-05 20:01:27,114 INFO [Listener at jenkins-hbase4.apache.org/35067] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/export-test/export-1696536087114 2023-10-05 20:01:27,114 INFO [Listener at jenkins-hbase4.apache.org/35067] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:45929, tgtDir=hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/export-test/export-1696536087114, rawTgtDir=hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/export-test/export-1696536087114, srcFsUri=hdfs://localhost:45929, srcDir=hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2 2023-10-05 20:01:27,136 DEBUG [Listener at jenkins-hbase4.apache.org/35067] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:45929, inputRoot=hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2 2023-10-05 20:01:27,136 DEBUG [Listener at jenkins-hbase4.apache.org/35067] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1484967191_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/export-test/export-1696536087114, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/export-test/export-1696536087114/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-10-05 20:01:27,136 INFO [Listener at jenkins-hbase4.apache.org/35067] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:45929, inputRoot=hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2, snapshotDir=hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState. 2023-10-05 20:01:27,141 INFO [Listener at jenkins-hbase4.apache.org/35067] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState to hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/export-test/export-1696536087114/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-10-05 20:01:27,161 DEBUG [Listener at jenkins-hbase4.apache.org/35067] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-10-05 20:01:27,161 DEBUG [Listener at jenkins-hbase4.apache.org/35067] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-10-05 20:01:27,162 DEBUG [Listener at jenkins-hbase4.apache.org/35067] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-10-05 20:01:27,162 DEBUG [Listener at jenkins-hbase4.apache.org/35067] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-10-05 20:01:28,032 DEBUG [Listener at jenkins-hbase4.apache.org/35067] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/190200ca-70b6-4852-ff08-4943c98578e6/hadoop-7665396441078347188.jar 2023-10-05 20:01:28,033 DEBUG [Listener at jenkins-hbase4.apache.org/35067] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-10-05 20:01:28,033 DEBUG [Listener at jenkins-hbase4.apache.org/35067] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-10-05 20:01:28,099 DEBUG [Listener at jenkins-hbase4.apache.org/35067] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/190200ca-70b6-4852-ff08-4943c98578e6/hadoop-7207190024569375376.jar 2023-10-05 20:01:28,099 DEBUG [Listener at jenkins-hbase4.apache.org/35067] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-10-05 20:01:28,100 DEBUG [Listener at jenkins-hbase4.apache.org/35067] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-10-05 20:01:28,100 DEBUG [Listener at jenkins-hbase4.apache.org/35067] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-10-05 20:01:28,100 DEBUG [Listener at jenkins-hbase4.apache.org/35067] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-10-05 20:01:28,101 DEBUG [Listener at jenkins-hbase4.apache.org/35067] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-10-05 20:01:28,101 DEBUG [Listener at jenkins-hbase4.apache.org/35067] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-10-05 20:01:28,101 DEBUG [Listener at jenkins-hbase4.apache.org/35067] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-10-05 20:01:28,102 DEBUG [Listener at jenkins-hbase4.apache.org/35067] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-10-05 20:01:28,102 DEBUG [Listener at jenkins-hbase4.apache.org/35067] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-10-05 20:01:28,102 DEBUG [Listener at jenkins-hbase4.apache.org/35067] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-10-05 20:01:28,103 DEBUG [Listener at jenkins-hbase4.apache.org/35067] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-10-05 20:01:28,103 DEBUG [Listener at jenkins-hbase4.apache.org/35067] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-10-05 20:01:28,104 DEBUG [Listener at jenkins-hbase4.apache.org/35067] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-10-05 20:01:28,104 DEBUG [Listener at jenkins-hbase4.apache.org/35067] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-10-05 20:01:28,104 DEBUG [Listener at jenkins-hbase4.apache.org/35067] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-10-05 20:01:28,105 DEBUG [Listener at jenkins-hbase4.apache.org/35067] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-10-05 20:01:28,105 DEBUG [Listener at jenkins-hbase4.apache.org/35067] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-05 20:01:28,106 DEBUG [Listener at jenkins-hbase4.apache.org/35067] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-05 20:01:28,106 DEBUG [Listener at jenkins-hbase4.apache.org/35067] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-10-05 20:01:28,106 DEBUG [Listener at jenkins-hbase4.apache.org/35067] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-05 20:01:28,107 DEBUG [Listener at jenkins-hbase4.apache.org/35067] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-05 20:01:28,107 DEBUG [Listener at jenkins-hbase4.apache.org/35067] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-10-05 20:01:28,108 DEBUG [Listener at jenkins-hbase4.apache.org/35067] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-10-05 20:01:28,452 WARN [Listener at jenkins-hbase4.apache.org/35067] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-10-05 20:01:28,454 INFO [Listener at jenkins-hbase4.apache.org/35067] snapshot.ExportSnapshot(578): Loading Snapshot 'emptySnaptb0-testEmptyExportFileSystemState' hfile list 2023-10-05 20:01:29,405 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-10-05 20:01:29,405 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-10-05 20:01:29,411 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696536006875_0005_000001 (auth:SIMPLE) 2023-10-05 20:01:29,545 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696536006875_0006_000001 (auth:SIMPLE) 2023-10-05 20:01:30,846 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-10-05 20:01:33,227 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696536006875_0006_000001 (auth:SIMPLE) 2023-10-05 20:01:35,784 INFO [Listener at jenkins-hbase4.apache.org/35067] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-10-05 20:01:35,785 INFO [Listener at jenkins-hbase4.apache.org/35067] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-10-05 20:01:35,790 INFO [Listener at jenkins-hbase4.apache.org/35067] snapshot.ExportSnapshot(1127): Export Completed: emptySnaptb0-testEmptyExportFileSystemState 2023-10-05 20:01:35,790 INFO [Listener at jenkins-hbase4.apache.org/35067] snapshot.TestExportSnapshot(279): Exported snapshot 2023-10-05 20:01:35,791 INFO [Listener at jenkins-hbase4.apache.org/35067] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-10-05 20:01:35,791 DEBUG [Listener at jenkins-hbase4.apache.org/35067] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-2070727397_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState at hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState 2023-10-05 20:01:35,792 DEBUG [Listener at jenkins-hbase4.apache.org/35067] snapshot.TestExportSnapshot(367): hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/.snapshotinfo 2023-10-05 20:01:35,792 DEBUG [Listener at jenkins-hbase4.apache.org/35067] snapshot.TestExportSnapshot(367): hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/data.manifest 2023-10-05 20:01:35,792 DEBUG [Listener at jenkins-hbase4.apache.org/35067] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-2070727397_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/export-test/export-1696536087114/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState at hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/export-test/export-1696536087114/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState 2023-10-05 20:01:35,792 DEBUG [Listener at jenkins-hbase4.apache.org/35067] snapshot.TestExportSnapshot(367): hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/export-test/export-1696536087114/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/.snapshotinfo 2023-10-05 20:01:35,792 DEBUG [Listener at jenkins-hbase4.apache.org/35067] snapshot.TestExportSnapshot(367): hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/export-test/export-1696536087114/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/data.manifest 2023-10-05 20:01:35,798 INFO [Listener at jenkins-hbase4.apache.org/35067] client.HBaseAdmin$15(890): Started disable of testtb-testEmptyExportFileSystemState 2023-10-05 20:01:35,798 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40857] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testEmptyExportFileSystemState 2023-10-05 20:01:35,799 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40857] procedure2.ProcedureExecutor(1028): Stored pid=99, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testEmptyExportFileSystemState 2023-10-05 20:01:35,802 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40857] master.MasterRpcServices(1230): Checking to see if procedure is done pid=99 2023-10-05 20:01:35,803 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696536095802"}]},"ts":"1696536095802"} 2023-10-05 20:01:35,804 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=DISABLING in hbase:meta 2023-10-05 20:01:35,805 INFO [PEWorker-4] procedure.DisableTableProcedure(293): Set testtb-testEmptyExportFileSystemState to state=DISABLING 2023-10-05 20:01:35,806 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=100, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=3c44e9f2082b4b948b4622d8058d43c2, UNASSIGN}, {pid=101, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=2181c668f20cc320434bc68f718d676e, UNASSIGN}] 2023-10-05 20:01:35,808 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=100, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=3c44e9f2082b4b948b4622d8058d43c2, UNASSIGN 2023-10-05 20:01:35,808 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=101, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=2181c668f20cc320434bc68f718d676e, UNASSIGN 2023-10-05 20:01:35,809 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=100 updating hbase:meta row=3c44e9f2082b4b948b4622d8058d43c2, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,32861,1696535998642 2023-10-05 20:01:35,809 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=101 updating hbase:meta row=2181c668f20cc320434bc68f718d676e, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,44821,1696535998698 2023-10-05 20:01:35,809 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,,1696536086002.3c44e9f2082b4b948b4622d8058d43c2.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1696536095809"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696536095809"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696536095809"}]},"ts":"1696536095809"} 2023-10-05 20:01:35,809 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,1,1696536086002.2181c668f20cc320434bc68f718d676e.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1696536095809"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696536095809"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696536095809"}]},"ts":"1696536095809"} 2023-10-05 20:01:35,810 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=102, ppid=100, state=RUNNABLE; CloseRegionProcedure 3c44e9f2082b4b948b4622d8058d43c2, server=jenkins-hbase4.apache.org,32861,1696535998642}] 2023-10-05 20:01:35,811 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=103, ppid=101, state=RUNNABLE; CloseRegionProcedure 2181c668f20cc320434bc68f718d676e, server=jenkins-hbase4.apache.org,44821,1696535998698}] 2023-10-05 20:01:35,903 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40857] master.MasterRpcServices(1230): Checking to see if procedure is done pid=99 2023-10-05 20:01:35,962 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 2181c668f20cc320434bc68f718d676e 2023-10-05 20:01:35,962 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 3c44e9f2082b4b948b4622d8058d43c2 2023-10-05 20:01:35,963 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 2181c668f20cc320434bc68f718d676e, disabling compactions & flushes 2023-10-05 20:01:35,963 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 3c44e9f2082b4b948b4622d8058d43c2, disabling compactions & flushes 2023-10-05 20:01:35,963 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,1,1696536086002.2181c668f20cc320434bc68f718d676e. 2023-10-05 20:01:35,963 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,1,1696536086002.2181c668f20cc320434bc68f718d676e. 2023-10-05 20:01:35,963 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,,1696536086002.3c44e9f2082b4b948b4622d8058d43c2. 2023-10-05 20:01:35,963 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,1,1696536086002.2181c668f20cc320434bc68f718d676e. after waiting 0 ms 2023-10-05 20:01:35,963 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,1,1696536086002.2181c668f20cc320434bc68f718d676e. 2023-10-05 20:01:35,963 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,,1696536086002.3c44e9f2082b4b948b4622d8058d43c2. 2023-10-05 20:01:35,963 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,,1696536086002.3c44e9f2082b4b948b4622d8058d43c2. after waiting 0 ms 2023-10-05 20:01:35,963 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,,1696536086002.3c44e9f2082b4b948b4622d8058d43c2. 2023-10-05 20:01:35,972 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/data/default/testtb-testEmptyExportFileSystemState/2181c668f20cc320434bc68f718d676e/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-10-05 20:01:35,972 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/data/default/testtb-testEmptyExportFileSystemState/3c44e9f2082b4b948b4622d8058d43c2/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-10-05 20:01:35,973 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-10-05 20:01:35,973 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,1,1696536086002.2181c668f20cc320434bc68f718d676e. 2023-10-05 20:01:35,973 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-10-05 20:01:35,973 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 2181c668f20cc320434bc68f718d676e: 2023-10-05 20:01:35,974 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,,1696536086002.3c44e9f2082b4b948b4622d8058d43c2. 2023-10-05 20:01:35,974 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 3c44e9f2082b4b948b4622d8058d43c2: 2023-10-05 20:01:35,976 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 2181c668f20cc320434bc68f718d676e 2023-10-05 20:01:35,976 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=101 updating hbase:meta row=2181c668f20cc320434bc68f718d676e, regionState=CLOSED 2023-10-05 20:01:35,976 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,1,1696536086002.2181c668f20cc320434bc68f718d676e.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1696536095976"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696536095976"}]},"ts":"1696536095976"} 2023-10-05 20:01:35,976 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 3c44e9f2082b4b948b4622d8058d43c2 2023-10-05 20:01:35,977 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=100 updating hbase:meta row=3c44e9f2082b4b948b4622d8058d43c2, regionState=CLOSED 2023-10-05 20:01:35,977 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,,1696536086002.3c44e9f2082b4b948b4622d8058d43c2.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1696536095977"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696536095977"}]},"ts":"1696536095977"} 2023-10-05 20:01:35,979 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=103, resume processing ppid=101 2023-10-05 20:01:35,979 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=103, ppid=101, state=SUCCESS; CloseRegionProcedure 2181c668f20cc320434bc68f718d676e, server=jenkins-hbase4.apache.org,44821,1696535998698 in 166 msec 2023-10-05 20:01:35,980 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=102, resume processing ppid=100 2023-10-05 20:01:35,980 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=102, ppid=100, state=SUCCESS; CloseRegionProcedure 3c44e9f2082b4b948b4622d8058d43c2, server=jenkins-hbase4.apache.org,32861,1696535998642 in 168 msec 2023-10-05 20:01:35,980 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=101, ppid=99, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=2181c668f20cc320434bc68f718d676e, UNASSIGN in 173 msec 2023-10-05 20:01:35,981 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=100, resume processing ppid=99 2023-10-05 20:01:35,981 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=100, ppid=99, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=3c44e9f2082b4b948b4622d8058d43c2, UNASSIGN in 174 msec 2023-10-05 20:01:35,982 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696536095982"}]},"ts":"1696536095982"} 2023-10-05 20:01:35,983 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=DISABLED in hbase:meta 2023-10-05 20:01:35,985 INFO [PEWorker-1] procedure.DisableTableProcedure(305): Set testtb-testEmptyExportFileSystemState to state=DISABLED 2023-10-05 20:01:35,986 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=99, state=SUCCESS; DisableTableProcedure table=testtb-testEmptyExportFileSystemState in 187 msec 2023-10-05 20:01:36,104 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40857] master.MasterRpcServices(1230): Checking to see if procedure is done pid=99 2023-10-05 20:01:36,104 INFO [Listener at jenkins-hbase4.apache.org/35067] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testEmptyExportFileSystemState, procId: 99 completed 2023-10-05 20:01:36,105 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40857] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testEmptyExportFileSystemState 2023-10-05 20:01:36,106 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40857] procedure2.ProcedureExecutor(1028): Stored pid=104, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-10-05 20:01:36,108 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=104, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-10-05 20:01:36,108 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40857] access.PermissionStorage(259): Removing permissions of removed table testtb-testEmptyExportFileSystemState 2023-10-05 20:01:36,109 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=104, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-10-05 20:01:36,110 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=32861] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testEmptyExportFileSystemState 2023-10-05 20:01:36,112 DEBUG [HFileArchiver-18] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/.tmp/data/default/testtb-testEmptyExportFileSystemState/3c44e9f2082b4b948b4622d8058d43c2 2023-10-05 20:01:36,112 DEBUG [HFileArchiver-14] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/.tmp/data/default/testtb-testEmptyExportFileSystemState/2181c668f20cc320434bc68f718d676e 2023-10-05 20:01:36,114 DEBUG [HFileArchiver-18] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/.tmp/data/default/testtb-testEmptyExportFileSystemState/3c44e9f2082b4b948b4622d8058d43c2/cf, FileablePath, hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/.tmp/data/default/testtb-testEmptyExportFileSystemState/3c44e9f2082b4b948b4622d8058d43c2/recovered.edits] 2023-10-05 20:01:36,114 DEBUG [HFileArchiver-14] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/.tmp/data/default/testtb-testEmptyExportFileSystemState/2181c668f20cc320434bc68f718d676e/cf, FileablePath, hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/.tmp/data/default/testtb-testEmptyExportFileSystemState/2181c668f20cc320434bc68f718d676e/recovered.edits] 2023-10-05 20:01:36,116 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): regionserver:32861-0x101182c1f970001, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-10-05 20:01:36,116 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): master:40857-0x101182c1f970000, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-10-05 20:01:36,116 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): regionserver:36369-0x101182c1f970003, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-10-05 20:01:36,116 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): regionserver:44821-0x101182c1f970002, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-10-05 20:01:36,117 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-10-05 20:01:36,117 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-10-05 20:01:36,117 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-10-05 20:01:36,117 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-10-05 20:01:36,118 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): master:40857-0x101182c1f970000, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-10-05 20:01:36,118 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): regionserver:36369-0x101182c1f970003, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-10-05 20:01:36,118 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): regionserver:32861-0x101182c1f970001, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-10-05 20:01:36,118 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): regionserver:44821-0x101182c1f970002, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-10-05 20:01:36,118 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): regionserver:44821-0x101182c1f970002, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-05 20:01:36,118 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): master:40857-0x101182c1f970000, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-05 20:01:36,118 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): regionserver:32861-0x101182c1f970001, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-05 20:01:36,118 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): regionserver:36369-0x101182c1f970003, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-05 20:01:36,119 DEBUG [HFileArchiver-18] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/.tmp/data/default/testtb-testEmptyExportFileSystemState/3c44e9f2082b4b948b4622d8058d43c2/cf/79312ef965e1458a84911d79a20d117d to hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/archive/data/default/testtb-testEmptyExportFileSystemState/3c44e9f2082b4b948b4622d8058d43c2/cf/79312ef965e1458a84911d79a20d117d 2023-10-05 20:01:36,119 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40857] master.MasterRpcServices(1230): Checking to see if procedure is done pid=104 2023-10-05 20:01:36,120 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/.tmp/data/default/testtb-testEmptyExportFileSystemState/2181c668f20cc320434bc68f718d676e/cf/593887169c8749c386df16daac11c8aa to hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/archive/data/default/testtb-testEmptyExportFileSystemState/2181c668f20cc320434bc68f718d676e/cf/593887169c8749c386df16daac11c8aa 2023-10-05 20:01:36,122 DEBUG [HFileArchiver-18] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/.tmp/data/default/testtb-testEmptyExportFileSystemState/3c44e9f2082b4b948b4622d8058d43c2/recovered.edits/9.seqid to hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/archive/data/default/testtb-testEmptyExportFileSystemState/3c44e9f2082b4b948b4622d8058d43c2/recovered.edits/9.seqid 2023-10-05 20:01:36,123 DEBUG [HFileArchiver-18] backup.HFileArchiver(596): Deleted hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/.tmp/data/default/testtb-testEmptyExportFileSystemState/3c44e9f2082b4b948b4622d8058d43c2 2023-10-05 20:01:36,123 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/.tmp/data/default/testtb-testEmptyExportFileSystemState/2181c668f20cc320434bc68f718d676e/recovered.edits/9.seqid to hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/archive/data/default/testtb-testEmptyExportFileSystemState/2181c668f20cc320434bc68f718d676e/recovered.edits/9.seqid 2023-10-05 20:01:36,123 DEBUG [HFileArchiver-14] backup.HFileArchiver(596): Deleted hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/.tmp/data/default/testtb-testEmptyExportFileSystemState/2181c668f20cc320434bc68f718d676e 2023-10-05 20:01:36,123 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testtb-testEmptyExportFileSystemState regions 2023-10-05 20:01:36,124 DEBUG [PEWorker-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0 2023-10-05 20:01:36,124 DEBUG [PEWorker-5] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf] 2023-10-05 20:01:36,127 DEBUG [PEWorker-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b20231005ee0ceda737674b00b7d64a56bac4fc2a to hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/archive/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b20231005ee0ceda737674b00b7d64a56bac4fc2a 2023-10-05 20:01:36,128 DEBUG [PEWorker-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e20231005fc276167d2414eca97d7ec944759f1d1 to hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/archive/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e20231005fc276167d2414eca97d7ec944759f1d1 2023-10-05 20:01:36,129 DEBUG [PEWorker-5] backup.HFileArchiver(596): Deleted hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0 2023-10-05 20:01:36,130 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=104, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-10-05 20:01:36,132 WARN [PEWorker-5] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testEmptyExportFileSystemState from hbase:meta 2023-10-05 20:01:36,134 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(421): Removing 'testtb-testEmptyExportFileSystemState' descriptor. 2023-10-05 20:01:36,135 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=104, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-10-05 20:01:36,135 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(411): Removing 'testtb-testEmptyExportFileSystemState' from region states. 2023-10-05 20:01:36,135 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState,,1696536086002.3c44e9f2082b4b948b4622d8058d43c2.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1696536096135"}]},"ts":"9223372036854775807"} 2023-10-05 20:01:36,135 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState,1,1696536086002.2181c668f20cc320434bc68f718d676e.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1696536096135"}]},"ts":"9223372036854775807"} 2023-10-05 20:01:36,137 INFO [PEWorker-5] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-10-05 20:01:36,137 DEBUG [PEWorker-5] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 3c44e9f2082b4b948b4622d8058d43c2, NAME => 'testtb-testEmptyExportFileSystemState,,1696536086002.3c44e9f2082b4b948b4622d8058d43c2.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 2181c668f20cc320434bc68f718d676e, NAME => 'testtb-testEmptyExportFileSystemState,1,1696536086002.2181c668f20cc320434bc68f718d676e.', STARTKEY => '1', ENDKEY => ''}] 2023-10-05 20:01:36,137 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(415): Marking 'testtb-testEmptyExportFileSystemState' as deleted. 2023-10-05 20:01:36,137 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1696536096137"}]},"ts":"9223372036854775807"} 2023-10-05 20:01:36,138 INFO [PEWorker-5] hbase.MetaTableAccessor(1658): Deleted table testtb-testEmptyExportFileSystemState state from META 2023-10-05 20:01:36,140 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(130): Finished pid=104, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-10-05 20:01:36,141 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=104, state=SUCCESS; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState in 35 msec 2023-10-05 20:01:36,220 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40857] master.MasterRpcServices(1230): Checking to see if procedure is done pid=104 2023-10-05 20:01:36,221 INFO [Listener at jenkins-hbase4.apache.org/35067] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testEmptyExportFileSystemState, procId: 104 completed 2023-10-05 20:01:36,227 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40857] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testEmptyExportFileSystemState" 2023-10-05 20:01:36,229 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40857] snapshot.SnapshotManager(335): Deleting snapshot: emptySnaptb0-testEmptyExportFileSystemState 2023-10-05 20:01:36,230 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40857] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testEmptyExportFileSystemState" 2023-10-05 20:01:36,231 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40857] snapshot.SnapshotManager(335): Deleting snapshot: snaptb0-testEmptyExportFileSystemState 2023-10-05 20:01:36,255 INFO [Listener at jenkins-hbase4.apache.org/35067] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testEmptyExportFileSystemState Thread=765 (was 758) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-2070727397_17 at /127.0.0.1:41594 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Parameter Sending Thread #3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x13ec5c25-shared-pool-34 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-4607 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_397630922_1 at /127.0.0.1:37042 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_397630922_1 at /127.0.0.1:41750 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x13ec5c25-shared-pool-36 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #10 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x13ec5c25-shared-pool-33 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x13ec5c25-shared-pool-35 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #9 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-2070727397_17 at /127.0.0.1:52660 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (638145229) connection to jenkins-hbase4.apache.org/172.31.14.131:34749 from appattempt_1696536006875_0006_000001 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: IPC Client (638145229) connection to jenkins-hbase4.apache.org/172.31.14.131:41317 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: LogDeleter #3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1088) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (638145229) connection to jenkins-hbase4.apache.org/172.31.14.131:42199 from appattempt_1696536006875_0005_000001 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-2070727397_17 at /127.0.0.1:60684 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=938 (was 912) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=236 (was 225) - SystemLoadAverage LEAK? -, ProcessCount=168 (was 168), AvailableMemoryMB=5913 (was 6023) 2023-10-05 20:01:36,255 WARN [Listener at jenkins-hbase4.apache.org/35067] hbase.ResourceChecker(130): Thread=765 is superior to 500 2023-10-05 20:01:36,274 INFO [Listener at jenkins-hbase4.apache.org/35067] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testExportFileSystemStateWithSkipTmp Thread=765, OpenFileDescriptor=938, MaxFileDescriptor=60000, SystemLoadAverage=236, ProcessCount=168, AvailableMemoryMB=5912 2023-10-05 20:01:36,274 WARN [Listener at jenkins-hbase4.apache.org/35067] hbase.ResourceChecker(130): Thread=765 is superior to 500 2023-10-05 20:01:36,276 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40857] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemStateWithSkipTmp', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-10-05 20:01:36,277 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40857] procedure2.ProcedureExecutor(1028): Stored pid=105, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-10-05 20:01:36,279 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_PRE_OPERATION 2023-10-05 20:01:36,279 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40857] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemStateWithSkipTmp" procId is: 105 2023-10-05 20:01:36,280 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-10-05 20:01:36,280 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40857] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-10-05 20:01:36,282 DEBUG [HFileArchiver-20] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/d665bff47eec0d0a8c75cc5874c2c640 2023-10-05 20:01:36,282 DEBUG [HFileArchiver-19] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/a1009326bc422e219da3d11b45282ac3 2023-10-05 20:01:36,282 DEBUG [HFileArchiver-19] backup.HFileArchiver(153): Directory hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/a1009326bc422e219da3d11b45282ac3 empty. 2023-10-05 20:01:36,282 DEBUG [HFileArchiver-20] backup.HFileArchiver(153): Directory hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/d665bff47eec0d0a8c75cc5874c2c640 empty. 2023-10-05 20:01:36,283 DEBUG [HFileArchiver-19] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/a1009326bc422e219da3d11b45282ac3 2023-10-05 20:01:36,283 DEBUG [HFileArchiver-20] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/d665bff47eec0d0a8c75cc5874c2c640 2023-10-05 20:01:36,283 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithSkipTmp regions 2023-10-05 20:01:36,298 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/.tabledesc/.tableinfo.0000000001 2023-10-05 20:01:36,299 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(7675): creating {ENCODED => a1009326bc422e219da3d11b45282ac3, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,1,1696536096276.a1009326bc422e219da3d11b45282ac3.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemStateWithSkipTmp', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/.tmp 2023-10-05 20:01:36,299 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(7675): creating {ENCODED => d665bff47eec0d0a8c75cc5874c2c640, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,,1696536096276.d665bff47eec0d0a8c75cc5874c2c640.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportFileSystemStateWithSkipTmp', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/.tmp 2023-10-05 20:01:36,316 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,1,1696536096276.a1009326bc422e219da3d11b45282ac3.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-05 20:01:36,316 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1604): Closing a1009326bc422e219da3d11b45282ac3, disabling compactions & flushes 2023-10-05 20:01:36,316 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,1,1696536096276.a1009326bc422e219da3d11b45282ac3. 2023-10-05 20:01:36,316 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1696536096276.a1009326bc422e219da3d11b45282ac3. 2023-10-05 20:01:36,316 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1696536096276.a1009326bc422e219da3d11b45282ac3. after waiting 0 ms 2023-10-05 20:01:36,316 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,1,1696536096276.a1009326bc422e219da3d11b45282ac3. 2023-10-05 20:01:36,316 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,1,1696536096276.a1009326bc422e219da3d11b45282ac3. 2023-10-05 20:01:36,316 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1558): Region close journal for a1009326bc422e219da3d11b45282ac3: 2023-10-05 20:01:36,317 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,,1696536096276.d665bff47eec0d0a8c75cc5874c2c640.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-05 20:01:36,318 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1604): Closing d665bff47eec0d0a8c75cc5874c2c640, disabling compactions & flushes 2023-10-05 20:01:36,318 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,,1696536096276.d665bff47eec0d0a8c75cc5874c2c640. 2023-10-05 20:01:36,318 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,,1696536096276.d665bff47eec0d0a8c75cc5874c2c640. 2023-10-05 20:01:36,318 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,,1696536096276.d665bff47eec0d0a8c75cc5874c2c640. after waiting 0 ms 2023-10-05 20:01:36,318 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,,1696536096276.d665bff47eec0d0a8c75cc5874c2c640. 2023-10-05 20:01:36,318 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,,1696536096276.d665bff47eec0d0a8c75cc5874c2c640. 2023-10-05 20:01:36,318 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1558): Region close journal for d665bff47eec0d0a8c75cc5874c2c640: 2023-10-05 20:01:36,320 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_ADD_TO_META 2023-10-05 20:01:36,321 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1696536096276.a1009326bc422e219da3d11b45282ac3.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1696536096321"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696536096321"}]},"ts":"1696536096321"} 2023-10-05 20:01:36,321 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1696536096276.d665bff47eec0d0a8c75cc5874c2c640.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1696536096321"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696536096321"}]},"ts":"1696536096321"} 2023-10-05 20:01:36,323 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-10-05 20:01:36,324 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-10-05 20:01:36,324 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696536096324"}]},"ts":"1696536096324"} 2023-10-05 20:01:36,326 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=ENABLING in hbase:meta 2023-10-05 20:01:36,329 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-10-05 20:01:36,330 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-10-05 20:01:36,330 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-10-05 20:01:36,330 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-10-05 20:01:36,330 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-10-05 20:01:36,330 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=d665bff47eec0d0a8c75cc5874c2c640, ASSIGN}, {pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=a1009326bc422e219da3d11b45282ac3, ASSIGN}] 2023-10-05 20:01:36,333 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=d665bff47eec0d0a8c75cc5874c2c640, ASSIGN 2023-10-05 20:01:36,333 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=a1009326bc422e219da3d11b45282ac3, ASSIGN 2023-10-05 20:01:36,334 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=d665bff47eec0d0a8c75cc5874c2c640, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,44821,1696535998698; forceNewPlan=false, retain=false 2023-10-05 20:01:36,334 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=a1009326bc422e219da3d11b45282ac3, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,36369,1696535998737; forceNewPlan=false, retain=false 2023-10-05 20:01:36,381 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40857] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-10-05 20:01:36,484 INFO [jenkins-hbase4:40857] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-10-05 20:01:36,487 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=107 updating hbase:meta row=a1009326bc422e219da3d11b45282ac3, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,36369,1696535998737 2023-10-05 20:01:36,487 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=106 updating hbase:meta row=d665bff47eec0d0a8c75cc5874c2c640, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,44821,1696535998698 2023-10-05 20:01:36,487 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1696536096276.a1009326bc422e219da3d11b45282ac3.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1696536096487"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696536096487"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696536096487"}]},"ts":"1696536096487"} 2023-10-05 20:01:36,487 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1696536096276.d665bff47eec0d0a8c75cc5874c2c640.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1696536096487"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696536096487"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696536096487"}]},"ts":"1696536096487"} 2023-10-05 20:01:36,488 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=108, ppid=107, state=RUNNABLE; OpenRegionProcedure a1009326bc422e219da3d11b45282ac3, server=jenkins-hbase4.apache.org,36369,1696535998737}] 2023-10-05 20:01:36,489 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=109, ppid=106, state=RUNNABLE; OpenRegionProcedure d665bff47eec0d0a8c75cc5874c2c640, server=jenkins-hbase4.apache.org,44821,1696535998698}] 2023-10-05 20:01:36,582 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40857] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-10-05 20:01:36,643 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithSkipTmp,1,1696536096276.a1009326bc422e219da3d11b45282ac3. 2023-10-05 20:01:36,643 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithSkipTmp,,1696536096276.d665bff47eec0d0a8c75cc5874c2c640. 2023-10-05 20:01:36,643 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => a1009326bc422e219da3d11b45282ac3, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,1,1696536096276.a1009326bc422e219da3d11b45282ac3.', STARTKEY => '1', ENDKEY => ''} 2023-10-05 20:01:36,643 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => d665bff47eec0d0a8c75cc5874c2c640, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,,1696536096276.d665bff47eec0d0a8c75cc5874c2c640.', STARTKEY => '', ENDKEY => '1'} 2023-10-05 20:01:36,644 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithSkipTmp,1,1696536096276.a1009326bc422e219da3d11b45282ac3. service=AccessControlService 2023-10-05 20:01:36,644 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithSkipTmp,,1696536096276.d665bff47eec0d0a8c75cc5874c2c640. service=AccessControlService 2023-10-05 20:01:36,644 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-10-05 20:01:36,644 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-10-05 20:01:36,644 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithSkipTmp a1009326bc422e219da3d11b45282ac3 2023-10-05 20:01:36,644 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,1,1696536096276.a1009326bc422e219da3d11b45282ac3.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-05 20:01:36,644 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithSkipTmp d665bff47eec0d0a8c75cc5874c2c640 2023-10-05 20:01:36,644 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for a1009326bc422e219da3d11b45282ac3 2023-10-05 20:01:36,644 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,,1696536096276.d665bff47eec0d0a8c75cc5874c2c640.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-05 20:01:36,644 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for a1009326bc422e219da3d11b45282ac3 2023-10-05 20:01:36,644 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for d665bff47eec0d0a8c75cc5874c2c640 2023-10-05 20:01:36,644 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for d665bff47eec0d0a8c75cc5874c2c640 2023-10-05 20:01:36,645 INFO [StoreOpener-d665bff47eec0d0a8c75cc5874c2c640-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region d665bff47eec0d0a8c75cc5874c2c640 2023-10-05 20:01:36,645 INFO [StoreOpener-a1009326bc422e219da3d11b45282ac3-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region a1009326bc422e219da3d11b45282ac3 2023-10-05 20:01:36,647 DEBUG [StoreOpener-d665bff47eec0d0a8c75cc5874c2c640-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/data/default/testtb-testExportFileSystemStateWithSkipTmp/d665bff47eec0d0a8c75cc5874c2c640/cf 2023-10-05 20:01:36,647 DEBUG [StoreOpener-d665bff47eec0d0a8c75cc5874c2c640-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/data/default/testtb-testExportFileSystemStateWithSkipTmp/d665bff47eec0d0a8c75cc5874c2c640/cf 2023-10-05 20:01:36,647 DEBUG [StoreOpener-a1009326bc422e219da3d11b45282ac3-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/data/default/testtb-testExportFileSystemStateWithSkipTmp/a1009326bc422e219da3d11b45282ac3/cf 2023-10-05 20:01:36,647 DEBUG [StoreOpener-a1009326bc422e219da3d11b45282ac3-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/data/default/testtb-testExportFileSystemStateWithSkipTmp/a1009326bc422e219da3d11b45282ac3/cf 2023-10-05 20:01:36,647 INFO [StoreOpener-d665bff47eec0d0a8c75cc5874c2c640-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region d665bff47eec0d0a8c75cc5874c2c640 columnFamilyName cf 2023-10-05 20:01:36,647 INFO [StoreOpener-a1009326bc422e219da3d11b45282ac3-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region a1009326bc422e219da3d11b45282ac3 columnFamilyName cf 2023-10-05 20:01:36,648 INFO [StoreOpener-d665bff47eec0d0a8c75cc5874c2c640-1] regionserver.HStore(310): Store=d665bff47eec0d0a8c75cc5874c2c640/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-05 20:01:36,648 INFO [StoreOpener-a1009326bc422e219da3d11b45282ac3-1] regionserver.HStore(310): Store=a1009326bc422e219da3d11b45282ac3/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-05 20:01:36,649 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/data/default/testtb-testExportFileSystemStateWithSkipTmp/d665bff47eec0d0a8c75cc5874c2c640 2023-10-05 20:01:36,649 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/data/default/testtb-testExportFileSystemStateWithSkipTmp/a1009326bc422e219da3d11b45282ac3 2023-10-05 20:01:36,649 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/data/default/testtb-testExportFileSystemStateWithSkipTmp/d665bff47eec0d0a8c75cc5874c2c640 2023-10-05 20:01:36,649 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/data/default/testtb-testExportFileSystemStateWithSkipTmp/a1009326bc422e219da3d11b45282ac3 2023-10-05 20:01:36,651 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for d665bff47eec0d0a8c75cc5874c2c640 2023-10-05 20:01:36,651 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for a1009326bc422e219da3d11b45282ac3 2023-10-05 20:01:36,653 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/data/default/testtb-testExportFileSystemStateWithSkipTmp/a1009326bc422e219da3d11b45282ac3/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-05 20:01:36,653 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/data/default/testtb-testExportFileSystemStateWithSkipTmp/d665bff47eec0d0a8c75cc5874c2c640/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-05 20:01:36,653 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened a1009326bc422e219da3d11b45282ac3; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73910601, jitterRate=0.10135377943515778}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-10-05 20:01:36,654 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for a1009326bc422e219da3d11b45282ac3: 2023-10-05 20:01:36,654 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened d665bff47eec0d0a8c75cc5874c2c640; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64616899, jitterRate=-0.037133172154426575}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-10-05 20:01:36,654 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for d665bff47eec0d0a8c75cc5874c2c640: 2023-10-05 20:01:36,654 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithSkipTmp,1,1696536096276.a1009326bc422e219da3d11b45282ac3., pid=108, masterSystemTime=1696536096640 2023-10-05 20:01:36,654 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithSkipTmp,,1696536096276.d665bff47eec0d0a8c75cc5874c2c640., pid=109, masterSystemTime=1696536096640 2023-10-05 20:01:36,655 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithSkipTmp,1,1696536096276.a1009326bc422e219da3d11b45282ac3. 2023-10-05 20:01:36,655 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithSkipTmp,1,1696536096276.a1009326bc422e219da3d11b45282ac3. 2023-10-05 20:01:36,656 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=107 updating hbase:meta row=a1009326bc422e219da3d11b45282ac3, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,36369,1696535998737 2023-10-05 20:01:36,656 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithSkipTmp,,1696536096276.d665bff47eec0d0a8c75cc5874c2c640. 2023-10-05 20:01:36,656 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithSkipTmp,,1696536096276.d665bff47eec0d0a8c75cc5874c2c640. 2023-10-05 20:01:36,656 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1696536096276.a1009326bc422e219da3d11b45282ac3.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1696536096656"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1696536096656"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1696536096656"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1696536096656"}]},"ts":"1696536096656"} 2023-10-05 20:01:36,656 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=106 updating hbase:meta row=d665bff47eec0d0a8c75cc5874c2c640, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,44821,1696535998698 2023-10-05 20:01:36,656 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1696536096276.d665bff47eec0d0a8c75cc5874c2c640.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1696536096656"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1696536096656"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1696536096656"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1696536096656"}]},"ts":"1696536096656"} 2023-10-05 20:01:36,659 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=108, resume processing ppid=107 2023-10-05 20:01:36,659 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=108, ppid=107, state=SUCCESS; OpenRegionProcedure a1009326bc422e219da3d11b45282ac3, server=jenkins-hbase4.apache.org,36369,1696535998737 in 169 msec 2023-10-05 20:01:36,660 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=109, resume processing ppid=106 2023-10-05 20:01:36,660 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=109, ppid=106, state=SUCCESS; OpenRegionProcedure d665bff47eec0d0a8c75cc5874c2c640, server=jenkins-hbase4.apache.org,44821,1696535998698 in 169 msec 2023-10-05 20:01:36,660 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=107, ppid=105, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=a1009326bc422e219da3d11b45282ac3, ASSIGN in 329 msec 2023-10-05 20:01:36,661 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=106, resume processing ppid=105 2023-10-05 20:01:36,661 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=106, ppid=105, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=d665bff47eec0d0a8c75cc5874c2c640, ASSIGN in 330 msec 2023-10-05 20:01:36,662 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-10-05 20:01:36,662 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696536096662"}]},"ts":"1696536096662"} 2023-10-05 20:01:36,663 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=ENABLED in hbase:meta 2023-10-05 20:01:36,666 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_POST_OPERATION 2023-10-05 20:01:36,666 DEBUG [PEWorker-1] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemStateWithSkipTmp jenkins: RWXCA 2023-10-05 20:01:36,668 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=32861] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithSkipTmp], kv [jenkins: RWXCA] 2023-10-05 20:01:36,670 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): regionserver:44821-0x101182c1f970002, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-05 20:01:36,670 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): regionserver:36369-0x101182c1f970003, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-05 20:01:36,670 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): master:40857-0x101182c1f970000, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-05 20:01:36,670 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): regionserver:32861-0x101182c1f970001, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-05 20:01:36,673 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-10-05 20:01:36,673 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-10-05 20:01:36,674 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-10-05 20:01:36,674 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-10-05 20:01:36,674 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=105, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp in 397 msec 2023-10-05 20:01:36,884 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40857] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-10-05 20:01:36,884 INFO [Listener at jenkins-hbase4.apache.org/35067] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemStateWithSkipTmp, procId: 105 completed 2023-10-05 20:01:36,886 DEBUG [Listener at jenkins-hbase4.apache.org/35067] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithSkipTmp 2023-10-05 20:01:36,886 DEBUG [Listener at jenkins-hbase4.apache.org/35067] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithSkipTmp,,1696536096276.d665bff47eec0d0a8c75cc5874c2c640. 2023-10-05 20:01:36,888 INFO [Listener at jenkins-hbase4.apache.org/35067] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-10-05 20:01:36,897 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40857] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-10-05 20:01:36,897 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40857] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1696536096897 (current time:1696536096897). 2023-10-05 20:01:36,898 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40857] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-10-05 20:01:36,898 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40857] zookeeper.ReadOnlyZKClient(139): Connect 0x2c9ff2b7 to 127.0.0.1:57530 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-05 20:01:36,906 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40857] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7f1bfdd0, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-05 20:01:36,907 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40857] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-05 20:01:36,909 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:46358, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-05 20:01:36,910 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40857] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x2c9ff2b7 to 127.0.0.1:57530 2023-10-05 20:01:36,910 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40857] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-05 20:01:36,911 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40857] zookeeper.ReadOnlyZKClient(139): Connect 0x2d35675d to 127.0.0.1:57530 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-05 20:01:36,916 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40857] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7eec2206, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-05 20:01:36,917 DEBUG [hconnection-0x5e39b576-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-05 20:01:36,920 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:46374, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-05 20:01:36,923 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40857] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-05 20:01:36,929 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:35292, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-05 20:01:36,930 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40857] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x2d35675d to 127.0.0.1:57530 2023-10-05 20:01:36,930 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40857] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-05 20:01:36,930 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40857] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithSkipTmp], kv [jenkins: RWXCA] 2023-10-05 20:01:36,931 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40857] snapshot.SnapshotManager(637): No existing snapshot, attempting snapshot... 2023-10-05 20:01:36,931 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40857] snapshot.SnapshotManager(684): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-10-05 20:01:36,933 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40857] snapshot.SnapshotManager(519): Unable to retrieve ACL status for path: hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/.hbase-snapshot, current working dir path: hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp org.apache.hadoop.hdfs.protocol.AclException: The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.ipc.RemoteException.instantiateException(RemoteException.java:121) at org.apache.hadoop.ipc.RemoteException.unwrapRemoteException(RemoteException.java:88) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2736) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2294) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2291) at org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81) at org.apache.hadoop.hdfs.DistributedFileSystem.getAclStatus(DistributedFileSystem.java:2291) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.updateWorkingDirAclsIfRequired(SnapshotManager.java:517) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.prepareToTakeSnapshot(SnapshotManager.java:490) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.snapshotEnabledTable(SnapshotManager.java:559) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshotInternal(SnapshotManager.java:687) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshot(SnapshotManager.java:623) at org.apache.hadoop.hbase.master.MasterRpcServices.snapshot(MasterRpcServices.java:1588) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) Caused by: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.hdfs.protocol.AclException): The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at org.apache.hadoop.ipc.Client.getRpcResponse(Client.java:1540) at org.apache.hadoop.ipc.Client.call(Client.java:1486) at org.apache.hadoop.ipc.Client.call(Client.java:1385) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:232) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:118) at com.sun.proxy.$Proxy32.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.getAclStatus(ClientNamenodeProtocolTranslatorPB.java:1385) at sun.reflect.GeneratedMethodAccessor62.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:422) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeMethod(RetryInvocationHandler.java:165) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invoke(RetryInvocationHandler.java:157) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeOnce(RetryInvocationHandler.java:95) at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:359) at com.sun.proxy.$Proxy35.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor62.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor62.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor62.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor62.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor62.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2734) ... 15 more 2023-10-05 20:01:36,935 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40857] procedure2.ProcedureExecutor(1028): Stored pid=110, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-10-05 20:01:36,935 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=110, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-10-05 20:01:36,936 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=110, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE; timeout=600000, timestamp=1696536696936 2023-10-05 20:01:36,936 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp 2023-10-05 20:01:36,936 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40857] snapshot.SnapshotManager(689): Started snapshot: { ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-10-05 20:01:36,937 DEBUG [Listener at jenkins-hbase4.apache.org/35067] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-10-05 20:01:36,937 DEBUG [Listener at jenkins-hbase4.apache.org/35067] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-10-05 20:01:36,938 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=110, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-10-05 20:01:36,938 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=111, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-10-05 20:01:36,939 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=110, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE in 4 msec 2023-10-05 20:01:36,940 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=111, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-10-05 20:01:36,941 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=111, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED; timeout=600000, timestamp=1696536696941 2023-10-05 20:01:36,946 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithSkipTmp' 2023-10-05 20:01:36,950 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 20:01:36,950 INFO [(jenkins-hbase4.apache.org,40857,1696535997381)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' 2023-10-05 20:01:36,950 DEBUG [(jenkins-hbase4.apache.org,40857,1696535997381)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-05 20:01:36,951 DEBUG [(jenkins-hbase4.apache.org,40857,1696535997381)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' 2023-10-05 20:01:36,951 DEBUG [(jenkins-hbase4.apache.org,40857,1696535997381)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp', kicking off acquire phase on members. 2023-10-05 20:01:36,951 DEBUG [(jenkins-hbase4.apache.org,40857,1696535997381)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40857-0x101182c1f970000, quorum=127.0.0.1:57530, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 20:01:36,951 DEBUG [(jenkins-hbase4.apache.org,40857,1696535997381)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 20:01:36,953 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): regionserver:32861-0x101182c1f970001, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-05 20:01:36,953 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): regionserver:44821-0x101182c1f970002, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-05 20:01:36,953 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-05 20:01:36,953 DEBUG [(jenkins-hbase4.apache.org,40857,1696535997381)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,44821,1696535998698 2023-10-05 20:01:36,953 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): regionserver:36369-0x101182c1f970003, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-05 20:01:36,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-05 20:01:36,953 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-05 20:01:36,954 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-05 20:01:36,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-05 20:01:36,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-05 20:01:36,954 DEBUG [(jenkins-hbase4.apache.org,40857,1696535997381)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40857-0x101182c1f970000, quorum=127.0.0.1:57530, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,44821,1696535998698 2023-10-05 20:01:36,954 DEBUG [(jenkins-hbase4.apache.org,40857,1696535997381)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,36369,1696535998737 2023-10-05 20:01:36,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 20:01:36,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 20:01:36,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 20:01:36,954 DEBUG [(jenkins-hbase4.apache.org,40857,1696535997381)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40857-0x101182c1f970000, quorum=127.0.0.1:57530, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,36369,1696535998737 2023-10-05 20:01:36,954 DEBUG [(jenkins-hbase4.apache.org,40857,1696535997381)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-05 20:01:36,954 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:32861-0x101182c1f970001, quorum=127.0.0.1:57530, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 20:01:36,955 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36369-0x101182c1f970003, quorum=127.0.0.1:57530, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 20:01:36,955 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44821-0x101182c1f970002, quorum=127.0.0.1:57530, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 20:01:36,955 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 207 2023-10-05 20:01:36,955 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 20:01:36,955 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 207 2023-10-05 20:01:36,955 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 207 2023-10-05 20:01:36,955 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-10-05 20:01:36,955 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 20:01:36,955 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 20:01:36,955 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-10-05 20:01:36,955 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-10-05 20:01:36,955 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 20:01:36,955 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 20:01:36,955 DEBUG [member: 'jenkins-hbase4.apache.org,32861,1696535998642' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-10-05 20:01:36,955 DEBUG [member: 'jenkins-hbase4.apache.org,36369,1696535998737' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-10-05 20:01:36,955 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 20:01:36,955 DEBUG [member: 'jenkins-hbase4.apache.org,36369,1696535998737' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-05 20:01:36,956 DEBUG [member: 'jenkins-hbase4.apache.org,44821,1696535998698' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-10-05 20:01:36,956 DEBUG [member: 'jenkins-hbase4.apache.org,44821,1696535998698' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-05 20:01:36,955 DEBUG [member: 'jenkins-hbase4.apache.org,32861,1696535998642' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-05 20:01:36,957 DEBUG [member: 'jenkins-hbase4.apache.org,44821,1696535998698' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-10-05 20:01:36,957 DEBUG [member: 'jenkins-hbase4.apache.org,44821,1696535998698' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-10-05 20:01:36,957 DEBUG [member: 'jenkins-hbase4.apache.org,36369,1696535998737' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-10-05 20:01:36,958 DEBUG [member: 'jenkins-hbase4.apache.org,36369,1696535998737' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-10-05 20:01:36,958 DEBUG [member: 'jenkins-hbase4.apache.org,44821,1696535998698' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44821,1696535998698' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-10-05 20:01:36,958 DEBUG [member: 'jenkins-hbase4.apache.org,36369,1696535998737' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,36369,1696535998737' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-10-05 20:01:36,958 DEBUG [member: 'jenkins-hbase4.apache.org,32861,1696535998642' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-10-05 20:01:36,959 DEBUG [member: 'jenkins-hbase4.apache.org,32861,1696535998642' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-10-05 20:01:36,959 DEBUG [member: 'jenkins-hbase4.apache.org,32861,1696535998642' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,32861,1696535998642' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-10-05 20:01:36,965 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): master:40857-0x101182c1f970000, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,44821,1696535998698 2023-10-05 20:01:36,965 DEBUG [member: 'jenkins-hbase4.apache.org,36369,1696535998737' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 20:01:36,965 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): master:40857-0x101182c1f970000, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,36369,1696535998737 2023-10-05 20:01:36,965 DEBUG [member: 'jenkins-hbase4.apache.org,44821,1696535998698' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 20:01:36,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,44821,1696535998698 2023-10-05 20:01:36,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-05 20:01:36,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-05 20:01:36,965 DEBUG [member: 'jenkins-hbase4.apache.org,32861,1696535998642' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 20:01:36,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-05 20:01:36,965 DEBUG [member: 'jenkins-hbase4.apache.org,44821,1696535998698' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44821-0x101182c1f970002, quorum=127.0.0.1:57530, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 20:01:36,965 DEBUG [member: 'jenkins-hbase4.apache.org,36369,1696535998737' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36369-0x101182c1f970003, quorum=127.0.0.1:57530, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 20:01:36,966 DEBUG [member: 'jenkins-hbase4.apache.org,36369,1696535998737' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-05 20:01:36,965 DEBUG [member: 'jenkins-hbase4.apache.org,44821,1696535998698' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-05 20:01:36,966 DEBUG [member: 'jenkins-hbase4.apache.org,32861,1696535998642' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:32861-0x101182c1f970001, quorum=127.0.0.1:57530, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 20:01:36,966 DEBUG [member: 'jenkins-hbase4.apache.org,32861,1696535998642' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-05 20:01:36,966 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-05 20:01:36,966 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 20:01:36,966 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32861,1696535998642 2023-10-05 20:01:36,966 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36369,1696535998737 2023-10-05 20:01:36,967 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44821,1696535998698 2023-10-05 20:01:36,967 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-05 20:01:36,967 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,44821,1696535998698' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-10-05 20:01:36,967 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2fb69be3[Count = 1] remaining members to acquire global barrier 2023-10-05 20:01:36,967 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,36369,1696535998737 2023-10-05 20:01:36,967 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-05 20:01:36,967 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-05 20:01:36,967 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-05 20:01:36,968 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-05 20:01:36,968 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 20:01:36,968 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32861,1696535998642 2023-10-05 20:01:36,968 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36369,1696535998737 2023-10-05 20:01:36,968 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44821,1696535998698 2023-10-05 20:01:36,969 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-05 20:01:36,969 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,36369,1696535998737' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-10-05 20:01:36,969 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2fb69be3[Count = 0] remaining members to acquire global barrier 2023-10-05 20:01:36,969 DEBUG [(jenkins-hbase4.apache.org,40857,1696535997381)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'in-barrier' execution. 2023-10-05 20:01:36,969 DEBUG [(jenkins-hbase4.apache.org,40857,1696535997381)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 20:01:36,970 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): regionserver:44821-0x101182c1f970002, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 20:01:36,970 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): regionserver:36369-0x101182c1f970003, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 20:01:36,970 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 20:01:36,970 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 20:01:36,970 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 20:01:36,970 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): regionserver:32861-0x101182c1f970001, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 20:01:36,970 DEBUG [member: 'jenkins-hbase4.apache.org,44821,1696535998698' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-10-05 20:01:36,970 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 20:01:36,970 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 20:01:36,970 DEBUG [(jenkins-hbase4.apache.org,40857,1696535997381)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40857-0x101182c1f970000, quorum=127.0.0.1:57530, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,44821,1696535998698 2023-10-05 20:01:36,970 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 20:01:36,970 DEBUG [member: 'jenkins-hbase4.apache.org,44821,1696535998698' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-05 20:01:36,970 DEBUG [member: 'jenkins-hbase4.apache.org,44821,1696535998698' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-05 20:01:36,970 DEBUG [member: 'jenkins-hbase4.apache.org,36369,1696535998737' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-10-05 20:01:36,970 DEBUG [member: 'jenkins-hbase4.apache.org,32861,1696535998642' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-10-05 20:01:36,970 DEBUG [rs(jenkins-hbase4.apache.org,44821,1696535998698)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1696536096276.d665bff47eec0d0a8c75cc5874c2c640. 2023-10-05 20:01:36,971 DEBUG [member: 'jenkins-hbase4.apache.org,36369,1696535998737' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-05 20:01:36,971 DEBUG [rs(jenkins-hbase4.apache.org,44821,1696535998698)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1696536096276.d665bff47eec0d0a8c75cc5874c2c640. started... 2023-10-05 20:01:36,971 DEBUG [rs(jenkins-hbase4.apache.org,36369,1696535998737)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1696536096276.a1009326bc422e219da3d11b45282ac3. 2023-10-05 20:01:36,971 DEBUG [member: 'jenkins-hbase4.apache.org,32861,1696535998642' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-10-05 20:01:36,971 DEBUG [rs(jenkins-hbase4.apache.org,36369,1696535998737)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1696536096276.a1009326bc422e219da3d11b45282ac3. started... 2023-10-05 20:01:36,971 DEBUG [member: 'jenkins-hbase4.apache.org,32861,1696535998642' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,32861,1696535998642' in zk 2023-10-05 20:01:36,971 DEBUG [member: 'jenkins-hbase4.apache.org,36369,1696535998737' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-05 20:01:36,971 DEBUG [(jenkins-hbase4.apache.org,40857,1696535997381)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40857-0x101182c1f970000, quorum=127.0.0.1:57530, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,36369,1696535998737 2023-10-05 20:01:36,971 DEBUG [(jenkins-hbase4.apache.org,40857,1696535997381)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-05 20:01:36,972 DEBUG [rs(jenkins-hbase4.apache.org,36369,1696535998737)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for a1009326bc422e219da3d11b45282ac3: 2023-10-05 20:01:36,971 DEBUG [rs(jenkins-hbase4.apache.org,44821,1696535998698)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for d665bff47eec0d0a8c75cc5874c2c640: 2023-10-05 20:01:36,972 DEBUG [rs(jenkins-hbase4.apache.org,36369,1696535998737)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,1,1696536096276.a1009326bc422e219da3d11b45282ac3.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 20:01:36,972 DEBUG [rs(jenkins-hbase4.apache.org,44821,1696535998698)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,,1696536096276.d665bff47eec0d0a8c75cc5874c2c640.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 20:01:36,972 DEBUG [rs(jenkins-hbase4.apache.org,36369,1696535998737)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-05 20:01:36,972 DEBUG [rs(jenkins-hbase4.apache.org,44821,1696535998698)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-05 20:01:36,972 DEBUG [rs(jenkins-hbase4.apache.org,36369,1696535998737)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-10-05 20:01:36,972 DEBUG [rs(jenkins-hbase4.apache.org,44821,1696535998698)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-10-05 20:01:36,975 DEBUG [member: 'jenkins-hbase4.apache.org,32861,1696535998642' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-10-05 20:01:36,975 DEBUG [member: 'jenkins-hbase4.apache.org,32861,1696535998642' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-05 20:01:36,975 DEBUG [member: 'jenkins-hbase4.apache.org,32861,1696535998642' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-10-05 20:01:36,986 DEBUG [rs(jenkins-hbase4.apache.org,44821,1696535998698)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1696536096276.d665bff47eec0d0a8c75cc5874c2c640. completed. 2023-10-05 20:01:36,986 DEBUG [rs(jenkins-hbase4.apache.org,44821,1696535998698)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1696536096276.d665bff47eec0d0a8c75cc5874c2c640. 2023-10-05 20:01:36,986 DEBUG [member: 'jenkins-hbase4.apache.org,44821,1696535998698' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-05 20:01:36,986 DEBUG [member: 'jenkins-hbase4.apache.org,44821,1696535998698' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-05 20:01:36,986 DEBUG [rs(jenkins-hbase4.apache.org,36369,1696535998737)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1696536096276.a1009326bc422e219da3d11b45282ac3. completed. 2023-10-05 20:01:36,986 DEBUG [rs(jenkins-hbase4.apache.org,36369,1696535998737)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1696536096276.a1009326bc422e219da3d11b45282ac3. 2023-10-05 20:01:36,986 DEBUG [member: 'jenkins-hbase4.apache.org,44821,1696535998698' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,44821,1696535998698 2023-10-05 20:01:36,986 DEBUG [member: 'jenkins-hbase4.apache.org,36369,1696535998737' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-05 20:01:36,986 DEBUG [member: 'jenkins-hbase4.apache.org,36369,1696535998737' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-05 20:01:36,986 DEBUG [member: 'jenkins-hbase4.apache.org,44821,1696535998698' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-10-05 20:01:36,986 DEBUG [member: 'jenkins-hbase4.apache.org,44821,1696535998698' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,44821,1696535998698' in zk 2023-10-05 20:01:36,986 DEBUG [member: 'jenkins-hbase4.apache.org,36369,1696535998737' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,36369,1696535998737 2023-10-05 20:01:36,986 DEBUG [member: 'jenkins-hbase4.apache.org,36369,1696535998737' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-10-05 20:01:36,987 DEBUG [member: 'jenkins-hbase4.apache.org,36369,1696535998737' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,36369,1696535998737' in zk 2023-10-05 20:01:36,988 DEBUG [member: 'jenkins-hbase4.apache.org,36369,1696535998737' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-10-05 20:01:36,988 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): master:40857-0x101182c1f970000, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,44821,1696535998698 2023-10-05 20:01:36,988 DEBUG [member: 'jenkins-hbase4.apache.org,44821,1696535998698' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-10-05 20:01:36,988 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,44821,1696535998698 2023-10-05 20:01:36,988 DEBUG [member: 'jenkins-hbase4.apache.org,36369,1696535998737' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-05 20:01:36,988 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-05 20:01:36,989 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-05 20:01:36,988 DEBUG [member: 'jenkins-hbase4.apache.org,44821,1696535998698' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-05 20:01:36,988 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): master:40857-0x101182c1f970000, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,36369,1696535998737 2023-10-05 20:01:36,990 DEBUG [member: 'jenkins-hbase4.apache.org,44821,1696535998698' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-10-05 20:01:36,988 DEBUG [member: 'jenkins-hbase4.apache.org,36369,1696535998737' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-10-05 20:01:36,992 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-05 20:01:36,992 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-05 20:01:36,992 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 20:01:36,993 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32861,1696535998642 2023-10-05 20:01:36,993 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36369,1696535998737 2023-10-05 20:01:36,993 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44821,1696535998698 2023-10-05 20:01:36,993 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-05 20:01:36,994 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 20:01:36,994 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32861,1696535998642 2023-10-05 20:01:36,994 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36369,1696535998737 2023-10-05 20:01:36,994 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44821,1696535998698 2023-10-05 20:01:36,995 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,44821,1696535998698': 2023-10-05 20:01:36,995 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,44821,1696535998698' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 1 more 2023-10-05 20:01:36,995 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,36369,1696535998737 2023-10-05 20:01:36,995 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-05 20:01:36,995 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-05 20:01:36,995 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-05 20:01:36,995 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-05 20:01:36,995 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 20:01:36,996 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32861,1696535998642 2023-10-05 20:01:36,996 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36369,1696535998737 2023-10-05 20:01:36,996 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44821,1696535998698 2023-10-05 20:01:36,997 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-05 20:01:36,997 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 20:01:36,997 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32861,1696535998642 2023-10-05 20:01:36,997 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36369,1696535998737 2023-10-05 20:01:36,998 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44821,1696535998698 2023-10-05 20:01:36,998 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,36369,1696535998737': 2023-10-05 20:01:36,998 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,36369,1696535998737' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 0 more 2023-10-05 20:01:36,998 INFO [(jenkins-hbase4.apache.org,40857,1696535997381)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' execution completed 2023-10-05 20:01:36,998 DEBUG [(jenkins-hbase4.apache.org,40857,1696535997381)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-05 20:01:36,998 DEBUG [(jenkins-hbase4.apache.org,40857,1696535997381)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-05 20:01:36,998 DEBUG [(jenkins-hbase4.apache.org,40857,1696535997381)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 20:01:36,998 INFO [(jenkins-hbase4.apache.org,40857,1696535997381)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportFileSystemStateWithSkipTmpincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-10-05 20:01:37,000 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): regionserver:44821-0x101182c1f970002, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 20:01:37,000 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): regionserver:32861-0x101182c1f970001, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 20:01:37,000 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 20:01:37,000 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): regionserver:36369-0x101182c1f970003, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 20:01:37,000 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 20:01:37,000 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): regionserver:32861-0x101182c1f970001, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-05 20:01:37,000 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): master:40857-0x101182c1f970000, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 20:01:37,000 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): regionserver:44821-0x101182c1f970002, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-05 20:01:37,000 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 20:01:37,000 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-05 20:01:37,000 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-05 20:01:37,000 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 20:01:37,000 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 20:01:37,000 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): regionserver:36369-0x101182c1f970003, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-05 20:01:37,000 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 20:01:37,000 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 20:01:37,001 DEBUG [(jenkins-hbase4.apache.org,40857,1696535997381)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40857-0x101182c1f970000, quorum=127.0.0.1:57530, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,32861,1696535998642 2023-10-05 20:01:37,001 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-05 20:01:37,001 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-05 20:01:37,001 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-05 20:01:37,001 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-05 20:01:37,001 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-05 20:01:37,001 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-05 20:01:37,001 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-05 20:01:37,001 DEBUG [(jenkins-hbase4.apache.org,40857,1696535997381)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40857-0x101182c1f970000, quorum=127.0.0.1:57530, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,36369,1696535998737 2023-10-05 20:01:37,001 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 20:01:37,001 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 20:01:37,001 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 20:01:37,001 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 20:01:37,001 DEBUG [(jenkins-hbase4.apache.org,40857,1696535997381)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40857-0x101182c1f970000, quorum=127.0.0.1:57530, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,44821,1696535998698 2023-10-05 20:01:37,001 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-05 20:01:37,002 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 20:01:37,002 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32861,1696535998642 2023-10-05 20:01:37,002 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36369,1696535998737 2023-10-05 20:01:37,003 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44821,1696535998698 2023-10-05 20:01:37,003 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-05 20:01:37,003 DEBUG [(jenkins-hbase4.apache.org,40857,1696535997381)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40857-0x101182c1f970000, quorum=127.0.0.1:57530, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,32861,1696535998642 2023-10-05 20:01:37,003 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 20:01:37,003 DEBUG [(jenkins-hbase4.apache.org,40857,1696535997381)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40857-0x101182c1f970000, quorum=127.0.0.1:57530, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,36369,1696535998737 2023-10-05 20:01:37,003 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32861,1696535998642 2023-10-05 20:01:37,004 DEBUG [(jenkins-hbase4.apache.org,40857,1696535997381)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40857-0x101182c1f970000, quorum=127.0.0.1:57530, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,44821,1696535998698 2023-10-05 20:01:37,004 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36369,1696535998737 2023-10-05 20:01:37,004 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44821,1696535998698 2023-10-05 20:01:37,006 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): master:40857-0x101182c1f970000, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,44821,1696535998698 2023-10-05 20:01:37,007 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): master:40857-0x101182c1f970000, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 20:01:37,007 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): regionserver:32861-0x101182c1f970001, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-05 20:01:37,007 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): regionserver:36369-0x101182c1f970003, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-05 20:01:37,007 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): regionserver:36369-0x101182c1f970003, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-05 20:01:37,007 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-05 20:01:37,007 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): regionserver:44821-0x101182c1f970002, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-05 20:01:37,007 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): master:40857-0x101182c1f970000, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,36369,1696535998737 2023-10-05 20:01:37,007 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 20:01:37,007 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): master:40857-0x101182c1f970000, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,32861,1696535998642 2023-10-05 20:01:37,007 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemStateWithSkipTmp 2023-10-05 20:01:37,007 DEBUG [(jenkins-hbase4.apache.org,40857,1696535997381)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-05 20:01:37,007 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => e9516f04c7d2974b21addb190acc6c0a, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,.mob,0.e9516f04c7d2974b21addb190acc6c0a.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 20:01:37,007 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-05 20:01:37,008 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-05 20:01:37,007 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): regionserver:44821-0x101182c1f970002, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-05 20:01:37,007 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-05 20:01:37,007 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): regionserver:32861-0x101182c1f970001, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-05 20:01:37,007 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-05 20:01:37,009 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-05 20:01:37,008 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-10-05 20:01:37,007 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): master:40857-0x101182c1f970000, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 20:01:37,009 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-05 20:01:37,009 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-05 20:01:37,009 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): master:40857-0x101182c1f970000, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,44821,1696535998698 2023-10-05 20:01:37,009 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): master:40857-0x101182c1f970000, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 20:01:37,009 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-05 20:01:37,009 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-05 20:01:37,009 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-05 20:01:37,009 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-05 20:01:37,009 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): master:40857-0x101182c1f970000, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,36369,1696535998737 2023-10-05 20:01:37,009 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): master:40857-0x101182c1f970000, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,32861,1696535998642 2023-10-05 20:01:37,009 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): master:40857-0x101182c1f970000, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 20:01:37,009 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): master:40857-0x101182c1f970000, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 20:01:37,009 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-10-05 20:01:37,017 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 20:01:37,018 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 20:01:37,035 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp to hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/.hbase-snapshot/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 20:01:37,036 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed 2023-10-05 20:01:37,036 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 20:01:37,036 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 20:01:37,036 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp at 1696536096936Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemStateWithSkipTmp at 1696536097017 (+81 ms)Consolidate snapshot: emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1696536097017Loading Region manifests for emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1696536097017Writing data manifest for emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1696536097020 (+3 ms)Verifying snapshot: emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1696536097030 (+10 ms)Snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed at 1696536097036 (+6 ms) 2023-10-05 20:01:37,039 DEBUG [Listener at jenkins-hbase4.apache.org/35067] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-05 20:01:37,039 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=111, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-10-05 20:01:37,040 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40857] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-10-05 20:01:37,040 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40857] snapshot.SnapshotManager(403): Snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' has completed, notifying client. 2023-10-05 20:01:37,040 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=111, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED in 102 msec 2023-10-05 20:01:37,042 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44821] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithSkipTmp,,1696536096276.d665bff47eec0d0a8c75cc5874c2c640. with WAL disabled. Data may be lost in the event of a crash. 2023-10-05 20:01:37,043 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36369] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithSkipTmp,1,1696536096276.a1009326bc422e219da3d11b45282ac3. with WAL disabled. Data may be lost in the event of a crash. 2023-10-05 20:01:37,045 DEBUG [Listener at jenkins-hbase4.apache.org/35067] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithSkipTmp 2023-10-05 20:01:37,045 DEBUG [Listener at jenkins-hbase4.apache.org/35067] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithSkipTmp,,1696536096276.d665bff47eec0d0a8c75cc5874c2c640. 2023-10-05 20:01:37,046 INFO [Listener at jenkins-hbase4.apache.org/35067] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-10-05 20:01:37,054 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40857] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-10-05 20:01:37,054 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40857] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1696536097054 (current time:1696536097054). 2023-10-05 20:01:37,054 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40857] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-10-05 20:01:37,055 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40857] zookeeper.ReadOnlyZKClient(139): Connect 0x2841b7a2 to 127.0.0.1:57530 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-05 20:01:37,063 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40857] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@38928894, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-05 20:01:37,064 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40857] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-05 20:01:37,065 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:46386, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-05 20:01:37,065 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40857] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x2841b7a2 to 127.0.0.1:57530 2023-10-05 20:01:37,065 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40857] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-05 20:01:37,066 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40857] zookeeper.ReadOnlyZKClient(139): Connect 0x2756fa6e to 127.0.0.1:57530 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-05 20:01:37,071 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40857] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@28fa581, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-05 20:01:37,073 DEBUG [hconnection-0x2ef55b6c-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-05 20:01:37,075 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:46394, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-05 20:01:37,079 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40857] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-05 20:01:37,082 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:35306, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-05 20:01:37,083 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40857] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x2756fa6e to 127.0.0.1:57530 2023-10-05 20:01:37,083 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40857] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-05 20:01:37,083 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40857] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithSkipTmp], kv [jenkins: RWXCA] 2023-10-05 20:01:37,084 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40857] snapshot.SnapshotManager(637): No existing snapshot, attempting snapshot... 2023-10-05 20:01:37,084 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40857] snapshot.SnapshotManager(684): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-10-05 20:01:37,087 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40857] snapshot.SnapshotManager(519): Unable to retrieve ACL status for path: hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/.hbase-snapshot, current working dir path: hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp org.apache.hadoop.hdfs.protocol.AclException: The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.ipc.RemoteException.instantiateException(RemoteException.java:121) at org.apache.hadoop.ipc.RemoteException.unwrapRemoteException(RemoteException.java:88) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2736) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2294) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2291) at org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81) at org.apache.hadoop.hdfs.DistributedFileSystem.getAclStatus(DistributedFileSystem.java:2291) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.updateWorkingDirAclsIfRequired(SnapshotManager.java:517) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.prepareToTakeSnapshot(SnapshotManager.java:490) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.snapshotEnabledTable(SnapshotManager.java:559) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshotInternal(SnapshotManager.java:687) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshot(SnapshotManager.java:623) at org.apache.hadoop.hbase.master.MasterRpcServices.snapshot(MasterRpcServices.java:1588) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) Caused by: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.hdfs.protocol.AclException): The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at org.apache.hadoop.ipc.Client.getRpcResponse(Client.java:1540) at org.apache.hadoop.ipc.Client.call(Client.java:1486) at org.apache.hadoop.ipc.Client.call(Client.java:1385) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:232) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:118) at com.sun.proxy.$Proxy32.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.getAclStatus(ClientNamenodeProtocolTranslatorPB.java:1385) at sun.reflect.GeneratedMethodAccessor62.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:422) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeMethod(RetryInvocationHandler.java:165) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invoke(RetryInvocationHandler.java:157) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeOnce(RetryInvocationHandler.java:95) at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:359) at com.sun.proxy.$Proxy35.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor62.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor62.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor62.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor62.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor62.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2734) ... 15 more 2023-10-05 20:01:37,088 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40857] procedure2.ProcedureExecutor(1028): Stored pid=112, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-10-05 20:01:37,089 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=112, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-10-05 20:01:37,090 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=112, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE; timeout=600000, timestamp=1696536697090 2023-10-05 20:01:37,090 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp 2023-10-05 20:01:37,090 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40857] snapshot.SnapshotManager(689): Started snapshot: { ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-10-05 20:01:37,092 DEBUG [Listener at jenkins-hbase4.apache.org/35067] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-10-05 20:01:37,092 DEBUG [Listener at jenkins-hbase4.apache.org/35067] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-10-05 20:01:37,092 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=113, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-10-05 20:01:37,093 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=112, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-10-05 20:01:37,094 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=112, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE in 6 msec 2023-10-05 20:01:37,095 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=113, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-10-05 20:01:37,095 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=113, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED; timeout=600000, timestamp=1696536697095 2023-10-05 20:01:37,104 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 20:01:37,104 INFO [(jenkins-hbase4.apache.org,40857,1696535997381)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' 2023-10-05 20:01:37,104 DEBUG [(jenkins-hbase4.apache.org,40857,1696535997381)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-05 20:01:37,105 DEBUG [(jenkins-hbase4.apache.org,40857,1696535997381)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' 2023-10-05 20:01:37,105 DEBUG [(jenkins-hbase4.apache.org,40857,1696535997381)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemStateWithSkipTmp', kicking off acquire phase on members. 2023-10-05 20:01:37,105 DEBUG [(jenkins-hbase4.apache.org,40857,1696535997381)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40857-0x101182c1f970000, quorum=127.0.0.1:57530, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 20:01:37,105 DEBUG [(jenkins-hbase4.apache.org,40857,1696535997381)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 20:01:37,108 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): regionserver:44821-0x101182c1f970002, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-05 20:01:37,108 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): regionserver:36369-0x101182c1f970003, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-05 20:01:37,108 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-05 20:01:37,108 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-05 20:01:37,108 DEBUG [(jenkins-hbase4.apache.org,40857,1696535997381)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,44821,1696535998698 2023-10-05 20:01:37,108 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): regionserver:32861-0x101182c1f970001, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-05 20:01:37,108 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-05 20:01:37,108 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-05 20:01:37,108 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-05 20:01:37,108 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-05 20:01:37,108 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 20:01:37,108 DEBUG [(jenkins-hbase4.apache.org,40857,1696535997381)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40857-0x101182c1f970000, quorum=127.0.0.1:57530, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,44821,1696535998698 2023-10-05 20:01:37,108 DEBUG [(jenkins-hbase4.apache.org,40857,1696535997381)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,36369,1696535998737 2023-10-05 20:01:37,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 20:01:37,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 20:01:37,109 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44821-0x101182c1f970002, quorum=127.0.0.1:57530, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 20:01:37,109 DEBUG [(jenkins-hbase4.apache.org,40857,1696535997381)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40857-0x101182c1f970000, quorum=127.0.0.1:57530, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,36369,1696535998737 2023-10-05 20:01:37,109 DEBUG [(jenkins-hbase4.apache.org,40857,1696535997381)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-05 20:01:37,109 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:32861-0x101182c1f970001, quorum=127.0.0.1:57530, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 20:01:37,109 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36369-0x101182c1f970003, quorum=127.0.0.1:57530, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 20:01:37,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 202 2023-10-05 20:01:37,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 20:01:37,109 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-10-05 20:01:37,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 202 2023-10-05 20:01:37,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 20:01:37,110 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-10-05 20:01:37,110 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 202 2023-10-05 20:01:37,110 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 20:01:37,110 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 20:01:37,110 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 20:01:37,110 DEBUG [member: 'jenkins-hbase4.apache.org,44821,1696535998698' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-10-05 20:01:37,110 DEBUG [member: 'jenkins-hbase4.apache.org,36369,1696535998737' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-10-05 20:01:37,110 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-10-05 20:01:37,110 DEBUG [member: 'jenkins-hbase4.apache.org,36369,1696535998737' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-05 20:01:37,110 DEBUG [member: 'jenkins-hbase4.apache.org,44821,1696535998698' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-05 20:01:37,111 DEBUG [member: 'jenkins-hbase4.apache.org,36369,1696535998737' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-10-05 20:01:37,111 DEBUG [member: 'jenkins-hbase4.apache.org,44821,1696535998698' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-10-05 20:01:37,111 DEBUG [member: 'jenkins-hbase4.apache.org,44821,1696535998698' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-10-05 20:01:37,111 DEBUG [member: 'jenkins-hbase4.apache.org,36369,1696535998737' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-10-05 20:01:37,111 DEBUG [member: 'jenkins-hbase4.apache.org,36369,1696535998737' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,36369,1696535998737' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-10-05 20:01:37,111 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 20:01:37,111 DEBUG [member: 'jenkins-hbase4.apache.org,44821,1696535998698' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44821,1696535998698' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-10-05 20:01:37,112 DEBUG [member: 'jenkins-hbase4.apache.org,32861,1696535998642' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-10-05 20:01:37,112 DEBUG [member: 'jenkins-hbase4.apache.org,32861,1696535998642' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-05 20:01:37,113 DEBUG [member: 'jenkins-hbase4.apache.org,32861,1696535998642' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-10-05 20:01:37,113 DEBUG [member: 'jenkins-hbase4.apache.org,32861,1696535998642' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-10-05 20:01:37,113 DEBUG [member: 'jenkins-hbase4.apache.org,32861,1696535998642' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,32861,1696535998642' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-10-05 20:01:37,115 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): master:40857-0x101182c1f970000, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,36369,1696535998737 2023-10-05 20:01:37,115 DEBUG [member: 'jenkins-hbase4.apache.org,36369,1696535998737' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 20:01:37,115 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,36369,1696535998737 2023-10-05 20:01:37,115 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-05 20:01:37,115 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-05 20:01:37,116 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): master:40857-0x101182c1f970000, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,44821,1696535998698 2023-10-05 20:01:37,116 DEBUG [member: 'jenkins-hbase4.apache.org,44821,1696535998698' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 20:01:37,116 DEBUG [member: 'jenkins-hbase4.apache.org,36369,1696535998737' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36369-0x101182c1f970003, quorum=127.0.0.1:57530, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 20:01:37,116 DEBUG [member: 'jenkins-hbase4.apache.org,36369,1696535998737' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-05 20:01:37,117 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-05 20:01:37,117 DEBUG [member: 'jenkins-hbase4.apache.org,32861,1696535998642' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 20:01:37,117 DEBUG [member: 'jenkins-hbase4.apache.org,44821,1696535998698' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44821-0x101182c1f970002, quorum=127.0.0.1:57530, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 20:01:37,117 DEBUG [member: 'jenkins-hbase4.apache.org,44821,1696535998698' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-05 20:01:37,118 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-05 20:01:37,118 DEBUG [member: 'jenkins-hbase4.apache.org,32861,1696535998642' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:32861-0x101182c1f970001, quorum=127.0.0.1:57530, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 20:01:37,118 DEBUG [member: 'jenkins-hbase4.apache.org,32861,1696535998642' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-05 20:01:37,118 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 20:01:37,118 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32861,1696535998642 2023-10-05 20:01:37,118 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36369,1696535998737 2023-10-05 20:01:37,119 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44821,1696535998698 2023-10-05 20:01:37,119 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-05 20:01:37,119 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,36369,1696535998737' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-10-05 20:01:37,119 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@52312b20[Count = 1] remaining members to acquire global barrier 2023-10-05 20:01:37,119 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,44821,1696535998698 2023-10-05 20:01:37,119 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-05 20:01:37,119 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-05 20:01:37,120 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-05 20:01:37,120 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-05 20:01:37,120 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 20:01:37,121 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32861,1696535998642 2023-10-05 20:01:37,121 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36369,1696535998737 2023-10-05 20:01:37,121 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44821,1696535998698 2023-10-05 20:01:37,121 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-05 20:01:37,122 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,44821,1696535998698' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-10-05 20:01:37,122 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@52312b20[Count = 0] remaining members to acquire global barrier 2023-10-05 20:01:37,122 DEBUG [(jenkins-hbase4.apache.org,40857,1696535997381)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'in-barrier' execution. 2023-10-05 20:01:37,122 DEBUG [(jenkins-hbase4.apache.org,40857,1696535997381)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 20:01:37,126 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): regionserver:32861-0x101182c1f970001, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 20:01:37,126 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): regionserver:36369-0x101182c1f970003, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 20:01:37,126 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): regionserver:44821-0x101182c1f970002, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 20:01:37,126 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 20:01:37,126 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 20:01:37,127 DEBUG [(jenkins-hbase4.apache.org,40857,1696535997381)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40857-0x101182c1f970000, quorum=127.0.0.1:57530, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,36369,1696535998737 2023-10-05 20:01:37,127 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 20:01:37,127 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 20:01:37,127 DEBUG [member: 'jenkins-hbase4.apache.org,32861,1696535998642' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-10-05 20:01:37,126 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 20:01:37,127 DEBUG [member: 'jenkins-hbase4.apache.org,32861,1696535998642' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-10-05 20:01:37,127 DEBUG [member: 'jenkins-hbase4.apache.org,36369,1696535998737' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-10-05 20:01:37,127 DEBUG [member: 'jenkins-hbase4.apache.org,32861,1696535998642' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,32861,1696535998642' in zk 2023-10-05 20:01:37,127 DEBUG [(jenkins-hbase4.apache.org,40857,1696535997381)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40857-0x101182c1f970000, quorum=127.0.0.1:57530, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,44821,1696535998698 2023-10-05 20:01:37,127 DEBUG [(jenkins-hbase4.apache.org,40857,1696535997381)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-05 20:01:37,127 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 20:01:37,127 DEBUG [member: 'jenkins-hbase4.apache.org,36369,1696535998737' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-05 20:01:37,127 DEBUG [member: 'jenkins-hbase4.apache.org,36369,1696535998737' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-05 20:01:37,127 DEBUG [rs(jenkins-hbase4.apache.org,36369,1696535998737)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1696536096276.a1009326bc422e219da3d11b45282ac3. 2023-10-05 20:01:37,127 DEBUG [member: 'jenkins-hbase4.apache.org,44821,1696535998698' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-10-05 20:01:37,127 DEBUG [rs(jenkins-hbase4.apache.org,36369,1696535998737)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1696536096276.a1009326bc422e219da3d11b45282ac3. started... 2023-10-05 20:01:37,127 DEBUG [member: 'jenkins-hbase4.apache.org,44821,1696535998698' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-05 20:01:37,127 DEBUG [member: 'jenkins-hbase4.apache.org,44821,1696535998698' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-05 20:01:37,127 DEBUG [rs(jenkins-hbase4.apache.org,44821,1696535998698)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1696536096276.d665bff47eec0d0a8c75cc5874c2c640. 2023-10-05 20:01:37,127 DEBUG [rs(jenkins-hbase4.apache.org,44821,1696535998698)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1696536096276.d665bff47eec0d0a8c75cc5874c2c640. started... 2023-10-05 20:01:37,127 INFO [rs(jenkins-hbase4.apache.org,36369,1696535998737)-snapshot-pool-0] regionserver.HRegion(2745): Flushing a1009326bc422e219da3d11b45282ac3 1/1 column families, dataSize=2.93 KB heapSize=6.58 KB 2023-10-05 20:01:37,128 INFO [rs(jenkins-hbase4.apache.org,44821,1696535998698)-snapshot-pool-0] regionserver.HRegion(2745): Flushing d665bff47eec0d0a8c75cc5874c2c640 1/1 column families, dataSize=333 B heapSize=976 B 2023-10-05 20:01:37,128 DEBUG [member: 'jenkins-hbase4.apache.org,32861,1696535998642' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-10-05 20:01:37,128 DEBUG [member: 'jenkins-hbase4.apache.org,32861,1696535998642' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-05 20:01:37,128 DEBUG [member: 'jenkins-hbase4.apache.org,32861,1696535998642' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-10-05 20:01:37,156 INFO [rs(jenkins-hbase4.apache.org,44821,1696535998698)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231005c8e2da0423eb4464bf109fe5239d7d63 to hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e20231005c8e2da0423eb4464bf109fe5239d7d63 2023-10-05 20:01:37,157 INFO [rs(jenkins-hbase4.apache.org,36369,1696535998737)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202310059cbbe9913e9e465e857a1d4870f09b5a to hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b202310059cbbe9913e9e465e857a1d4870f09b5a 2023-10-05 20:01:37,175 INFO [rs(jenkins-hbase4.apache.org,44821,1696535998698)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=333, hasBloomFilter=true, into tmp file hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/data/default/testtb-testExportFileSystemStateWithSkipTmp/d665bff47eec0d0a8c75cc5874c2c640/.tmp/cf/937b737001864293aae7206845e9d34f 2023-10-05 20:01:37,175 INFO [rs(jenkins-hbase4.apache.org,36369,1696535998737)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=2.9 K, hasBloomFilter=true, into tmp file hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/data/default/testtb-testExportFileSystemStateWithSkipTmp/a1009326bc422e219da3d11b45282ac3/.tmp/cf/1ef455070ba445d7a4e9da114b5212e2 2023-10-05 20:01:37,180 DEBUG [rs(jenkins-hbase4.apache.org,44821,1696535998698)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/data/default/testtb-testExportFileSystemStateWithSkipTmp/d665bff47eec0d0a8c75cc5874c2c640/.tmp/cf/937b737001864293aae7206845e9d34f as hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/data/default/testtb-testExportFileSystemStateWithSkipTmp/d665bff47eec0d0a8c75cc5874c2c640/cf/937b737001864293aae7206845e9d34f 2023-10-05 20:01:37,180 DEBUG [rs(jenkins-hbase4.apache.org,36369,1696535998737)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/data/default/testtb-testExportFileSystemStateWithSkipTmp/a1009326bc422e219da3d11b45282ac3/.tmp/cf/1ef455070ba445d7a4e9da114b5212e2 as hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/data/default/testtb-testExportFileSystemStateWithSkipTmp/a1009326bc422e219da3d11b45282ac3/cf/1ef455070ba445d7a4e9da114b5212e2 2023-10-05 20:01:37,186 INFO [rs(jenkins-hbase4.apache.org,44821,1696535998698)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/data/default/testtb-testExportFileSystemStateWithSkipTmp/d665bff47eec0d0a8c75cc5874c2c640/cf/937b737001864293aae7206845e9d34f, entries=5, sequenceid=6, filesize=5.8 K 2023-10-05 20:01:37,186 INFO [rs(jenkins-hbase4.apache.org,36369,1696535998737)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/data/default/testtb-testExportFileSystemStateWithSkipTmp/a1009326bc422e219da3d11b45282ac3/cf/1ef455070ba445d7a4e9da114b5212e2, entries=45, sequenceid=6, filesize=13.0 K 2023-10-05 20:01:37,187 INFO [rs(jenkins-hbase4.apache.org,44821,1696535998698)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~333 B/333, heapSize ~960 B/960, currentSize=0 B/0 for d665bff47eec0d0a8c75cc5874c2c640 in 59ms, sequenceid=6, compaction requested=false 2023-10-05 20:01:37,187 INFO [rs(jenkins-hbase4.apache.org,36369,1696535998737)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~2.93 KB/3003, heapSize ~6.56 KB/6720, currentSize=0 B/0 for a1009326bc422e219da3d11b45282ac3 in 60ms, sequenceid=6, compaction requested=false 2023-10-05 20:01:37,188 DEBUG [rs(jenkins-hbase4.apache.org,44821,1696535998698)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for d665bff47eec0d0a8c75cc5874c2c640: 2023-10-05 20:01:37,188 DEBUG [rs(jenkins-hbase4.apache.org,36369,1696535998737)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for a1009326bc422e219da3d11b45282ac3: 2023-10-05 20:01:37,189 DEBUG [rs(jenkins-hbase4.apache.org,44821,1696535998698)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,,1696536096276.d665bff47eec0d0a8c75cc5874c2c640.' region-info for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 20:01:37,189 DEBUG [rs(jenkins-hbase4.apache.org,36369,1696535998737)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,1,1696536096276.a1009326bc422e219da3d11b45282ac3.' region-info for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 20:01:37,189 DEBUG [rs(jenkins-hbase4.apache.org,44821,1696535998698)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-05 20:01:37,189 DEBUG [rs(jenkins-hbase4.apache.org,36369,1696535998737)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-05 20:01:37,189 DEBUG [rs(jenkins-hbase4.apache.org,44821,1696535998698)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/data/default/testtb-testExportFileSystemStateWithSkipTmp/d665bff47eec0d0a8c75cc5874c2c640/cf/937b737001864293aae7206845e9d34f] hfiles 2023-10-05 20:01:37,189 DEBUG [rs(jenkins-hbase4.apache.org,36369,1696535998737)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/data/default/testtb-testExportFileSystemStateWithSkipTmp/a1009326bc422e219da3d11b45282ac3/cf/1ef455070ba445d7a4e9da114b5212e2] hfiles 2023-10-05 20:01:37,189 DEBUG [rs(jenkins-hbase4.apache.org,44821,1696535998698)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/data/default/testtb-testExportFileSystemStateWithSkipTmp/d665bff47eec0d0a8c75cc5874c2c640/cf/937b737001864293aae7206845e9d34f for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 20:01:37,189 DEBUG [rs(jenkins-hbase4.apache.org,36369,1696535998737)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/data/default/testtb-testExportFileSystemStateWithSkipTmp/a1009326bc422e219da3d11b45282ac3/cf/1ef455070ba445d7a4e9da114b5212e2 for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 20:01:37,192 DEBUG [Listener at jenkins-hbase4.apache.org/35067] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-05 20:01:37,193 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40857] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-10-05 20:01:37,193 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40857] snapshot.SnapshotManager(406): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-10-05 20:01:37,193 DEBUG [Listener at jenkins-hbase4.apache.org/35067] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-10-05 20:01:37,201 DEBUG [rs(jenkins-hbase4.apache.org,36369,1696535998737)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1696536096276.a1009326bc422e219da3d11b45282ac3. completed. 2023-10-05 20:01:37,201 DEBUG [rs(jenkins-hbase4.apache.org,36369,1696535998737)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1696536096276.a1009326bc422e219da3d11b45282ac3. 2023-10-05 20:01:37,201 DEBUG [member: 'jenkins-hbase4.apache.org,36369,1696535998737' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-05 20:01:37,201 DEBUG [member: 'jenkins-hbase4.apache.org,36369,1696535998737' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-05 20:01:37,201 DEBUG [member: 'jenkins-hbase4.apache.org,36369,1696535998737' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,36369,1696535998737 2023-10-05 20:01:37,204 DEBUG [member: 'jenkins-hbase4.apache.org,36369,1696535998737' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-10-05 20:01:37,204 DEBUG [member: 'jenkins-hbase4.apache.org,36369,1696535998737' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,36369,1696535998737' in zk 2023-10-05 20:01:37,206 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): master:40857-0x101182c1f970000, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,36369,1696535998737 2023-10-05 20:01:37,206 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,36369,1696535998737 2023-10-05 20:01:37,206 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-05 20:01:37,206 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-05 20:01:37,206 DEBUG [member: 'jenkins-hbase4.apache.org,36369,1696535998737' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-10-05 20:01:37,206 DEBUG [member: 'jenkins-hbase4.apache.org,36369,1696535998737' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-05 20:01:37,206 DEBUG [member: 'jenkins-hbase4.apache.org,36369,1696535998737' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-10-05 20:01:37,208 DEBUG [rs(jenkins-hbase4.apache.org,44821,1696535998698)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1696536096276.d665bff47eec0d0a8c75cc5874c2c640. completed. 2023-10-05 20:01:37,208 DEBUG [rs(jenkins-hbase4.apache.org,44821,1696535998698)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1696536096276.d665bff47eec0d0a8c75cc5874c2c640. 2023-10-05 20:01:37,208 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-05 20:01:37,209 DEBUG [member: 'jenkins-hbase4.apache.org,44821,1696535998698' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-05 20:01:37,209 DEBUG [member: 'jenkins-hbase4.apache.org,44821,1696535998698' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-05 20:01:37,209 DEBUG [member: 'jenkins-hbase4.apache.org,44821,1696535998698' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,44821,1696535998698 2023-10-05 20:01:37,209 DEBUG [member: 'jenkins-hbase4.apache.org,44821,1696535998698' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-10-05 20:01:37,209 DEBUG [member: 'jenkins-hbase4.apache.org,44821,1696535998698' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,44821,1696535998698' in zk 2023-10-05 20:01:37,209 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-05 20:01:37,210 DEBUG [member: 'jenkins-hbase4.apache.org,44821,1696535998698' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-10-05 20:01:37,210 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): master:40857-0x101182c1f970000, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,44821,1696535998698 2023-10-05 20:01:37,210 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 20:01:37,210 DEBUG [member: 'jenkins-hbase4.apache.org,44821,1696535998698' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-05 20:01:37,210 DEBUG [member: 'jenkins-hbase4.apache.org,44821,1696535998698' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-10-05 20:01:37,212 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32861,1696535998642 2023-10-05 20:01:37,212 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36369,1696535998737 2023-10-05 20:01:37,212 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44821,1696535998698 2023-10-05 20:01:37,213 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-05 20:01:37,213 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 20:01:37,214 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32861,1696535998642 2023-10-05 20:01:37,215 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36369,1696535998737 2023-10-05 20:01:37,215 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44821,1696535998698 2023-10-05 20:01:37,216 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,36369,1696535998737': 2023-10-05 20:01:37,216 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,36369,1696535998737' released barrier for procedure'snaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 1 more 2023-10-05 20:01:37,216 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,44821,1696535998698 2023-10-05 20:01:37,216 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-05 20:01:37,216 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-05 20:01:37,216 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-05 20:01:37,216 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-05 20:01:37,217 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 20:01:37,217 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32861,1696535998642 2023-10-05 20:01:37,217 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36369,1696535998737 2023-10-05 20:01:37,218 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44821,1696535998698 2023-10-05 20:01:37,218 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-05 20:01:37,218 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 20:01:37,218 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32861,1696535998642 2023-10-05 20:01:37,219 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36369,1696535998737 2023-10-05 20:01:37,219 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44821,1696535998698 2023-10-05 20:01:37,219 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,44821,1696535998698': 2023-10-05 20:01:37,219 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,44821,1696535998698' released barrier for procedure'snaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 0 more 2023-10-05 20:01:37,219 INFO [(jenkins-hbase4.apache.org,40857,1696535997381)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' execution completed 2023-10-05 20:01:37,220 DEBUG [(jenkins-hbase4.apache.org,40857,1696535997381)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-05 20:01:37,220 DEBUG [(jenkins-hbase4.apache.org,40857,1696535997381)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-05 20:01:37,220 DEBUG [(jenkins-hbase4.apache.org,40857,1696535997381)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 20:01:37,220 INFO [(jenkins-hbase4.apache.org,40857,1696535997381)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateWithSkipTmpincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-10-05 20:01:37,222 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): master:40857-0x101182c1f970000, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 20:01:37,222 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): regionserver:32861-0x101182c1f970001, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 20:01:37,222 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 20:01:37,222 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): regionserver:36369-0x101182c1f970003, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 20:01:37,222 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-05 20:01:37,222 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 20:01:37,222 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 20:01:37,222 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): regionserver:32861-0x101182c1f970001, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-05 20:01:37,222 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): regionserver:44821-0x101182c1f970002, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 20:01:37,222 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): regionserver:44821-0x101182c1f970002, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-05 20:01:37,222 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 20:01:37,222 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 20:01:37,222 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-05 20:01:37,222 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): regionserver:36369-0x101182c1f970003, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-05 20:01:37,222 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 20:01:37,223 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 20:01:37,223 DEBUG [(jenkins-hbase4.apache.org,40857,1696535997381)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40857-0x101182c1f970000, quorum=127.0.0.1:57530, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,32861,1696535998642 2023-10-05 20:01:37,223 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-05 20:01:37,223 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-05 20:01:37,223 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-05 20:01:37,223 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-05 20:01:37,223 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-05 20:01:37,223 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-05 20:01:37,223 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-05 20:01:37,223 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 20:01:37,224 DEBUG [(jenkins-hbase4.apache.org,40857,1696535997381)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40857-0x101182c1f970000, quorum=127.0.0.1:57530, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,36369,1696535998737 2023-10-05 20:01:37,224 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 20:01:37,224 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 20:01:37,224 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 20:01:37,224 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-05 20:01:37,224 DEBUG [(jenkins-hbase4.apache.org,40857,1696535997381)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40857-0x101182c1f970000, quorum=127.0.0.1:57530, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,44821,1696535998698 2023-10-05 20:01:37,224 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 20:01:37,225 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32861,1696535998642 2023-10-05 20:01:37,225 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36369,1696535998737 2023-10-05 20:01:37,225 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44821,1696535998698 2023-10-05 20:01:37,226 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-05 20:01:37,226 DEBUG [(jenkins-hbase4.apache.org,40857,1696535997381)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40857-0x101182c1f970000, quorum=127.0.0.1:57530, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,32861,1696535998642 2023-10-05 20:01:37,226 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 20:01:37,226 DEBUG [(jenkins-hbase4.apache.org,40857,1696535997381)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40857-0x101182c1f970000, quorum=127.0.0.1:57530, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,36369,1696535998737 2023-10-05 20:01:37,226 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32861,1696535998642 2023-10-05 20:01:37,226 DEBUG [(jenkins-hbase4.apache.org,40857,1696535997381)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40857-0x101182c1f970000, quorum=127.0.0.1:57530, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,44821,1696535998698 2023-10-05 20:01:37,227 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36369,1696535998737 2023-10-05 20:01:37,227 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44821,1696535998698 2023-10-05 20:01:37,229 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): regionserver:44821-0x101182c1f970002, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-05 20:01:37,229 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): master:40857-0x101182c1f970000, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,44821,1696535998698 2023-10-05 20:01:37,229 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): regionserver:36369-0x101182c1f970003, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-05 20:01:37,229 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): master:40857-0x101182c1f970000, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 20:01:37,229 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): master:40857-0x101182c1f970000, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,36369,1696535998737 2023-10-05 20:01:37,229 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): master:40857-0x101182c1f970000, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,32861,1696535998642 2023-10-05 20:01:37,229 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): master:40857-0x101182c1f970000, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 20:01:37,229 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): master:40857-0x101182c1f970000, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,44821,1696535998698 2023-10-05 20:01:37,229 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): master:40857-0x101182c1f970000, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 20:01:37,229 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): master:40857-0x101182c1f970000, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,36369,1696535998737 2023-10-05 20:01:37,229 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): master:40857-0x101182c1f970000, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,32861,1696535998642 2023-10-05 20:01:37,229 DEBUG [(jenkins-hbase4.apache.org,40857,1696535997381)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-05 20:01:37,229 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): regionserver:44821-0x101182c1f970002, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-05 20:01:37,229 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-05 20:01:37,229 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): regionserver:32861-0x101182c1f970001, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-05 20:01:37,231 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-05 20:01:37,229 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 20:01:37,229 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): master:40857-0x101182c1f970000, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 20:01:37,229 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): regionserver:36369-0x101182c1f970003, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-05 20:01:37,229 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-05 20:01:37,231 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-05 20:01:37,231 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): master:40857-0x101182c1f970000, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 20:01:37,231 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemStateWithSkipTmp 2023-10-05 20:01:37,231 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-05 20:01:37,231 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-05 20:01:37,231 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): regionserver:32861-0x101182c1f970001, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-05 20:01:37,231 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-05 20:01:37,232 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-05 20:01:37,231 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => e9516f04c7d2974b21addb190acc6c0a, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,.mob,0.e9516f04c7d2974b21addb190acc6c0a.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 20:01:37,231 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-05 20:01:37,232 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-10-05 20:01:37,232 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-05 20:01:37,232 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-05 20:01:37,232 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-05 20:01:37,233 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b202310059cbbe9913e9e465e857a1d4870f09b5a, hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e20231005c8e2da0423eb4464bf109fe5239d7d63] mob files 2023-10-05 20:01:37,233 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b202310059cbbe9913e9e465e857a1d4870f09b5a 2023-10-05 20:01:37,233 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e20231005c8e2da0423eb4464bf109fe5239d7d63 2023-10-05 20:01:37,240 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 20:01:37,240 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 20:01:37,260 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp to hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 20:01:37,261 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed 2023-10-05 20:01:37,261 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 20:01:37,261 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 20:01:37,261 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp at 1696536097090Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemStateWithSkipTmp at 1696536097240 (+150 ms)Consolidate snapshot: snaptb0-testExportFileSystemStateWithSkipTmp at 1696536097240Loading Region manifests for snaptb0-testExportFileSystemStateWithSkipTmp at 1696536097240Writing data manifest for snaptb0-testExportFileSystemStateWithSkipTmp at 1696536097243 (+3 ms)Verifying snapshot: snaptb0-testExportFileSystemStateWithSkipTmp at 1696536097253 (+10 ms)Snapshot snaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed at 1696536097261 (+8 ms) 2023-10-05 20:01:37,264 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=113, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-10-05 20:01:37,266 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=113, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED in 173 msec 2023-10-05 20:01:37,393 DEBUG [Listener at jenkins-hbase4.apache.org/35067] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-05 20:01:37,394 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40857] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-10-05 20:01:37,394 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40857] snapshot.SnapshotManager(403): Snapshot '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' has completed, notifying client. 2023-10-05 20:01:37,395 INFO [Listener at jenkins-hbase4.apache.org/35067] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/export-test/export-1696536097395 2023-10-05 20:01:37,395 INFO [Listener at jenkins-hbase4.apache.org/35067] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:45929, tgtDir=hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/export-test/export-1696536097395, rawTgtDir=hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/export-test/export-1696536097395, srcFsUri=hdfs://localhost:45929, srcDir=hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2 2023-10-05 20:01:37,417 DEBUG [Listener at jenkins-hbase4.apache.org/35067] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:45929, inputRoot=hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2 2023-10-05 20:01:37,417 DEBUG [Listener at jenkins-hbase4.apache.org/35067] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1214155135_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/export-test/export-1696536097395, skipTmp=true, initialOutputSnapshotDir=hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/export-test/export-1696536097395/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 20:01:37,417 INFO [Listener at jenkins-hbase4.apache.org/35067] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:45929, inputRoot=hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2, snapshotDir=hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp. 2023-10-05 20:01:37,429 INFO [Listener at jenkins-hbase4.apache.org/35067] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp to hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/export-test/export-1696536097395/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 20:01:37,451 DEBUG [Listener at jenkins-hbase4.apache.org/35067] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-10-05 20:01:37,451 DEBUG [Listener at jenkins-hbase4.apache.org/35067] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-10-05 20:01:37,452 DEBUG [Listener at jenkins-hbase4.apache.org/35067] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-10-05 20:01:37,452 DEBUG [Listener at jenkins-hbase4.apache.org/35067] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-10-05 20:01:38,325 DEBUG [Listener at jenkins-hbase4.apache.org/35067] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/190200ca-70b6-4852-ff08-4943c98578e6/hadoop-4639880854246091645.jar 2023-10-05 20:01:38,326 DEBUG [Listener at jenkins-hbase4.apache.org/35067] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-10-05 20:01:38,326 DEBUG [Listener at jenkins-hbase4.apache.org/35067] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-10-05 20:01:38,392 DEBUG [Listener at jenkins-hbase4.apache.org/35067] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/190200ca-70b6-4852-ff08-4943c98578e6/hadoop-2858746576003908775.jar 2023-10-05 20:01:38,393 DEBUG [Listener at jenkins-hbase4.apache.org/35067] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-10-05 20:01:38,393 DEBUG [Listener at jenkins-hbase4.apache.org/35067] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-10-05 20:01:38,393 DEBUG [Listener at jenkins-hbase4.apache.org/35067] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-10-05 20:01:38,394 DEBUG [Listener at jenkins-hbase4.apache.org/35067] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-10-05 20:01:38,394 DEBUG [Listener at jenkins-hbase4.apache.org/35067] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-10-05 20:01:38,394 DEBUG [Listener at jenkins-hbase4.apache.org/35067] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-10-05 20:01:38,395 DEBUG [Listener at jenkins-hbase4.apache.org/35067] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-10-05 20:01:38,395 DEBUG [Listener at jenkins-hbase4.apache.org/35067] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-10-05 20:01:38,395 DEBUG [Listener at jenkins-hbase4.apache.org/35067] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-10-05 20:01:38,396 DEBUG [Listener at jenkins-hbase4.apache.org/35067] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-10-05 20:01:38,396 DEBUG [Listener at jenkins-hbase4.apache.org/35067] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-10-05 20:01:38,397 DEBUG [Listener at jenkins-hbase4.apache.org/35067] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-10-05 20:01:38,397 DEBUG [Listener at jenkins-hbase4.apache.org/35067] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-10-05 20:01:38,397 DEBUG [Listener at jenkins-hbase4.apache.org/35067] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-10-05 20:01:38,397 DEBUG [Listener at jenkins-hbase4.apache.org/35067] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-10-05 20:01:38,398 DEBUG [Listener at jenkins-hbase4.apache.org/35067] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-10-05 20:01:38,398 DEBUG [Listener at jenkins-hbase4.apache.org/35067] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-05 20:01:38,399 DEBUG [Listener at jenkins-hbase4.apache.org/35067] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-05 20:01:38,399 DEBUG [Listener at jenkins-hbase4.apache.org/35067] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-10-05 20:01:38,400 DEBUG [Listener at jenkins-hbase4.apache.org/35067] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-05 20:01:38,400 DEBUG [Listener at jenkins-hbase4.apache.org/35067] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-05 20:01:38,400 DEBUG [Listener at jenkins-hbase4.apache.org/35067] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-10-05 20:01:38,401 DEBUG [Listener at jenkins-hbase4.apache.org/35067] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-10-05 20:01:38,739 WARN [Listener at jenkins-hbase4.apache.org/35067] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-10-05 20:01:38,741 INFO [Listener at jenkins-hbase4.apache.org/35067] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportFileSystemStateWithSkipTmp' hfile list 2023-10-05 20:01:38,743 DEBUG [Listener at jenkins-hbase4.apache.org/35067] snapshot.ExportSnapshot(671): export split=0 size=31.5 K 2023-10-05 20:01:40,529 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-10-05 20:01:40,529 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-10-05 20:01:40,532 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696536006875_0006_000001 (auth:SIMPLE) 2023-10-05 20:01:41,418 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696536006875_0007_000001 (auth:SIMPLE) 2023-10-05 20:01:41,555 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-10-05 20:01:45,142 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696536006875_0007_000001 (auth:SIMPLE) 2023-10-05 20:01:47,354 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696536006875_0007_000001 (auth:SIMPLE) 2023-10-05 20:01:49,837 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696536006875_0007_000001 (auth:SIMPLE) 2023-10-05 20:01:50,896 INFO [Listener at jenkins-hbase4.apache.org/35067] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-10-05 20:01:50,896 INFO [Listener at jenkins-hbase4.apache.org/35067] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-10-05 20:01:50,906 INFO [Listener at jenkins-hbase4.apache.org/35067] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 20:01:50,907 INFO [Listener at jenkins-hbase4.apache.org/35067] snapshot.TestExportSnapshot(279): Exported snapshot 2023-10-05 20:01:50,907 INFO [Listener at jenkins-hbase4.apache.org/35067] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-10-05 20:01:50,907 DEBUG [Listener at jenkins-hbase4.apache.org/35067] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-2070727397_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp at hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 20:01:50,908 DEBUG [Listener at jenkins-hbase4.apache.org/35067] snapshot.TestExportSnapshot(367): hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/.snapshotinfo 2023-10-05 20:01:50,908 DEBUG [Listener at jenkins-hbase4.apache.org/35067] snapshot.TestExportSnapshot(367): hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/data.manifest 2023-10-05 20:01:50,908 DEBUG [Listener at jenkins-hbase4.apache.org/35067] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-2070727397_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/export-test/export-1696536097395/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp at hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/export-test/export-1696536097395/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 20:01:50,908 DEBUG [Listener at jenkins-hbase4.apache.org/35067] snapshot.TestExportSnapshot(367): hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/export-test/export-1696536097395/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/.snapshotinfo 2023-10-05 20:01:50,908 DEBUG [Listener at jenkins-hbase4.apache.org/35067] snapshot.TestExportSnapshot(367): hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/export-test/export-1696536097395/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/data.manifest 2023-10-05 20:01:50,914 INFO [Listener at jenkins-hbase4.apache.org/35067] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemStateWithSkipTmp 2023-10-05 20:01:50,914 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40857] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemStateWithSkipTmp 2023-10-05 20:01:50,915 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40857] procedure2.ProcedureExecutor(1028): Stored pid=114, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-10-05 20:01:50,917 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40857] master.MasterRpcServices(1230): Checking to see if procedure is done pid=114 2023-10-05 20:01:50,917 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696536110917"}]},"ts":"1696536110917"} 2023-10-05 20:01:50,918 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=DISABLING in hbase:meta 2023-10-05 20:01:50,920 INFO [PEWorker-4] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemStateWithSkipTmp to state=DISABLING 2023-10-05 20:01:50,920 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=115, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=d665bff47eec0d0a8c75cc5874c2c640, UNASSIGN}, {pid=116, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=a1009326bc422e219da3d11b45282ac3, UNASSIGN}] 2023-10-05 20:01:50,922 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=115, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=d665bff47eec0d0a8c75cc5874c2c640, UNASSIGN 2023-10-05 20:01:50,922 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=116, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=a1009326bc422e219da3d11b45282ac3, UNASSIGN 2023-10-05 20:01:50,923 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=115 updating hbase:meta row=d665bff47eec0d0a8c75cc5874c2c640, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,44821,1696535998698 2023-10-05 20:01:50,923 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=116 updating hbase:meta row=a1009326bc422e219da3d11b45282ac3, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,36369,1696535998737 2023-10-05 20:01:50,923 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1696536096276.d665bff47eec0d0a8c75cc5874c2c640.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1696536110922"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696536110922"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696536110922"}]},"ts":"1696536110922"} 2023-10-05 20:01:50,923 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1696536096276.a1009326bc422e219da3d11b45282ac3.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1696536110923"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696536110923"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696536110923"}]},"ts":"1696536110923"} 2023-10-05 20:01:50,924 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=117, ppid=115, state=RUNNABLE; CloseRegionProcedure d665bff47eec0d0a8c75cc5874c2c640, server=jenkins-hbase4.apache.org,44821,1696535998698}] 2023-10-05 20:01:50,925 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=118, ppid=116, state=RUNNABLE; CloseRegionProcedure a1009326bc422e219da3d11b45282ac3, server=jenkins-hbase4.apache.org,36369,1696535998737}] 2023-10-05 20:01:51,018 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40857] master.MasterRpcServices(1230): Checking to see if procedure is done pid=114 2023-10-05 20:01:51,076 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close a1009326bc422e219da3d11b45282ac3 2023-10-05 20:01:51,076 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close d665bff47eec0d0a8c75cc5874c2c640 2023-10-05 20:01:51,076 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing a1009326bc422e219da3d11b45282ac3, disabling compactions & flushes 2023-10-05 20:01:51,076 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,1,1696536096276.a1009326bc422e219da3d11b45282ac3. 2023-10-05 20:01:51,076 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1696536096276.a1009326bc422e219da3d11b45282ac3. 2023-10-05 20:01:51,076 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing d665bff47eec0d0a8c75cc5874c2c640, disabling compactions & flushes 2023-10-05 20:01:51,076 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1696536096276.a1009326bc422e219da3d11b45282ac3. after waiting 0 ms 2023-10-05 20:01:51,076 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,1,1696536096276.a1009326bc422e219da3d11b45282ac3. 2023-10-05 20:01:51,076 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,,1696536096276.d665bff47eec0d0a8c75cc5874c2c640. 2023-10-05 20:01:51,076 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,,1696536096276.d665bff47eec0d0a8c75cc5874c2c640. 2023-10-05 20:01:51,077 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,,1696536096276.d665bff47eec0d0a8c75cc5874c2c640. after waiting 0 ms 2023-10-05 20:01:51,077 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,,1696536096276.d665bff47eec0d0a8c75cc5874c2c640. 2023-10-05 20:01:51,086 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/data/default/testtb-testExportFileSystemStateWithSkipTmp/a1009326bc422e219da3d11b45282ac3/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-10-05 20:01:51,086 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/data/default/testtb-testExportFileSystemStateWithSkipTmp/d665bff47eec0d0a8c75cc5874c2c640/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-10-05 20:01:51,087 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-10-05 20:01:51,087 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-10-05 20:01:51,088 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,1,1696536096276.a1009326bc422e219da3d11b45282ac3. 2023-10-05 20:01:51,088 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,,1696536096276.d665bff47eec0d0a8c75cc5874c2c640. 2023-10-05 20:01:51,088 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for a1009326bc422e219da3d11b45282ac3: 2023-10-05 20:01:51,088 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for d665bff47eec0d0a8c75cc5874c2c640: 2023-10-05 20:01:51,090 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed d665bff47eec0d0a8c75cc5874c2c640 2023-10-05 20:01:51,090 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=115 updating hbase:meta row=d665bff47eec0d0a8c75cc5874c2c640, regionState=CLOSED 2023-10-05 20:01:51,090 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed a1009326bc422e219da3d11b45282ac3 2023-10-05 20:01:51,090 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1696536096276.d665bff47eec0d0a8c75cc5874c2c640.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1696536111090"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696536111090"}]},"ts":"1696536111090"} 2023-10-05 20:01:51,090 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=116 updating hbase:meta row=a1009326bc422e219da3d11b45282ac3, regionState=CLOSED 2023-10-05 20:01:51,091 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1696536096276.a1009326bc422e219da3d11b45282ac3.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1696536111090"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696536111090"}]},"ts":"1696536111090"} 2023-10-05 20:01:51,093 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=117, resume processing ppid=115 2023-10-05 20:01:51,093 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=117, ppid=115, state=SUCCESS; CloseRegionProcedure d665bff47eec0d0a8c75cc5874c2c640, server=jenkins-hbase4.apache.org,44821,1696535998698 in 167 msec 2023-10-05 20:01:51,094 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=118, resume processing ppid=116 2023-10-05 20:01:51,094 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=118, ppid=116, state=SUCCESS; CloseRegionProcedure a1009326bc422e219da3d11b45282ac3, server=jenkins-hbase4.apache.org,36369,1696535998737 in 167 msec 2023-10-05 20:01:51,094 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=115, ppid=114, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=d665bff47eec0d0a8c75cc5874c2c640, UNASSIGN in 173 msec 2023-10-05 20:01:51,095 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=116, resume processing ppid=114 2023-10-05 20:01:51,095 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=116, ppid=114, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=a1009326bc422e219da3d11b45282ac3, UNASSIGN in 174 msec 2023-10-05 20:01:51,096 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696536111096"}]},"ts":"1696536111096"} 2023-10-05 20:01:51,097 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=DISABLED in hbase:meta 2023-10-05 20:01:51,098 INFO [PEWorker-5] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemStateWithSkipTmp to state=DISABLED 2023-10-05 20:01:51,100 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=114, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp in 185 msec 2023-10-05 20:01:51,219 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40857] master.MasterRpcServices(1230): Checking to see if procedure is done pid=114 2023-10-05 20:01:51,220 INFO [Listener at jenkins-hbase4.apache.org/35067] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemStateWithSkipTmp, procId: 114 completed 2023-10-05 20:01:51,220 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40857] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemStateWithSkipTmp 2023-10-05 20:01:51,221 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40857] procedure2.ProcedureExecutor(1028): Stored pid=119, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-10-05 20:01:51,223 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=119, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-10-05 20:01:51,223 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40857] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemStateWithSkipTmp 2023-10-05 20:01:51,224 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=119, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-10-05 20:01:51,225 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=32861] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemStateWithSkipTmp 2023-10-05 20:01:51,227 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/d665bff47eec0d0a8c75cc5874c2c640 2023-10-05 20:01:51,227 DEBUG [HFileArchiver-15] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/a1009326bc422e219da3d11b45282ac3 2023-10-05 20:01:51,228 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): master:40857-0x101182c1f970000, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-10-05 20:01:51,229 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): regionserver:36369-0x101182c1f970003, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-10-05 20:01:51,229 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): regionserver:44821-0x101182c1f970002, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-10-05 20:01:51,229 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): regionserver:32861-0x101182c1f970001, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-10-05 20:01:51,229 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-10-05 20:01:51,229 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-10-05 20:01:51,229 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-10-05 20:01:51,229 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-10-05 20:01:51,230 DEBUG [HFileArchiver-13] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/d665bff47eec0d0a8c75cc5874c2c640/cf, FileablePath, hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/d665bff47eec0d0a8c75cc5874c2c640/recovered.edits] 2023-10-05 20:01:51,230 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): master:40857-0x101182c1f970000, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-10-05 20:01:51,230 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): regionserver:44821-0x101182c1f970002, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-10-05 20:01:51,230 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): regionserver:36369-0x101182c1f970003, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-10-05 20:01:51,230 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): master:40857-0x101182c1f970000, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-05 20:01:51,230 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): regionserver:32861-0x101182c1f970001, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-10-05 20:01:51,230 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): regionserver:32861-0x101182c1f970001, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-05 20:01:51,230 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): regionserver:36369-0x101182c1f970003, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-05 20:01:51,230 DEBUG [HFileArchiver-15] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/a1009326bc422e219da3d11b45282ac3/cf, FileablePath, hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/a1009326bc422e219da3d11b45282ac3/recovered.edits] 2023-10-05 20:01:51,230 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): regionserver:44821-0x101182c1f970002, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-05 20:01:51,231 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40857] master.MasterRpcServices(1230): Checking to see if procedure is done pid=119 2023-10-05 20:01:51,234 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/d665bff47eec0d0a8c75cc5874c2c640/cf/937b737001864293aae7206845e9d34f to hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/d665bff47eec0d0a8c75cc5874c2c640/cf/937b737001864293aae7206845e9d34f 2023-10-05 20:01:51,234 DEBUG [HFileArchiver-15] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/a1009326bc422e219da3d11b45282ac3/cf/1ef455070ba445d7a4e9da114b5212e2 to hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/a1009326bc422e219da3d11b45282ac3/cf/1ef455070ba445d7a4e9da114b5212e2 2023-10-05 20:01:51,237 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/d665bff47eec0d0a8c75cc5874c2c640/recovered.edits/9.seqid to hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/d665bff47eec0d0a8c75cc5874c2c640/recovered.edits/9.seqid 2023-10-05 20:01:51,237 DEBUG [HFileArchiver-15] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/a1009326bc422e219da3d11b45282ac3/recovered.edits/9.seqid to hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/a1009326bc422e219da3d11b45282ac3/recovered.edits/9.seqid 2023-10-05 20:01:51,238 DEBUG [HFileArchiver-13] backup.HFileArchiver(596): Deleted hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/d665bff47eec0d0a8c75cc5874c2c640 2023-10-05 20:01:51,238 DEBUG [HFileArchiver-15] backup.HFileArchiver(596): Deleted hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/a1009326bc422e219da3d11b45282ac3 2023-10-05 20:01:51,238 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithSkipTmp regions 2023-10-05 20:01:51,238 DEBUG [PEWorker-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a 2023-10-05 20:01:51,239 DEBUG [PEWorker-3] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf] 2023-10-05 20:01:51,242 DEBUG [PEWorker-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b202310059cbbe9913e9e465e857a1d4870f09b5a to hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b202310059cbbe9913e9e465e857a1d4870f09b5a 2023-10-05 20:01:51,243 DEBUG [PEWorker-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e20231005c8e2da0423eb4464bf109fe5239d7d63 to hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e20231005c8e2da0423eb4464bf109fe5239d7d63 2023-10-05 20:01:51,243 DEBUG [PEWorker-3] backup.HFileArchiver(596): Deleted hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a 2023-10-05 20:01:51,245 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=119, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-10-05 20:01:51,247 WARN [PEWorker-3] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportFileSystemStateWithSkipTmp from hbase:meta 2023-10-05 20:01:51,249 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemStateWithSkipTmp' descriptor. 2023-10-05 20:01:51,250 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=119, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-10-05 20:01:51,250 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemStateWithSkipTmp' from region states. 2023-10-05 20:01:51,250 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1696536096276.d665bff47eec0d0a8c75cc5874c2c640.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1696536111250"}]},"ts":"9223372036854775807"} 2023-10-05 20:01:51,250 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1696536096276.a1009326bc422e219da3d11b45282ac3.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1696536111250"}]},"ts":"9223372036854775807"} 2023-10-05 20:01:51,251 INFO [PEWorker-3] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-10-05 20:01:51,252 DEBUG [PEWorker-3] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => d665bff47eec0d0a8c75cc5874c2c640, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,,1696536096276.d665bff47eec0d0a8c75cc5874c2c640.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => a1009326bc422e219da3d11b45282ac3, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,1,1696536096276.a1009326bc422e219da3d11b45282ac3.', STARTKEY => '1', ENDKEY => ''}] 2023-10-05 20:01:51,252 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemStateWithSkipTmp' as deleted. 2023-10-05 20:01:51,252 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1696536111252"}]},"ts":"9223372036854775807"} 2023-10-05 20:01:51,253 INFO [PEWorker-3] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemStateWithSkipTmp state from META 2023-10-05 20:01:51,255 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(130): Finished pid=119, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-10-05 20:01:51,256 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=119, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp in 35 msec 2023-10-05 20:01:51,332 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40857] master.MasterRpcServices(1230): Checking to see if procedure is done pid=119 2023-10-05 20:01:51,332 INFO [Listener at jenkins-hbase4.apache.org/35067] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemStateWithSkipTmp, procId: 119 completed 2023-10-05 20:01:51,338 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40857] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportFileSystemStateWithSkipTmp" 2023-10-05 20:01:51,340 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40857] snapshot.SnapshotManager(335): Deleting snapshot: emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 20:01:51,341 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40857] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemStateWithSkipTmp" 2023-10-05 20:01:51,342 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40857] snapshot.SnapshotManager(335): Deleting snapshot: snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 20:01:51,365 INFO [Listener at jenkins-hbase4.apache.org/35067] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testExportFileSystemStateWithSkipTmp Thread=766 (was 765) Potentially hanging thread: hconnection-0x13ec5c25-shared-pool-42 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #11 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-2070727397_17 at /127.0.0.1:39828 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x13ec5c25-shared-pool-41 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #12 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x13ec5c25-shared-pool-40 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-5213 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-230463238_1 at /127.0.0.1:37014 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (638145229) connection to jenkins-hbase4.apache.org/172.31.14.131:42199 from appattempt_1696536006875_0007_000001 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: hconnection-0x13ec5c25-shared-pool-39 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-2070727397_17 at /127.0.0.1:49836 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (638145229) connection to jenkins-hbase4.apache.org/172.31.14.131:46409 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-230463238_1 at /127.0.0.1:39816 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-2070727397_17 at /127.0.0.1:37040 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=912 (was 938), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=218 (was 236), ProcessCount=168 (was 168), AvailableMemoryMB=5812 (was 5912) 2023-10-05 20:01:51,366 WARN [Listener at jenkins-hbase4.apache.org/35067] hbase.ResourceChecker(130): Thread=766 is superior to 500 2023-10-05 20:01:51,366 INFO [Listener at jenkins-hbase4.apache.org/35067] hbase.HBaseTestingUtility(2762): Stopping mini mapreduce cluster... 2023-10-05 20:01:51,377 INFO [Listener at jenkins-hbase4.apache.org/35067] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-10-05 20:01:56,010 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696536006875_0007_000001 (auth:SIMPLE) 2023-10-05 20:01:56,652 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-10-05 20:02:05,498 INFO [Listener at jenkins-hbase4.apache.org/35067] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-10-05 20:02:19,614 ERROR [Thread[Thread-409,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager$ExpiredTokenRemover(696): ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted 2023-10-05 20:02:19,615 INFO [Listener at jenkins-hbase4.apache.org/35067] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-10-05 20:02:19,723 WARN [ApplicationMaster Launcher] amlauncher.ApplicationMasterLauncher$LauncherThread(122): org.apache.hadoop.yarn.server.resourcemanager.amlauncher.ApplicationMasterLauncher$LauncherThread interrupted. Returning. 2023-10-05 20:02:19,727 ERROR [SchedulerEventDispatcher:Event Processor] event.EventDispatcher$EventProcessor(61): Returning, interrupted : java.lang.InterruptedException 2023-10-05 20:02:19,729 ERROR [Thread[Thread-419,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager$ExpiredTokenRemover(696): ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted 2023-10-05 20:02:19,735 INFO [Listener at jenkins-hbase4.apache.org/35067] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-10-05 20:02:19,838 ERROR [Thread[Thread-383,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager$ExpiredTokenRemover(696): ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted 2023-10-05 20:02:19,839 INFO [Listener at jenkins-hbase4.apache.org/35067] hbase.HBaseTestingUtility(2765): Mini mapreduce cluster stopped 2023-10-05 20:02:19,839 INFO [Listener at jenkins-hbase4.apache.org/35067] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-10-05 20:02:19,839 INFO [Listener at jenkins-hbase4.apache.org/35067] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-10-05 20:02:19,839 DEBUG [Listener at jenkins-hbase4.apache.org/35067] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x782e04b0 to 127.0.0.1:57530 2023-10-05 20:02:19,839 DEBUG [Listener at jenkins-hbase4.apache.org/35067] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-05 20:02:19,839 DEBUG [Listener at jenkins-hbase4.apache.org/35067] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-10-05 20:02:19,839 DEBUG [Listener at jenkins-hbase4.apache.org/35067] util.JVMClusterUtil(257): Found active master hash=1844215420, stopped=false 2023-10-05 20:02:19,839 DEBUG [Listener at jenkins-hbase4.apache.org/35067] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-10-05 20:02:19,840 DEBUG [Listener at jenkins-hbase4.apache.org/35067] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver 2023-10-05 20:02:19,840 INFO [Listener at jenkins-hbase4.apache.org/35067] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase4.apache.org,40857,1696535997381 2023-10-05 20:02:19,841 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): regionserver:44821-0x101182c1f970002, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-10-05 20:02:19,841 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): regionserver:36369-0x101182c1f970003, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-10-05 20:02:19,841 INFO [Listener at jenkins-hbase4.apache.org/35067] procedure2.ProcedureExecutor(628): Stopping 2023-10-05 20:02:19,841 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): master:40857-0x101182c1f970000, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-10-05 20:02:19,841 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): master:40857-0x101182c1f970000, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-10-05 20:02:19,841 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): regionserver:32861-0x101182c1f970001, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-10-05 20:02:19,841 DEBUG [Listener at jenkins-hbase4.apache.org/35067] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x66c1b6dc to 127.0.0.1:57530 2023-10-05 20:02:19,842 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44821-0x101182c1f970002, quorum=127.0.0.1:57530, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-10-05 20:02:19,842 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36369-0x101182c1f970003, quorum=127.0.0.1:57530, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-10-05 20:02:19,842 DEBUG [Listener at jenkins-hbase4.apache.org/35067] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-05 20:02:19,842 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:40857-0x101182c1f970000, quorum=127.0.0.1:57530, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-10-05 20:02:19,842 INFO [Listener at jenkins-hbase4.apache.org/35067] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,32861,1696535998642' ***** 2023-10-05 20:02:19,842 DEBUG [Listener at jenkins-hbase4.apache.org/35067] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-10-05 20:02:19,842 INFO [Listener at jenkins-hbase4.apache.org/35067] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-10-05 20:02:19,842 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:32861-0x101182c1f970001, quorum=127.0.0.1:57530, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-10-05 20:02:19,842 INFO [Listener at jenkins-hbase4.apache.org/35067] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,44821,1696535998698' ***** 2023-10-05 20:02:19,843 DEBUG [Listener at jenkins-hbase4.apache.org/35067] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-10-05 20:02:19,843 INFO [RS:0;jenkins-hbase4:32861] regionserver.HeapMemoryManager(220): Stopping 2023-10-05 20:02:19,843 INFO [Listener at jenkins-hbase4.apache.org/35067] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-10-05 20:02:19,843 INFO [Listener at jenkins-hbase4.apache.org/35067] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,36369,1696535998737' ***** 2023-10-05 20:02:19,843 DEBUG [Listener at jenkins-hbase4.apache.org/35067] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-10-05 20:02:19,843 INFO [RS:1;jenkins-hbase4:44821] regionserver.HeapMemoryManager(220): Stopping 2023-10-05 20:02:19,843 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-10-05 20:02:19,843 INFO [RS:1;jenkins-hbase4:44821] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-10-05 20:02:19,843 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-10-05 20:02:19,843 INFO [Listener at jenkins-hbase4.apache.org/35067] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-10-05 20:02:19,843 INFO [RS:0;jenkins-hbase4:32861] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-10-05 20:02:19,843 INFO [RS:1;jenkins-hbase4:44821] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-10-05 20:02:19,843 INFO [RS:2;jenkins-hbase4:36369] regionserver.HeapMemoryManager(220): Stopping 2023-10-05 20:02:19,843 INFO [RS:1;jenkins-hbase4:44821] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,44821,1696535998698 2023-10-05 20:02:19,843 INFO [RS:2;jenkins-hbase4:36369] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-10-05 20:02:19,843 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-10-05 20:02:19,843 INFO [RS:0;jenkins-hbase4:32861] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-10-05 20:02:19,843 INFO [RS:2;jenkins-hbase4:36369] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-10-05 20:02:19,843 DEBUG [RS:1;jenkins-hbase4:44821] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4d1538ce to 127.0.0.1:57530 2023-10-05 20:02:19,844 INFO [RS:2;jenkins-hbase4:36369] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,36369,1696535998737 2023-10-05 20:02:19,844 INFO [RS:0;jenkins-hbase4:32861] regionserver.HRegionServer(3305): Received CLOSE for 7dd7dd186e42708b85afa72232ef75c8 2023-10-05 20:02:19,844 DEBUG [RS:1;jenkins-hbase4:44821] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-05 20:02:19,844 DEBUG [RS:2;jenkins-hbase4:36369] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x209c06dd to 127.0.0.1:57530 2023-10-05 20:02:19,846 DEBUG [RS:2;jenkins-hbase4:36369] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-05 20:02:19,846 INFO [RS:1;jenkins-hbase4:44821] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-10-05 20:02:19,847 INFO [RS:1;jenkins-hbase4:44821] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-10-05 20:02:19,847 INFO [RS:0;jenkins-hbase4:32861] regionserver.HRegionServer(3305): Received CLOSE for 12bcfc4a1a38b61d92a51bfd9d1d5629 2023-10-05 20:02:19,847 INFO [RS:1;jenkins-hbase4:44821] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-10-05 20:02:19,847 INFO [RS:0;jenkins-hbase4:32861] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,32861,1696535998642 2023-10-05 20:02:19,847 INFO [RS:1;jenkins-hbase4:44821] regionserver.HRegionServer(3305): Received CLOSE for 1588230740 2023-10-05 20:02:19,847 DEBUG [RS:0;jenkins-hbase4:32861] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x64df4c58 to 127.0.0.1:57530 2023-10-05 20:02:19,847 INFO [RS:2;jenkins-hbase4:36369] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,36369,1696535998737; all regions closed. 2023-10-05 20:02:19,847 DEBUG [RS:0;jenkins-hbase4:32861] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-05 20:02:19,847 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 7dd7dd186e42708b85afa72232ef75c8, disabling compactions & flushes 2023-10-05 20:02:19,848 INFO [RS:0;jenkins-hbase4:32861] regionserver.HRegionServer(1474): Waiting on 2 regions to close 2023-10-05 20:02:19,848 INFO [RS:1;jenkins-hbase4:44821] regionserver.HRegionServer(1474): Waiting on 1 regions to close 2023-10-05 20:02:19,848 DEBUG [RS:0;jenkins-hbase4:32861] regionserver.HRegionServer(1478): Online Regions={7dd7dd186e42708b85afa72232ef75c8=hbase:namespace,,1696536000786.7dd7dd186e42708b85afa72232ef75c8., 12bcfc4a1a38b61d92a51bfd9d1d5629=hbase:acl,,1696536001542.12bcfc4a1a38b61d92a51bfd9d1d5629.} 2023-10-05 20:02:19,848 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1696536000786.7dd7dd186e42708b85afa72232ef75c8. 2023-10-05 20:02:19,848 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-10-05 20:02:19,848 DEBUG [RS:1;jenkins-hbase4:44821] regionserver.HRegionServer(1478): Online Regions={1588230740=hbase:meta,,1.1588230740} 2023-10-05 20:02:19,849 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-10-05 20:02:19,848 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1696536000786.7dd7dd186e42708b85afa72232ef75c8. 2023-10-05 20:02:19,849 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-10-05 20:02:19,849 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1696536000786.7dd7dd186e42708b85afa72232ef75c8. after waiting 0 ms 2023-10-05 20:02:19,849 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1696536000786.7dd7dd186e42708b85afa72232ef75c8. 2023-10-05 20:02:19,849 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-10-05 20:02:19,849 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 7dd7dd186e42708b85afa72232ef75c8 1/1 column families, dataSize=78 B heapSize=488 B 2023-10-05 20:02:19,849 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-10-05 20:02:19,849 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 1588230740 3/3 column families, dataSize=45.93 KB heapSize=71.92 KB 2023-10-05 20:02:19,849 DEBUG [RS:1;jenkins-hbase4:44821] regionserver.HRegionServer(1504): Waiting on 1588230740 2023-10-05 20:02:19,849 DEBUG [RS:0;jenkins-hbase4:32861] regionserver.HRegionServer(1504): Waiting on 12bcfc4a1a38b61d92a51bfd9d1d5629, 7dd7dd186e42708b85afa72232ef75c8 2023-10-05 20:02:19,868 DEBUG [RS:2;jenkins-hbase4:36369] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/oldWALs 2023-10-05 20:02:19,868 INFO [RS:2;jenkins-hbase4:36369] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C36369%2C1696535998737:(num 1696536000311) 2023-10-05 20:02:19,868 DEBUG [RS:2;jenkins-hbase4:36369] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-05 20:02:19,868 INFO [RS:2;jenkins-hbase4:36369] regionserver.LeaseManager(133): Closed leases 2023-10-05 20:02:19,874 INFO [RS:2;jenkins-hbase4:36369] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-10-05 20:02:19,874 INFO [RS:2;jenkins-hbase4:36369] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-10-05 20:02:19,874 INFO [RS:2;jenkins-hbase4:36369] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-10-05 20:02:19,874 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-10-05 20:02:19,874 INFO [RS:2;jenkins-hbase4:36369] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-10-05 20:02:19,875 INFO [RS:2;jenkins-hbase4:36369] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:36369 2023-10-05 20:02:19,876 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=78 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/data/hbase/namespace/7dd7dd186e42708b85afa72232ef75c8/.tmp/info/7e0eb0700041480cacf329aff9e545a4 2023-10-05 20:02:19,880 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=40.45 KB at sequenceid=131 (bloomFilter=false), to=hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/data/hbase/meta/1588230740/.tmp/info/500a85f8b6fc4eeda7331871d92c99c1 2023-10-05 20:02:19,881 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): regionserver:44821-0x101182c1f970002, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,36369,1696535998737 2023-10-05 20:02:19,881 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): regionserver:32861-0x101182c1f970001, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,36369,1696535998737 2023-10-05 20:02:19,881 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): regionserver:44821-0x101182c1f970002, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-10-05 20:02:19,881 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): regionserver:32861-0x101182c1f970001, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-10-05 20:02:19,881 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): master:40857-0x101182c1f970000, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-10-05 20:02:19,881 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): regionserver:36369-0x101182c1f970003, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,36369,1696535998737 2023-10-05 20:02:19,881 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): regionserver:36369-0x101182c1f970003, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-10-05 20:02:19,882 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/data/hbase/namespace/7dd7dd186e42708b85afa72232ef75c8/.tmp/info/7e0eb0700041480cacf329aff9e545a4 as hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/data/hbase/namespace/7dd7dd186e42708b85afa72232ef75c8/info/7e0eb0700041480cacf329aff9e545a4 2023-10-05 20:02:19,882 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,36369,1696535998737] 2023-10-05 20:02:19,883 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,36369,1696535998737; numProcessing=1 2023-10-05 20:02:19,887 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,36369,1696535998737 already deleted, retry=false 2023-10-05 20:02:19,887 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,36369,1696535998737 expired; onlineServers=2 2023-10-05 20:02:19,889 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 500a85f8b6fc4eeda7331871d92c99c1 2023-10-05 20:02:19,891 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/data/hbase/namespace/7dd7dd186e42708b85afa72232ef75c8/info/7e0eb0700041480cacf329aff9e545a4, entries=2, sequenceid=6, filesize=4.8 K 2023-10-05 20:02:19,892 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for 7dd7dd186e42708b85afa72232ef75c8 in 43ms, sequenceid=6, compaction requested=false 2023-10-05 20:02:19,906 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/data/hbase/namespace/7dd7dd186e42708b85afa72232ef75c8/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-10-05 20:02:19,908 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-10-05 20:02:19,908 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:namespace,,1696536000786.7dd7dd186e42708b85afa72232ef75c8. 2023-10-05 20:02:19,908 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 7dd7dd186e42708b85afa72232ef75c8: 2023-10-05 20:02:19,909 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1696536000786.7dd7dd186e42708b85afa72232ef75c8. 2023-10-05 20:02:19,909 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 12bcfc4a1a38b61d92a51bfd9d1d5629, disabling compactions & flushes 2023-10-05 20:02:19,909 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:acl,,1696536001542.12bcfc4a1a38b61d92a51bfd9d1d5629. 2023-10-05 20:02:19,909 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:acl,,1696536001542.12bcfc4a1a38b61d92a51bfd9d1d5629. 2023-10-05 20:02:19,909 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:acl,,1696536001542.12bcfc4a1a38b61d92a51bfd9d1d5629. after waiting 0 ms 2023-10-05 20:02:19,909 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:acl,,1696536001542.12bcfc4a1a38b61d92a51bfd9d1d5629. 2023-10-05 20:02:19,909 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 12bcfc4a1a38b61d92a51bfd9d1d5629 1/1 column families, dataSize=914 B heapSize=2.17 KB 2023-10-05 20:02:19,910 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=1.50 KB at sequenceid=131 (bloomFilter=false), to=hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/data/hbase/meta/1588230740/.tmp/rep_barrier/e7b91f31452c4f188fd797947f763b52 2023-10-05 20:02:19,914 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for e7b91f31452c4f188fd797947f763b52 2023-10-05 20:02:19,914 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-10-05 20:02:19,914 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-10-05 20:02:19,914 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-10-05 20:02:19,923 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=914 B at sequenceid=18 (bloomFilter=false), to=hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/data/hbase/acl/12bcfc4a1a38b61d92a51bfd9d1d5629/.tmp/l/ff50715a66e74b26bbd2a3378691d8a6 2023-10-05 20:02:19,928 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for ff50715a66e74b26bbd2a3378691d8a6 2023-10-05 20:02:19,928 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/data/hbase/acl/12bcfc4a1a38b61d92a51bfd9d1d5629/.tmp/l/ff50715a66e74b26bbd2a3378691d8a6 as hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/data/hbase/acl/12bcfc4a1a38b61d92a51bfd9d1d5629/l/ff50715a66e74b26bbd2a3378691d8a6 2023-10-05 20:02:19,933 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for ff50715a66e74b26bbd2a3378691d8a6 2023-10-05 20:02:19,933 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/data/hbase/acl/12bcfc4a1a38b61d92a51bfd9d1d5629/l/ff50715a66e74b26bbd2a3378691d8a6, entries=7, sequenceid=18, filesize=5.2 K 2023-10-05 20:02:19,934 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~914 B/914, heapSize ~2.16 KB/2208, currentSize=0 B/0 for 12bcfc4a1a38b61d92a51bfd9d1d5629 in 25ms, sequenceid=18, compaction requested=false 2023-10-05 20:02:19,944 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/data/hbase/acl/12bcfc4a1a38b61d92a51bfd9d1d5629/recovered.edits/21.seqid, newMaxSeqId=21, maxSeqId=1 2023-10-05 20:02:19,944 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-10-05 20:02:19,945 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:acl,,1696536001542.12bcfc4a1a38b61d92a51bfd9d1d5629. 2023-10-05 20:02:19,945 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 12bcfc4a1a38b61d92a51bfd9d1d5629: 2023-10-05 20:02:19,945 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:acl,,1696536001542.12bcfc4a1a38b61d92a51bfd9d1d5629. 2023-10-05 20:02:19,946 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.98 KB at sequenceid=131 (bloomFilter=false), to=hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/data/hbase/meta/1588230740/.tmp/table/9370941c003b44338e52be4af6af6e78 2023-10-05 20:02:19,950 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 9370941c003b44338e52be4af6af6e78 2023-10-05 20:02:19,950 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/data/hbase/meta/1588230740/.tmp/info/500a85f8b6fc4eeda7331871d92c99c1 as hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/data/hbase/meta/1588230740/info/500a85f8b6fc4eeda7331871d92c99c1 2023-10-05 20:02:19,955 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 500a85f8b6fc4eeda7331871d92c99c1 2023-10-05 20:02:19,955 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/data/hbase/meta/1588230740/info/500a85f8b6fc4eeda7331871d92c99c1, entries=48, sequenceid=131, filesize=10.3 K 2023-10-05 20:02:19,956 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/data/hbase/meta/1588230740/.tmp/rep_barrier/e7b91f31452c4f188fd797947f763b52 as hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/data/hbase/meta/1588230740/rep_barrier/e7b91f31452c4f188fd797947f763b52 2023-10-05 20:02:19,961 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for e7b91f31452c4f188fd797947f763b52 2023-10-05 20:02:19,961 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/data/hbase/meta/1588230740/rep_barrier/e7b91f31452c4f188fd797947f763b52, entries=13, sequenceid=131, filesize=6.4 K 2023-10-05 20:02:19,962 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/data/hbase/meta/1588230740/.tmp/table/9370941c003b44338e52be4af6af6e78 as hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/data/hbase/meta/1588230740/table/9370941c003b44338e52be4af6af6e78 2023-10-05 20:02:19,967 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 9370941c003b44338e52be4af6af6e78 2023-10-05 20:02:19,967 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/data/hbase/meta/1588230740/table/9370941c003b44338e52be4af6af6e78, entries=24, sequenceid=131, filesize=6.9 K 2023-10-05 20:02:19,968 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~45.93 KB/47028, heapSize ~71.88 KB/73600, currentSize=0 B/0 for 1588230740 in 119ms, sequenceid=131, compaction requested=false 2023-10-05 20:02:19,979 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/data/hbase/meta/1588230740/recovered.edits/134.seqid, newMaxSeqId=134, maxSeqId=1 2023-10-05 20:02:19,979 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-10-05 20:02:19,979 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-10-05 20:02:19,980 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-10-05 20:02:19,980 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-10-05 20:02:19,980 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-10-05 20:02:19,983 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): regionserver:36369-0x101182c1f970003, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-10-05 20:02:19,983 INFO [RS:2;jenkins-hbase4:36369] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,36369,1696535998737; zookeeper connection closed. 2023-10-05 20:02:19,983 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): regionserver:36369-0x101182c1f970003, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-10-05 20:02:19,983 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@525c2757] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@525c2757 2023-10-05 20:02:20,049 INFO [RS:1;jenkins-hbase4:44821] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,44821,1696535998698; all regions closed. 2023-10-05 20:02:20,050 INFO [RS:0;jenkins-hbase4:32861] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,32861,1696535998642; all regions closed. 2023-10-05 20:02:20,057 DEBUG [RS:0;jenkins-hbase4:32861] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/oldWALs 2023-10-05 20:02:20,057 INFO [RS:0;jenkins-hbase4:32861] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C32861%2C1696535998642:(num 1696536000312) 2023-10-05 20:02:20,057 DEBUG [RS:0;jenkins-hbase4:32861] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-05 20:02:20,057 INFO [RS:0;jenkins-hbase4:32861] regionserver.LeaseManager(133): Closed leases 2023-10-05 20:02:20,058 INFO [RS:0;jenkins-hbase4:32861] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-10-05 20:02:20,058 INFO [RS:0;jenkins-hbase4:32861] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-10-05 20:02:20,058 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-10-05 20:02:20,059 DEBUG [RS:1;jenkins-hbase4:44821] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/oldWALs 2023-10-05 20:02:20,059 INFO [RS:1;jenkins-hbase4:44821] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C44821%2C1696535998698.meta:.meta(num 1696536000505) 2023-10-05 20:02:20,058 INFO [RS:0;jenkins-hbase4:32861] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-10-05 20:02:20,060 INFO [RS:0;jenkins-hbase4:32861] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-10-05 20:02:20,061 INFO [RS:0;jenkins-hbase4:32861] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:32861 2023-10-05 20:02:20,063 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): regionserver:44821-0x101182c1f970002, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,32861,1696535998642 2023-10-05 20:02:20,063 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): master:40857-0x101182c1f970000, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-10-05 20:02:20,064 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): regionserver:32861-0x101182c1f970001, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,32861,1696535998642 2023-10-05 20:02:20,064 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,32861,1696535998642] 2023-10-05 20:02:20,064 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,32861,1696535998642; numProcessing=2 2023-10-05 20:02:20,066 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,32861,1696535998642 already deleted, retry=false 2023-10-05 20:02:20,066 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,32861,1696535998642 expired; onlineServers=1 2023-10-05 20:02:20,066 DEBUG [RS:1;jenkins-hbase4:44821] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/oldWALs 2023-10-05 20:02:20,066 INFO [RS:1;jenkins-hbase4:44821] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C44821%2C1696535998698:(num 1696536000311) 2023-10-05 20:02:20,066 DEBUG [RS:1;jenkins-hbase4:44821] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-05 20:02:20,066 INFO [RS:1;jenkins-hbase4:44821] regionserver.LeaseManager(133): Closed leases 2023-10-05 20:02:20,067 INFO [RS:1;jenkins-hbase4:44821] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-10-05 20:02:20,067 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-10-05 20:02:20,068 INFO [RS:1;jenkins-hbase4:44821] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:44821 2023-10-05 20:02:20,070 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): master:40857-0x101182c1f970000, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-10-05 20:02:20,070 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): regionserver:44821-0x101182c1f970002, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,44821,1696535998698 2023-10-05 20:02:20,071 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,44821,1696535998698] 2023-10-05 20:02:20,071 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,44821,1696535998698; numProcessing=3 2023-10-05 20:02:20,072 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,44821,1696535998698 already deleted, retry=false 2023-10-05 20:02:20,072 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,44821,1696535998698 expired; onlineServers=0 2023-10-05 20:02:20,072 INFO [RegionServerTracker-0] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,40857,1696535997381' ***** 2023-10-05 20:02:20,072 INFO [RegionServerTracker-0] regionserver.HRegionServer(2311): STOPPED: Cluster shutdown set; onlineServer=0 2023-10-05 20:02:20,072 DEBUG [M:0;jenkins-hbase4:40857] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2cd17447, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-10-05 20:02:20,072 INFO [M:0;jenkins-hbase4:40857] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,40857,1696535997381 2023-10-05 20:02:20,072 INFO [M:0;jenkins-hbase4:40857] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,40857,1696535997381; all regions closed. 2023-10-05 20:02:20,072 DEBUG [M:0;jenkins-hbase4:40857] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-05 20:02:20,072 DEBUG [M:0;jenkins-hbase4:40857] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-10-05 20:02:20,072 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-10-05 20:02:20,072 DEBUG [M:0;jenkins-hbase4:40857] cleaner.HFileCleaner(317): Stopping file delete threads 2023-10-05 20:02:20,072 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1696535999947] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1696535999947,5,FailOnTimeoutGroup] 2023-10-05 20:02:20,072 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1696535999947] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1696535999947,5,FailOnTimeoutGroup] 2023-10-05 20:02:20,073 INFO [M:0;jenkins-hbase4:40857] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-10-05 20:02:20,073 INFO [M:0;jenkins-hbase4:40857] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-10-05 20:02:20,073 INFO [M:0;jenkins-hbase4:40857] hbase.ChoreService(369): Chore service for: master/jenkins-hbase4:0 had [] on shutdown 2023-10-05 20:02:20,073 DEBUG [M:0;jenkins-hbase4:40857] master.HMaster(1512): Stopping service threads 2023-10-05 20:02:20,073 INFO [M:0;jenkins-hbase4:40857] procedure2.RemoteProcedureDispatcher(119): Stopping procedure remote dispatcher 2023-10-05 20:02:20,073 ERROR [M:0;jenkins-hbase4:40857] procedure2.ProcedureExecutor(652): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT 2023-10-05 20:02:20,073 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): master:40857-0x101182c1f970000, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] Thread[HFileArchiver-13,5,PEWorkerGroup] Thread[HFileArchiver-15,5,PEWorkerGroup] 2023-10-05 20:02:20,073 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): master:40857-0x101182c1f970000, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-10-05 20:02:20,074 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:40857-0x101182c1f970000, quorum=127.0.0.1:57530, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-10-05 20:02:20,074 INFO [M:0;jenkins-hbase4:40857] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-10-05 20:02:20,074 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-10-05 20:02:20,074 DEBUG [M:0;jenkins-hbase4:40857] zookeeper.ZKUtil(398): master:40857-0x101182c1f970000, quorum=127.0.0.1:57530, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-10-05 20:02:20,074 WARN [M:0;jenkins-hbase4:40857] master.ActiveMasterManager(326): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-10-05 20:02:20,075 INFO [M:0;jenkins-hbase4:40857] assignment.AssignmentManager(315): Stopping assignment manager 2023-10-05 20:02:20,075 INFO [M:0;jenkins-hbase4:40857] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-10-05 20:02:20,075 DEBUG [M:0;jenkins-hbase4:40857] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-10-05 20:02:20,075 INFO [M:0;jenkins-hbase4:40857] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-10-05 20:02:20,075 DEBUG [M:0;jenkins-hbase4:40857] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-10-05 20:02:20,075 DEBUG [M:0;jenkins-hbase4:40857] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-10-05 20:02:20,075 DEBUG [M:0;jenkins-hbase4:40857] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-10-05 20:02:20,075 INFO [M:0;jenkins-hbase4:40857] regionserver.HRegion(2745): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=375.88 KB heapSize=452.12 KB 2023-10-05 20:02:20,090 INFO [M:0;jenkins-hbase4:40857] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=375.88 KB at sequenceid=899 (bloomFilter=true), to=hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/8b741c472bc442fd98ba68e3a4229ea6 2023-10-05 20:02:20,094 INFO [M:0;jenkins-hbase4:40857] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 8b741c472bc442fd98ba68e3a4229ea6 2023-10-05 20:02:20,094 DEBUG [M:0;jenkins-hbase4:40857] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/8b741c472bc442fd98ba68e3a4229ea6 as hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/8b741c472bc442fd98ba68e3a4229ea6 2023-10-05 20:02:20,098 INFO [M:0;jenkins-hbase4:40857] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 8b741c472bc442fd98ba68e3a4229ea6 2023-10-05 20:02:20,098 INFO [M:0;jenkins-hbase4:40857] regionserver.HStore(1080): Added hdfs://localhost:45929/user/jenkins/test-data/11792201-b670-aa61-3db9-9b65c9fa73c2/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/8b741c472bc442fd98ba68e3a4229ea6, entries=119, sequenceid=899, filesize=28.7 K 2023-10-05 20:02:20,099 INFO [M:0;jenkins-hbase4:40857] regionserver.HRegion(2948): Finished flush of dataSize ~375.88 KB/384906, heapSize ~452.10 KB/462952, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 24ms, sequenceid=899, compaction requested=false 2023-10-05 20:02:20,100 INFO [M:0;jenkins-hbase4:40857] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-10-05 20:02:20,101 DEBUG [M:0;jenkins-hbase4:40857] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-10-05 20:02:20,104 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-10-05 20:02:20,104 INFO [M:0;jenkins-hbase4:40857] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-10-05 20:02:20,105 INFO [M:0;jenkins-hbase4:40857] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:40857 2023-10-05 20:02:20,108 DEBUG [M:0;jenkins-hbase4:40857] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase4.apache.org,40857,1696535997381 already deleted, retry=false 2023-10-05 20:02:20,165 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): regionserver:32861-0x101182c1f970001, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-10-05 20:02:20,165 INFO [RS:0;jenkins-hbase4:32861] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,32861,1696535998642; zookeeper connection closed. 2023-10-05 20:02:20,165 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): regionserver:32861-0x101182c1f970001, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-10-05 20:02:20,166 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@2b8e179b] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@2b8e179b 2023-10-05 20:02:20,266 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): master:40857-0x101182c1f970000, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-10-05 20:02:20,266 INFO [M:0;jenkins-hbase4:40857] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,40857,1696535997381; zookeeper connection closed. 2023-10-05 20:02:20,266 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): master:40857-0x101182c1f970000, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-10-05 20:02:20,366 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): regionserver:44821-0x101182c1f970002, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-10-05 20:02:20,366 INFO [RS:1;jenkins-hbase4:44821] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,44821,1696535998698; zookeeper connection closed. 2023-10-05 20:02:20,366 DEBUG [Listener at localhost/32941-EventThread] zookeeper.ZKWatcher(600): regionserver:44821-0x101182c1f970002, quorum=127.0.0.1:57530, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-10-05 20:02:20,366 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@17c1d7dc] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@17c1d7dc 2023-10-05 20:02:20,366 INFO [Listener at jenkins-hbase4.apache.org/35067] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 3 regionserver(s) complete 2023-10-05 20:02:20,367 WARN [Listener at jenkins-hbase4.apache.org/35067] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-10-05 20:02:20,369 INFO [Listener at jenkins-hbase4.apache.org/35067] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-10-05 20:02:20,472 WARN [BP-753622663-172.31.14.131-1696535993647 heartbeating to localhost/127.0.0.1:45929] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-10-05 20:02:20,472 WARN [BP-753622663-172.31.14.131-1696535993647 heartbeating to localhost/127.0.0.1:45929] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-753622663-172.31.14.131-1696535993647 (Datanode Uuid d250e794-9c99-414b-885b-44ace439f4e2) service to localhost/127.0.0.1:45929 2023-10-05 20:02:20,474 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/190200ca-70b6-4852-ff08-4943c98578e6/cluster_78e2df33-fa2c-67a8-7ffd-0907f5603662/dfs/data/data5/current/BP-753622663-172.31.14.131-1696535993647] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-10-05 20:02:20,474 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/190200ca-70b6-4852-ff08-4943c98578e6/cluster_78e2df33-fa2c-67a8-7ffd-0907f5603662/dfs/data/data6/current/BP-753622663-172.31.14.131-1696535993647] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-10-05 20:02:20,475 WARN [Listener at jenkins-hbase4.apache.org/35067] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-10-05 20:02:20,477 INFO [Listener at jenkins-hbase4.apache.org/35067] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-10-05 20:02:20,580 WARN [BP-753622663-172.31.14.131-1696535993647 heartbeating to localhost/127.0.0.1:45929] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-10-05 20:02:20,580 WARN [BP-753622663-172.31.14.131-1696535993647 heartbeating to localhost/127.0.0.1:45929] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-753622663-172.31.14.131-1696535993647 (Datanode Uuid a6bc1e55-4d84-41e7-9faa-d661b03673f9) service to localhost/127.0.0.1:45929 2023-10-05 20:02:20,581 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/190200ca-70b6-4852-ff08-4943c98578e6/cluster_78e2df33-fa2c-67a8-7ffd-0907f5603662/dfs/data/data3/current/BP-753622663-172.31.14.131-1696535993647] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-10-05 20:02:20,581 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/190200ca-70b6-4852-ff08-4943c98578e6/cluster_78e2df33-fa2c-67a8-7ffd-0907f5603662/dfs/data/data4/current/BP-753622663-172.31.14.131-1696535993647] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-10-05 20:02:20,582 WARN [Listener at jenkins-hbase4.apache.org/35067] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-10-05 20:02:20,584 INFO [Listener at jenkins-hbase4.apache.org/35067] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-10-05 20:02:20,687 WARN [BP-753622663-172.31.14.131-1696535993647 heartbeating to localhost/127.0.0.1:45929] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-10-05 20:02:20,687 WARN [BP-753622663-172.31.14.131-1696535993647 heartbeating to localhost/127.0.0.1:45929] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-753622663-172.31.14.131-1696535993647 (Datanode Uuid 1480d934-1e25-4193-8166-2b36d4a3dcd0) service to localhost/127.0.0.1:45929 2023-10-05 20:02:20,687 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/190200ca-70b6-4852-ff08-4943c98578e6/cluster_78e2df33-fa2c-67a8-7ffd-0907f5603662/dfs/data/data1/current/BP-753622663-172.31.14.131-1696535993647] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-10-05 20:02:20,688 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/190200ca-70b6-4852-ff08-4943c98578e6/cluster_78e2df33-fa2c-67a8-7ffd-0907f5603662/dfs/data/data2/current/BP-753622663-172.31.14.131-1696535993647] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-10-05 20:02:20,711 INFO [Listener at jenkins-hbase4.apache.org/35067] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-10-05 20:02:20,836 INFO [Listener at jenkins-hbase4.apache.org/35067] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-10-05 20:02:20,929 INFO [Listener at jenkins-hbase4.apache.org/35067] hbase.HBaseTestingUtility(1293): Minicluster is down