2023-10-02 16:02:31,134 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.snapshot.TestExportSnapshot timeout: 13 mins 2023-10-02 16:02:31,376 DEBUG [main] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ec4ab044-456e-ce77-098f-f91b72a3e0ab 2023-10-02 16:02:31,376 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.snapshot.TestMobExportSnapshot timeout: 13 mins 2023-10-02 16:02:31,376 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.snapshot.TestMobSecureExportSnapshot timeout: 13 mins 2023-10-02 16:02:31,417 WARN [Time-limited test] util.NativeCodeLoader(62): Unable to load native-hadoop library for your platform... using builtin-java classes where applicable 2023-10-02 16:02:31,677 INFO [Time-limited test] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=3, rsPorts=, rsClass=null, numDataNodes=3, dataNodeHosts=null, numZkServers=1, createRootDir=false, createWALDir=false} 2023-10-02 16:02:31,678 INFO [Time-limited test] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ec4ab044-456e-ce77-098f-f91b72a3e0ab/cluster_a1e9014f-f81d-2e22-2bb2-f7ceda69c14c, deleteOnExit=true 2023-10-02 16:02:31,678 INFO [Time-limited test] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-10-02 16:02:31,679 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ec4ab044-456e-ce77-098f-f91b72a3e0ab/test.cache.data in system properties and HBase conf 2023-10-02 16:02:31,680 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ec4ab044-456e-ce77-098f-f91b72a3e0ab/hadoop.tmp.dir in system properties and HBase conf 2023-10-02 16:02:31,680 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ec4ab044-456e-ce77-098f-f91b72a3e0ab/hadoop.log.dir in system properties and HBase conf 2023-10-02 16:02:31,681 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ec4ab044-456e-ce77-098f-f91b72a3e0ab/mapreduce.cluster.local.dir in system properties and HBase conf 2023-10-02 16:02:31,681 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ec4ab044-456e-ce77-098f-f91b72a3e0ab/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-10-02 16:02:31,681 INFO [Time-limited test] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-10-02 16:02:32,021 DEBUG [Time-limited test] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-10-02 16:02:32,026 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ec4ab044-456e-ce77-098f-f91b72a3e0ab/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-10-02 16:02:32,027 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ec4ab044-456e-ce77-098f-f91b72a3e0ab/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-10-02 16:02:32,027 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ec4ab044-456e-ce77-098f-f91b72a3e0ab/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-10-02 16:02:32,027 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ec4ab044-456e-ce77-098f-f91b72a3e0ab/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-10-02 16:02:32,028 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ec4ab044-456e-ce77-098f-f91b72a3e0ab/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-10-02 16:02:32,028 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ec4ab044-456e-ce77-098f-f91b72a3e0ab/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-10-02 16:02:32,029 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ec4ab044-456e-ce77-098f-f91b72a3e0ab/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-10-02 16:02:32,029 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ec4ab044-456e-ce77-098f-f91b72a3e0ab/dfs.journalnode.edits.dir in system properties and HBase conf 2023-10-02 16:02:32,030 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ec4ab044-456e-ce77-098f-f91b72a3e0ab/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-10-02 16:02:32,030 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ec4ab044-456e-ce77-098f-f91b72a3e0ab/nfs.dump.dir in system properties and HBase conf 2023-10-02 16:02:32,031 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ec4ab044-456e-ce77-098f-f91b72a3e0ab/java.io.tmpdir in system properties and HBase conf 2023-10-02 16:02:32,031 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ec4ab044-456e-ce77-098f-f91b72a3e0ab/dfs.journalnode.edits.dir in system properties and HBase conf 2023-10-02 16:02:32,031 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ec4ab044-456e-ce77-098f-f91b72a3e0ab/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-10-02 16:02:32,032 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ec4ab044-456e-ce77-098f-f91b72a3e0ab/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-10-02 16:02:32,623 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-10-02 16:02:32,628 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-10-02 16:02:32,995 WARN [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-namenode.properties,hadoop-metrics2.properties 2023-10-02 16:02:33,203 INFO [Time-limited test] log.Slf4jLog(67): Logging to org.slf4j.impl.Reload4jLoggerAdapter(org.mortbay.log) via org.mortbay.log.Slf4jLog 2023-10-02 16:02:33,219 WARN [Time-limited test] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-10-02 16:02:33,275 INFO [Time-limited test] log.Slf4jLog(67): jetty-6.1.26 2023-10-02 16:02:33,323 INFO [Time-limited test] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ec4ab044-456e-ce77-098f-f91b72a3e0ab/java.io.tmpdir/Jetty_localhost_42115_hdfs____8ggy9t/webapp 2023-10-02 16:02:33,497 INFO [Time-limited test] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:42115 2023-10-02 16:02:33,545 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-10-02 16:02:33,546 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-10-02 16:02:34,156 WARN [Listener at localhost/42119] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-10-02 16:02:34,243 WARN [Listener at localhost/42119] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-10-02 16:02:34,277 WARN [Listener at localhost/42119] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-10-02 16:02:34,285 INFO [Listener at localhost/42119] log.Slf4jLog(67): jetty-6.1.26 2023-10-02 16:02:34,296 INFO [Listener at localhost/42119] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ec4ab044-456e-ce77-098f-f91b72a3e0ab/java.io.tmpdir/Jetty_localhost_39923_datanode____.y6l151/webapp 2023-10-02 16:02:34,422 INFO [Listener at localhost/42119] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:39923 2023-10-02 16:02:35,018 WARN [Listener at localhost/37577] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-10-02 16:02:35,041 WARN [Listener at localhost/37577] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-10-02 16:02:35,044 WARN [Listener at localhost/37577] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-10-02 16:02:35,045 INFO [Listener at localhost/37577] log.Slf4jLog(67): jetty-6.1.26 2023-10-02 16:02:35,054 INFO [Listener at localhost/37577] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ec4ab044-456e-ce77-098f-f91b72a3e0ab/java.io.tmpdir/Jetty_localhost_37893_datanode____.tq34x7/webapp 2023-10-02 16:02:35,165 INFO [Listener at localhost/37577] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:37893 2023-10-02 16:02:35,179 WARN [Listener at localhost/45991] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-10-02 16:02:35,204 WARN [Listener at localhost/45991] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-10-02 16:02:35,207 WARN [Listener at localhost/45991] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-10-02 16:02:35,209 INFO [Listener at localhost/45991] log.Slf4jLog(67): jetty-6.1.26 2023-10-02 16:02:35,220 INFO [Listener at localhost/45991] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ec4ab044-456e-ce77-098f-f91b72a3e0ab/java.io.tmpdir/Jetty_localhost_44685_datanode____.x7z04m/webapp 2023-10-02 16:02:35,334 INFO [Listener at localhost/45991] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:44685 2023-10-02 16:02:35,352 WARN [Listener at localhost/38719] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-10-02 16:02:35,721 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x9230dc5a1bb07c3e: Processing first storage report for DS-6c644a30-a172-46d5-a374-7a50c58e2ccd from datanode dbbc5bf0-6ae7-42c7-9c36-7792d22cfac1 2023-10-02 16:02:35,724 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x9230dc5a1bb07c3e: from storage DS-6c644a30-a172-46d5-a374-7a50c58e2ccd node DatanodeRegistration(127.0.0.1:45007, datanodeUuid=dbbc5bf0-6ae7-42c7-9c36-7792d22cfac1, infoPort=33729, infoSecurePort=0, ipcPort=45991, storageInfo=lv=-57;cid=testClusterID;nsid=1267659221;c=1696262552717), blocks: 0, hasStaleStorage: true, processing time: 2 msecs, invalidatedBlocks: 0 2023-10-02 16:02:35,724 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x2ea866ca0ac5ea59: Processing first storage report for DS-9cfabd62-e832-42ed-ba21-f9823a5bca3d from datanode fee509bd-121f-4d50-85f9-5ac3450d857f 2023-10-02 16:02:35,724 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x2ea866ca0ac5ea59: from storage DS-9cfabd62-e832-42ed-ba21-f9823a5bca3d node DatanodeRegistration(127.0.0.1:34267, datanodeUuid=fee509bd-121f-4d50-85f9-5ac3450d857f, infoPort=36045, infoSecurePort=0, ipcPort=38719, storageInfo=lv=-57;cid=testClusterID;nsid=1267659221;c=1696262552717), blocks: 0, hasStaleStorage: true, processing time: 1 msecs, invalidatedBlocks: 0 2023-10-02 16:02:35,725 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x397f5df69acc7ab4: Processing first storage report for DS-6b551b8f-3d7c-461e-bafe-94fdd27cb007 from datanode a82a1096-ff63-42b1-93e5-7b20244449f9 2023-10-02 16:02:35,725 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x397f5df69acc7ab4: from storage DS-6b551b8f-3d7c-461e-bafe-94fdd27cb007 node DatanodeRegistration(127.0.0.1:42279, datanodeUuid=a82a1096-ff63-42b1-93e5-7b20244449f9, infoPort=42451, infoSecurePort=0, ipcPort=37577, storageInfo=lv=-57;cid=testClusterID;nsid=1267659221;c=1696262552717), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-10-02 16:02:35,725 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x9230dc5a1bb07c3e: Processing first storage report for DS-29451f45-924a-45b8-988f-3d4b27907b94 from datanode dbbc5bf0-6ae7-42c7-9c36-7792d22cfac1 2023-10-02 16:02:35,725 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x9230dc5a1bb07c3e: from storage DS-29451f45-924a-45b8-988f-3d4b27907b94 node DatanodeRegistration(127.0.0.1:45007, datanodeUuid=dbbc5bf0-6ae7-42c7-9c36-7792d22cfac1, infoPort=33729, infoSecurePort=0, ipcPort=45991, storageInfo=lv=-57;cid=testClusterID;nsid=1267659221;c=1696262552717), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-10-02 16:02:35,725 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x2ea866ca0ac5ea59: Processing first storage report for DS-c0d9be03-7fb9-422a-8925-cb8775fafba0 from datanode fee509bd-121f-4d50-85f9-5ac3450d857f 2023-10-02 16:02:35,725 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x2ea866ca0ac5ea59: from storage DS-c0d9be03-7fb9-422a-8925-cb8775fafba0 node DatanodeRegistration(127.0.0.1:34267, datanodeUuid=fee509bd-121f-4d50-85f9-5ac3450d857f, infoPort=36045, infoSecurePort=0, ipcPort=38719, storageInfo=lv=-57;cid=testClusterID;nsid=1267659221;c=1696262552717), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-10-02 16:02:35,725 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x397f5df69acc7ab4: Processing first storage report for DS-ab3a3a3d-04d5-422f-8f47-ad45640f8d60 from datanode a82a1096-ff63-42b1-93e5-7b20244449f9 2023-10-02 16:02:35,725 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x397f5df69acc7ab4: from storage DS-ab3a3a3d-04d5-422f-8f47-ad45640f8d60 node DatanodeRegistration(127.0.0.1:42279, datanodeUuid=a82a1096-ff63-42b1-93e5-7b20244449f9, infoPort=42451, infoSecurePort=0, ipcPort=37577, storageInfo=lv=-57;cid=testClusterID;nsid=1267659221;c=1696262552717), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-10-02 16:02:35,953 DEBUG [Listener at localhost/38719] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ec4ab044-456e-ce77-098f-f91b72a3e0ab 2023-10-02 16:02:36,098 INFO [Listener at localhost/38719] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ec4ab044-456e-ce77-098f-f91b72a3e0ab/cluster_a1e9014f-f81d-2e22-2bb2-f7ceda69c14c/zookeeper_0, clientPort=50210, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ec4ab044-456e-ce77-098f-f91b72a3e0ab/cluster_a1e9014f-f81d-2e22-2bb2-f7ceda69c14c/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ec4ab044-456e-ce77-098f-f91b72a3e0ab/cluster_a1e9014f-f81d-2e22-2bb2-f7ceda69c14c/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-10-02 16:02:36,119 INFO [Listener at localhost/38719] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=50210 2023-10-02 16:02:36,130 INFO [Listener at localhost/38719] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-10-02 16:02:36,133 INFO [Listener at localhost/38719] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-10-02 16:02:36,538 INFO [Listener at localhost/38719] util.FSUtils(471): Created version file at hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af with version=8 2023-10-02 16:02:36,538 INFO [Listener at localhost/38719] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/hbase-staging 2023-10-02 16:02:36,947 INFO [Listener at localhost/38719] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl 2023-10-02 16:02:37,741 INFO [Listener at localhost/38719] client.ConnectionUtils(127): master/jenkins-hbase4:0 server-side Connection retries=45 2023-10-02 16:02:37,788 INFO [Listener at localhost/38719] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-10-02 16:02:37,788 INFO [Listener at localhost/38719] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-10-02 16:02:37,789 INFO [Listener at localhost/38719] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-10-02 16:02:37,789 INFO [Listener at localhost/38719] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-10-02 16:02:37,789 INFO [Listener at localhost/38719] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-10-02 16:02:38,005 INFO [Listener at localhost/38719] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-10-02 16:02:38,097 DEBUG [Listener at localhost/38719] util.ClassSize(228): Using Unsafe to estimate memory layout 2023-10-02 16:02:38,252 INFO [Listener at localhost/38719] ipc.NettyRpcServer(120): Bind to /172.31.14.131:44227 2023-10-02 16:02:38,272 INFO [Listener at localhost/38719] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-10-02 16:02:38,275 INFO [Listener at localhost/38719] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-10-02 16:02:38,315 INFO [Listener at localhost/38719] zookeeper.RecoverableZooKeeper(93): Process identifier=master:44227 connecting to ZooKeeper ensemble=127.0.0.1:50210 2023-10-02 16:02:38,472 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): master:442270x0, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-10-02 16:02:38,495 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): master:44227-0x10107dfc1490000 connected 2023-10-02 16:02:38,572 DEBUG [Listener at localhost/38719] zookeeper.ZKUtil(164): master:44227-0x10107dfc1490000, quorum=127.0.0.1:50210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-10-02 16:02:38,573 DEBUG [Listener at localhost/38719] zookeeper.ZKUtil(164): master:44227-0x10107dfc1490000, quorum=127.0.0.1:50210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-10-02 16:02:38,594 DEBUG [Listener at localhost/38719] zookeeper.ZKUtil(164): master:44227-0x10107dfc1490000, quorum=127.0.0.1:50210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-10-02 16:02:38,609 DEBUG [Listener at localhost/38719] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=44227 2023-10-02 16:02:38,621 DEBUG [Listener at localhost/38719] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=44227 2023-10-02 16:02:38,641 DEBUG [Listener at localhost/38719] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=44227 2023-10-02 16:02:38,670 DEBUG [Listener at localhost/38719] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=44227 2023-10-02 16:02:38,679 DEBUG [Listener at localhost/38719] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=44227 2023-10-02 16:02:38,698 INFO [Listener at localhost/38719] master.HMaster(444): hbase.rootdir=hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af, hbase.cluster.distributed=false 2023-10-02 16:02:38,836 INFO [Listener at localhost/38719] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-10-02 16:02:38,837 INFO [Listener at localhost/38719] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-10-02 16:02:38,837 INFO [Listener at localhost/38719] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-10-02 16:02:38,837 INFO [Listener at localhost/38719] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-10-02 16:02:38,837 INFO [Listener at localhost/38719] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-10-02 16:02:38,838 INFO [Listener at localhost/38719] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-10-02 16:02:38,845 INFO [Listener at localhost/38719] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-10-02 16:02:38,854 INFO [Listener at localhost/38719] ipc.NettyRpcServer(120): Bind to /172.31.14.131:43801 2023-10-02 16:02:38,858 INFO [Listener at localhost/38719] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-10-02 16:02:38,870 INFO [Listener at localhost/38719] mob.MobFileCache(125): MobFileCache disabled 2023-10-02 16:02:38,871 INFO [Listener at localhost/38719] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-10-02 16:02:38,875 INFO [Listener at localhost/38719] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-10-02 16:02:38,878 INFO [Listener at localhost/38719] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:43801 connecting to ZooKeeper ensemble=127.0.0.1:50210 2023-10-02 16:02:38,888 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): regionserver:438010x0, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-10-02 16:02:38,890 DEBUG [Listener at localhost/38719] zookeeper.ZKUtil(164): regionserver:43801-0x10107dfc1490001, quorum=127.0.0.1:50210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-10-02 16:02:38,890 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:43801-0x10107dfc1490001 connected 2023-10-02 16:02:38,891 DEBUG [Listener at localhost/38719] zookeeper.ZKUtil(164): regionserver:43801-0x10107dfc1490001, quorum=127.0.0.1:50210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-10-02 16:02:38,893 DEBUG [Listener at localhost/38719] zookeeper.ZKUtil(164): regionserver:43801-0x10107dfc1490001, quorum=127.0.0.1:50210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-10-02 16:02:38,893 DEBUG [Listener at localhost/38719] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=43801 2023-10-02 16:02:38,894 DEBUG [Listener at localhost/38719] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=43801 2023-10-02 16:02:38,894 DEBUG [Listener at localhost/38719] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=43801 2023-10-02 16:02:38,895 DEBUG [Listener at localhost/38719] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=43801 2023-10-02 16:02:38,895 DEBUG [Listener at localhost/38719] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=43801 2023-10-02 16:02:38,910 INFO [Listener at localhost/38719] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-10-02 16:02:38,910 INFO [Listener at localhost/38719] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-10-02 16:02:38,910 INFO [Listener at localhost/38719] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-10-02 16:02:38,911 INFO [Listener at localhost/38719] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-10-02 16:02:38,911 INFO [Listener at localhost/38719] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-10-02 16:02:38,911 INFO [Listener at localhost/38719] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-10-02 16:02:38,912 INFO [Listener at localhost/38719] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-10-02 16:02:38,914 INFO [Listener at localhost/38719] ipc.NettyRpcServer(120): Bind to /172.31.14.131:37455 2023-10-02 16:02:38,915 INFO [Listener at localhost/38719] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-10-02 16:02:38,917 INFO [Listener at localhost/38719] mob.MobFileCache(125): MobFileCache disabled 2023-10-02 16:02:38,918 INFO [Listener at localhost/38719] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-10-02 16:02:38,922 INFO [Listener at localhost/38719] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-10-02 16:02:38,926 INFO [Listener at localhost/38719] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:37455 connecting to ZooKeeper ensemble=127.0.0.1:50210 2023-10-02 16:02:38,931 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): regionserver:374550x0, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-10-02 16:02:38,932 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:37455-0x10107dfc1490002 connected 2023-10-02 16:02:38,932 DEBUG [Listener at localhost/38719] zookeeper.ZKUtil(164): regionserver:37455-0x10107dfc1490002, quorum=127.0.0.1:50210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-10-02 16:02:38,933 DEBUG [Listener at localhost/38719] zookeeper.ZKUtil(164): regionserver:37455-0x10107dfc1490002, quorum=127.0.0.1:50210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-10-02 16:02:38,934 DEBUG [Listener at localhost/38719] zookeeper.ZKUtil(164): regionserver:37455-0x10107dfc1490002, quorum=127.0.0.1:50210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-10-02 16:02:38,937 DEBUG [Listener at localhost/38719] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=37455 2023-10-02 16:02:38,937 DEBUG [Listener at localhost/38719] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=37455 2023-10-02 16:02:38,938 DEBUG [Listener at localhost/38719] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=37455 2023-10-02 16:02:38,942 DEBUG [Listener at localhost/38719] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=37455 2023-10-02 16:02:38,943 DEBUG [Listener at localhost/38719] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=37455 2023-10-02 16:02:38,957 INFO [Listener at localhost/38719] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-10-02 16:02:38,957 INFO [Listener at localhost/38719] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-10-02 16:02:38,958 INFO [Listener at localhost/38719] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-10-02 16:02:38,958 INFO [Listener at localhost/38719] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-10-02 16:02:38,958 INFO [Listener at localhost/38719] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-10-02 16:02:38,958 INFO [Listener at localhost/38719] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-10-02 16:02:38,958 INFO [Listener at localhost/38719] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-10-02 16:02:38,960 INFO [Listener at localhost/38719] ipc.NettyRpcServer(120): Bind to /172.31.14.131:42303 2023-10-02 16:02:38,960 INFO [Listener at localhost/38719] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-10-02 16:02:38,965 INFO [Listener at localhost/38719] mob.MobFileCache(125): MobFileCache disabled 2023-10-02 16:02:38,966 INFO [Listener at localhost/38719] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-10-02 16:02:38,969 INFO [Listener at localhost/38719] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-10-02 16:02:38,972 INFO [Listener at localhost/38719] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:42303 connecting to ZooKeeper ensemble=127.0.0.1:50210 2023-10-02 16:02:38,976 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): regionserver:423030x0, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-10-02 16:02:38,978 DEBUG [Listener at localhost/38719] zookeeper.ZKUtil(164): regionserver:423030x0, quorum=127.0.0.1:50210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-10-02 16:02:38,979 DEBUG [Listener at localhost/38719] zookeeper.ZKUtil(164): regionserver:423030x0, quorum=127.0.0.1:50210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-10-02 16:02:38,981 DEBUG [Listener at localhost/38719] zookeeper.ZKUtil(164): regionserver:423030x0, quorum=127.0.0.1:50210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-10-02 16:02:38,982 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:42303-0x10107dfc1490003 connected 2023-10-02 16:02:38,985 DEBUG [Listener at localhost/38719] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=42303 2023-10-02 16:02:38,985 DEBUG [Listener at localhost/38719] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=42303 2023-10-02 16:02:38,989 DEBUG [Listener at localhost/38719] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=42303 2023-10-02 16:02:38,992 DEBUG [Listener at localhost/38719] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=42303 2023-10-02 16:02:38,993 DEBUG [Listener at localhost/38719] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=42303 2023-10-02 16:02:38,995 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2168): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase4.apache.org,44227,1696262556745 2023-10-02 16:02:39,008 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): master:44227-0x10107dfc1490000, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-10-02 16:02:39,010 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:44227-0x10107dfc1490000, quorum=127.0.0.1:50210, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase4.apache.org,44227,1696262556745 2023-10-02 16:02:39,037 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): regionserver:42303-0x10107dfc1490003, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-10-02 16:02:39,037 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): master:44227-0x10107dfc1490000, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-10-02 16:02:39,037 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): regionserver:37455-0x10107dfc1490002, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-10-02 16:02:39,037 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): regionserver:43801-0x10107dfc1490001, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-10-02 16:02:39,038 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): master:44227-0x10107dfc1490000, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-10-02 16:02:39,039 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:44227-0x10107dfc1490000, quorum=127.0.0.1:50210, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-10-02 16:02:39,042 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:44227-0x10107dfc1490000, quorum=127.0.0.1:50210, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-10-02 16:02:39,042 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(227): Deleting ZNode for /hbase/backup-masters/jenkins-hbase4.apache.org,44227,1696262556745 from backup master directory 2023-10-02 16:02:39,047 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): master:44227-0x10107dfc1490000, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase4.apache.org,44227,1696262556745 2023-10-02 16:02:39,047 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): master:44227-0x10107dfc1490000, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-10-02 16:02:39,048 WARN [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-10-02 16:02:39,048 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(237): Registered as active master=jenkins-hbase4.apache.org,44227,1696262556745 2023-10-02 16:02:39,052 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating data MemStoreChunkPool with chunk size 2 MB, max count 352, initial count 0 2023-10-02 16:02:39,053 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating index MemStoreChunkPool with chunk size 204.80 KB, max count 391, initial count 0 2023-10-02 16:02:39,171 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] util.FSUtils(620): Created cluster ID file at hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/hbase.id with ID: a11dc693-667a-41c2-ac3e-2a17ab665791 2023-10-02 16:02:39,216 INFO [master/jenkins-hbase4:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-10-02 16:02:39,234 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): master:44227-0x10107dfc1490000, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-10-02 16:02:39,298 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x45a45377 to 127.0.0.1:50210 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-02 16:02:39,338 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5eca1532, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-02 16:02:39,367 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-10-02 16:02:39,369 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-10-02 16:02:39,397 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(264): ClientProtocol::create wrong number of arguments, should be hadoop 3.2 or below 2023-10-02 16:02:39,397 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(270): ClientProtocol::create wrong number of arguments, should be hadoop 2.x 2023-10-02 16:02:39,399 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(279): can not find SHOULD_REPLICATE flag, should be hadoop 2.x java.lang.IllegalArgumentException: No enum constant org.apache.hadoop.fs.CreateFlag.SHOULD_REPLICATE at java.lang.Enum.valueOf(Enum.java:238) at org.apache.hadoop.fs.CreateFlag.valueOf(CreateFlag.java:63) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.loadShouldReplicateFlag(FanOutOneBlockAsyncDFSOutputHelper.java:277) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.(FanOutOneBlockAsyncDFSOutputHelper.java:304) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:139) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:855) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2193) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:528) at java.lang.Thread.run(Thread.java:750) 2023-10-02 16:02:39,405 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(243): No decryptEncryptedDataEncryptionKey method in DFSClient, should be hadoop version with HDFS-12396 java.lang.NoSuchMethodException: org.apache.hadoop.hdfs.DFSClient.decryptEncryptedDataEncryptionKey(org.apache.hadoop.fs.FileEncryptionInfo) at java.lang.Class.getDeclaredMethod(Class.java:2130) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelperWithoutHDFS12396(FanOutOneBlockAsyncDFSOutputSaslHelper.java:182) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelper(FanOutOneBlockAsyncDFSOutputSaslHelper.java:241) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.(FanOutOneBlockAsyncDFSOutputSaslHelper.java:252) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:140) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:855) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2193) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:528) at java.lang.Thread.run(Thread.java:750) 2023-10-02 16:02:39,407 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-10-02 16:02:39,469 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7693): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/MasterData/data/master/store-tmp 2023-10-02 16:02:39,513 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-02 16:02:39,513 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-10-02 16:02:39,513 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-10-02 16:02:39,513 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-10-02 16:02:39,514 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-10-02 16:02:39,514 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-10-02 16:02:39,514 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-10-02 16:02:39,514 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-10-02 16:02:39,516 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/MasterData/WALs/jenkins-hbase4.apache.org,44227,1696262556745 2023-10-02 16:02:39,539 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C44227%2C1696262556745, suffix=, logDir=hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/MasterData/WALs/jenkins-hbase4.apache.org,44227,1696262556745, archiveDir=hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/MasterData/oldWALs, maxLogs=10 2023-10-02 16:02:39,666 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:45007,DS-6c644a30-a172-46d5-a374-7a50c58e2ccd,DISK] 2023-10-02 16:02:39,670 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:42279,DS-6b551b8f-3d7c-461e-bafe-94fdd27cb007,DISK] 2023-10-02 16:02:39,659 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:34267,DS-9cfabd62-e832-42ed-ba21-f9823a5bca3d,DISK] 2023-10-02 16:02:39,694 DEBUG [RS-EventLoopGroup-5-1] asyncfs.ProtobufDecoder(123): Hadoop 3.2 and below use unshaded protobuf. java.lang.ClassNotFoundException: org.apache.hadoop.thirdparty.protobuf.MessageLite at java.net.URLClassLoader.findClass(URLClassLoader.java:387) at java.lang.ClassLoader.loadClass(ClassLoader.java:418) at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:352) at java.lang.ClassLoader.loadClass(ClassLoader.java:351) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.io.asyncfs.ProtobufDecoder.(ProtobufDecoder.java:118) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.processWriteBlockResponse(FanOutOneBlockAsyncDFSOutputHelper.java:340) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$100(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$4.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:424) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:557) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.addListener(DefaultPromise.java:185) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.initialize(FanOutOneBlockAsyncDFSOutputHelper.java:418) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$300(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:476) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:471) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:583) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:559) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:636) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setSuccess0(DefaultPromise.java:625) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.trySuccess(DefaultPromise.java:105) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPromise.trySuccess(DefaultChannelPromise.java:84) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.fulfillConnectPromise(AbstractEpollChannel.java:653) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:691) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-10-02 16:02:39,789 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/MasterData/WALs/jenkins-hbase4.apache.org,44227,1696262556745/jenkins-hbase4.apache.org%2C44227%2C1696262556745.1696262559555 2023-10-02 16:02:39,789 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:34267,DS-9cfabd62-e832-42ed-ba21-f9823a5bca3d,DISK], DatanodeInfoWithStorage[127.0.0.1:45007,DS-6c644a30-a172-46d5-a374-7a50c58e2ccd,DISK], DatanodeInfoWithStorage[127.0.0.1:42279,DS-6b551b8f-3d7c-461e-bafe-94fdd27cb007,DISK]] 2023-10-02 16:02:39,790 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7854): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-10-02 16:02:39,791 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-02 16:02:39,795 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7894): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-10-02 16:02:39,797 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7897): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-10-02 16:02:39,898 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-10-02 16:02:39,920 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-10-02 16:02:39,963 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-10-02 16:02:39,981 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-02 16:02:39,988 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-10-02 16:02:39,991 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-10-02 16:02:40,012 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1055): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-10-02 16:02:40,017 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-02 16:02:40,018 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1072): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65223707, jitterRate=-0.028091028332710266}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-10-02 16:02:40,018 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(965): Region open journal for 1595e783b53d99cd5eef43b6debb2682: 2023-10-02 16:02:40,020 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-10-02 16:02:40,053 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-10-02 16:02:40,053 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(561): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-10-02 16:02:40,056 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-10-02 16:02:40,058 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(581): Recovered RegionProcedureStore lease in 1 msec 2023-10-02 16:02:40,098 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(595): Loaded RegionProcedureStore in 39 msec 2023-10-02 16:02:40,098 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(96): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-10-02 16:02:40,132 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-10-02 16:02:40,140 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-10-02 16:02:40,168 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-10-02 16:02:40,173 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-10-02 16:02:40,175 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:44227-0x10107dfc1490000, quorum=127.0.0.1:50210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-10-02 16:02:40,182 INFO [master/jenkins-hbase4:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-10-02 16:02:40,186 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:44227-0x10107dfc1490000, quorum=127.0.0.1:50210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-10-02 16:02:40,190 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): master:44227-0x10107dfc1490000, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-10-02 16:02:40,192 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:44227-0x10107dfc1490000, quorum=127.0.0.1:50210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-10-02 16:02:40,193 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:44227-0x10107dfc1490000, quorum=127.0.0.1:50210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-10-02 16:02:40,208 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:44227-0x10107dfc1490000, quorum=127.0.0.1:50210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-10-02 16:02:40,213 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): regionserver:43801-0x10107dfc1490001, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-10-02 16:02:40,214 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): regionserver:37455-0x10107dfc1490002, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-10-02 16:02:40,214 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): master:44227-0x10107dfc1490000, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-10-02 16:02:40,214 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): regionserver:42303-0x10107dfc1490003, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-10-02 16:02:40,215 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): master:44227-0x10107dfc1490000, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-10-02 16:02:40,216 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(744): Active/primary master=jenkins-hbase4.apache.org,44227,1696262556745, sessionid=0x10107dfc1490000, setting cluster-up flag (Was=false) 2023-10-02 16:02:40,237 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): master:44227-0x10107dfc1490000, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-10-02 16:02:40,245 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-10-02 16:02:40,246 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,44227,1696262556745 2023-10-02 16:02:40,255 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): master:44227-0x10107dfc1490000, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-10-02 16:02:40,262 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-10-02 16:02:40,263 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,44227,1696262556745 2023-10-02 16:02:40,267 WARN [master/jenkins-hbase4:0:becomeActiveMaster] snapshot.SnapshotManager(304): Couldn't delete working snapshot directory: hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/.hbase-snapshot/.tmp 2023-10-02 16:02:40,313 INFO [RS:1;jenkins-hbase4:37455] regionserver.HRegionServer(951): ClusterId : a11dc693-667a-41c2-ac3e-2a17ab665791 2023-10-02 16:02:40,313 INFO [RS:0;jenkins-hbase4:43801] regionserver.HRegionServer(951): ClusterId : a11dc693-667a-41c2-ac3e-2a17ab665791 2023-10-02 16:02:40,321 INFO [RS:2;jenkins-hbase4:42303] regionserver.HRegionServer(951): ClusterId : a11dc693-667a-41c2-ac3e-2a17ab665791 2023-10-02 16:02:40,322 DEBUG [RS:0;jenkins-hbase4:43801] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-10-02 16:02:40,322 DEBUG [RS:2;jenkins-hbase4:42303] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-10-02 16:02:40,322 DEBUG [RS:1;jenkins-hbase4:37455] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-10-02 16:02:40,331 DEBUG [RS:2;jenkins-hbase4:42303] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-10-02 16:02:40,331 DEBUG [RS:0;jenkins-hbase4:43801] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-10-02 16:02:40,331 DEBUG [RS:1;jenkins-hbase4:37455] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-10-02 16:02:40,331 DEBUG [RS:2;jenkins-hbase4:42303] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-10-02 16:02:40,331 DEBUG [RS:0;jenkins-hbase4:43801] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-10-02 16:02:40,331 DEBUG [RS:1;jenkins-hbase4:37455] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-10-02 16:02:40,349 DEBUG [RS:1;jenkins-hbase4:37455] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-10-02 16:02:40,356 DEBUG [RS:2;jenkins-hbase4:42303] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-10-02 16:02:40,356 DEBUG [RS:0;jenkins-hbase4:43801] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-10-02 16:02:40,356 DEBUG [RS:1;jenkins-hbase4:37455] zookeeper.ReadOnlyZKClient(139): Connect 0x29c90dff to 127.0.0.1:50210 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-02 16:02:40,368 DEBUG [RS:2;jenkins-hbase4:42303] zookeeper.ReadOnlyZKClient(139): Connect 0x1c306437 to 127.0.0.1:50210 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-02 16:02:40,369 DEBUG [RS:0;jenkins-hbase4:43801] zookeeper.ReadOnlyZKClient(139): Connect 0x309db57c to 127.0.0.1:50210 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-02 16:02:40,385 DEBUG [RS:0;jenkins-hbase4:43801] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3e5a5d1f, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-02 16:02:40,389 DEBUG [RS:1;jenkins-hbase4:37455] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@270ee6b6, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-02 16:02:40,389 DEBUG [RS:0;jenkins-hbase4:43801] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3a65de0c, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-10-02 16:02:40,389 DEBUG [RS:2;jenkins-hbase4:42303] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@12f789c1, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-02 16:02:40,389 DEBUG [RS:2;jenkins-hbase4:42303] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@16c80f47, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-10-02 16:02:40,389 DEBUG [RS:1;jenkins-hbase4:37455] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2331668f, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-10-02 16:02:40,417 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2930): Registered master coprocessor service: service=AccessControlService 2023-10-02 16:02:40,421 DEBUG [RS:0;jenkins-hbase4:43801] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase4:43801 2023-10-02 16:02:40,422 DEBUG [RS:2;jenkins-hbase4:42303] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:2;jenkins-hbase4:42303 2023-10-02 16:02:40,423 INFO [master/jenkins-hbase4:0:becomeActiveMaster] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-10-02 16:02:40,424 INFO [master/jenkins-hbase4:0:becomeActiveMaster] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver loaded, priority=536870912. 2023-10-02 16:02:40,441 INFO [RS:0;jenkins-hbase4:43801] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-10-02 16:02:40,445 INFO [RS:0;jenkins-hbase4:43801] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-10-02 16:02:40,446 DEBUG [RS:0;jenkins-hbase4:43801] regionserver.HRegionServer(839): Registered regionserver coprocessor executorService: executorService=AccessControlService 2023-10-02 16:02:40,441 INFO [RS:2;jenkins-hbase4:42303] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-10-02 16:02:40,448 INFO [RS:2;jenkins-hbase4:42303] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-10-02 16:02:40,448 DEBUG [RS:2;jenkins-hbase4:42303] regionserver.HRegionServer(839): Registered regionserver coprocessor executorService: executorService=AccessControlService 2023-10-02 16:02:40,448 INFO [RS:2;jenkins-hbase4:42303] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-10-02 16:02:40,448 DEBUG [RS:2;jenkins-hbase4:42303] regionserver.HRegionServer(1022): About to register with Master. 2023-10-02 16:02:40,447 INFO [RS:0;jenkins-hbase4:43801] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-10-02 16:02:40,449 DEBUG [RS:0;jenkins-hbase4:43801] regionserver.HRegionServer(1022): About to register with Master. 2023-10-02 16:02:40,448 DEBUG [RS:1;jenkins-hbase4:37455] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:1;jenkins-hbase4:37455 2023-10-02 16:02:40,450 INFO [RS:1;jenkins-hbase4:37455] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-10-02 16:02:40,450 INFO [RS:1;jenkins-hbase4:37455] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-10-02 16:02:40,450 DEBUG [RS:1;jenkins-hbase4:37455] regionserver.HRegionServer(839): Registered regionserver coprocessor executorService: executorService=AccessControlService 2023-10-02 16:02:40,450 INFO [RS:1;jenkins-hbase4:37455] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-10-02 16:02:40,451 DEBUG [RS:1;jenkins-hbase4:37455] regionserver.HRegionServer(1022): About to register with Master. 2023-10-02 16:02:40,455 INFO [RS:2;jenkins-hbase4:42303] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,44227,1696262556745 with isa=jenkins-hbase4.apache.org/172.31.14.131:42303, startcode=1696262558956 2023-10-02 16:02:40,455 INFO [RS:1;jenkins-hbase4:37455] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,44227,1696262556745 with isa=jenkins-hbase4.apache.org/172.31.14.131:37455, startcode=1696262558909 2023-10-02 16:02:40,455 INFO [RS:0;jenkins-hbase4:43801] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,44227,1696262556745 with isa=jenkins-hbase4.apache.org/172.31.14.131:43801, startcode=1696262558835 2023-10-02 16:02:40,482 DEBUG [RS:2;jenkins-hbase4:42303] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-10-02 16:02:40,483 DEBUG [RS:1;jenkins-hbase4:37455] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-10-02 16:02:40,483 DEBUG [RS:0;jenkins-hbase4:43801] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-10-02 16:02:40,560 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1028): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-10-02 16:02:40,575 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-10-02 16:02:40,575 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-10-02 16:02:40,575 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-10-02 16:02:40,576 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-10-02 16:02:40,576 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase4:0, corePoolSize=10, maxPoolSize=10 2023-10-02 16:02:40,576 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-10-02 16:02:40,576 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:57937, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.2 (auth:SIMPLE), service=RegionServerStatusService 2023-10-02 16:02:40,576 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-10-02 16:02:40,576 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:42887, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.0 (auth:SIMPLE), service=RegionServerStatusService 2023-10-02 16:02:40,576 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:48347, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.1 (auth:SIMPLE), service=RegionServerStatusService 2023-10-02 16:02:40,577 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-10-02 16:02:40,587 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1696262590586 2023-10-02 16:02:40,589 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-10-02 16:02:40,592 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=44227] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server is not running yet at org.apache.hadoop.hbase.master.HMaster.checkServiceStarted(HMaster.java:2832) at org.apache.hadoop.hbase.master.MasterRpcServices.regionServerStartup(MasterRpcServices.java:579) at org.apache.hadoop.hbase.shaded.protobuf.generated.RegionServerStatusProtos$RegionServerStatusService$2.callBlockingMethod(RegionServerStatusProtos.java:15952) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-10-02 16:02:40,595 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-10-02 16:02:40,595 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-10-02 16:02:40,602 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-10-02 16:02:40,603 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=44227] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server is not running yet at org.apache.hadoop.hbase.master.HMaster.checkServiceStarted(HMaster.java:2832) at org.apache.hadoop.hbase.master.MasterRpcServices.regionServerStartup(MasterRpcServices.java:579) at org.apache.hadoop.hbase.shaded.protobuf.generated.RegionServerStatusProtos$RegionServerStatusService$2.callBlockingMethod(RegionServerStatusProtos.java:15952) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-10-02 16:02:40,608 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-10-02 16:02:40,609 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=44227] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server is not running yet at org.apache.hadoop.hbase.master.HMaster.checkServiceStarted(HMaster.java:2832) at org.apache.hadoop.hbase.master.MasterRpcServices.regionServerStartup(MasterRpcServices.java:579) at org.apache.hadoop.hbase.shaded.protobuf.generated.RegionServerStatusProtos$RegionServerStatusService$2.callBlockingMethod(RegionServerStatusProtos.java:15952) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-10-02 16:02:40,616 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-10-02 16:02:40,617 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-10-02 16:02:40,618 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-10-02 16:02:40,618 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-10-02 16:02:40,618 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-10-02 16:02:40,620 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-10-02 16:02:40,623 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-10-02 16:02:40,623 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-10-02 16:02:40,627 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-10-02 16:02:40,627 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-10-02 16:02:40,633 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1696262560629,5,FailOnTimeoutGroup] 2023-10-02 16:02:40,633 DEBUG [RS:2;jenkins-hbase4:42303] regionserver.HRegionServer(2830): Master is not running yet 2023-10-02 16:02:40,633 DEBUG [RS:1;jenkins-hbase4:37455] regionserver.HRegionServer(2830): Master is not running yet 2023-10-02 16:02:40,633 WARN [RS:2;jenkins-hbase4:42303] regionserver.HRegionServer(1030): reportForDuty failed; sleeping 100 ms and then retrying. 2023-10-02 16:02:40,633 DEBUG [RS:0;jenkins-hbase4:43801] regionserver.HRegionServer(2830): Master is not running yet 2023-10-02 16:02:40,633 WARN [RS:1;jenkins-hbase4:37455] regionserver.HRegionServer(1030): reportForDuty failed; sleeping 100 ms and then retrying. 2023-10-02 16:02:40,634 WARN [RS:0;jenkins-hbase4:43801] regionserver.HRegionServer(1030): reportForDuty failed; sleeping 100 ms and then retrying. 2023-10-02 16:02:40,634 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1696262560633,5,FailOnTimeoutGroup] 2023-10-02 16:02:40,634 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-10-02 16:02:40,635 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1461): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-10-02 16:02:40,636 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-10-02 16:02:40,637 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-10-02 16:02:40,662 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-10-02 16:02:40,663 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-10-02 16:02:40,664 INFO [PEWorker-1] regionserver.HRegion(7675): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af 2023-10-02 16:02:40,697 DEBUG [PEWorker-1] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-02 16:02:40,700 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-10-02 16:02:40,704 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/data/hbase/meta/1588230740/info 2023-10-02 16:02:40,706 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-10-02 16:02:40,708 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-02 16:02:40,708 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-10-02 16:02:40,711 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/data/hbase/meta/1588230740/rep_barrier 2023-10-02 16:02:40,712 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-10-02 16:02:40,713 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-02 16:02:40,713 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-10-02 16:02:40,716 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/data/hbase/meta/1588230740/table 2023-10-02 16:02:40,717 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-10-02 16:02:40,718 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-02 16:02:40,719 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/data/hbase/meta/1588230740 2023-10-02 16:02:40,721 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/data/hbase/meta/1588230740 2023-10-02 16:02:40,724 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-10-02 16:02:40,735 INFO [RS:2;jenkins-hbase4:42303] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,44227,1696262556745 with isa=jenkins-hbase4.apache.org/172.31.14.131:42303, startcode=1696262558956 2023-10-02 16:02:40,735 INFO [RS:1;jenkins-hbase4:37455] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,44227,1696262556745 with isa=jenkins-hbase4.apache.org/172.31.14.131:37455, startcode=1696262558909 2023-10-02 16:02:40,735 DEBUG [PEWorker-1] regionserver.HRegion(1055): writing seq id for 1588230740 2023-10-02 16:02:40,736 INFO [RS:0;jenkins-hbase4:43801] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,44227,1696262556745 with isa=jenkins-hbase4.apache.org/172.31.14.131:43801, startcode=1696262558835 2023-10-02 16:02:40,744 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-02 16:02:40,745 INFO [PEWorker-1] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65360166, jitterRate=-0.02605763077735901}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-10-02 16:02:40,745 DEBUG [PEWorker-1] regionserver.HRegion(965): Region open journal for 1588230740: 2023-10-02 16:02:40,745 DEBUG [PEWorker-1] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-10-02 16:02:40,747 INFO [PEWorker-1] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-10-02 16:02:40,747 DEBUG [PEWorker-1] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-10-02 16:02:40,748 DEBUG [PEWorker-1] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-10-02 16:02:40,748 DEBUG [PEWorker-1] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-10-02 16:02:40,748 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=44227] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,42303,1696262558956 2023-10-02 16:02:40,758 INFO [PEWorker-1] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-10-02 16:02:40,758 DEBUG [PEWorker-1] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-10-02 16:02:40,763 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=44227] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,37455,1696262558909 2023-10-02 16:02:40,764 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=44227] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,43801,1696262558835 2023-10-02 16:02:40,766 DEBUG [RS:1;jenkins-hbase4:37455] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af 2023-10-02 16:02:40,767 DEBUG [RS:1;jenkins-hbase4:37455] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:42119 2023-10-02 16:02:40,767 DEBUG [RS:1;jenkins-hbase4:37455] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-10-02 16:02:40,765 DEBUG [RS:2;jenkins-hbase4:42303] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af 2023-10-02 16:02:40,772 DEBUG [RS:2;jenkins-hbase4:42303] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:42119 2023-10-02 16:02:40,772 DEBUG [RS:2;jenkins-hbase4:42303] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-10-02 16:02:40,775 DEBUG [RS:0;jenkins-hbase4:43801] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af 2023-10-02 16:02:40,775 DEBUG [RS:0;jenkins-hbase4:43801] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:42119 2023-10-02 16:02:40,775 DEBUG [RS:0;jenkins-hbase4:43801] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-10-02 16:02:40,775 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-10-02 16:02:40,775 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-10-02 16:02:40,781 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): master:44227-0x10107dfc1490000, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-10-02 16:02:40,787 DEBUG [RS:0;jenkins-hbase4:43801] zookeeper.ZKUtil(162): regionserver:43801-0x10107dfc1490001, quorum=127.0.0.1:50210, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,43801,1696262558835 2023-10-02 16:02:40,787 DEBUG [RS:1;jenkins-hbase4:37455] zookeeper.ZKUtil(162): regionserver:37455-0x10107dfc1490002, quorum=127.0.0.1:50210, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,37455,1696262558909 2023-10-02 16:02:40,787 WARN [RS:0;jenkins-hbase4:43801] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-10-02 16:02:40,787 DEBUG [RS:2;jenkins-hbase4:42303] zookeeper.ZKUtil(162): regionserver:42303-0x10107dfc1490003, quorum=127.0.0.1:50210, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,42303,1696262558956 2023-10-02 16:02:40,788 WARN [RS:2;jenkins-hbase4:42303] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-10-02 16:02:40,787 WARN [RS:1;jenkins-hbase4:37455] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-10-02 16:02:40,787 INFO [RS:0;jenkins-hbase4:43801] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-10-02 16:02:40,789 DEBUG [RS:0;jenkins-hbase4:43801] regionserver.HRegionServer(1948): logDir=hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/WALs/jenkins-hbase4.apache.org,43801,1696262558835 2023-10-02 16:02:40,789 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,37455,1696262558909] 2023-10-02 16:02:40,789 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,42303,1696262558956] 2023-10-02 16:02:40,790 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,43801,1696262558835] 2023-10-02 16:02:40,788 INFO [RS:2;jenkins-hbase4:42303] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-10-02 16:02:40,790 DEBUG [RS:2;jenkins-hbase4:42303] regionserver.HRegionServer(1948): logDir=hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/WALs/jenkins-hbase4.apache.org,42303,1696262558956 2023-10-02 16:02:40,790 INFO [RS:1;jenkins-hbase4:37455] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-10-02 16:02:40,791 DEBUG [RS:1;jenkins-hbase4:37455] regionserver.HRegionServer(1948): logDir=hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/WALs/jenkins-hbase4.apache.org,37455,1696262558909 2023-10-02 16:02:40,793 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-10-02 16:02:40,808 DEBUG [RS:0;jenkins-hbase4:43801] zookeeper.ZKUtil(162): regionserver:43801-0x10107dfc1490001, quorum=127.0.0.1:50210, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,37455,1696262558909 2023-10-02 16:02:40,808 DEBUG [RS:1;jenkins-hbase4:37455] zookeeper.ZKUtil(162): regionserver:37455-0x10107dfc1490002, quorum=127.0.0.1:50210, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,37455,1696262558909 2023-10-02 16:02:40,808 DEBUG [RS:2;jenkins-hbase4:42303] zookeeper.ZKUtil(162): regionserver:42303-0x10107dfc1490003, quorum=127.0.0.1:50210, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,37455,1696262558909 2023-10-02 16:02:40,809 DEBUG [RS:0;jenkins-hbase4:43801] zookeeper.ZKUtil(162): regionserver:43801-0x10107dfc1490001, quorum=127.0.0.1:50210, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,42303,1696262558956 2023-10-02 16:02:40,809 DEBUG [RS:1;jenkins-hbase4:37455] zookeeper.ZKUtil(162): regionserver:37455-0x10107dfc1490002, quorum=127.0.0.1:50210, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,42303,1696262558956 2023-10-02 16:02:40,809 DEBUG [RS:2;jenkins-hbase4:42303] zookeeper.ZKUtil(162): regionserver:42303-0x10107dfc1490003, quorum=127.0.0.1:50210, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,42303,1696262558956 2023-10-02 16:02:40,809 DEBUG [RS:0;jenkins-hbase4:43801] zookeeper.ZKUtil(162): regionserver:43801-0x10107dfc1490001, quorum=127.0.0.1:50210, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,43801,1696262558835 2023-10-02 16:02:40,810 DEBUG [RS:1;jenkins-hbase4:37455] zookeeper.ZKUtil(162): regionserver:37455-0x10107dfc1490002, quorum=127.0.0.1:50210, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,43801,1696262558835 2023-10-02 16:02:40,810 DEBUG [RS:2;jenkins-hbase4:42303] zookeeper.ZKUtil(162): regionserver:42303-0x10107dfc1490003, quorum=127.0.0.1:50210, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,43801,1696262558835 2023-10-02 16:02:40,816 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-10-02 16:02:40,821 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-10-02 16:02:40,827 DEBUG [RS:0;jenkins-hbase4:43801] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-10-02 16:02:40,827 DEBUG [RS:2;jenkins-hbase4:42303] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-10-02 16:02:40,827 DEBUG [RS:1;jenkins-hbase4:37455] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-10-02 16:02:40,839 INFO [RS:2;jenkins-hbase4:42303] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-10-02 16:02:40,839 INFO [RS:0;jenkins-hbase4:43801] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-10-02 16:02:40,839 INFO [RS:1;jenkins-hbase4:37455] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-10-02 16:02:40,867 INFO [RS:1;jenkins-hbase4:37455] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-10-02 16:02:40,867 INFO [RS:2;jenkins-hbase4:42303] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-10-02 16:02:40,867 INFO [RS:0;jenkins-hbase4:43801] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-10-02 16:02:40,873 INFO [RS:0;jenkins-hbase4:43801] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-10-02 16:02:40,873 INFO [RS:2;jenkins-hbase4:42303] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-10-02 16:02:40,873 INFO [RS:1;jenkins-hbase4:37455] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-10-02 16:02:40,874 INFO [RS:2;jenkins-hbase4:42303] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-10-02 16:02:40,874 INFO [RS:0;jenkins-hbase4:43801] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-10-02 16:02:40,874 INFO [RS:1;jenkins-hbase4:37455] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-10-02 16:02:40,879 INFO [RS:1;jenkins-hbase4:37455] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-10-02 16:02:40,879 INFO [RS:2;jenkins-hbase4:42303] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-10-02 16:02:40,879 INFO [RS:0;jenkins-hbase4:43801] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-10-02 16:02:40,890 INFO [RS:1;jenkins-hbase4:37455] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-10-02 16:02:40,890 INFO [RS:2;jenkins-hbase4:42303] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-10-02 16:02:40,890 INFO [RS:0;jenkins-hbase4:43801] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-10-02 16:02:40,890 DEBUG [RS:2;jenkins-hbase4:42303] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-10-02 16:02:40,890 DEBUG [RS:1;jenkins-hbase4:37455] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-10-02 16:02:40,891 DEBUG [RS:0;jenkins-hbase4:43801] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-10-02 16:02:40,891 DEBUG [RS:1;jenkins-hbase4:37455] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-10-02 16:02:40,891 DEBUG [RS:2;jenkins-hbase4:42303] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-10-02 16:02:40,891 DEBUG [RS:1;jenkins-hbase4:37455] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-10-02 16:02:40,891 DEBUG [RS:2;jenkins-hbase4:42303] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-10-02 16:02:40,891 DEBUG [RS:1;jenkins-hbase4:37455] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-10-02 16:02:40,891 DEBUG [RS:2;jenkins-hbase4:42303] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-10-02 16:02:40,891 DEBUG [RS:1;jenkins-hbase4:37455] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-10-02 16:02:40,891 DEBUG [RS:2;jenkins-hbase4:42303] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-10-02 16:02:40,891 DEBUG [RS:1;jenkins-hbase4:37455] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-10-02 16:02:40,892 DEBUG [RS:2;jenkins-hbase4:42303] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-10-02 16:02:40,891 DEBUG [RS:0;jenkins-hbase4:43801] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-10-02 16:02:40,892 DEBUG [RS:2;jenkins-hbase4:42303] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-10-02 16:02:40,892 DEBUG [RS:1;jenkins-hbase4:37455] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-10-02 16:02:40,892 DEBUG [RS:0;jenkins-hbase4:43801] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-10-02 16:02:40,892 DEBUG [RS:1;jenkins-hbase4:37455] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-10-02 16:02:40,892 DEBUG [RS:2;jenkins-hbase4:42303] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-10-02 16:02:40,892 DEBUG [RS:0;jenkins-hbase4:43801] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-10-02 16:02:40,892 DEBUG [RS:2;jenkins-hbase4:42303] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-10-02 16:02:40,892 DEBUG [RS:1;jenkins-hbase4:37455] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-10-02 16:02:40,892 DEBUG [RS:2;jenkins-hbase4:42303] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-10-02 16:02:40,892 DEBUG [RS:0;jenkins-hbase4:43801] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-10-02 16:02:40,893 DEBUG [RS:1;jenkins-hbase4:37455] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-10-02 16:02:40,893 DEBUG [RS:0;jenkins-hbase4:43801] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-10-02 16:02:40,893 DEBUG [RS:0;jenkins-hbase4:43801] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-10-02 16:02:40,894 DEBUG [RS:0;jenkins-hbase4:43801] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-10-02 16:02:40,894 DEBUG [RS:0;jenkins-hbase4:43801] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-10-02 16:02:40,894 INFO [RS:1;jenkins-hbase4:37455] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-10-02 16:02:40,894 DEBUG [RS:0;jenkins-hbase4:43801] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-10-02 16:02:40,894 INFO [RS:1;jenkins-hbase4:37455] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-10-02 16:02:40,894 INFO [RS:1;jenkins-hbase4:37455] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-10-02 16:02:40,899 INFO [RS:2;jenkins-hbase4:42303] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-10-02 16:02:40,900 INFO [RS:2;jenkins-hbase4:42303] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-10-02 16:02:40,900 INFO [RS:2;jenkins-hbase4:42303] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-10-02 16:02:40,901 INFO [RS:0;jenkins-hbase4:43801] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-10-02 16:02:40,901 INFO [RS:0;jenkins-hbase4:43801] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-10-02 16:02:40,901 INFO [RS:0;jenkins-hbase4:43801] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-10-02 16:02:40,921 INFO [RS:0;jenkins-hbase4:43801] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-10-02 16:02:40,921 INFO [RS:1;jenkins-hbase4:37455] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-10-02 16:02:40,921 INFO [RS:2;jenkins-hbase4:42303] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-10-02 16:02:40,926 INFO [RS:2;jenkins-hbase4:42303] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,42303,1696262558956-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-10-02 16:02:40,926 INFO [RS:0;jenkins-hbase4:43801] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,43801,1696262558835-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-10-02 16:02:40,926 INFO [RS:1;jenkins-hbase4:37455] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,37455,1696262558909-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-10-02 16:02:40,960 INFO [RS:0;jenkins-hbase4:43801] regionserver.Replication(203): jenkins-hbase4.apache.org,43801,1696262558835 started 2023-10-02 16:02:40,960 INFO [RS:0;jenkins-hbase4:43801] regionserver.HRegionServer(1637): Serving as jenkins-hbase4.apache.org,43801,1696262558835, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:43801, sessionid=0x10107dfc1490001 2023-10-02 16:02:40,960 DEBUG [RS:0;jenkins-hbase4:43801] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-10-02 16:02:40,960 DEBUG [RS:0;jenkins-hbase4:43801] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,43801,1696262558835 2023-10-02 16:02:40,961 DEBUG [RS:0;jenkins-hbase4:43801] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,43801,1696262558835' 2023-10-02 16:02:40,961 DEBUG [RS:0;jenkins-hbase4:43801] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-02 16:02:40,962 INFO [RS:2;jenkins-hbase4:42303] regionserver.Replication(203): jenkins-hbase4.apache.org,42303,1696262558956 started 2023-10-02 16:02:40,962 INFO [RS:2;jenkins-hbase4:42303] regionserver.HRegionServer(1637): Serving as jenkins-hbase4.apache.org,42303,1696262558956, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:42303, sessionid=0x10107dfc1490003 2023-10-02 16:02:40,963 INFO [RS:1;jenkins-hbase4:37455] regionserver.Replication(203): jenkins-hbase4.apache.org,37455,1696262558909 started 2023-10-02 16:02:40,963 INFO [RS:1;jenkins-hbase4:37455] regionserver.HRegionServer(1637): Serving as jenkins-hbase4.apache.org,37455,1696262558909, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:37455, sessionid=0x10107dfc1490002 2023-10-02 16:02:40,963 DEBUG [RS:1;jenkins-hbase4:37455] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-10-02 16:02:40,963 DEBUG [RS:1;jenkins-hbase4:37455] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,37455,1696262558909 2023-10-02 16:02:40,965 DEBUG [RS:2;jenkins-hbase4:42303] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-10-02 16:02:40,966 DEBUG [RS:0;jenkins-hbase4:43801] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-02 16:02:40,966 DEBUG [RS:2;jenkins-hbase4:42303] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,42303,1696262558956 2023-10-02 16:02:40,965 DEBUG [RS:1;jenkins-hbase4:37455] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,37455,1696262558909' 2023-10-02 16:02:40,967 DEBUG [RS:1;jenkins-hbase4:37455] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-02 16:02:40,967 DEBUG [RS:0;jenkins-hbase4:43801] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-10-02 16:02:40,967 DEBUG [RS:0;jenkins-hbase4:43801] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-10-02 16:02:40,967 DEBUG [RS:0;jenkins-hbase4:43801] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,43801,1696262558835 2023-10-02 16:02:40,967 DEBUG [RS:0;jenkins-hbase4:43801] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,43801,1696262558835' 2023-10-02 16:02:40,967 DEBUG [RS:1;jenkins-hbase4:37455] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-02 16:02:40,966 DEBUG [RS:2;jenkins-hbase4:42303] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,42303,1696262558956' 2023-10-02 16:02:40,968 DEBUG [RS:2;jenkins-hbase4:42303] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-02 16:02:40,967 DEBUG [RS:0;jenkins-hbase4:43801] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-02 16:02:40,968 DEBUG [RS:1;jenkins-hbase4:37455] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-10-02 16:02:40,968 DEBUG [RS:1;jenkins-hbase4:37455] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-10-02 16:02:40,968 DEBUG [RS:1;jenkins-hbase4:37455] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,37455,1696262558909 2023-10-02 16:02:40,969 DEBUG [RS:1;jenkins-hbase4:37455] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,37455,1696262558909' 2023-10-02 16:02:40,969 DEBUG [RS:1;jenkins-hbase4:37455] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-02 16:02:40,969 DEBUG [RS:2;jenkins-hbase4:42303] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-02 16:02:40,969 DEBUG [RS:0;jenkins-hbase4:43801] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-02 16:02:40,969 DEBUG [RS:1;jenkins-hbase4:37455] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-02 16:02:40,970 DEBUG [RS:2;jenkins-hbase4:42303] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-10-02 16:02:40,970 DEBUG [RS:2;jenkins-hbase4:42303] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-10-02 16:02:40,970 DEBUG [RS:2;jenkins-hbase4:42303] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,42303,1696262558956 2023-10-02 16:02:40,970 DEBUG [RS:1;jenkins-hbase4:37455] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-10-02 16:02:40,970 DEBUG [RS:2;jenkins-hbase4:42303] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,42303,1696262558956' 2023-10-02 16:02:40,970 INFO [RS:1;jenkins-hbase4:37455] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-10-02 16:02:40,970 DEBUG [RS:2;jenkins-hbase4:42303] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-02 16:02:40,970 INFO [RS:1;jenkins-hbase4:37455] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-10-02 16:02:40,971 DEBUG [RS:0;jenkins-hbase4:43801] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-10-02 16:02:40,971 DEBUG [RS:2;jenkins-hbase4:42303] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-02 16:02:40,971 INFO [RS:0;jenkins-hbase4:43801] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-10-02 16:02:40,971 INFO [RS:0;jenkins-hbase4:43801] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-10-02 16:02:40,974 DEBUG [RS:2;jenkins-hbase4:42303] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-10-02 16:02:40,974 INFO [RS:2;jenkins-hbase4:42303] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-10-02 16:02:40,974 INFO [RS:2;jenkins-hbase4:42303] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-10-02 16:02:40,979 DEBUG [jenkins-hbase4:44227] assignment.AssignmentManager(2176): Processing assignQueue; systemServersCount=3, allServersCount=3 2023-10-02 16:02:40,984 DEBUG [jenkins-hbase4:44227] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-10-02 16:02:40,991 DEBUG [jenkins-hbase4:44227] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-10-02 16:02:40,991 DEBUG [jenkins-hbase4:44227] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-10-02 16:02:40,991 DEBUG [jenkins-hbase4:44227] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-10-02 16:02:40,991 DEBUG [jenkins-hbase4:44227] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-10-02 16:02:40,995 INFO [PEWorker-3] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,42303,1696262558956, state=OPENING 2023-10-02 16:02:41,005 DEBUG [PEWorker-3] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-10-02 16:02:41,008 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): master:44227-0x10107dfc1490000, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-10-02 16:02:41,009 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-10-02 16:02:41,014 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,42303,1696262558956}] 2023-10-02 16:02:41,082 INFO [RS:0;jenkins-hbase4:43801] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C43801%2C1696262558835, suffix=, logDir=hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/WALs/jenkins-hbase4.apache.org,43801,1696262558835, archiveDir=hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/oldWALs, maxLogs=32 2023-10-02 16:02:41,082 INFO [RS:2;jenkins-hbase4:42303] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C42303%2C1696262558956, suffix=, logDir=hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/WALs/jenkins-hbase4.apache.org,42303,1696262558956, archiveDir=hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/oldWALs, maxLogs=32 2023-10-02 16:02:41,082 INFO [RS:1;jenkins-hbase4:37455] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C37455%2C1696262558909, suffix=, logDir=hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/WALs/jenkins-hbase4.apache.org,37455,1696262558909, archiveDir=hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/oldWALs, maxLogs=32 2023-10-02 16:02:41,116 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:42279,DS-6b551b8f-3d7c-461e-bafe-94fdd27cb007,DISK] 2023-10-02 16:02:41,116 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:45007,DS-6c644a30-a172-46d5-a374-7a50c58e2ccd,DISK] 2023-10-02 16:02:41,117 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:34267,DS-9cfabd62-e832-42ed-ba21-f9823a5bca3d,DISK] 2023-10-02 16:02:41,128 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:34267,DS-9cfabd62-e832-42ed-ba21-f9823a5bca3d,DISK] 2023-10-02 16:02:41,128 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:45007,DS-6c644a30-a172-46d5-a374-7a50c58e2ccd,DISK] 2023-10-02 16:02:41,128 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:42279,DS-6b551b8f-3d7c-461e-bafe-94fdd27cb007,DISK] 2023-10-02 16:02:41,129 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:42279,DS-6b551b8f-3d7c-461e-bafe-94fdd27cb007,DISK] 2023-10-02 16:02:41,129 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:34267,DS-9cfabd62-e832-42ed-ba21-f9823a5bca3d,DISK] 2023-10-02 16:02:41,129 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:45007,DS-6c644a30-a172-46d5-a374-7a50c58e2ccd,DISK] 2023-10-02 16:02:41,144 INFO [RS:1;jenkins-hbase4:37455] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/WALs/jenkins-hbase4.apache.org,37455,1696262558909/jenkins-hbase4.apache.org%2C37455%2C1696262558909.1696262561087 2023-10-02 16:02:41,149 DEBUG [RS:1;jenkins-hbase4:37455] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:42279,DS-6b551b8f-3d7c-461e-bafe-94fdd27cb007,DISK], DatanodeInfoWithStorage[127.0.0.1:34267,DS-9cfabd62-e832-42ed-ba21-f9823a5bca3d,DISK], DatanodeInfoWithStorage[127.0.0.1:45007,DS-6c644a30-a172-46d5-a374-7a50c58e2ccd,DISK]] 2023-10-02 16:02:41,150 INFO [RS:0;jenkins-hbase4:43801] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/WALs/jenkins-hbase4.apache.org,43801,1696262558835/jenkins-hbase4.apache.org%2C43801%2C1696262558835.1696262561087 2023-10-02 16:02:41,151 DEBUG [RS:0;jenkins-hbase4:43801] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:42279,DS-6b551b8f-3d7c-461e-bafe-94fdd27cb007,DISK], DatanodeInfoWithStorage[127.0.0.1:34267,DS-9cfabd62-e832-42ed-ba21-f9823a5bca3d,DISK], DatanodeInfoWithStorage[127.0.0.1:45007,DS-6c644a30-a172-46d5-a374-7a50c58e2ccd,DISK]] 2023-10-02 16:02:41,152 INFO [RS:2;jenkins-hbase4:42303] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/WALs/jenkins-hbase4.apache.org,42303,1696262558956/jenkins-hbase4.apache.org%2C42303%2C1696262558956.1696262561088 2023-10-02 16:02:41,153 DEBUG [RS:2;jenkins-hbase4:42303] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:45007,DS-6c644a30-a172-46d5-a374-7a50c58e2ccd,DISK], DatanodeInfoWithStorage[127.0.0.1:42279,DS-6b551b8f-3d7c-461e-bafe-94fdd27cb007,DISK], DatanodeInfoWithStorage[127.0.0.1:34267,DS-9cfabd62-e832-42ed-ba21-f9823a5bca3d,DISK]] 2023-10-02 16:02:41,210 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,42303,1696262558956 2023-10-02 16:02:41,212 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-10-02 16:02:41,216 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:36976, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-10-02 16:02:41,274 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:meta,,1.1588230740 2023-10-02 16:02:41,274 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-10-02 16:02:41,280 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C42303%2C1696262558956.meta, suffix=.meta, logDir=hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/WALs/jenkins-hbase4.apache.org,42303,1696262558956, archiveDir=hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/oldWALs, maxLogs=32 2023-10-02 16:02:41,318 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:42279,DS-6b551b8f-3d7c-461e-bafe-94fdd27cb007,DISK] 2023-10-02 16:02:41,320 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:34267,DS-9cfabd62-e832-42ed-ba21-f9823a5bca3d,DISK] 2023-10-02 16:02:41,320 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:45007,DS-6c644a30-a172-46d5-a374-7a50c58e2ccd,DISK] 2023-10-02 16:02:41,332 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/WALs/jenkins-hbase4.apache.org,42303,1696262558956/jenkins-hbase4.apache.org%2C42303%2C1696262558956.meta.1696262561282.meta 2023-10-02 16:02:41,332 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:42279,DS-6b551b8f-3d7c-461e-bafe-94fdd27cb007,DISK], DatanodeInfoWithStorage[127.0.0.1:34267,DS-9cfabd62-e832-42ed-ba21-f9823a5bca3d,DISK], DatanodeInfoWithStorage[127.0.0.1:45007,DS-6c644a30-a172-46d5-a374-7a50c58e2ccd,DISK]] 2023-10-02 16:02:41,333 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-10-02 16:02:41,334 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:meta,,1 service=AccessControlService 2023-10-02 16:02:41,335 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-10-02 16:02:41,336 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-10-02 16:02:41,338 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-10-02 16:02:41,340 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-10-02 16:02:41,354 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-10-02 16:02:41,354 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-02 16:02:41,354 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 1588230740 2023-10-02 16:02:41,354 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 1588230740 2023-10-02 16:02:41,358 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-10-02 16:02:41,360 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/data/hbase/meta/1588230740/info 2023-10-02 16:02:41,360 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/data/hbase/meta/1588230740/info 2023-10-02 16:02:41,361 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-10-02 16:02:41,362 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-02 16:02:41,362 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-10-02 16:02:41,364 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/data/hbase/meta/1588230740/rep_barrier 2023-10-02 16:02:41,364 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/data/hbase/meta/1588230740/rep_barrier 2023-10-02 16:02:41,365 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-10-02 16:02:41,366 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-02 16:02:41,366 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-10-02 16:02:41,368 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/data/hbase/meta/1588230740/table 2023-10-02 16:02:41,368 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/data/hbase/meta/1588230740/table 2023-10-02 16:02:41,369 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-10-02 16:02:41,370 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-02 16:02:41,372 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/data/hbase/meta/1588230740 2023-10-02 16:02:41,375 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/data/hbase/meta/1588230740 2023-10-02 16:02:41,379 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-10-02 16:02:41,384 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 1588230740 2023-10-02 16:02:41,387 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61100927, jitterRate=-0.0895252376794815}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-10-02 16:02:41,390 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 1588230740: 2023-10-02 16:02:41,404 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1696262561201 2023-10-02 16:02:41,429 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:meta,,1.1588230740 2023-10-02 16:02:41,430 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:meta,,1.1588230740 2023-10-02 16:02:41,431 INFO [PEWorker-5] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,42303,1696262558956, state=OPEN 2023-10-02 16:02:41,435 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): master:44227-0x10107dfc1490000, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-10-02 16:02:41,435 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-10-02 16:02:41,443 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=3, resume processing ppid=2 2023-10-02 16:02:41,443 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,42303,1696262558956 in 421 msec 2023-10-02 16:02:41,458 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=2, resume processing ppid=1 2023-10-02 16:02:41,459 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 653 msec 2023-10-02 16:02:41,467 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 1.0310 sec 2023-10-02 16:02:41,467 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(953): Wait for region servers to report in: status=null, state=RUNNING, startTime=1696262561467, completionTime=-1 2023-10-02 16:02:41,467 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=3; waited=0ms, expected min=3 server(s), max=3 server(s), master is running 2023-10-02 16:02:41,468 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1517): Joining cluster... 2023-10-02 16:02:41,570 DEBUG [hconnection-0x646a4964-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-02 16:02:41,574 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:36980, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-02 16:02:41,602 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1529): Number of RegionServers=3 2023-10-02 16:02:41,602 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1696262621602 2023-10-02 16:02:41,603 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1696262681603 2023-10-02 16:02:41,603 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1536): Joined the cluster in 135 msec 2023-10-02 16:02:41,638 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,44227,1696262556745-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-10-02 16:02:41,638 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,44227,1696262556745-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-10-02 16:02:41,638 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,44227,1696262556745-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-10-02 16:02:41,641 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase4:44227, period=300000, unit=MILLISECONDS is enabled. 2023-10-02 16:02:41,642 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-10-02 16:02:41,653 DEBUG [master/jenkins-hbase4:0.Chore.1] janitor.CatalogJanitor(175): 2023-10-02 16:02:41,661 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-10-02 16:02:41,662 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2148): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-10-02 16:02:41,672 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1028): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-10-02 16:02:41,676 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-10-02 16:02:41,679 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-10-02 16:02:41,708 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/.tmp/data/hbase/namespace/629418abee8c789ea807f30d3267c0ae 2023-10-02 16:02:41,711 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/.tmp/data/hbase/namespace/629418abee8c789ea807f30d3267c0ae empty. 2023-10-02 16:02:41,712 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/.tmp/data/hbase/namespace/629418abee8c789ea807f30d3267c0ae 2023-10-02 16:02:41,712 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-10-02 16:02:41,768 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-10-02 16:02:41,772 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7675): creating {ENCODED => 629418abee8c789ea807f30d3267c0ae, NAME => 'hbase:namespace,,1696262561661.629418abee8c789ea807f30d3267c0ae.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/.tmp 2023-10-02 16:02:41,802 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1696262561661.629418abee8c789ea807f30d3267c0ae.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-02 16:02:41,802 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1604): Closing 629418abee8c789ea807f30d3267c0ae, disabling compactions & flushes 2023-10-02 16:02:41,802 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1696262561661.629418abee8c789ea807f30d3267c0ae. 2023-10-02 16:02:41,803 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1696262561661.629418abee8c789ea807f30d3267c0ae. 2023-10-02 16:02:41,803 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1696262561661.629418abee8c789ea807f30d3267c0ae. after waiting 0 ms 2023-10-02 16:02:41,803 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1696262561661.629418abee8c789ea807f30d3267c0ae. 2023-10-02 16:02:41,803 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1838): Closed hbase:namespace,,1696262561661.629418abee8c789ea807f30d3267c0ae. 2023-10-02 16:02:41,803 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1558): Region close journal for 629418abee8c789ea807f30d3267c0ae: 2023-10-02 16:02:41,809 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-10-02 16:02:41,828 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1696262561661.629418abee8c789ea807f30d3267c0ae.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1696262561813"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696262561813"}]},"ts":"1696262561813"} 2023-10-02 16:02:41,867 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-10-02 16:02:41,872 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-10-02 16:02:41,878 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696262561872"}]},"ts":"1696262561872"} 2023-10-02 16:02:41,884 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-10-02 16:02:41,888 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-10-02 16:02:41,890 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-10-02 16:02:41,890 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-10-02 16:02:41,890 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-10-02 16:02:41,890 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-10-02 16:02:41,893 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=629418abee8c789ea807f30d3267c0ae, ASSIGN}] 2023-10-02 16:02:41,898 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=629418abee8c789ea807f30d3267c0ae, ASSIGN 2023-10-02 16:02:41,901 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=629418abee8c789ea807f30d3267c0ae, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,42303,1696262558956; forceNewPlan=false, retain=false 2023-10-02 16:02:42,053 INFO [jenkins-hbase4:44227] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-10-02 16:02:42,055 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=629418abee8c789ea807f30d3267c0ae, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,42303,1696262558956 2023-10-02 16:02:42,055 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1696262561661.629418abee8c789ea807f30d3267c0ae.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1696262562054"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696262562054"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696262562054"}]},"ts":"1696262562054"} 2023-10-02 16:02:42,060 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure 629418abee8c789ea807f30d3267c0ae, server=jenkins-hbase4.apache.org,42303,1696262558956}] 2023-10-02 16:02:42,242 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:namespace,,1696262561661.629418abee8c789ea807f30d3267c0ae. 2023-10-02 16:02:42,243 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 629418abee8c789ea807f30d3267c0ae, NAME => 'hbase:namespace,,1696262561661.629418abee8c789ea807f30d3267c0ae.', STARTKEY => '', ENDKEY => ''} 2023-10-02 16:02:42,243 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:namespace,,1696262561661.629418abee8c789ea807f30d3267c0ae. service=AccessControlService 2023-10-02 16:02:42,244 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-10-02 16:02:42,245 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace 629418abee8c789ea807f30d3267c0ae 2023-10-02 16:02:42,245 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1696262561661.629418abee8c789ea807f30d3267c0ae.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-02 16:02:42,246 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 629418abee8c789ea807f30d3267c0ae 2023-10-02 16:02:42,246 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 629418abee8c789ea807f30d3267c0ae 2023-10-02 16:02:42,249 INFO [StoreOpener-629418abee8c789ea807f30d3267c0ae-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 629418abee8c789ea807f30d3267c0ae 2023-10-02 16:02:42,254 DEBUG [StoreOpener-629418abee8c789ea807f30d3267c0ae-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/data/hbase/namespace/629418abee8c789ea807f30d3267c0ae/info 2023-10-02 16:02:42,254 DEBUG [StoreOpener-629418abee8c789ea807f30d3267c0ae-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/data/hbase/namespace/629418abee8c789ea807f30d3267c0ae/info 2023-10-02 16:02:42,255 INFO [StoreOpener-629418abee8c789ea807f30d3267c0ae-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 629418abee8c789ea807f30d3267c0ae columnFamilyName info 2023-10-02 16:02:42,256 INFO [StoreOpener-629418abee8c789ea807f30d3267c0ae-1] regionserver.HStore(310): Store=629418abee8c789ea807f30d3267c0ae/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-02 16:02:42,260 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/data/hbase/namespace/629418abee8c789ea807f30d3267c0ae 2023-10-02 16:02:42,269 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/data/hbase/namespace/629418abee8c789ea807f30d3267c0ae 2023-10-02 16:02:42,284 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 629418abee8c789ea807f30d3267c0ae 2023-10-02 16:02:42,303 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/data/hbase/namespace/629418abee8c789ea807f30d3267c0ae/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-02 16:02:42,305 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 629418abee8c789ea807f30d3267c0ae; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64374042, jitterRate=-0.040752023458480835}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-10-02 16:02:42,306 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 629418abee8c789ea807f30d3267c0ae: 2023-10-02 16:02:42,311 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:namespace,,1696262561661.629418abee8c789ea807f30d3267c0ae., pid=6, masterSystemTime=1696262562217 2023-10-02 16:02:42,316 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:namespace,,1696262561661.629418abee8c789ea807f30d3267c0ae. 2023-10-02 16:02:42,316 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:namespace,,1696262561661.629418abee8c789ea807f30d3267c0ae. 2023-10-02 16:02:42,318 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=629418abee8c789ea807f30d3267c0ae, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,42303,1696262558956 2023-10-02 16:02:42,319 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1696262561661.629418abee8c789ea807f30d3267c0ae.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1696262562318"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1696262562318"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1696262562318"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1696262562318"}]},"ts":"1696262562318"} 2023-10-02 16:02:42,334 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=6, resume processing ppid=5 2023-10-02 16:02:42,334 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure 629418abee8c789ea807f30d3267c0ae, server=jenkins-hbase4.apache.org,42303,1696262558956 in 265 msec 2023-10-02 16:02:42,340 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=5, resume processing ppid=4 2023-10-02 16:02:42,342 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=629418abee8c789ea807f30d3267c0ae, ASSIGN in 441 msec 2023-10-02 16:02:42,345 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-10-02 16:02:42,345 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696262562345"}]},"ts":"1696262562345"} 2023-10-02 16:02:42,349 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-10-02 16:02:42,354 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-10-02 16:02:42,365 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 691 msec 2023-10-02 16:02:42,379 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:44227-0x10107dfc1490000, quorum=127.0.0.1:50210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-10-02 16:02:42,380 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): master:44227-0x10107dfc1490000, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-10-02 16:02:42,381 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): master:44227-0x10107dfc1490000, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-10-02 16:02:42,440 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1028): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-10-02 16:02:42,482 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): master:44227-0x10107dfc1490000, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-10-02 16:02:42,506 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 80 msec 2023-10-02 16:02:42,522 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1028): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-10-02 16:02:42,560 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): master:44227-0x10107dfc1490000, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-10-02 16:02:42,586 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 58 msec 2023-10-02 16:02:42,637 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): master:44227-0x10107dfc1490000, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-10-02 16:02:42,665 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): master:44227-0x10107dfc1490000, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-10-02 16:02:42,668 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1083): Master has completed initialization 3.620sec 2023-10-02 16:02:42,680 INFO [master/jenkins-hbase4:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-10-02 16:02:42,682 INFO [master/jenkins-hbase4:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-10-02 16:02:42,682 INFO [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-10-02 16:02:42,684 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,44227,1696262556745-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-10-02 16:02:42,685 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,44227,1696262556745-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-10-02 16:02:42,719 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster$4(2112): Client=null/null create 'hbase:acl', {NAME => 'l', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-10-02 16:02:42,723 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1028): Stored pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:acl 2023-10-02 16:02:42,730 DEBUG [Listener at localhost/38719] zookeeper.ReadOnlyZKClient(139): Connect 0x627146cd to 127.0.0.1:50210 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-02 16:02:42,732 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_PRE_OPERATION 2023-10-02 16:02:42,738 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-10-02 16:02:42,748 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/.tmp/data/hbase/acl/ec420c8fac16838c0245735817757993 2023-10-02 16:02:42,748 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(700): Client=null/null procedure request for creating table: namespace: "hbase" qualifier: "acl" procId is: 9 2023-10-02 16:02:42,752 DEBUG [HFileArchiver-2] backup.HFileArchiver(153): Directory hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/.tmp/data/hbase/acl/ec420c8fac16838c0245735817757993 empty. 2023-10-02 16:02:42,761 DEBUG [HFileArchiver-2] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/.tmp/data/hbase/acl/ec420c8fac16838c0245735817757993 2023-10-02 16:02:42,761 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived hbase:acl regions 2023-10-02 16:02:42,761 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-10-02 16:02:42,763 DEBUG [Listener at localhost/38719] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@cba4ac7, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-02 16:02:42,868 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-10-02 16:02:42,885 DEBUG [hconnection-0x1eb93e1b-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-02 16:02:42,940 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:36992, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-02 16:02:42,981 INFO [Listener at localhost/38719] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase4.apache.org,44227,1696262556745 2023-10-02 16:02:42,981 INFO [Listener at localhost/38719] hbase.HBaseTestingUtility(2699): Starting mini mapreduce cluster... 2023-10-02 16:02:42,981 INFO [Listener at localhost/38719] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ec4ab044-456e-ce77-098f-f91b72a3e0ab/test.cache.data in system properties and HBase conf 2023-10-02 16:02:42,981 INFO [Listener at localhost/38719] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ec4ab044-456e-ce77-098f-f91b72a3e0ab/hadoop.tmp.dir in system properties and HBase conf 2023-10-02 16:02:42,981 INFO [Listener at localhost/38719] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ec4ab044-456e-ce77-098f-f91b72a3e0ab/hadoop.log.dir in system properties and HBase conf 2023-10-02 16:02:42,982 INFO [Listener at localhost/38719] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ec4ab044-456e-ce77-098f-f91b72a3e0ab/mapreduce.cluster.local.dir in system properties and HBase conf 2023-10-02 16:02:42,982 INFO [Listener at localhost/38719] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ec4ab044-456e-ce77-098f-f91b72a3e0ab/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-10-02 16:02:42,982 INFO [Listener at localhost/38719] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-10-02 16:02:42,982 INFO [Listener at localhost/38719] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ec4ab044-456e-ce77-098f-f91b72a3e0ab/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-10-02 16:02:42,982 INFO [Listener at localhost/38719] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ec4ab044-456e-ce77-098f-f91b72a3e0ab/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-10-02 16:02:42,982 INFO [Listener at localhost/38719] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ec4ab044-456e-ce77-098f-f91b72a3e0ab/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-10-02 16:02:42,982 INFO [Listener at localhost/38719] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ec4ab044-456e-ce77-098f-f91b72a3e0ab/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-10-02 16:02:42,983 INFO [Listener at localhost/38719] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ec4ab044-456e-ce77-098f-f91b72a3e0ab/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-10-02 16:02:42,983 INFO [Listener at localhost/38719] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ec4ab044-456e-ce77-098f-f91b72a3e0ab/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-10-02 16:02:42,983 INFO [Listener at localhost/38719] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ec4ab044-456e-ce77-098f-f91b72a3e0ab/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-10-02 16:02:42,983 INFO [Listener at localhost/38719] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ec4ab044-456e-ce77-098f-f91b72a3e0ab/dfs.journalnode.edits.dir in system properties and HBase conf 2023-10-02 16:02:42,983 INFO [Listener at localhost/38719] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ec4ab044-456e-ce77-098f-f91b72a3e0ab/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-10-02 16:02:42,983 INFO [Listener at localhost/38719] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ec4ab044-456e-ce77-098f-f91b72a3e0ab/nfs.dump.dir in system properties and HBase conf 2023-10-02 16:02:42,983 INFO [Listener at localhost/38719] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ec4ab044-456e-ce77-098f-f91b72a3e0ab/java.io.tmpdir in system properties and HBase conf 2023-10-02 16:02:42,983 INFO [Listener at localhost/38719] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ec4ab044-456e-ce77-098f-f91b72a3e0ab/dfs.journalnode.edits.dir in system properties and HBase conf 2023-10-02 16:02:42,983 INFO [Listener at localhost/38719] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ec4ab044-456e-ce77-098f-f91b72a3e0ab/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-10-02 16:02:42,984 INFO [Listener at localhost/38719] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ec4ab044-456e-ce77-098f-f91b72a3e0ab/fs.s3a.committer.staging.tmp.path in system properties and HBase conf 2023-10-02 16:02:42,991 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/.tmp/data/hbase/acl/.tabledesc/.tableinfo.0000000001 2023-10-02 16:02:43,018 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(7675): creating {ENCODED => ec420c8fac16838c0245735817757993, NAME => 'hbase:acl,,1696262562713.ec420c8fac16838c0245735817757993.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:acl', {NAME => 'l', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/.tmp 2023-10-02 16:02:43,068 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-10-02 16:02:43,196 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(866): Instantiated hbase:acl,,1696262562713.ec420c8fac16838c0245735817757993.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-02 16:02:43,206 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1604): Closing ec420c8fac16838c0245735817757993, disabling compactions & flushes 2023-10-02 16:02:43,206 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1626): Closing region hbase:acl,,1696262562713.ec420c8fac16838c0245735817757993. 2023-10-02 16:02:43,206 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:acl,,1696262562713.ec420c8fac16838c0245735817757993. 2023-10-02 16:02:43,206 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1714): Acquired close lock on hbase:acl,,1696262562713.ec420c8fac16838c0245735817757993. after waiting 0 ms 2023-10-02 16:02:43,206 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1724): Updates disabled for region hbase:acl,,1696262562713.ec420c8fac16838c0245735817757993. 2023-10-02 16:02:43,206 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1838): Closed hbase:acl,,1696262562713.ec420c8fac16838c0245735817757993. 2023-10-02 16:02:43,206 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1558): Region close journal for ec420c8fac16838c0245735817757993: 2023-10-02 16:02:43,225 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_ADD_TO_META 2023-10-02 16:02:43,230 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:acl,,1696262562713.ec420c8fac16838c0245735817757993.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1696262563230"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696262563230"}]},"ts":"1696262563230"} 2023-10-02 16:02:43,241 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-10-02 16:02:43,252 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-10-02 16:02:43,252 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:acl","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696262563252"}]},"ts":"1696262563252"} 2023-10-02 16:02:43,275 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=hbase:acl, state=ENABLING in hbase:meta 2023-10-02 16:02:43,287 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-10-02 16:02:43,291 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-10-02 16:02:43,291 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-10-02 16:02:43,291 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-10-02 16:02:43,291 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-10-02 16:02:43,292 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:acl, region=ec420c8fac16838c0245735817757993, ASSIGN}] 2023-10-02 16:02:43,308 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:acl, region=ec420c8fac16838c0245735817757993, ASSIGN 2023-10-02 16:02:43,321 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:acl, region=ec420c8fac16838c0245735817757993, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,42303,1696262558956; forceNewPlan=false, retain=false 2023-10-02 16:02:43,373 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-10-02 16:02:43,475 INFO [jenkins-hbase4:44227] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-10-02 16:02:43,476 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=ec420c8fac16838c0245735817757993, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,42303,1696262558956 2023-10-02 16:02:43,477 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:acl,,1696262562713.ec420c8fac16838c0245735817757993.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1696262563476"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696262563476"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696262563476"}]},"ts":"1696262563476"} 2023-10-02 16:02:43,485 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE; OpenRegionProcedure ec420c8fac16838c0245735817757993, server=jenkins-hbase4.apache.org,42303,1696262558956}] 2023-10-02 16:02:43,657 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:acl,,1696262562713.ec420c8fac16838c0245735817757993. 2023-10-02 16:02:43,658 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => ec420c8fac16838c0245735817757993, NAME => 'hbase:acl,,1696262562713.ec420c8fac16838c0245735817757993.', STARTKEY => '', ENDKEY => ''} 2023-10-02 16:02:43,658 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:acl,,1696262562713.ec420c8fac16838c0245735817757993. service=AccessControlService 2023-10-02 16:02:43,658 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-10-02 16:02:43,659 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table acl ec420c8fac16838c0245735817757993 2023-10-02 16:02:43,659 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:acl,,1696262562713.ec420c8fac16838c0245735817757993.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-02 16:02:43,659 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for ec420c8fac16838c0245735817757993 2023-10-02 16:02:43,659 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for ec420c8fac16838c0245735817757993 2023-10-02 16:02:43,662 INFO [StoreOpener-ec420c8fac16838c0245735817757993-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family l of region ec420c8fac16838c0245735817757993 2023-10-02 16:02:43,666 DEBUG [StoreOpener-ec420c8fac16838c0245735817757993-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/data/hbase/acl/ec420c8fac16838c0245735817757993/l 2023-10-02 16:02:43,666 DEBUG [StoreOpener-ec420c8fac16838c0245735817757993-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/data/hbase/acl/ec420c8fac16838c0245735817757993/l 2023-10-02 16:02:43,666 INFO [StoreOpener-ec420c8fac16838c0245735817757993-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region ec420c8fac16838c0245735817757993 columnFamilyName l 2023-10-02 16:02:43,668 INFO [StoreOpener-ec420c8fac16838c0245735817757993-1] regionserver.HStore(310): Store=ec420c8fac16838c0245735817757993/l, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-02 16:02:43,673 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/data/hbase/acl/ec420c8fac16838c0245735817757993 2023-10-02 16:02:43,675 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/data/hbase/acl/ec420c8fac16838c0245735817757993 2023-10-02 16:02:43,681 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for ec420c8fac16838c0245735817757993 2023-10-02 16:02:43,704 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/data/hbase/acl/ec420c8fac16838c0245735817757993/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-02 16:02:43,705 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened ec420c8fac16838c0245735817757993; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62733081, jitterRate=-0.06520424783229828}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-10-02 16:02:43,706 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for ec420c8fac16838c0245735817757993: 2023-10-02 16:02:43,721 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:acl,,1696262562713.ec420c8fac16838c0245735817757993., pid=11, masterSystemTime=1696262563649 2023-10-02 16:02:43,741 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=ec420c8fac16838c0245735817757993, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,42303,1696262558956 2023-10-02 16:02:43,741 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:acl,,1696262562713.ec420c8fac16838c0245735817757993.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1696262563740"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1696262563740"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1696262563740"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1696262563740"}]},"ts":"1696262563740"} 2023-10-02 16:02:43,742 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:acl,,1696262562713.ec420c8fac16838c0245735817757993. 2023-10-02 16:02:43,742 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:acl,,1696262562713.ec420c8fac16838c0245735817757993. 2023-10-02 16:02:43,756 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=11, resume processing ppid=10 2023-10-02 16:02:43,756 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=11, ppid=10, state=SUCCESS; OpenRegionProcedure ec420c8fac16838c0245735817757993, server=jenkins-hbase4.apache.org,42303,1696262558956 in 262 msec 2023-10-02 16:02:43,766 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=10, resume processing ppid=9 2023-10-02 16:02:43,767 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=10, ppid=9, state=SUCCESS; TransitRegionStateProcedure table=hbase:acl, region=ec420c8fac16838c0245735817757993, ASSIGN in 466 msec 2023-10-02 16:02:43,767 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-10-02 16:02:43,768 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:acl","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696262563767"}]},"ts":"1696262563767"} 2023-10-02 16:02:43,781 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:acl, state=ENABLED in hbase:meta 2023-10-02 16:02:43,796 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_POST_OPERATION 2023-10-02 16:02:43,801 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=9, state=SUCCESS; CreateTableProcedure table=hbase:acl in 1.0760 sec 2023-10-02 16:02:43,873 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-10-02 16:02:43,874 INFO [master/jenkins-hbase4:0:becomeActiveMaster] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: hbase:acl, procId: 9 completed 2023-10-02 16:02:43,933 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1175): Balancer post startup initialization complete, took 0 seconds 2023-10-02 16:02:45,109 WARN [Thread-383] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-10-02 16:02:45,685 INFO [Thread-383] log.Slf4jLog(67): jetty-6.1.26 2023-10-02 16:02:45,709 INFO [Thread-383] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/jobhistory to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ec4ab044-456e-ce77-098f-f91b72a3e0ab/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_33577_jobhistory____w542ji/webapp 2023-10-02 16:02:45,971 INFO [Thread-383] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.mapreduce.v2.hs.webapp.HsWebServices as a root resource class 2023-10-02 16:02:45,971 INFO [Thread-383] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.mapreduce.v2.hs.webapp.JAXBContextResolver as a provider class 2023-10-02 16:02:45,972 INFO [Thread-383] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-10-02 16:02:45,977 INFO [Thread-383] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-10-02 16:02:46,161 INFO [Thread-383] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.mapreduce.v2.hs.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-10-02 16:02:46,802 INFO [Thread-383] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-10-02 16:02:46,992 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-10-02 16:02:47,121 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:meta' 2023-10-02 16:02:47,123 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:namespace' 2023-10-02 16:02:47,124 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:acl' 2023-10-02 16:02:47,125 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.RegionServer.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-10-02 16:02:47,126 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.RegionServer.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase RegionServerObservers 2023-10-02 16:02:47,126 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-10-02 16:02:47,126 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase MasterObservers 2023-10-02 16:02:47,127 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver 2023-10-02 16:02:47,127 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver Metrics about HBase MasterObservers 2023-10-02 16:02:47,127 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-10-02 16:02:47,127 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase RegionObservers 2023-10-02 16:02:47,127 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-10-02 16:02:47,127 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint Metrics about HBase RegionObservers 2023-10-02 16:02:47,261 INFO [Thread-383] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.mapreduce.v2.hs.webapp.HsWebServices to GuiceManagedComponentProvider with the scope "PerRequest" 2023-10-02 16:02:47,309 INFO [Thread-383] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:33577 2023-10-02 16:02:48,249 WARN [Listener at jenkins-hbase4.apache.org/35641] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-10-02 16:02:48,396 WARN [Listener at jenkins-hbase4.apache.org/35641] servlet.GuiceFilter(87): Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected. 2023-10-02 16:02:48,397 INFO [Listener at jenkins-hbase4.apache.org/35641] log.Slf4jLog(67): jetty-6.1.26 2023-10-02 16:02:48,429 INFO [Listener at jenkins-hbase4.apache.org/35641] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/cluster to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ec4ab044-456e-ce77-098f-f91b72a3e0ab/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_41807_cluster____av132a/webapp 2023-10-02 16:02:48,552 INFO [Listener at jenkins-hbase4.apache.org/35641] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.server.resourcemanager.webapp.JAXBContextResolver as a provider class 2023-10-02 16:02:48,552 INFO [Listener at jenkins-hbase4.apache.org/35641] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.yarn.server.resourcemanager.webapp.RMWebServices as a root resource class 2023-10-02 16:02:48,553 INFO [Listener at jenkins-hbase4.apache.org/35641] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-10-02 16:02:48,553 INFO [Listener at jenkins-hbase4.apache.org/35641] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-10-02 16:02:48,574 INFO [Listener at jenkins-hbase4.apache.org/35641] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.resourcemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-10-02 16:02:48,853 INFO [Listener at jenkins-hbase4.apache.org/35641] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-10-02 16:02:48,982 INFO [Listener at jenkins-hbase4.apache.org/35641] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.resourcemanager.webapp.RMWebServices to GuiceManagedComponentProvider with the scope "Singleton" 2023-10-02 16:02:48,993 INFO [Listener at jenkins-hbase4.apache.org/35641] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:41807 2023-10-02 16:02:50,033 WARN [Listener at jenkins-hbase4.apache.org/42007] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-10-02 16:02:50,070 WARN [Listener at jenkins-hbase4.apache.org/42007] servlet.GuiceFilter(87): Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected. 2023-10-02 16:02:50,071 INFO [Listener at jenkins-hbase4.apache.org/42007] log.Slf4jLog(67): jetty-6.1.26 2023-10-02 16:02:50,086 INFO [Listener at jenkins-hbase4.apache.org/42007] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/node to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ec4ab044-456e-ce77-098f-f91b72a3e0ab/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_39807_node____.kx97l5/webapp 2023-10-02 16:02:50,166 INFO [Listener at jenkins-hbase4.apache.org/42007] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices as a root resource class 2023-10-02 16:02:50,166 INFO [Listener at jenkins-hbase4.apache.org/42007] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-10-02 16:02:50,167 INFO [Listener at jenkins-hbase4.apache.org/42007] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver as a provider class 2023-10-02 16:02:50,167 INFO [Listener at jenkins-hbase4.apache.org/42007] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-10-02 16:02:50,188 INFO [Listener at jenkins-hbase4.apache.org/42007] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-10-02 16:02:50,250 INFO [Listener at jenkins-hbase4.apache.org/42007] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-10-02 16:02:50,442 INFO [Listener at jenkins-hbase4.apache.org/42007] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices to GuiceManagedComponentProvider with the scope "Singleton" 2023-10-02 16:02:50,466 INFO [Listener at jenkins-hbase4.apache.org/42007] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:39807 2023-10-02 16:02:50,800 WARN [Listener at jenkins-hbase4.apache.org/32975] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-10-02 16:02:50,808 WARN [Listener at jenkins-hbase4.apache.org/32975] servlet.GuiceFilter(87): Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected. 2023-10-02 16:02:50,809 INFO [Listener at jenkins-hbase4.apache.org/32975] log.Slf4jLog(67): jetty-6.1.26 2023-10-02 16:02:50,824 INFO [Listener at jenkins-hbase4.apache.org/32975] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/node to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ec4ab044-456e-ce77-098f-f91b72a3e0ab/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_33435_node____.6vxpcc/webapp 2023-10-02 16:02:50,889 INFO [Listener at jenkins-hbase4.apache.org/32975] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices as a root resource class 2023-10-02 16:02:50,889 INFO [Listener at jenkins-hbase4.apache.org/32975] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-10-02 16:02:50,889 INFO [Listener at jenkins-hbase4.apache.org/32975] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver as a provider class 2023-10-02 16:02:50,889 INFO [Listener at jenkins-hbase4.apache.org/32975] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-10-02 16:02:50,902 INFO [Listener at jenkins-hbase4.apache.org/32975] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-10-02 16:02:50,936 INFO [Listener at jenkins-hbase4.apache.org/32975] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-10-02 16:02:51,057 INFO [Listener at jenkins-hbase4.apache.org/32975] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices to GuiceManagedComponentProvider with the scope "Singleton" 2023-10-02 16:02:51,078 INFO [Listener at jenkins-hbase4.apache.org/32975] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:33435 2023-10-02 16:02:51,123 INFO [Listener at jenkins-hbase4.apache.org/32975] hbase.HBaseTestingUtility(2726): Mini mapreduce cluster started 2023-10-02 16:02:51,126 INFO [Listener at jenkins-hbase4.apache.org/32975] hbase.Waiter(180): Waiting up to [30,000] milli-secs(wait.for.ratio=[1]) 2023-10-02 16:02:51,221 INFO [Listener at jenkins-hbase4.apache.org/32975] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testExportWithTargetName Thread=700, OpenFileDescriptor=903, MaxFileDescriptor=60000, SystemLoadAverage=500, ProcessCount=194, AvailableMemoryMB=253 2023-10-02 16:02:51,221 WARN [Listener at jenkins-hbase4.apache.org/32975] hbase.ResourceChecker(130): Thread=700 is superior to 500 2023-10-02 16:02:51,242 DEBUG [Listener at jenkins-hbase4.apache.org/32975] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-10-02 16:02:51,251 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:35270, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-10-02 16:02:51,264 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44227] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportWithTargetName', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-10-02 16:02:51,268 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44227] procedure2.ProcedureExecutor(1028): Stored pid=12, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportWithTargetName 2023-10-02 16:02:51,272 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_PRE_OPERATION 2023-10-02 16:02:51,276 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44227] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportWithTargetName" procId is: 12 2023-10-02 16:02:51,277 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-10-02 16:02:51,279 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44227] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-10-02 16:02:51,282 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/.tmp/data/default/testtb-testExportWithTargetName/0dce21880e3bd38446fdcc09c01710de 2023-10-02 16:02:51,284 DEBUG [HFileArchiver-3] backup.HFileArchiver(153): Directory hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/.tmp/data/default/testtb-testExportWithTargetName/0dce21880e3bd38446fdcc09c01710de empty. 2023-10-02 16:02:51,290 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/.tmp/data/default/testtb-testExportWithTargetName/a405b86bbfbe0589c4f6da2d89902060 2023-10-02 16:02:51,291 DEBUG [HFileArchiver-3] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/.tmp/data/default/testtb-testExportWithTargetName/0dce21880e3bd38446fdcc09c01710de 2023-10-02 16:02:51,295 DEBUG [HFileArchiver-4] backup.HFileArchiver(153): Directory hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/.tmp/data/default/testtb-testExportWithTargetName/a405b86bbfbe0589c4f6da2d89902060 empty. 2023-10-02 16:02:51,297 DEBUG [HFileArchiver-4] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/.tmp/data/default/testtb-testExportWithTargetName/a405b86bbfbe0589c4f6da2d89902060 2023-10-02 16:02:51,297 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testtb-testExportWithTargetName regions 2023-10-02 16:02:51,359 DEBUG [PEWorker-5] util.FSTableDescriptors(570): Wrote into hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/.tmp/data/default/testtb-testExportWithTargetName/.tabledesc/.tableinfo.0000000001 2023-10-02 16:02:51,361 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(7675): creating {ENCODED => 0dce21880e3bd38446fdcc09c01710de, NAME => 'testtb-testExportWithTargetName,,1696262571263.0dce21880e3bd38446fdcc09c01710de.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportWithTargetName', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/.tmp 2023-10-02 16:02:51,361 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(7675): creating {ENCODED => a405b86bbfbe0589c4f6da2d89902060, NAME => 'testtb-testExportWithTargetName,1,1696262571263.a405b86bbfbe0589c4f6da2d89902060.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportWithTargetName', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/.tmp 2023-10-02 16:02:51,386 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44227] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-10-02 16:02:51,438 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,,1696262571263.0dce21880e3bd38446fdcc09c01710de.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-02 16:02:51,439 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1604): Closing 0dce21880e3bd38446fdcc09c01710de, disabling compactions & flushes 2023-10-02 16:02:51,440 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,,1696262571263.0dce21880e3bd38446fdcc09c01710de. 2023-10-02 16:02:51,440 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,,1696262571263.0dce21880e3bd38446fdcc09c01710de. 2023-10-02 16:02:51,440 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,,1696262571263.0dce21880e3bd38446fdcc09c01710de. after waiting 0 ms 2023-10-02 16:02:51,440 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,,1696262571263.0dce21880e3bd38446fdcc09c01710de. 2023-10-02 16:02:51,440 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,,1696262571263.0dce21880e3bd38446fdcc09c01710de. 2023-10-02 16:02:51,440 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1558): Region close journal for 0dce21880e3bd38446fdcc09c01710de: 2023-10-02 16:02:51,453 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,1,1696262571263.a405b86bbfbe0589c4f6da2d89902060.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-02 16:02:51,453 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1604): Closing a405b86bbfbe0589c4f6da2d89902060, disabling compactions & flushes 2023-10-02 16:02:51,453 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,1,1696262571263.a405b86bbfbe0589c4f6da2d89902060. 2023-10-02 16:02:51,453 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,1,1696262571263.a405b86bbfbe0589c4f6da2d89902060. 2023-10-02 16:02:51,453 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,1,1696262571263.a405b86bbfbe0589c4f6da2d89902060. after waiting 0 ms 2023-10-02 16:02:51,454 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,1,1696262571263.a405b86bbfbe0589c4f6da2d89902060. 2023-10-02 16:02:51,454 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,1,1696262571263.a405b86bbfbe0589c4f6da2d89902060. 2023-10-02 16:02:51,454 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1558): Region close journal for a405b86bbfbe0589c4f6da2d89902060: 2023-10-02 16:02:51,465 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_ADD_TO_META 2023-10-02 16:02:51,467 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,,1696262571263.0dce21880e3bd38446fdcc09c01710de.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1696262571467"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696262571467"}]},"ts":"1696262571467"} 2023-10-02 16:02:51,467 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,1,1696262571263.a405b86bbfbe0589c4f6da2d89902060.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1696262571467"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696262571467"}]},"ts":"1696262571467"} 2023-10-02 16:02:51,526 INFO [PEWorker-5] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-10-02 16:02:51,528 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-10-02 16:02:51,528 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696262571528"}]},"ts":"1696262571528"} 2023-10-02 16:02:51,533 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=ENABLING in hbase:meta 2023-10-02 16:02:51,538 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-10-02 16:02:51,542 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-10-02 16:02:51,543 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-10-02 16:02:51,543 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-10-02 16:02:51,543 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-10-02 16:02:51,543 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=0dce21880e3bd38446fdcc09c01710de, ASSIGN}, {pid=14, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=a405b86bbfbe0589c4f6da2d89902060, ASSIGN}] 2023-10-02 16:02:51,547 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=0dce21880e3bd38446fdcc09c01710de, ASSIGN 2023-10-02 16:02:51,549 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=0dce21880e3bd38446fdcc09c01710de, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,42303,1696262558956; forceNewPlan=false, retain=false 2023-10-02 16:02:51,551 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=14, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=a405b86bbfbe0589c4f6da2d89902060, ASSIGN 2023-10-02 16:02:51,552 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=14, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=a405b86bbfbe0589c4f6da2d89902060, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,43801,1696262558835; forceNewPlan=false, retain=false 2023-10-02 16:02:51,600 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44227] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-10-02 16:02:51,700 INFO [jenkins-hbase4:44227] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-10-02 16:02:51,703 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=0dce21880e3bd38446fdcc09c01710de, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,42303,1696262558956 2023-10-02 16:02:51,703 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=a405b86bbfbe0589c4f6da2d89902060, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,43801,1696262558835 2023-10-02 16:02:51,704 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,,1696262571263.0dce21880e3bd38446fdcc09c01710de.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1696262571703"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696262571703"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696262571703"}]},"ts":"1696262571703"} 2023-10-02 16:02:51,704 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,1,1696262571263.a405b86bbfbe0589c4f6da2d89902060.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1696262571703"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696262571703"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696262571703"}]},"ts":"1696262571703"} 2023-10-02 16:02:51,710 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=15, ppid=14, state=RUNNABLE; OpenRegionProcedure a405b86bbfbe0589c4f6da2d89902060, server=jenkins-hbase4.apache.org,43801,1696262558835}] 2023-10-02 16:02:51,712 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=16, ppid=13, state=RUNNABLE; OpenRegionProcedure 0dce21880e3bd38446fdcc09c01710de, server=jenkins-hbase4.apache.org,42303,1696262558956}] 2023-10-02 16:02:51,866 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,43801,1696262558835 2023-10-02 16:02:51,867 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-10-02 16:02:51,874 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:39384, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-10-02 16:02:51,893 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportWithTargetName,,1696262571263.0dce21880e3bd38446fdcc09c01710de. 2023-10-02 16:02:51,893 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 0dce21880e3bd38446fdcc09c01710de, NAME => 'testtb-testExportWithTargetName,,1696262571263.0dce21880e3bd38446fdcc09c01710de.', STARTKEY => '', ENDKEY => '1'} 2023-10-02 16:02:51,894 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportWithTargetName,,1696262571263.0dce21880e3bd38446fdcc09c01710de. service=AccessControlService 2023-10-02 16:02:51,894 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-10-02 16:02:51,894 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportWithTargetName 0dce21880e3bd38446fdcc09c01710de 2023-10-02 16:02:51,895 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,,1696262571263.0dce21880e3bd38446fdcc09c01710de.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-02 16:02:51,895 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 0dce21880e3bd38446fdcc09c01710de 2023-10-02 16:02:51,895 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 0dce21880e3bd38446fdcc09c01710de 2023-10-02 16:02:51,901 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportWithTargetName,1,1696262571263.a405b86bbfbe0589c4f6da2d89902060. 2023-10-02 16:02:51,902 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => a405b86bbfbe0589c4f6da2d89902060, NAME => 'testtb-testExportWithTargetName,1,1696262571263.a405b86bbfbe0589c4f6da2d89902060.', STARTKEY => '1', ENDKEY => ''} 2023-10-02 16:02:51,902 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44227] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-10-02 16:02:51,902 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportWithTargetName,1,1696262571263.a405b86bbfbe0589c4f6da2d89902060. service=AccessControlService 2023-10-02 16:02:51,902 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-10-02 16:02:51,903 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportWithTargetName a405b86bbfbe0589c4f6da2d89902060 2023-10-02 16:02:51,903 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,1,1696262571263.a405b86bbfbe0589c4f6da2d89902060.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-02 16:02:51,903 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for a405b86bbfbe0589c4f6da2d89902060 2023-10-02 16:02:51,903 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for a405b86bbfbe0589c4f6da2d89902060 2023-10-02 16:02:51,915 INFO [StoreOpener-0dce21880e3bd38446fdcc09c01710de-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 0dce21880e3bd38446fdcc09c01710de 2023-10-02 16:02:51,915 INFO [StoreOpener-a405b86bbfbe0589c4f6da2d89902060-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region a405b86bbfbe0589c4f6da2d89902060 2023-10-02 16:02:51,919 DEBUG [StoreOpener-0dce21880e3bd38446fdcc09c01710de-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/data/default/testtb-testExportWithTargetName/0dce21880e3bd38446fdcc09c01710de/cf 2023-10-02 16:02:51,920 DEBUG [StoreOpener-a405b86bbfbe0589c4f6da2d89902060-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/data/default/testtb-testExportWithTargetName/a405b86bbfbe0589c4f6da2d89902060/cf 2023-10-02 16:02:51,920 DEBUG [StoreOpener-0dce21880e3bd38446fdcc09c01710de-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/data/default/testtb-testExportWithTargetName/0dce21880e3bd38446fdcc09c01710de/cf 2023-10-02 16:02:51,920 DEBUG [StoreOpener-a405b86bbfbe0589c4f6da2d89902060-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/data/default/testtb-testExportWithTargetName/a405b86bbfbe0589c4f6da2d89902060/cf 2023-10-02 16:02:51,925 INFO [StoreOpener-0dce21880e3bd38446fdcc09c01710de-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 0dce21880e3bd38446fdcc09c01710de columnFamilyName cf 2023-10-02 16:02:51,925 INFO [StoreOpener-a405b86bbfbe0589c4f6da2d89902060-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region a405b86bbfbe0589c4f6da2d89902060 columnFamilyName cf 2023-10-02 16:02:51,931 INFO [StoreOpener-0dce21880e3bd38446fdcc09c01710de-1] regionserver.HStore(310): Store=0dce21880e3bd38446fdcc09c01710de/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-02 16:02:51,934 INFO [StoreOpener-a405b86bbfbe0589c4f6da2d89902060-1] regionserver.HStore(310): Store=a405b86bbfbe0589c4f6da2d89902060/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-02 16:02:51,937 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/data/default/testtb-testExportWithTargetName/a405b86bbfbe0589c4f6da2d89902060 2023-10-02 16:02:51,938 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/data/default/testtb-testExportWithTargetName/a405b86bbfbe0589c4f6da2d89902060 2023-10-02 16:02:51,941 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/data/default/testtb-testExportWithTargetName/0dce21880e3bd38446fdcc09c01710de 2023-10-02 16:02:51,942 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/data/default/testtb-testExportWithTargetName/0dce21880e3bd38446fdcc09c01710de 2023-10-02 16:02:51,950 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for a405b86bbfbe0589c4f6da2d89902060 2023-10-02 16:02:51,952 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 0dce21880e3bd38446fdcc09c01710de 2023-10-02 16:02:51,971 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/data/default/testtb-testExportWithTargetName/0dce21880e3bd38446fdcc09c01710de/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-02 16:02:51,975 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/data/default/testtb-testExportWithTargetName/a405b86bbfbe0589c4f6da2d89902060/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-02 16:02:51,976 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened a405b86bbfbe0589c4f6da2d89902060; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64525318, jitterRate=-0.03849783539772034}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-10-02 16:02:51,976 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for a405b86bbfbe0589c4f6da2d89902060: 2023-10-02 16:02:51,977 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 0dce21880e3bd38446fdcc09c01710de; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63839510, jitterRate=-0.04871717095375061}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-10-02 16:02:51,977 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 0dce21880e3bd38446fdcc09c01710de: 2023-10-02 16:02:51,980 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportWithTargetName,1,1696262571263.a405b86bbfbe0589c4f6da2d89902060., pid=15, masterSystemTime=1696262571866 2023-10-02 16:02:51,989 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportWithTargetName,,1696262571263.0dce21880e3bd38446fdcc09c01710de., pid=16, masterSystemTime=1696262571869 2023-10-02 16:02:51,992 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=a405b86bbfbe0589c4f6da2d89902060, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,43801,1696262558835 2023-10-02 16:02:51,992 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportWithTargetName,1,1696262571263.a405b86bbfbe0589c4f6da2d89902060. 2023-10-02 16:02:51,992 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportWithTargetName,1,1696262571263.a405b86bbfbe0589c4f6da2d89902060.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1696262571991"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1696262571991"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1696262571991"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1696262571991"}]},"ts":"1696262571991"} 2023-10-02 16:02:51,997 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportWithTargetName,1,1696262571263.a405b86bbfbe0589c4f6da2d89902060. 2023-10-02 16:02:52,002 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=0dce21880e3bd38446fdcc09c01710de, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,42303,1696262558956 2023-10-02 16:02:52,004 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportWithTargetName,,1696262571263.0dce21880e3bd38446fdcc09c01710de. 2023-10-02 16:02:52,006 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportWithTargetName,,1696262571263.0dce21880e3bd38446fdcc09c01710de. 2023-10-02 16:02:52,008 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportWithTargetName,,1696262571263.0dce21880e3bd38446fdcc09c01710de.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1696262572002"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1696262572002"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1696262572002"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1696262572002"}]},"ts":"1696262572002"} 2023-10-02 16:02:52,017 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=15, resume processing ppid=14 2023-10-02 16:02:52,017 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=15, ppid=14, state=SUCCESS; OpenRegionProcedure a405b86bbfbe0589c4f6da2d89902060, server=jenkins-hbase4.apache.org,43801,1696262558835 in 293 msec 2023-10-02 16:02:52,024 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=14, ppid=12, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=a405b86bbfbe0589c4f6da2d89902060, ASSIGN in 475 msec 2023-10-02 16:02:52,027 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=16, resume processing ppid=13 2023-10-02 16:02:52,032 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=16, ppid=13, state=SUCCESS; OpenRegionProcedure 0dce21880e3bd38446fdcc09c01710de, server=jenkins-hbase4.apache.org,42303,1696262558956 in 303 msec 2023-10-02 16:02:52,041 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=13, resume processing ppid=12 2023-10-02 16:02:52,043 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=13, ppid=12, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=0dce21880e3bd38446fdcc09c01710de, ASSIGN in 489 msec 2023-10-02 16:02:52,045 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-10-02 16:02:52,046 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696262572045"}]},"ts":"1696262572045"} 2023-10-02 16:02:52,050 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=ENABLED in hbase:meta 2023-10-02 16:02:52,055 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_POST_OPERATION 2023-10-02 16:02:52,062 DEBUG [PEWorker-3] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportWithTargetName jenkins: RWXCA 2023-10-02 16:02:52,090 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=42303] access.PermissionStorage(611): Read acl: entry[testtb-testExportWithTargetName], kv [jenkins: RWXCA] 2023-10-02 16:02:52,139 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): master:44227-0x10107dfc1490000, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-10-02 16:02:52,139 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): regionserver:37455-0x10107dfc1490002, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-10-02 16:02:52,139 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): regionserver:43801-0x10107dfc1490001, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-10-02 16:02:52,140 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): regionserver:42303-0x10107dfc1490003, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-10-02 16:02:52,139 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): master:44227-0x10107dfc1490000, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-10-02 16:02:52,159 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): regionserver:37455-0x10107dfc1490002, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-10-02 16:02:52,159 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): regionserver:42303-0x10107dfc1490003, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-10-02 16:02:52,160 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): regionserver:43801-0x10107dfc1490001, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-10-02 16:02:52,161 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-10-02 16:02:52,162 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-10-02 16:02:52,165 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-10-02 16:02:52,165 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-10-02 16:02:52,166 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=12, state=SUCCESS; CreateTableProcedure table=testtb-testExportWithTargetName in 897 msec 2023-10-02 16:02:52,404 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44227] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-10-02 16:02:52,405 INFO [Listener at jenkins-hbase4.apache.org/32975] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportWithTargetName, procId: 12 completed 2023-10-02 16:02:52,412 DEBUG [Listener at jenkins-hbase4.apache.org/32975] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportWithTargetName 2023-10-02 16:02:52,413 DEBUG [Listener at jenkins-hbase4.apache.org/32975] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportWithTargetName,,1696262571263.0dce21880e3bd38446fdcc09c01710de. 2023-10-02 16:02:52,416 INFO [Listener at jenkins-hbase4.apache.org/32975] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-10-02 16:02:52,464 DEBUG [hconnection-0x1eb93e1b-shared-pool-5] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-02 16:02:52,474 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:39390, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-02 16:02:52,500 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44227] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-10-02 16:02:52,500 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44227] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1696262572500 (current time:1696262572500). 2023-10-02 16:02:52,500 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44227] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-10-02 16:02:52,502 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44227] zookeeper.ReadOnlyZKClient(139): Connect 0x2f4d9ce5 to 127.0.0.1:50210 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-02 16:02:52,524 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44227] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@380f4bab, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-02 16:02:52,527 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44227] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-02 16:02:52,534 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:34066, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-02 16:02:52,536 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44227] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x2f4d9ce5 to 127.0.0.1:50210 2023-10-02 16:02:52,536 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44227] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-02 16:02:52,540 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44227] zookeeper.ReadOnlyZKClient(139): Connect 0x2c5b4dfd to 127.0.0.1:50210 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-02 16:02:52,550 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44227] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@67a376e3, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-02 16:02:52,554 DEBUG [hconnection-0x5a6fc92c-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-02 16:02:52,558 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:34074, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-02 16:02:52,567 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44227] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x2c5b4dfd to 127.0.0.1:50210 2023-10-02 16:02:52,567 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44227] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-02 16:02:52,568 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44227] access.PermissionStorage(611): Read acl: entry[testtb-testExportWithTargetName], kv [jenkins: RWXCA] 2023-10-02 16:02:52,610 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44227] snapshot.SnapshotManager(637): No existing snapshot, attempting snapshot... 2023-10-02 16:02:52,613 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44227] snapshot.SnapshotManager(684): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-10-02 16:02:52,635 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44227] snapshot.SnapshotManager(519): Unable to retrieve ACL status for path: hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/.hbase-snapshot, current working dir path: hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName org.apache.hadoop.hdfs.protocol.AclException: The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.ipc.RemoteException.instantiateException(RemoteException.java:121) at org.apache.hadoop.ipc.RemoteException.unwrapRemoteException(RemoteException.java:88) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2736) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2294) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2291) at org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81) at org.apache.hadoop.hdfs.DistributedFileSystem.getAclStatus(DistributedFileSystem.java:2291) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.updateWorkingDirAclsIfRequired(SnapshotManager.java:517) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.prepareToTakeSnapshot(SnapshotManager.java:490) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.snapshotEnabledTable(SnapshotManager.java:559) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshotInternal(SnapshotManager.java:687) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshot(SnapshotManager.java:623) at org.apache.hadoop.hbase.master.MasterRpcServices.snapshot(MasterRpcServices.java:1588) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) Caused by: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.hdfs.protocol.AclException): The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at org.apache.hadoop.ipc.Client.getRpcResponse(Client.java:1540) at org.apache.hadoop.ipc.Client.call(Client.java:1486) at org.apache.hadoop.ipc.Client.call(Client.java:1385) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:232) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:118) at com.sun.proxy.$Proxy32.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.getAclStatus(ClientNamenodeProtocolTranslatorPB.java:1385) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:422) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeMethod(RetryInvocationHandler.java:165) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invoke(RetryInvocationHandler.java:157) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeOnce(RetryInvocationHandler.java:95) at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:359) at com.sun.proxy.$Proxy35.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2734) ... 15 more 2023-10-02 16:02:52,673 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44227] procedure2.ProcedureExecutor(1028): Stored pid=17, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-10-02 16:02:52,676 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=17, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-10-02 16:02:52,682 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=17, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE; timeout=600000, timestamp=1696263172682 2023-10-02 16:02:52,685 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44227] snapshot.SnapshotManager(689): Started snapshot: { ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-10-02 16:02:52,685 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName 2023-10-02 16:02:52,695 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=17, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-10-02 16:02:52,698 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=17, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE in 41 msec 2023-10-02 16:02:52,699 DEBUG [Listener at jenkins-hbase4.apache.org/32975] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-10-02 16:02:52,699 DEBUG [Listener at jenkins-hbase4.apache.org/32975] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-10-02 16:02:52,703 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=18, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-10-02 16:02:52,704 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=18, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-10-02 16:02:52,707 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=18, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED; timeout=600000, timestamp=1696263172707 2023-10-02 16:02:52,801 DEBUG [Listener at jenkins-hbase4.apache.org/32975] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-02 16:02:52,804 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44227] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-10-02 16:02:52,807 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44227] snapshot.SnapshotManager(406): Snapshoting '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-10-02 16:02:52,808 DEBUG [Listener at jenkins-hbase4.apache.org/32975] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-10-02 16:02:53,008 DEBUG [Listener at jenkins-hbase4.apache.org/32975] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-02 16:02:53,010 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44227] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-10-02 16:02:53,012 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44227] snapshot.SnapshotManager(406): Snapshoting '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-10-02 16:02:53,012 DEBUG [Listener at jenkins-hbase4.apache.org/32975] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-10-02 16:02:53,119 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportWithTargetName' 2023-10-02 16:02:53,167 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportWithTargetName 2023-10-02 16:02:53,167 INFO [(jenkins-hbase4.apache.org,44227,1696262556745)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportWithTargetName' 2023-10-02 16:02:53,167 DEBUG [(jenkins-hbase4.apache.org,44227,1696262556745)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-02 16:02:53,168 DEBUG [(jenkins-hbase4.apache.org,44227,1696262556745)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' 2023-10-02 16:02:53,168 DEBUG [(jenkins-hbase4.apache.org,44227,1696262556745)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportWithTargetName', kicking off acquire phase on members. 2023-10-02 16:02:53,169 DEBUG [(jenkins-hbase4.apache.org,44227,1696262556745)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44227-0x10107dfc1490000, quorum=127.0.0.1:50210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-10-02 16:02:53,169 DEBUG [(jenkins-hbase4.apache.org,44227,1696262556745)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-10-02 16:02:53,180 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): regionserver:42303-0x10107dfc1490003, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-02 16:02:53,181 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): regionserver:37455-0x10107dfc1490002, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-02 16:02:53,181 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-02 16:02:53,181 DEBUG [(jenkins-hbase4.apache.org,44227,1696262556745)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,42303,1696262558956 2023-10-02 16:02:53,180 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): regionserver:43801-0x10107dfc1490001, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-02 16:02:53,181 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-02 16:02:53,181 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-02 16:02:53,181 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-02 16:02:53,182 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-10-02 16:02:53,183 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43801-0x10107dfc1490001, quorum=127.0.0.1:50210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-10-02 16:02:53,183 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-10-02 16:02:53,184 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42303-0x10107dfc1490003, quorum=127.0.0.1:50210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-10-02 16:02:53,184 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 171 2023-10-02 16:02:53,185 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-10-02 16:02:53,181 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-02 16:02:53,185 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-02 16:02:53,185 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-10-02 16:02:53,185 DEBUG [(jenkins-hbase4.apache.org,44227,1696262556745)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44227-0x10107dfc1490000, quorum=127.0.0.1:50210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,42303,1696262558956 2023-10-02 16:02:53,185 DEBUG [(jenkins-hbase4.apache.org,44227,1696262556745)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43801,1696262558835 2023-10-02 16:02:53,185 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 171 2023-10-02 16:02:53,186 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-10-02 16:02:53,187 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-10-02 16:02:53,189 DEBUG [(jenkins-hbase4.apache.org,44227,1696262556745)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44227-0x10107dfc1490000, quorum=127.0.0.1:50210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43801,1696262558835 2023-10-02 16:02:53,189 DEBUG [(jenkins-hbase4.apache.org,44227,1696262556745)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-02 16:02:53,191 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportWithTargetName 2023-10-02 16:02:53,191 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-10-02 16:02:53,192 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportWithTargetName 2023-10-02 16:02:53,192 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37455-0x10107dfc1490002, quorum=127.0.0.1:50210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-10-02 16:02:53,191 DEBUG [member: 'jenkins-hbase4.apache.org,42303,1696262558956' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportWithTargetName' with timeout 300000ms 2023-10-02 16:02:53,192 DEBUG [member: 'jenkins-hbase4.apache.org,42303,1696262558956' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-02 16:02:53,193 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 171 2023-10-02 16:02:53,198 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-10-02 16:02:53,198 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-10-02 16:02:53,199 DEBUG [member: 'jenkins-hbase4.apache.org,42303,1696262558956' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' stage 2023-10-02 16:02:53,199 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportWithTargetName 2023-10-02 16:02:53,199 DEBUG [member: 'jenkins-hbase4.apache.org,43801,1696262558835' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportWithTargetName' with timeout 300000ms 2023-10-02 16:02:53,199 DEBUG [member: 'jenkins-hbase4.apache.org,43801,1696262558835' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-02 16:02:53,199 DEBUG [member: 'jenkins-hbase4.apache.org,42303,1696262558956' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally acquired 2023-10-02 16:02:53,199 DEBUG [member: 'jenkins-hbase4.apache.org,42303,1696262558956' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42303,1696262558956' joining acquired barrier for procedure (emptySnaptb0-testExportWithTargetName) in zk 2023-10-02 16:02:53,218 DEBUG [member: 'jenkins-hbase4.apache.org,37455,1696262558909' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportWithTargetName' with timeout 300000ms 2023-10-02 16:02:53,219 DEBUG [member: 'jenkins-hbase4.apache.org,37455,1696262558909' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-02 16:02:53,219 DEBUG [member: 'jenkins-hbase4.apache.org,43801,1696262558835' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' stage 2023-10-02 16:02:53,221 DEBUG [member: 'jenkins-hbase4.apache.org,43801,1696262558835' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally acquired 2023-10-02 16:02:53,221 DEBUG [member: 'jenkins-hbase4.apache.org,43801,1696262558835' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43801,1696262558835' joining acquired barrier for procedure (emptySnaptb0-testExportWithTargetName) in zk 2023-10-02 16:02:53,220 DEBUG [member: 'jenkins-hbase4.apache.org,37455,1696262558909' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' stage 2023-10-02 16:02:53,222 DEBUG [member: 'jenkins-hbase4.apache.org,37455,1696262558909' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally acquired 2023-10-02 16:02:53,222 DEBUG [member: 'jenkins-hbase4.apache.org,37455,1696262558909' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37455,1696262558909' joining acquired barrier for procedure (emptySnaptb0-testExportWithTargetName) in zk 2023-10-02 16:02:53,229 DEBUG [member: 'jenkins-hbase4.apache.org,37455,1696262558909' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-10-02 16:02:53,232 DEBUG [member: 'jenkins-hbase4.apache.org,42303,1696262558956' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-10-02 16:02:53,230 DEBUG [member: 'jenkins-hbase4.apache.org,43801,1696262558835' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-10-02 16:02:53,229 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): master:44227-0x10107dfc1490000, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43801,1696262558835 2023-10-02 16:02:53,237 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): master:44227-0x10107dfc1490000, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,42303,1696262558956 2023-10-02 16:02:53,237 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43801,1696262558835 2023-10-02 16:02:53,237 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-02 16:02:53,237 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-02 16:02:53,237 DEBUG [member: 'jenkins-hbase4.apache.org,42303,1696262558956' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42303-0x10107dfc1490003, quorum=127.0.0.1:50210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-10-02 16:02:53,237 DEBUG [member: 'jenkins-hbase4.apache.org,42303,1696262558956' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-02 16:02:53,239 DEBUG [member: 'jenkins-hbase4.apache.org,43801,1696262558835' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43801-0x10107dfc1490001, quorum=127.0.0.1:50210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-10-02 16:02:53,239 DEBUG [member: 'jenkins-hbase4.apache.org,43801,1696262558835' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-02 16:02:53,239 DEBUG [member: 'jenkins-hbase4.apache.org,37455,1696262558909' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37455-0x10107dfc1490002, quorum=127.0.0.1:50210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-10-02 16:02:53,239 DEBUG [member: 'jenkins-hbase4.apache.org,37455,1696262558909' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-02 16:02:53,239 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-02 16:02:53,245 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-02 16:02:53,253 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-10-02 16:02:53,254 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37455,1696262558909 2023-10-02 16:02:53,254 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42303,1696262558956 2023-10-02 16:02:53,255 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43801,1696262558835 2023-10-02 16:02:53,256 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-02 16:02:53,257 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43801,1696262558835' joining acquired barrier for procedure 'emptySnaptb0-testExportWithTargetName' on coordinator 2023-10-02 16:02:53,257 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@37fe197[Count = 1] remaining members to acquire global barrier 2023-10-02 16:02:53,257 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,42303,1696262558956 2023-10-02 16:02:53,257 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-02 16:02:53,257 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-02 16:02:53,258 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-02 16:02:53,261 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-02 16:02:53,265 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-10-02 16:02:53,266 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37455,1696262558909 2023-10-02 16:02:53,266 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42303,1696262558956 2023-10-02 16:02:53,267 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43801,1696262558835 2023-10-02 16:02:53,269 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-02 16:02:53,269 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,42303,1696262558956' joining acquired barrier for procedure 'emptySnaptb0-testExportWithTargetName' on coordinator 2023-10-02 16:02:53,269 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@37fe197[Count = 0] remaining members to acquire global barrier 2023-10-02 16:02:53,273 DEBUG [(jenkins-hbase4.apache.org,44227,1696262556745)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportWithTargetName' starting 'in-barrier' execution. 2023-10-02 16:02:53,273 DEBUG [(jenkins-hbase4.apache.org,44227,1696262556745)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-10-02 16:02:53,276 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): regionserver:42303-0x10107dfc1490003, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-10-02 16:02:53,276 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): regionserver:43801-0x10107dfc1490001, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-10-02 16:02:53,276 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-10-02 16:02:53,276 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-10-02 16:02:53,277 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-10-02 16:02:53,277 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-10-02 16:02:53,277 DEBUG [member: 'jenkins-hbase4.apache.org,42303,1696262558956' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-10-02 16:02:53,278 DEBUG [member: 'jenkins-hbase4.apache.org,43801,1696262558835' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-10-02 16:02:53,280 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): regionserver:37455-0x10107dfc1490002, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-10-02 16:02:53,280 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-10-02 16:02:53,280 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-10-02 16:02:53,281 DEBUG [(jenkins-hbase4.apache.org,44227,1696262556745)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44227-0x10107dfc1490000, quorum=127.0.0.1:50210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43801,1696262558835 2023-10-02 16:02:53,282 DEBUG [(jenkins-hbase4.apache.org,44227,1696262556745)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44227-0x10107dfc1490000, quorum=127.0.0.1:50210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,42303,1696262558956 2023-10-02 16:02:53,283 DEBUG [(jenkins-hbase4.apache.org,44227,1696262556745)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-02 16:02:53,288 DEBUG [member: 'jenkins-hbase4.apache.org,42303,1696262558956' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-02 16:02:53,289 DEBUG [member: 'jenkins-hbase4.apache.org,42303,1696262558956' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-02 16:02:53,289 DEBUG [rs(jenkins-hbase4.apache.org,42303,1696262558956)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,,1696262571263.0dce21880e3bd38446fdcc09c01710de. 2023-10-02 16:02:53,290 DEBUG [rs(jenkins-hbase4.apache.org,42303,1696262558956)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,,1696262571263.0dce21880e3bd38446fdcc09c01710de. started... 2023-10-02 16:02:53,293 DEBUG [rs(jenkins-hbase4.apache.org,42303,1696262558956)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 0dce21880e3bd38446fdcc09c01710de: 2023-10-02 16:02:53,293 DEBUG [member: 'jenkins-hbase4.apache.org,37455,1696262558909' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-10-02 16:02:53,293 DEBUG [member: 'jenkins-hbase4.apache.org,37455,1696262558909' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally completed 2023-10-02 16:02:53,293 DEBUG [member: 'jenkins-hbase4.apache.org,37455,1696262558909' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,37455,1696262558909' in zk 2023-10-02 16:02:53,294 DEBUG [rs(jenkins-hbase4.apache.org,42303,1696262558956)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,,1696262571263.0dce21880e3bd38446fdcc09c01710de.' region-info for snapshot=emptySnaptb0-testExportWithTargetName 2023-10-02 16:02:53,297 DEBUG [member: 'jenkins-hbase4.apache.org,43801,1696262558835' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-02 16:02:53,297 DEBUG [member: 'jenkins-hbase4.apache.org,43801,1696262558835' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-02 16:02:53,297 DEBUG [rs(jenkins-hbase4.apache.org,43801,1696262558835)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,1,1696262571263.a405b86bbfbe0589c4f6da2d89902060. 2023-10-02 16:02:53,297 DEBUG [rs(jenkins-hbase4.apache.org,43801,1696262558835)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,1,1696262571263.a405b86bbfbe0589c4f6da2d89902060. started... 2023-10-02 16:02:53,310 DEBUG [rs(jenkins-hbase4.apache.org,43801,1696262558835)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for a405b86bbfbe0589c4f6da2d89902060: 2023-10-02 16:02:53,311 DEBUG [rs(jenkins-hbase4.apache.org,43801,1696262558835)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,1,1696262571263.a405b86bbfbe0589c4f6da2d89902060.' region-info for snapshot=emptySnaptb0-testExportWithTargetName 2023-10-02 16:02:53,313 DEBUG [Listener at jenkins-hbase4.apache.org/32975] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-02 16:02:53,314 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44227] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-10-02 16:02:53,315 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44227] snapshot.SnapshotManager(406): Snapshoting '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-10-02 16:02:53,315 DEBUG [Listener at jenkins-hbase4.apache.org/32975] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-10-02 16:02:53,335 DEBUG [rs(jenkins-hbase4.apache.org,42303,1696262558956)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-02 16:02:53,336 DEBUG [rs(jenkins-hbase4.apache.org,43801,1696262558835)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-02 16:02:53,344 DEBUG [rs(jenkins-hbase4.apache.org,43801,1696262558835)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-10-02 16:02:53,348 DEBUG [member: 'jenkins-hbase4.apache.org,37455,1696262558909' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportWithTargetName' has notified controller of completion 2023-10-02 16:02:53,348 DEBUG [member: 'jenkins-hbase4.apache.org,37455,1696262558909' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-02 16:02:53,348 DEBUG [member: 'jenkins-hbase4.apache.org,37455,1696262558909' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportWithTargetName' completed. 2023-10-02 16:02:53,349 DEBUG [rs(jenkins-hbase4.apache.org,42303,1696262558956)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-10-02 16:02:53,449 DEBUG [rs(jenkins-hbase4.apache.org,42303,1696262558956)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,,1696262571263.0dce21880e3bd38446fdcc09c01710de. completed. 2023-10-02 16:02:53,449 DEBUG [rs(jenkins-hbase4.apache.org,42303,1696262558956)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,,1696262571263.0dce21880e3bd38446fdcc09c01710de. 2023-10-02 16:02:53,450 DEBUG [member: 'jenkins-hbase4.apache.org,42303,1696262558956' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-02 16:02:53,450 DEBUG [member: 'jenkins-hbase4.apache.org,42303,1696262558956' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-02 16:02:53,450 DEBUG [member: 'jenkins-hbase4.apache.org,42303,1696262558956' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,42303,1696262558956 2023-10-02 16:02:53,450 DEBUG [member: 'jenkins-hbase4.apache.org,42303,1696262558956' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally completed 2023-10-02 16:02:53,450 DEBUG [member: 'jenkins-hbase4.apache.org,42303,1696262558956' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,42303,1696262558956' in zk 2023-10-02 16:02:53,451 DEBUG [rs(jenkins-hbase4.apache.org,43801,1696262558835)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,1,1696262571263.a405b86bbfbe0589c4f6da2d89902060. completed. 2023-10-02 16:02:53,451 DEBUG [rs(jenkins-hbase4.apache.org,43801,1696262558835)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,1,1696262571263.a405b86bbfbe0589c4f6da2d89902060. 2023-10-02 16:02:53,451 DEBUG [member: 'jenkins-hbase4.apache.org,43801,1696262558835' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-02 16:02:53,451 DEBUG [member: 'jenkins-hbase4.apache.org,43801,1696262558835' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-02 16:02:53,451 DEBUG [member: 'jenkins-hbase4.apache.org,43801,1696262558835' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,43801,1696262558835 2023-10-02 16:02:53,451 DEBUG [member: 'jenkins-hbase4.apache.org,43801,1696262558835' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally completed 2023-10-02 16:02:53,451 DEBUG [member: 'jenkins-hbase4.apache.org,43801,1696262558835' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,43801,1696262558835' in zk 2023-10-02 16:02:53,458 DEBUG [member: 'jenkins-hbase4.apache.org,43801,1696262558835' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportWithTargetName' has notified controller of completion 2023-10-02 16:02:53,458 DEBUG [member: 'jenkins-hbase4.apache.org,43801,1696262558835' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-02 16:02:53,458 DEBUG [member: 'jenkins-hbase4.apache.org,43801,1696262558835' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportWithTargetName' completed. 2023-10-02 16:02:53,461 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): master:44227-0x10107dfc1490000, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,42303,1696262558956 2023-10-02 16:02:53,461 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,42303,1696262558956 2023-10-02 16:02:53,461 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-02 16:02:53,461 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-02 16:02:53,461 DEBUG [member: 'jenkins-hbase4.apache.org,42303,1696262558956' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportWithTargetName' has notified controller of completion 2023-10-02 16:02:53,461 DEBUG [member: 'jenkins-hbase4.apache.org,42303,1696262558956' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-02 16:02:53,461 DEBUG [member: 'jenkins-hbase4.apache.org,42303,1696262558956' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportWithTargetName' completed. 2023-10-02 16:02:53,465 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): master:44227-0x10107dfc1490000, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43801,1696262558835 2023-10-02 16:02:53,470 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-02 16:02:53,471 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-02 16:02:53,471 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-10-02 16:02:53,472 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37455,1696262558909 2023-10-02 16:02:53,477 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42303,1696262558956 2023-10-02 16:02:53,477 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43801,1696262558835 2023-10-02 16:02:53,478 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-02 16:02:53,478 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-10-02 16:02:53,480 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37455,1696262558909 2023-10-02 16:02:53,480 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42303,1696262558956 2023-10-02 16:02:53,480 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43801,1696262558835 2023-10-02 16:02:53,482 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,42303,1696262558956': 2023-10-02 16:02:53,482 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,42303,1696262558956' released barrier for procedure'emptySnaptb0-testExportWithTargetName', counting down latch. Waiting for 1 more 2023-10-02 16:02:53,482 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43801,1696262558835 2023-10-02 16:02:53,482 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-02 16:02:53,482 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-02 16:02:53,482 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-02 16:02:53,483 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-02 16:02:53,483 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-10-02 16:02:53,484 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37455,1696262558909 2023-10-02 16:02:53,484 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42303,1696262558956 2023-10-02 16:02:53,485 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43801,1696262558835 2023-10-02 16:02:53,485 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-02 16:02:53,486 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-10-02 16:02:53,486 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37455,1696262558909 2023-10-02 16:02:53,487 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42303,1696262558956 2023-10-02 16:02:53,487 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43801,1696262558835 2023-10-02 16:02:53,489 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,43801,1696262558835': 2023-10-02 16:02:53,490 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43801,1696262558835' released barrier for procedure'emptySnaptb0-testExportWithTargetName', counting down latch. Waiting for 0 more 2023-10-02 16:02:53,490 INFO [(jenkins-hbase4.apache.org,44227,1696262556745)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportWithTargetName' execution completed 2023-10-02 16:02:53,490 DEBUG [(jenkins-hbase4.apache.org,44227,1696262556745)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-02 16:02:53,490 DEBUG [(jenkins-hbase4.apache.org,44227,1696262556745)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-02 16:02:53,490 DEBUG [(jenkins-hbase4.apache.org,44227,1696262556745)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportWithTargetName 2023-10-02 16:02:53,490 INFO [(jenkins-hbase4.apache.org,44227,1696262556745)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportWithTargetNameincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-10-02 16:02:53,496 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): regionserver:42303-0x10107dfc1490003, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-10-02 16:02:53,496 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): regionserver:42303-0x10107dfc1490003, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-02 16:02:53,496 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-10-02 16:02:53,496 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-10-02 16:02:53,497 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): regionserver:43801-0x10107dfc1490001, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-10-02 16:02:53,497 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): regionserver:43801-0x10107dfc1490001, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-02 16:02:53,497 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-10-02 16:02:53,497 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-02 16:02:53,497 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-02 16:02:53,498 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-10-02 16:02:53,498 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): master:44227-0x10107dfc1490000, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-10-02 16:02:53,498 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-10-02 16:02:53,498 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-02 16:02:53,499 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-02 16:02:53,500 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-02 16:02:53,500 DEBUG [(jenkins-hbase4.apache.org,44227,1696262556745)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44227-0x10107dfc1490000, quorum=127.0.0.1:50210, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,37455,1696262558909 2023-10-02 16:02:53,497 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-10-02 16:02:53,501 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-10-02 16:02:53,501 DEBUG [(jenkins-hbase4.apache.org,44227,1696262556745)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44227-0x10107dfc1490000, quorum=127.0.0.1:50210, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,42303,1696262558956 2023-10-02 16:02:53,502 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-02 16:02:53,502 DEBUG [(jenkins-hbase4.apache.org,44227,1696262556745)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44227-0x10107dfc1490000, quorum=127.0.0.1:50210, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43801,1696262558835 2023-10-02 16:02:53,503 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-10-02 16:02:53,501 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): regionserver:37455-0x10107dfc1490002, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-10-02 16:02:53,503 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): regionserver:37455-0x10107dfc1490002, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-02 16:02:53,503 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-10-02 16:02:53,503 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37455,1696262558909 2023-10-02 16:02:53,504 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-10-02 16:02:53,505 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42303,1696262558956 2023-10-02 16:02:53,505 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-02 16:02:53,505 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-02 16:02:53,506 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43801,1696262558835 2023-10-02 16:02:53,506 DEBUG [(jenkins-hbase4.apache.org,44227,1696262556745)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44227-0x10107dfc1490000, quorum=127.0.0.1:50210, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,37455,1696262558909 2023-10-02 16:02:53,507 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-02 16:02:53,507 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-02 16:02:53,507 DEBUG [(jenkins-hbase4.apache.org,44227,1696262556745)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44227-0x10107dfc1490000, quorum=127.0.0.1:50210, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,42303,1696262558956 2023-10-02 16:02:53,507 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-02 16:02:53,508 DEBUG [(jenkins-hbase4.apache.org,44227,1696262556745)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44227-0x10107dfc1490000, quorum=127.0.0.1:50210, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43801,1696262558835 2023-10-02 16:02:53,508 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-10-02 16:02:53,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-10-02 16:02:53,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37455,1696262558909 2023-10-02 16:02:53,510 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42303,1696262558956 2023-10-02 16:02:53,511 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43801,1696262558835 2023-10-02 16:02:53,513 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-10-02 16:02:53,545 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): regionserver:42303-0x10107dfc1490003, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-02 16:02:53,545 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-02 16:02:53,545 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): regionserver:42303-0x10107dfc1490003, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-02 16:02:53,546 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): master:44227-0x10107dfc1490000, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43801,1696262558835 2023-10-02 16:02:53,546 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): regionserver:37455-0x10107dfc1490002, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-02 16:02:53,546 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): regionserver:37455-0x10107dfc1490002, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-02 16:02:53,546 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-02 16:02:53,546 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): master:44227-0x10107dfc1490000, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-10-02 16:02:53,546 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): master:44227-0x10107dfc1490000, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,42303,1696262558956 2023-10-02 16:02:53,546 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): master:44227-0x10107dfc1490000, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,37455,1696262558909 2023-10-02 16:02:53,546 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): master:44227-0x10107dfc1490000, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-10-02 16:02:53,546 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): master:44227-0x10107dfc1490000, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43801,1696262558835 2023-10-02 16:02:53,546 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): master:44227-0x10107dfc1490000, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-10-02 16:02:53,546 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): master:44227-0x10107dfc1490000, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,42303,1696262558956 2023-10-02 16:02:53,546 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): master:44227-0x10107dfc1490000, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,37455,1696262558909 2023-10-02 16:02:53,546 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): master:44227-0x10107dfc1490000, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-10-02 16:02:53,546 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): master:44227-0x10107dfc1490000, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-10-02 16:02:53,547 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportWithTargetName 2023-10-02 16:02:53,547 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportWithTargetName 2023-10-02 16:02:53,547 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 90c8eeaaf01a24f585da11044309be71, NAME => 'testtb-testExportWithTargetName,.mob,0.90c8eeaaf01a24f585da11044309be71.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testExportWithTargetName 2023-10-02 16:02:53,547 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-10-02 16:02:53,546 DEBUG [(jenkins-hbase4.apache.org,44227,1696262556745)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-02 16:02:53,548 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-02 16:02:53,548 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-02 16:02:53,549 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-02 16:02:53,549 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-10-02 16:02:53,549 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-02 16:02:53,549 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): regionserver:43801-0x10107dfc1490001, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-02 16:02:53,549 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): regionserver:43801-0x10107dfc1490001, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-02 16:02:53,549 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-02 16:02:53,549 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-02 16:02:53,549 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-02 16:02:53,552 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-02 16:02:53,553 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-02 16:02:53,553 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-02 16:02:53,602 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportWithTargetName 2023-10-02 16:02:53,607 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName 2023-10-02 16:02:53,729 WARN [DataStreamer for file /user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName/data.manifest] hdfs.DataStreamer(982): Caught exception java.lang.InterruptedException at java.lang.Object.wait(Native Method) at java.lang.Thread.join(Thread.java:1257) at java.lang.Thread.join(Thread.java:1331) at org.apache.hadoop.hdfs.DataStreamer.closeResponder(DataStreamer.java:980) at org.apache.hadoop.hdfs.DataStreamer.endBlock(DataStreamer.java:630) at org.apache.hadoop.hdfs.DataStreamer.run(DataStreamer.java:807) 2023-10-02 16:02:53,762 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName to hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/.hbase-snapshot/emptySnaptb0-testExportWithTargetName 2023-10-02 16:02:53,763 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed 2023-10-02 16:02:53,764 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName 2023-10-02 16:02:53,764 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName 2023-10-02 16:02:53,765 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName at 1696262572686Completed referencing HFiles for the mob region of table: testtb-testExportWithTargetName at 1696262573602 (+916 ms)Consolidate snapshot: emptySnaptb0-testExportWithTargetName at 1696262573602Loading Region manifests for emptySnaptb0-testExportWithTargetName at 1696262573603 (+1 ms)Writing data manifest for emptySnaptb0-testExportWithTargetName at 1696262573649 (+46 ms)Verifying snapshot: emptySnaptb0-testExportWithTargetName at 1696262573739 (+90 ms)Snapshot emptySnaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed at 1696262573763 (+24 ms) 2023-10-02 16:02:53,768 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=18, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-10-02 16:02:53,784 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=18, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED in 1.0670 sec 2023-10-02 16:02:53,817 DEBUG [Listener at jenkins-hbase4.apache.org/32975] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-02 16:02:53,849 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44227] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-10-02 16:02:53,849 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44227] snapshot.SnapshotManager(403): Snapshot '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' has completed, notifying client. 2023-10-02 16:02:53,876 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43801] regionserver.HRegion(8805): writing data to region testtb-testExportWithTargetName,1,1696262571263.a405b86bbfbe0589c4f6da2d89902060. with WAL disabled. Data may be lost in the event of a crash. 2023-10-02 16:02:53,879 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42303] regionserver.HRegion(8805): writing data to region testtb-testExportWithTargetName,,1696262571263.0dce21880e3bd38446fdcc09c01710de. with WAL disabled. Data may be lost in the event of a crash. 2023-10-02 16:02:53,883 DEBUG [Listener at jenkins-hbase4.apache.org/32975] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportWithTargetName 2023-10-02 16:02:53,883 DEBUG [Listener at jenkins-hbase4.apache.org/32975] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportWithTargetName,,1696262571263.0dce21880e3bd38446fdcc09c01710de. 2023-10-02 16:02:53,883 INFO [Listener at jenkins-hbase4.apache.org/32975] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-10-02 16:02:53,901 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44227] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-10-02 16:02:53,902 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44227] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1696262573901 (current time:1696262573902). 2023-10-02 16:02:53,902 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44227] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-10-02 16:02:53,903 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44227] zookeeper.ReadOnlyZKClient(139): Connect 0x5b1c9076 to 127.0.0.1:50210 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-02 16:02:53,920 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44227] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3dc82e8d, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-02 16:02:53,926 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44227] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-02 16:02:53,928 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:34090, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-02 16:02:53,930 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44227] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x5b1c9076 to 127.0.0.1:50210 2023-10-02 16:02:53,930 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44227] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-02 16:02:53,931 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44227] zookeeper.ReadOnlyZKClient(139): Connect 0x7ae51ac6 to 127.0.0.1:50210 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-02 16:02:53,963 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44227] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4545bacc, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-02 16:02:54,044 DEBUG [hconnection-0x390558af-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-02 16:02:54,051 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:34106, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-02 16:02:54,060 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44227] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7ae51ac6 to 127.0.0.1:50210 2023-10-02 16:02:54,060 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44227] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-02 16:02:54,061 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44227] access.PermissionStorage(611): Read acl: entry[testtb-testExportWithTargetName], kv [jenkins: RWXCA] 2023-10-02 16:02:54,065 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44227] snapshot.SnapshotManager(637): No existing snapshot, attempting snapshot... 2023-10-02 16:02:54,066 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44227] snapshot.SnapshotManager(684): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-10-02 16:02:54,084 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44227] snapshot.SnapshotManager(519): Unable to retrieve ACL status for path: hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/.hbase-snapshot, current working dir path: hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName org.apache.hadoop.hdfs.protocol.AclException: The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.ipc.RemoteException.instantiateException(RemoteException.java:121) at org.apache.hadoop.ipc.RemoteException.unwrapRemoteException(RemoteException.java:88) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2736) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2294) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2291) at org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81) at org.apache.hadoop.hdfs.DistributedFileSystem.getAclStatus(DistributedFileSystem.java:2291) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.updateWorkingDirAclsIfRequired(SnapshotManager.java:517) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.prepareToTakeSnapshot(SnapshotManager.java:490) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.snapshotEnabledTable(SnapshotManager.java:559) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshotInternal(SnapshotManager.java:687) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshot(SnapshotManager.java:623) at org.apache.hadoop.hbase.master.MasterRpcServices.snapshot(MasterRpcServices.java:1588) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) Caused by: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.hdfs.protocol.AclException): The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at org.apache.hadoop.ipc.Client.getRpcResponse(Client.java:1540) at org.apache.hadoop.ipc.Client.call(Client.java:1486) at org.apache.hadoop.ipc.Client.call(Client.java:1385) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:232) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:118) at com.sun.proxy.$Proxy32.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.getAclStatus(ClientNamenodeProtocolTranslatorPB.java:1385) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:422) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeMethod(RetryInvocationHandler.java:165) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invoke(RetryInvocationHandler.java:157) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeOnce(RetryInvocationHandler.java:95) at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:359) at com.sun.proxy.$Proxy35.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2734) ... 15 more 2023-10-02 16:02:54,089 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44227] procedure2.ProcedureExecutor(1028): Stored pid=19, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-10-02 16:02:54,094 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=19, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-10-02 16:02:54,097 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=19, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE; timeout=600000, timestamp=1696263174097 2023-10-02 16:02:54,098 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44227] snapshot.SnapshotManager(689): Started snapshot: { ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-10-02 16:02:54,098 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName 2023-10-02 16:02:54,101 DEBUG [Listener at jenkins-hbase4.apache.org/32975] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-10-02 16:02:54,101 DEBUG [Listener at jenkins-hbase4.apache.org/32975] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-10-02 16:02:54,127 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=19, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-10-02 16:02:54,128 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=20, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-10-02 16:02:54,143 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=19, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE in 42 msec 2023-10-02 16:02:54,145 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=20, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-10-02 16:02:54,153 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=20, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED; timeout=600000, timestamp=1696263174153 2023-10-02 16:02:54,205 DEBUG [Listener at jenkins-hbase4.apache.org/32975] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-02 16:02:54,211 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44227] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-10-02 16:02:54,211 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44227] snapshot.SnapshotManager(406): Snapshoting '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-10-02 16:02:54,213 DEBUG [Listener at jenkins-hbase4.apache.org/32975] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-10-02 16:02:54,357 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportWithTargetName 2023-10-02 16:02:54,361 INFO [(jenkins-hbase4.apache.org,44227,1696262556745)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportWithTargetName' 2023-10-02 16:02:54,361 DEBUG [(jenkins-hbase4.apache.org,44227,1696262556745)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-02 16:02:54,361 DEBUG [(jenkins-hbase4.apache.org,44227,1696262556745)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportWithTargetName' starting 'acquire' 2023-10-02 16:02:54,361 DEBUG [(jenkins-hbase4.apache.org,44227,1696262556745)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportWithTargetName', kicking off acquire phase on members. 2023-10-02 16:02:54,362 DEBUG [(jenkins-hbase4.apache.org,44227,1696262556745)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44227-0x10107dfc1490000, quorum=127.0.0.1:50210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-10-02 16:02:54,362 DEBUG [(jenkins-hbase4.apache.org,44227,1696262556745)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-10-02 16:02:54,372 DEBUG [(jenkins-hbase4.apache.org,44227,1696262556745)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,42303,1696262558956 2023-10-02 16:02:54,372 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): regionserver:37455-0x10107dfc1490002, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-02 16:02:54,372 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-02 16:02:54,373 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-02 16:02:54,373 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-10-02 16:02:54,374 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37455-0x10107dfc1490002, quorum=127.0.0.1:50210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-10-02 16:02:54,374 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 166 2023-10-02 16:02:54,374 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-10-02 16:02:54,375 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-10-02 16:02:54,375 DEBUG [(jenkins-hbase4.apache.org,44227,1696262556745)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44227-0x10107dfc1490000, quorum=127.0.0.1:50210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,42303,1696262558956 2023-10-02 16:02:54,375 DEBUG [(jenkins-hbase4.apache.org,44227,1696262556745)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43801,1696262558835 2023-10-02 16:02:54,375 DEBUG [(jenkins-hbase4.apache.org,44227,1696262556745)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44227-0x10107dfc1490000, quorum=127.0.0.1:50210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43801,1696262558835 2023-10-02 16:02:54,376 DEBUG [(jenkins-hbase4.apache.org,44227,1696262556745)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-02 16:02:54,377 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): regionserver:42303-0x10107dfc1490003, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-02 16:02:54,377 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportWithTargetName 2023-10-02 16:02:54,377 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-02 16:02:54,377 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-02 16:02:54,378 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-10-02 16:02:54,378 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42303-0x10107dfc1490003, quorum=127.0.0.1:50210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-10-02 16:02:54,379 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 166 2023-10-02 16:02:54,379 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-10-02 16:02:54,379 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-10-02 16:02:54,377 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): regionserver:43801-0x10107dfc1490001, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-02 16:02:54,381 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportWithTargetName 2023-10-02 16:02:54,381 DEBUG [member: 'jenkins-hbase4.apache.org,37455,1696262558909' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportWithTargetName' with timeout 300000ms 2023-10-02 16:02:54,381 DEBUG [member: 'jenkins-hbase4.apache.org,37455,1696262558909' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-02 16:02:54,386 DEBUG [member: 'jenkins-hbase4.apache.org,37455,1696262558909' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportWithTargetName' starting 'acquire' stage 2023-10-02 16:02:54,386 DEBUG [member: 'jenkins-hbase4.apache.org,37455,1696262558909' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportWithTargetName' locally acquired 2023-10-02 16:02:54,386 DEBUG [member: 'jenkins-hbase4.apache.org,37455,1696262558909' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37455,1696262558909' joining acquired barrier for procedure (snaptb0-testExportWithTargetName) in zk 2023-10-02 16:02:54,390 DEBUG [member: 'jenkins-hbase4.apache.org,37455,1696262558909' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-10-02 16:02:54,391 DEBUG [member: 'jenkins-hbase4.apache.org,37455,1696262558909' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37455-0x10107dfc1490002, quorum=127.0.0.1:50210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-10-02 16:02:54,391 DEBUG [member: 'jenkins-hbase4.apache.org,37455,1696262558909' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-02 16:02:54,393 DEBUG [member: 'jenkins-hbase4.apache.org,42303,1696262558956' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportWithTargetName' with timeout 300000ms 2023-10-02 16:02:54,393 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-02 16:02:54,393 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-02 16:02:54,393 DEBUG [member: 'jenkins-hbase4.apache.org,42303,1696262558956' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-02 16:02:54,401 DEBUG [member: 'jenkins-hbase4.apache.org,42303,1696262558956' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportWithTargetName' starting 'acquire' stage 2023-10-02 16:02:54,401 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-10-02 16:02:54,401 DEBUG [member: 'jenkins-hbase4.apache.org,42303,1696262558956' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportWithTargetName' locally acquired 2023-10-02 16:02:54,401 DEBUG [member: 'jenkins-hbase4.apache.org,42303,1696262558956' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42303,1696262558956' joining acquired barrier for procedure (snaptb0-testExportWithTargetName) in zk 2023-10-02 16:02:54,402 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43801-0x10107dfc1490001, quorum=127.0.0.1:50210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-10-02 16:02:54,402 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 166 2023-10-02 16:02:54,402 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-10-02 16:02:54,403 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-10-02 16:02:54,405 DEBUG [member: 'jenkins-hbase4.apache.org,42303,1696262558956' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-10-02 16:02:54,405 DEBUG [member: 'jenkins-hbase4.apache.org,42303,1696262558956' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42303-0x10107dfc1490003, quorum=127.0.0.1:50210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-10-02 16:02:54,406 DEBUG [member: 'jenkins-hbase4.apache.org,42303,1696262558956' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-02 16:02:54,406 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): master:44227-0x10107dfc1490000, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,42303,1696262558956 2023-10-02 16:02:54,406 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,42303,1696262558956 2023-10-02 16:02:54,406 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-02 16:02:54,406 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-02 16:02:54,406 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportWithTargetName 2023-10-02 16:02:54,406 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-02 16:02:54,407 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-02 16:02:54,407 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-10-02 16:02:54,408 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37455,1696262558909 2023-10-02 16:02:54,408 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42303,1696262558956 2023-10-02 16:02:54,408 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-02 16:02:54,410 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,42303,1696262558956' joining acquired barrier for procedure 'snaptb0-testExportWithTargetName' on coordinator 2023-10-02 16:02:54,410 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@48cfb658[Count = 1] remaining members to acquire global barrier 2023-10-02 16:02:54,413 DEBUG [member: 'jenkins-hbase4.apache.org,43801,1696262558835' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportWithTargetName' with timeout 300000ms 2023-10-02 16:02:54,413 DEBUG [member: 'jenkins-hbase4.apache.org,43801,1696262558835' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-02 16:02:54,417 DEBUG [Listener at jenkins-hbase4.apache.org/32975] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-02 16:02:54,417 DEBUG [member: 'jenkins-hbase4.apache.org,43801,1696262558835' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportWithTargetName' starting 'acquire' stage 2023-10-02 16:02:54,418 DEBUG [member: 'jenkins-hbase4.apache.org,43801,1696262558835' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportWithTargetName' locally acquired 2023-10-02 16:02:54,418 DEBUG [member: 'jenkins-hbase4.apache.org,43801,1696262558835' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43801,1696262558835' joining acquired barrier for procedure (snaptb0-testExportWithTargetName) in zk 2023-10-02 16:02:54,420 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44227] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-10-02 16:02:54,420 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44227] snapshot.SnapshotManager(406): Snapshoting '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-10-02 16:02:54,420 DEBUG [Listener at jenkins-hbase4.apache.org/32975] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-10-02 16:02:54,422 DEBUG [member: 'jenkins-hbase4.apache.org,43801,1696262558835' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-10-02 16:02:54,424 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): master:44227-0x10107dfc1490000, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43801,1696262558835 2023-10-02 16:02:54,424 DEBUG [member: 'jenkins-hbase4.apache.org,43801,1696262558835' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43801-0x10107dfc1490001, quorum=127.0.0.1:50210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-10-02 16:02:54,424 DEBUG [member: 'jenkins-hbase4.apache.org,43801,1696262558835' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-02 16:02:54,424 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43801,1696262558835 2023-10-02 16:02:54,424 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-02 16:02:54,424 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-02 16:02:54,429 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-02 16:02:54,429 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-02 16:02:54,430 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-10-02 16:02:54,430 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37455,1696262558909 2023-10-02 16:02:54,431 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42303,1696262558956 2023-10-02 16:02:54,431 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43801,1696262558835 2023-10-02 16:02:54,431 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-02 16:02:54,432 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43801,1696262558835' joining acquired barrier for procedure 'snaptb0-testExportWithTargetName' on coordinator 2023-10-02 16:02:54,432 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@48cfb658[Count = 0] remaining members to acquire global barrier 2023-10-02 16:02:54,432 DEBUG [(jenkins-hbase4.apache.org,44227,1696262556745)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportWithTargetName' starting 'in-barrier' execution. 2023-10-02 16:02:54,432 DEBUG [(jenkins-hbase4.apache.org,44227,1696262556745)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-10-02 16:02:54,440 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): regionserver:37455-0x10107dfc1490002, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-10-02 16:02:54,440 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): regionserver:42303-0x10107dfc1490003, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-10-02 16:02:54,440 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-10-02 16:02:54,440 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-10-02 16:02:54,440 DEBUG [member: 'jenkins-hbase4.apache.org,37455,1696262558909' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-10-02 16:02:54,440 DEBUG [member: 'jenkins-hbase4.apache.org,37455,1696262558909' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportWithTargetName' locally completed 2023-10-02 16:02:54,440 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-10-02 16:02:54,440 DEBUG [member: 'jenkins-hbase4.apache.org,37455,1696262558909' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,37455,1696262558909' in zk 2023-10-02 16:02:54,440 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-10-02 16:02:54,441 DEBUG [(jenkins-hbase4.apache.org,44227,1696262556745)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44227-0x10107dfc1490000, quorum=127.0.0.1:50210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,42303,1696262558956 2023-10-02 16:02:54,441 DEBUG [member: 'jenkins-hbase4.apache.org,42303,1696262558956' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-10-02 16:02:54,441 DEBUG [(jenkins-hbase4.apache.org,44227,1696262556745)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44227-0x10107dfc1490000, quorum=127.0.0.1:50210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43801,1696262558835 2023-10-02 16:02:54,441 DEBUG [(jenkins-hbase4.apache.org,44227,1696262556745)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-02 16:02:54,445 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): regionserver:43801-0x10107dfc1490001, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-10-02 16:02:54,446 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-10-02 16:02:54,446 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-10-02 16:02:54,446 DEBUG [member: 'jenkins-hbase4.apache.org,42303,1696262558956' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-02 16:02:54,446 DEBUG [member: 'jenkins-hbase4.apache.org,42303,1696262558956' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-02 16:02:54,446 DEBUG [member: 'jenkins-hbase4.apache.org,43801,1696262558835' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-10-02 16:02:54,447 DEBUG [rs(jenkins-hbase4.apache.org,42303,1696262558956)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,,1696262571263.0dce21880e3bd38446fdcc09c01710de. 2023-10-02 16:02:54,447 DEBUG [rs(jenkins-hbase4.apache.org,42303,1696262558956)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,,1696262571263.0dce21880e3bd38446fdcc09c01710de. started... 2023-10-02 16:02:54,447 INFO [rs(jenkins-hbase4.apache.org,42303,1696262558956)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 0dce21880e3bd38446fdcc09c01710de 1/1 column families, dataSize=199 B heapSize=688 B 2023-10-02 16:02:54,447 DEBUG [member: 'jenkins-hbase4.apache.org,43801,1696262558835' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-02 16:02:54,447 DEBUG [rs(jenkins-hbase4.apache.org,43801,1696262558835)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,1,1696262571263.a405b86bbfbe0589c4f6da2d89902060. 2023-10-02 16:02:54,448 DEBUG [rs(jenkins-hbase4.apache.org,43801,1696262558835)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,1,1696262571263.a405b86bbfbe0589c4f6da2d89902060. started... 2023-10-02 16:02:54,447 DEBUG [member: 'jenkins-hbase4.apache.org,43801,1696262558835' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-02 16:02:54,448 INFO [rs(jenkins-hbase4.apache.org,43801,1696262558835)-snapshot-pool-0] regionserver.HRegion(2745): Flushing a405b86bbfbe0589c4f6da2d89902060 1/1 column families, dataSize=3.06 KB heapSize=6.86 KB 2023-10-02 16:02:54,451 DEBUG [member: 'jenkins-hbase4.apache.org,37455,1696262558909' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportWithTargetName' has notified controller of completion 2023-10-02 16:02:54,451 DEBUG [member: 'jenkins-hbase4.apache.org,37455,1696262558909' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-02 16:02:54,451 DEBUG [member: 'jenkins-hbase4.apache.org,37455,1696262558909' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportWithTargetName' completed. 2023-10-02 16:02:54,681 INFO [rs(jenkins-hbase4.apache.org,43801,1696262558835)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20231002bf2da138d7cd4e96ac7e2fad9703961b to hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b20231002bf2da138d7cd4e96ac7e2fad9703961b 2023-10-02 16:02:54,720 DEBUG [Listener at jenkins-hbase4.apache.org/32975] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-02 16:02:54,725 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44227] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-10-02 16:02:54,727 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44227] snapshot.SnapshotManager(406): Snapshoting '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-10-02 16:02:54,727 DEBUG [Listener at jenkins-hbase4.apache.org/32975] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-10-02 16:02:54,760 INFO [rs(jenkins-hbase4.apache.org,43801,1696262558835)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=3.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/data/default/testtb-testExportWithTargetName/a405b86bbfbe0589c4f6da2d89902060/.tmp/cf/84c7c73fa1094a0b830bb8d16c77af06 2023-10-02 16:02:54,793 DEBUG [rs(jenkins-hbase4.apache.org,43801,1696262558835)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/data/default/testtb-testExportWithTargetName/a405b86bbfbe0589c4f6da2d89902060/.tmp/cf/84c7c73fa1094a0b830bb8d16c77af06 as hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/data/default/testtb-testExportWithTargetName/a405b86bbfbe0589c4f6da2d89902060/cf/84c7c73fa1094a0b830bb8d16c77af06 2023-10-02 16:02:54,809 INFO [rs(jenkins-hbase4.apache.org,43801,1696262558835)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/data/default/testtb-testExportWithTargetName/a405b86bbfbe0589c4f6da2d89902060/cf/84c7c73fa1094a0b830bb8d16c77af06, entries=47, sequenceid=6, filesize=12.8 K 2023-10-02 16:02:54,813 INFO [rs(jenkins-hbase4.apache.org,43801,1696262558835)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.06 KB/3137, heapSize ~6.84 KB/7008, currentSize=0 B/0 for a405b86bbfbe0589c4f6da2d89902060 in 365ms, sequenceid=6, compaction requested=false 2023-10-02 16:02:54,815 DEBUG [rs(jenkins-hbase4.apache.org,43801,1696262558835)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for a405b86bbfbe0589c4f6da2d89902060: 2023-10-02 16:02:54,816 DEBUG [rs(jenkins-hbase4.apache.org,43801,1696262558835)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,1,1696262571263.a405b86bbfbe0589c4f6da2d89902060.' region-info for snapshot=snaptb0-testExportWithTargetName 2023-10-02 16:02:54,816 DEBUG [rs(jenkins-hbase4.apache.org,43801,1696262558835)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-02 16:02:54,816 DEBUG [rs(jenkins-hbase4.apache.org,43801,1696262558835)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/data/default/testtb-testExportWithTargetName/a405b86bbfbe0589c4f6da2d89902060/cf/84c7c73fa1094a0b830bb8d16c77af06] hfiles 2023-10-02 16:02:54,816 DEBUG [rs(jenkins-hbase4.apache.org,43801,1696262558835)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/data/default/testtb-testExportWithTargetName/a405b86bbfbe0589c4f6da2d89902060/cf/84c7c73fa1094a0b830bb8d16c77af06 for snapshot=snaptb0-testExportWithTargetName 2023-10-02 16:02:54,881 DEBUG [rs(jenkins-hbase4.apache.org,43801,1696262558835)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,1,1696262571263.a405b86bbfbe0589c4f6da2d89902060. completed. 2023-10-02 16:02:54,881 DEBUG [rs(jenkins-hbase4.apache.org,43801,1696262558835)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,1,1696262571263.a405b86bbfbe0589c4f6da2d89902060. 2023-10-02 16:02:54,881 DEBUG [member: 'jenkins-hbase4.apache.org,43801,1696262558835' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-02 16:02:54,883 DEBUG [member: 'jenkins-hbase4.apache.org,43801,1696262558835' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-02 16:02:54,883 DEBUG [member: 'jenkins-hbase4.apache.org,43801,1696262558835' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,43801,1696262558835 2023-10-02 16:02:54,883 DEBUG [member: 'jenkins-hbase4.apache.org,43801,1696262558835' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportWithTargetName' locally completed 2023-10-02 16:02:54,883 DEBUG [member: 'jenkins-hbase4.apache.org,43801,1696262558835' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,43801,1696262558835' in zk 2023-10-02 16:02:54,886 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): master:44227-0x10107dfc1490000, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43801,1696262558835 2023-10-02 16:02:54,886 DEBUG [member: 'jenkins-hbase4.apache.org,43801,1696262558835' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportWithTargetName' has notified controller of completion 2023-10-02 16:02:54,886 DEBUG [member: 'jenkins-hbase4.apache.org,43801,1696262558835' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-02 16:02:54,886 DEBUG [member: 'jenkins-hbase4.apache.org,43801,1696262558835' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportWithTargetName' completed. 2023-10-02 16:02:54,886 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43801,1696262558835 2023-10-02 16:02:54,886 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-02 16:02:54,886 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-02 16:02:54,890 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-02 16:02:54,890 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-02 16:02:54,891 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-10-02 16:02:54,891 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37455,1696262558909 2023-10-02 16:02:54,891 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42303,1696262558956 2023-10-02 16:02:54,892 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43801,1696262558835 2023-10-02 16:02:54,892 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-02 16:02:54,893 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-10-02 16:02:54,893 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37455,1696262558909 2023-10-02 16:02:54,894 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43801,1696262558835 2023-10-02 16:02:54,895 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,43801,1696262558835': 2023-10-02 16:02:54,895 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43801,1696262558835' released barrier for procedure'snaptb0-testExportWithTargetName', counting down latch. Waiting for 1 more 2023-10-02 16:02:55,030 INFO [rs(jenkins-hbase4.apache.org,42303,1696262558956)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202310022438e72623544a229a50066abe4d72f9 to hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e202310022438e72623544a229a50066abe4d72f9 2023-10-02 16:02:55,074 INFO [rs(jenkins-hbase4.apache.org,42303,1696262558956)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=199, hasBloomFilter=true, into tmp file hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/data/default/testtb-testExportWithTargetName/0dce21880e3bd38446fdcc09c01710de/.tmp/cf/a920b916b2314b8b96cff521fbd3be33 2023-10-02 16:02:55,095 DEBUG [rs(jenkins-hbase4.apache.org,42303,1696262558956)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/data/default/testtb-testExportWithTargetName/0dce21880e3bd38446fdcc09c01710de/.tmp/cf/a920b916b2314b8b96cff521fbd3be33 as hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/data/default/testtb-testExportWithTargetName/0dce21880e3bd38446fdcc09c01710de/cf/a920b916b2314b8b96cff521fbd3be33 2023-10-02 16:02:55,117 INFO [rs(jenkins-hbase4.apache.org,42303,1696262558956)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/data/default/testtb-testExportWithTargetName/0dce21880e3bd38446fdcc09c01710de/cf/a920b916b2314b8b96cff521fbd3be33, entries=3, sequenceid=6, filesize=5.4 K 2023-10-02 16:02:55,124 INFO [rs(jenkins-hbase4.apache.org,42303,1696262558956)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~199 B/199, heapSize ~672 B/672, currentSize=0 B/0 for 0dce21880e3bd38446fdcc09c01710de in 677ms, sequenceid=6, compaction requested=false 2023-10-02 16:02:55,125 DEBUG [rs(jenkins-hbase4.apache.org,42303,1696262558956)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 0dce21880e3bd38446fdcc09c01710de: 2023-10-02 16:02:55,125 DEBUG [rs(jenkins-hbase4.apache.org,42303,1696262558956)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,,1696262571263.0dce21880e3bd38446fdcc09c01710de.' region-info for snapshot=snaptb0-testExportWithTargetName 2023-10-02 16:02:55,125 DEBUG [rs(jenkins-hbase4.apache.org,42303,1696262558956)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-02 16:02:55,125 DEBUG [rs(jenkins-hbase4.apache.org,42303,1696262558956)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/data/default/testtb-testExportWithTargetName/0dce21880e3bd38446fdcc09c01710de/cf/a920b916b2314b8b96cff521fbd3be33] hfiles 2023-10-02 16:02:55,125 DEBUG [rs(jenkins-hbase4.apache.org,42303,1696262558956)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/data/default/testtb-testExportWithTargetName/0dce21880e3bd38446fdcc09c01710de/cf/a920b916b2314b8b96cff521fbd3be33 for snapshot=snaptb0-testExportWithTargetName 2023-10-02 16:02:55,202 DEBUG [rs(jenkins-hbase4.apache.org,42303,1696262558956)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,,1696262571263.0dce21880e3bd38446fdcc09c01710de. completed. 2023-10-02 16:02:55,202 DEBUG [rs(jenkins-hbase4.apache.org,42303,1696262558956)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,,1696262571263.0dce21880e3bd38446fdcc09c01710de. 2023-10-02 16:02:55,202 DEBUG [member: 'jenkins-hbase4.apache.org,42303,1696262558956' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-02 16:02:55,204 DEBUG [member: 'jenkins-hbase4.apache.org,42303,1696262558956' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-02 16:02:55,204 DEBUG [member: 'jenkins-hbase4.apache.org,42303,1696262558956' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,42303,1696262558956 2023-10-02 16:02:55,204 DEBUG [member: 'jenkins-hbase4.apache.org,42303,1696262558956' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportWithTargetName' locally completed 2023-10-02 16:02:55,205 DEBUG [member: 'jenkins-hbase4.apache.org,42303,1696262558956' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,42303,1696262558956' in zk 2023-10-02 16:02:55,207 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): master:44227-0x10107dfc1490000, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,42303,1696262558956 2023-10-02 16:02:55,207 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,42303,1696262558956 2023-10-02 16:02:55,207 DEBUG [member: 'jenkins-hbase4.apache.org,42303,1696262558956' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportWithTargetName' has notified controller of completion 2023-10-02 16:02:55,207 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-02 16:02:55,207 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-02 16:02:55,207 DEBUG [member: 'jenkins-hbase4.apache.org,42303,1696262558956' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-02 16:02:55,207 DEBUG [member: 'jenkins-hbase4.apache.org,42303,1696262558956' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportWithTargetName' completed. 2023-10-02 16:02:55,209 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-02 16:02:55,210 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-02 16:02:55,210 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-10-02 16:02:55,211 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37455,1696262558909 2023-10-02 16:02:55,211 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42303,1696262558956 2023-10-02 16:02:55,212 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43801,1696262558835 2023-10-02 16:02:55,212 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-02 16:02:55,212 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-10-02 16:02:55,213 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37455,1696262558909 2023-10-02 16:02:55,213 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42303,1696262558956 2023-10-02 16:02:55,214 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43801,1696262558835 2023-10-02 16:02:55,215 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,42303,1696262558956': 2023-10-02 16:02:55,215 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,42303,1696262558956' released barrier for procedure'snaptb0-testExportWithTargetName', counting down latch. Waiting for 0 more 2023-10-02 16:02:55,215 INFO [(jenkins-hbase4.apache.org,44227,1696262556745)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportWithTargetName' execution completed 2023-10-02 16:02:55,215 DEBUG [(jenkins-hbase4.apache.org,44227,1696262556745)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-02 16:02:55,215 DEBUG [(jenkins-hbase4.apache.org,44227,1696262556745)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-02 16:02:55,216 DEBUG [(jenkins-hbase4.apache.org,44227,1696262556745)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportWithTargetName 2023-10-02 16:02:55,216 INFO [(jenkins-hbase4.apache.org,44227,1696262556745)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportWithTargetNameincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-10-02 16:02:55,219 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): master:44227-0x10107dfc1490000, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-10-02 16:02:55,219 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): regionserver:37455-0x10107dfc1490002, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-10-02 16:02:55,219 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): regionserver:37455-0x10107dfc1490002, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-02 16:02:55,219 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-10-02 16:02:55,219 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-10-02 16:02:55,220 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): regionserver:43801-0x10107dfc1490001, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-10-02 16:02:55,220 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): regionserver:43801-0x10107dfc1490001, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-02 16:02:55,219 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-10-02 16:02:55,220 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-02 16:02:55,220 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-02 16:02:55,220 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-10-02 16:02:55,220 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-10-02 16:02:55,220 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): regionserver:42303-0x10107dfc1490003, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-10-02 16:02:55,220 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): regionserver:42303-0x10107dfc1490003, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-02 16:02:55,220 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-10-02 16:02:55,220 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-10-02 16:02:55,221 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-02 16:02:55,221 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-02 16:02:55,221 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-02 16:02:55,222 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-02 16:02:55,222 DEBUG [(jenkins-hbase4.apache.org,44227,1696262556745)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44227-0x10107dfc1490000, quorum=127.0.0.1:50210, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,37455,1696262558909 2023-10-02 16:02:55,222 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-02 16:02:55,222 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-02 16:02:55,222 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-02 16:02:55,222 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-10-02 16:02:55,229 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-10-02 16:02:55,229 DEBUG [Listener at jenkins-hbase4.apache.org/32975] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-02 16:02:55,229 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-10-02 16:02:55,230 DEBUG [(jenkins-hbase4.apache.org,44227,1696262556745)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44227-0x10107dfc1490000, quorum=127.0.0.1:50210, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,42303,1696262558956 2023-10-02 16:02:55,230 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-10-02 16:02:55,231 DEBUG [(jenkins-hbase4.apache.org,44227,1696262556745)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44227-0x10107dfc1490000, quorum=127.0.0.1:50210, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43801,1696262558835 2023-10-02 16:02:55,231 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-02 16:02:55,231 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-10-02 16:02:55,232 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37455,1696262558909 2023-10-02 16:02:55,232 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42303,1696262558956 2023-10-02 16:02:55,233 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43801,1696262558835 2023-10-02 16:02:55,233 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44227] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-10-02 16:02:55,233 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44227] snapshot.SnapshotManager(406): Snapshoting '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-10-02 16:02:55,234 DEBUG [(jenkins-hbase4.apache.org,44227,1696262556745)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44227-0x10107dfc1490000, quorum=127.0.0.1:50210, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,37455,1696262558909 2023-10-02 16:02:55,234 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-02 16:02:55,235 DEBUG [(jenkins-hbase4.apache.org,44227,1696262556745)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44227-0x10107dfc1490000, quorum=127.0.0.1:50210, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,42303,1696262558956 2023-10-02 16:02:55,235 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-10-02 16:02:55,235 DEBUG [(jenkins-hbase4.apache.org,44227,1696262556745)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44227-0x10107dfc1490000, quorum=127.0.0.1:50210, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43801,1696262558835 2023-10-02 16:02:55,236 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37455,1696262558909 2023-10-02 16:02:55,237 DEBUG [Listener at jenkins-hbase4.apache.org/32975] client.HBaseAdmin(2428): (#5) Sleeping: 1000ms while waiting for snapshot completion. 2023-10-02 16:02:55,239 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42303,1696262558956 2023-10-02 16:02:55,241 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43801,1696262558835 2023-10-02 16:02:55,253 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): regionserver:42303-0x10107dfc1490003, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-02 16:02:55,253 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): regionserver:43801-0x10107dfc1490001, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-02 16:02:55,253 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): regionserver:42303-0x10107dfc1490003, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-02 16:02:55,253 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): regionserver:37455-0x10107dfc1490002, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-02 16:02:55,253 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-02 16:02:55,253 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-02 16:02:55,253 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): regionserver:37455-0x10107dfc1490002, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-02 16:02:55,253 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-02 16:02:55,253 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-02 16:02:55,254 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): regionserver:43801-0x10107dfc1490001, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-02 16:02:55,253 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-02 16:02:55,254 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-02 16:02:55,254 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-02 16:02:55,254 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-02 16:02:55,254 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-02 16:02:55,255 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-02 16:02:55,254 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-02 16:02:55,254 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-02 16:02:55,257 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): master:44227-0x10107dfc1490000, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43801,1696262558835 2023-10-02 16:02:55,257 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): master:44227-0x10107dfc1490000, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-10-02 16:02:55,257 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): master:44227-0x10107dfc1490000, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,42303,1696262558956 2023-10-02 16:02:55,257 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): master:44227-0x10107dfc1490000, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,37455,1696262558909 2023-10-02 16:02:55,257 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): master:44227-0x10107dfc1490000, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-10-02 16:02:55,257 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): master:44227-0x10107dfc1490000, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43801,1696262558835 2023-10-02 16:02:55,257 DEBUG [(jenkins-hbase4.apache.org,44227,1696262556745)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-02 16:02:55,257 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): master:44227-0x10107dfc1490000, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-10-02 16:02:55,257 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportWithTargetName 2023-10-02 16:02:55,257 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportWithTargetName 2023-10-02 16:02:55,258 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 90c8eeaaf01a24f585da11044309be71, NAME => 'testtb-testExportWithTargetName,.mob,0.90c8eeaaf01a24f585da11044309be71.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testExportWithTargetName 2023-10-02 16:02:55,258 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-10-02 16:02:55,257 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): master:44227-0x10107dfc1490000, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,42303,1696262558956 2023-10-02 16:02:55,258 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): master:44227-0x10107dfc1490000, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,37455,1696262558909 2023-10-02 16:02:55,258 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): master:44227-0x10107dfc1490000, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-10-02 16:02:55,258 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): master:44227-0x10107dfc1490000, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-10-02 16:02:55,262 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:44227-0x10107dfc1490000, quorum=127.0.0.1:50210, baseZNode=/hbase Unable to get data of znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName because node does not exist (not an error) 2023-10-02 16:02:55,267 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b20231002bf2da138d7cd4e96ac7e2fad9703961b, hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e202310022438e72623544a229a50066abe4d72f9] mob files 2023-10-02 16:02:55,267 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b20231002bf2da138d7cd4e96ac7e2fad9703961b 2023-10-02 16:02:55,267 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e202310022438e72623544a229a50066abe4d72f9 2023-10-02 16:02:55,330 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportWithTargetName 2023-10-02 16:02:55,331 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName 2023-10-02 16:02:55,469 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName to hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/.hbase-snapshot/snaptb0-testExportWithTargetName 2023-10-02 16:02:55,471 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed 2023-10-02 16:02:55,471 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName 2023-10-02 16:02:55,471 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName 2023-10-02 16:02:55,471 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName at 1696262574098Completed referencing HFiles for the mob region of table: testtb-testExportWithTargetName at 1696262575330 (+1232 ms)Consolidate snapshot: snaptb0-testExportWithTargetName at 1696262575330Loading Region manifests for snaptb0-testExportWithTargetName at 1696262575330Writing data manifest for snaptb0-testExportWithTargetName at 1696262575363 (+33 ms)Verifying snapshot: snaptb0-testExportWithTargetName at 1696262575425 (+62 ms)Snapshot snaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed at 1696262575471 (+46 ms) 2023-10-02 16:02:55,475 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=20, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-10-02 16:02:55,482 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=20, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED in 1.3690 sec 2023-10-02 16:02:56,237 DEBUG [Listener at jenkins-hbase4.apache.org/32975] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-02 16:02:56,241 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44227] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-10-02 16:02:56,241 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44227] snapshot.SnapshotManager(403): Snapshot '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' has completed, notifying client. 2023-10-02 16:02:56,242 INFO [Listener at jenkins-hbase4.apache.org/32975] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/export-test/export-1696262576242 2023-10-02 16:02:56,243 INFO [Listener at jenkins-hbase4.apache.org/32975] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:42119, tgtDir=hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/export-test/export-1696262576242, rawTgtDir=hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/export-test/export-1696262576242, srcFsUri=hdfs://localhost:42119, srcDir=hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af 2023-10-02 16:02:56,317 DEBUG [Listener at jenkins-hbase4.apache.org/32975] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:42119, inputRoot=hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af 2023-10-02 16:02:56,317 DEBUG [Listener at jenkins-hbase4.apache.org/32975] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_472570526_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/export-test/export-1696262576242, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/export-test/export-1696262576242/.hbase-snapshot/.tmp/testExportWithTargetName 2023-10-02 16:02:56,317 INFO [Listener at jenkins-hbase4.apache.org/32975] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:42119, inputRoot=hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af, snapshotDir=hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/.hbase-snapshot/snaptb0-testExportWithTargetName. 2023-10-02 16:02:56,425 INFO [Listener at jenkins-hbase4.apache.org/32975] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/.hbase-snapshot/snaptb0-testExportWithTargetName to hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/export-test/export-1696262576242/.hbase-snapshot/.tmp/testExportWithTargetName 2023-10-02 16:02:57,182 DEBUG [Listener at jenkins-hbase4.apache.org/32975] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-10-02 16:02:57,183 DEBUG [Listener at jenkins-hbase4.apache.org/32975] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-10-02 16:02:57,184 DEBUG [Listener at jenkins-hbase4.apache.org/32975] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-10-02 16:02:57,185 DEBUG [Listener at jenkins-hbase4.apache.org/32975] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-10-02 16:02:57,429 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-10-02 16:02:58,702 DEBUG [Listener at jenkins-hbase4.apache.org/32975] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ec4ab044-456e-ce77-098f-f91b72a3e0ab/hadoop-6226118715035155378.jar 2023-10-02 16:02:58,703 DEBUG [Listener at jenkins-hbase4.apache.org/32975] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-10-02 16:02:58,704 DEBUG [Listener at jenkins-hbase4.apache.org/32975] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-10-02 16:02:58,804 DEBUG [Listener at jenkins-hbase4.apache.org/32975] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ec4ab044-456e-ce77-098f-f91b72a3e0ab/hadoop-8935806962491275206.jar 2023-10-02 16:02:58,805 DEBUG [Listener at jenkins-hbase4.apache.org/32975] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-10-02 16:02:58,806 DEBUG [Listener at jenkins-hbase4.apache.org/32975] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-10-02 16:02:58,806 DEBUG [Listener at jenkins-hbase4.apache.org/32975] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-10-02 16:02:58,807 DEBUG [Listener at jenkins-hbase4.apache.org/32975] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-10-02 16:02:58,808 DEBUG [Listener at jenkins-hbase4.apache.org/32975] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-10-02 16:02:58,808 DEBUG [Listener at jenkins-hbase4.apache.org/32975] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-10-02 16:02:58,809 DEBUG [Listener at jenkins-hbase4.apache.org/32975] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-10-02 16:02:58,810 DEBUG [Listener at jenkins-hbase4.apache.org/32975] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-10-02 16:02:58,811 DEBUG [Listener at jenkins-hbase4.apache.org/32975] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-10-02 16:02:58,811 DEBUG [Listener at jenkins-hbase4.apache.org/32975] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-10-02 16:02:58,812 DEBUG [Listener at jenkins-hbase4.apache.org/32975] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-10-02 16:02:58,813 DEBUG [Listener at jenkins-hbase4.apache.org/32975] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-10-02 16:02:58,813 DEBUG [Listener at jenkins-hbase4.apache.org/32975] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-10-02 16:02:58,814 DEBUG [Listener at jenkins-hbase4.apache.org/32975] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-10-02 16:02:58,815 DEBUG [Listener at jenkins-hbase4.apache.org/32975] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-10-02 16:02:58,816 DEBUG [Listener at jenkins-hbase4.apache.org/32975] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-10-02 16:02:58,823 DEBUG [Listener at jenkins-hbase4.apache.org/32975] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-02 16:02:58,823 DEBUG [Listener at jenkins-hbase4.apache.org/32975] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-02 16:02:58,824 DEBUG [Listener at jenkins-hbase4.apache.org/32975] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-10-02 16:02:58,825 DEBUG [Listener at jenkins-hbase4.apache.org/32975] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-02 16:02:58,826 DEBUG [Listener at jenkins-hbase4.apache.org/32975] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-02 16:02:58,827 DEBUG [Listener at jenkins-hbase4.apache.org/32975] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-10-02 16:02:58,827 DEBUG [Listener at jenkins-hbase4.apache.org/32975] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-10-02 16:03:00,663 WARN [Listener at jenkins-hbase4.apache.org/32975] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-10-02 16:03:00,674 INFO [Listener at jenkins-hbase4.apache.org/32975] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportWithTargetName' hfile list 2023-10-02 16:03:00,686 DEBUG [Listener at jenkins-hbase4.apache.org/32975] snapshot.ExportSnapshot(671): export split=0 size=30.9 K 2023-10-02 16:03:01,830 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-10-02 16:03:01,831 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-10-02 16:03:02,148 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696262569087_0001_000001 (auth:SIMPLE) 2023-10-02 16:03:09,047 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696262569087_0001_000001 (auth:SIMPLE) 2023-10-02 16:03:11,555 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696262569087_0001_000001 (auth:SIMPLE) 2023-10-02 16:03:21,780 INFO [Listener at jenkins-hbase4.apache.org/32975] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-10-02 16:03:21,782 INFO [Listener at jenkins-hbase4.apache.org/32975] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-10-02 16:03:21,867 INFO [Listener at jenkins-hbase4.apache.org/32975] snapshot.ExportSnapshot(1127): Export Completed: testExportWithTargetName 2023-10-02 16:03:21,867 INFO [Listener at jenkins-hbase4.apache.org/32975] snapshot.TestExportSnapshot(279): Exported snapshot 2023-10-02 16:03:21,869 INFO [Listener at jenkins-hbase4.apache.org/32975] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-10-02 16:03:21,869 DEBUG [Listener at jenkins-hbase4.apache.org/32975] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_95248091_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/.hbase-snapshot/snaptb0-testExportWithTargetName at hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/.hbase-snapshot/snaptb0-testExportWithTargetName 2023-10-02 16:03:21,870 DEBUG [Listener at jenkins-hbase4.apache.org/32975] snapshot.TestExportSnapshot(367): hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/.hbase-snapshot/snaptb0-testExportWithTargetName/.snapshotinfo 2023-10-02 16:03:21,870 DEBUG [Listener at jenkins-hbase4.apache.org/32975] snapshot.TestExportSnapshot(367): hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/.hbase-snapshot/snaptb0-testExportWithTargetName/data.manifest 2023-10-02 16:03:21,870 DEBUG [Listener at jenkins-hbase4.apache.org/32975] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_95248091_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/export-test/export-1696262576242/.hbase-snapshot/testExportWithTargetName at hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/export-test/export-1696262576242/.hbase-snapshot/testExportWithTargetName 2023-10-02 16:03:21,871 DEBUG [Listener at jenkins-hbase4.apache.org/32975] snapshot.TestExportSnapshot(367): hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/export-test/export-1696262576242/.hbase-snapshot/testExportWithTargetName/.snapshotinfo 2023-10-02 16:03:21,871 DEBUG [Listener at jenkins-hbase4.apache.org/32975] snapshot.TestExportSnapshot(367): hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/export-test/export-1696262576242/.hbase-snapshot/testExportWithTargetName/data.manifest 2023-10-02 16:03:21,913 INFO [Listener at jenkins-hbase4.apache.org/32975] client.HBaseAdmin$15(890): Started disable of testtb-testExportWithTargetName 2023-10-02 16:03:21,920 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44227] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportWithTargetName 2023-10-02 16:03:21,933 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44227] procedure2.ProcedureExecutor(1028): Stored pid=21, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportWithTargetName 2023-10-02 16:03:21,946 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44227] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-10-02 16:03:21,958 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696262601957"}]},"ts":"1696262601957"} 2023-10-02 16:03:21,960 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=DISABLING in hbase:meta 2023-10-02 16:03:21,974 INFO [PEWorker-4] procedure.DisableTableProcedure(293): Set testtb-testExportWithTargetName to state=DISABLING 2023-10-02 16:03:21,977 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=22, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=0dce21880e3bd38446fdcc09c01710de, UNASSIGN}, {pid=23, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=a405b86bbfbe0589c4f6da2d89902060, UNASSIGN}] 2023-10-02 16:03:21,979 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=22, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=0dce21880e3bd38446fdcc09c01710de, UNASSIGN 2023-10-02 16:03:21,981 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=22 updating hbase:meta row=0dce21880e3bd38446fdcc09c01710de, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,42303,1696262558956 2023-10-02 16:03:21,981 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,,1696262571263.0dce21880e3bd38446fdcc09c01710de.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1696262601981"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696262601981"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696262601981"}]},"ts":"1696262601981"} 2023-10-02 16:03:21,986 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=24, ppid=22, state=RUNNABLE; CloseRegionProcedure 0dce21880e3bd38446fdcc09c01710de, server=jenkins-hbase4.apache.org,42303,1696262558956}] 2023-10-02 16:03:21,990 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=23, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=a405b86bbfbe0589c4f6da2d89902060, UNASSIGN 2023-10-02 16:03:21,998 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=23 updating hbase:meta row=a405b86bbfbe0589c4f6da2d89902060, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,43801,1696262558835 2023-10-02 16:03:21,999 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,1,1696262571263.a405b86bbfbe0589c4f6da2d89902060.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1696262601998"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696262601998"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696262601998"}]},"ts":"1696262601998"} 2023-10-02 16:03:22,002 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=25, ppid=23, state=RUNNABLE; CloseRegionProcedure a405b86bbfbe0589c4f6da2d89902060, server=jenkins-hbase4.apache.org,43801,1696262558835}] 2023-10-02 16:03:22,048 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44227] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-10-02 16:03:22,168 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 0dce21880e3bd38446fdcc09c01710de 2023-10-02 16:03:22,168 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close a405b86bbfbe0589c4f6da2d89902060 2023-10-02 16:03:22,169 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 0dce21880e3bd38446fdcc09c01710de, disabling compactions & flushes 2023-10-02 16:03:22,169 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,,1696262571263.0dce21880e3bd38446fdcc09c01710de. 2023-10-02 16:03:22,169 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing a405b86bbfbe0589c4f6da2d89902060, disabling compactions & flushes 2023-10-02 16:03:22,169 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,,1696262571263.0dce21880e3bd38446fdcc09c01710de. 2023-10-02 16:03:22,169 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,1,1696262571263.a405b86bbfbe0589c4f6da2d89902060. 2023-10-02 16:03:22,169 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,1,1696262571263.a405b86bbfbe0589c4f6da2d89902060. 2023-10-02 16:03:22,169 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,1,1696262571263.a405b86bbfbe0589c4f6da2d89902060. after waiting 0 ms 2023-10-02 16:03:22,169 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,1,1696262571263.a405b86bbfbe0589c4f6da2d89902060. 2023-10-02 16:03:22,169 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,,1696262571263.0dce21880e3bd38446fdcc09c01710de. after waiting 0 ms 2023-10-02 16:03:22,170 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,,1696262571263.0dce21880e3bd38446fdcc09c01710de. 2023-10-02 16:03:22,226 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/data/default/testtb-testExportWithTargetName/a405b86bbfbe0589c4f6da2d89902060/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-10-02 16:03:22,226 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/data/default/testtb-testExportWithTargetName/0dce21880e3bd38446fdcc09c01710de/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-10-02 16:03:22,231 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-10-02 16:03:22,231 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-10-02 16:03:22,233 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,1,1696262571263.a405b86bbfbe0589c4f6da2d89902060. 2023-10-02 16:03:22,233 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for a405b86bbfbe0589c4f6da2d89902060: 2023-10-02 16:03:22,233 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,,1696262571263.0dce21880e3bd38446fdcc09c01710de. 2023-10-02 16:03:22,233 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 0dce21880e3bd38446fdcc09c01710de: 2023-10-02 16:03:22,239 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=23 updating hbase:meta row=a405b86bbfbe0589c4f6da2d89902060, regionState=CLOSED 2023-10-02 16:03:22,240 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,1,1696262571263.a405b86bbfbe0589c4f6da2d89902060.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1696262602239"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696262602239"}]},"ts":"1696262602239"} 2023-10-02 16:03:22,242 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed a405b86bbfbe0589c4f6da2d89902060 2023-10-02 16:03:22,243 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=22 updating hbase:meta row=0dce21880e3bd38446fdcc09c01710de, regionState=CLOSED 2023-10-02 16:03:22,243 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,,1696262571263.0dce21880e3bd38446fdcc09c01710de.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1696262602243"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696262602243"}]},"ts":"1696262602243"} 2023-10-02 16:03:22,245 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 0dce21880e3bd38446fdcc09c01710de 2023-10-02 16:03:22,252 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=25, resume processing ppid=23 2023-10-02 16:03:22,252 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=25, ppid=23, state=SUCCESS; CloseRegionProcedure a405b86bbfbe0589c4f6da2d89902060, server=jenkins-hbase4.apache.org,43801,1696262558835 in 246 msec 2023-10-02 16:03:22,253 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44227] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-10-02 16:03:22,254 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=24, resume processing ppid=22 2023-10-02 16:03:22,254 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=23, ppid=21, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=a405b86bbfbe0589c4f6da2d89902060, UNASSIGN in 275 msec 2023-10-02 16:03:22,254 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=24, ppid=22, state=SUCCESS; CloseRegionProcedure 0dce21880e3bd38446fdcc09c01710de, server=jenkins-hbase4.apache.org,42303,1696262558956 in 264 msec 2023-10-02 16:03:22,257 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=22, resume processing ppid=21 2023-10-02 16:03:22,257 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=22, ppid=21, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=0dce21880e3bd38446fdcc09c01710de, UNASSIGN in 277 msec 2023-10-02 16:03:22,258 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696262602258"}]},"ts":"1696262602258"} 2023-10-02 16:03:22,260 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=DISABLED in hbase:meta 2023-10-02 16:03:22,263 INFO [PEWorker-2] procedure.DisableTableProcedure(305): Set testtb-testExportWithTargetName to state=DISABLED 2023-10-02 16:03:22,268 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=21, state=SUCCESS; DisableTableProcedure table=testtb-testExportWithTargetName in 340 msec 2023-10-02 16:03:22,555 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44227] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-10-02 16:03:22,555 INFO [Listener at jenkins-hbase4.apache.org/32975] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportWithTargetName, procId: 21 completed 2023-10-02 16:03:22,562 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44227] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportWithTargetName 2023-10-02 16:03:22,572 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44227] procedure2.ProcedureExecutor(1028): Stored pid=26, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-10-02 16:03:22,577 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=26, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-10-02 16:03:22,578 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44227] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportWithTargetName 2023-10-02 16:03:22,583 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=42303] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportWithTargetName 2023-10-02 16:03:22,584 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=26, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-10-02 16:03:22,588 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): master:44227-0x10107dfc1490000, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-10-02 16:03:22,588 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): regionserver:37455-0x10107dfc1490002, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-10-02 16:03:22,589 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF 2023-10-02 16:03:22,589 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF 2023-10-02 16:03:22,593 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): regionserver:42303-0x10107dfc1490003, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-10-02 16:03:22,594 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF 2023-10-02 16:03:22,596 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): regionserver:43801-0x10107dfc1490001, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-10-02 16:03:22,597 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF 2023-10-02 16:03:22,597 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/.tmp/data/default/testtb-testExportWithTargetName/0dce21880e3bd38446fdcc09c01710de 2023-10-02 16:03:22,599 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/.tmp/data/default/testtb-testExportWithTargetName/a405b86bbfbe0589c4f6da2d89902060 2023-10-02 16:03:22,600 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): regionserver:43801-0x10107dfc1490001, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-10-02 16:03:22,600 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): regionserver:42303-0x10107dfc1490003, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-10-02 16:03:22,601 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): regionserver:42303-0x10107dfc1490003, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-02 16:03:22,600 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): regionserver:43801-0x10107dfc1490001, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-02 16:03:22,600 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): regionserver:37455-0x10107dfc1490002, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-10-02 16:03:22,602 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): regionserver:37455-0x10107dfc1490002, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-02 16:03:22,600 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): master:44227-0x10107dfc1490000, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-10-02 16:03:22,602 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): master:44227-0x10107dfc1490000, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-02 16:03:22,605 DEBUG [HFileArchiver-5] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/.tmp/data/default/testtb-testExportWithTargetName/0dce21880e3bd38446fdcc09c01710de/cf, FileablePath, hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/.tmp/data/default/testtb-testExportWithTargetName/0dce21880e3bd38446fdcc09c01710de/recovered.edits] 2023-10-02 16:03:22,606 DEBUG [HFileArchiver-6] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/.tmp/data/default/testtb-testExportWithTargetName/a405b86bbfbe0589c4f6da2d89902060/cf, FileablePath, hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/.tmp/data/default/testtb-testExportWithTargetName/a405b86bbfbe0589c4f6da2d89902060/recovered.edits] 2023-10-02 16:03:22,606 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44227] master.MasterRpcServices(1230): Checking to see if procedure is done pid=26 2023-10-02 16:03:22,618 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/.tmp/data/default/testtb-testExportWithTargetName/0dce21880e3bd38446fdcc09c01710de/cf/a920b916b2314b8b96cff521fbd3be33 to hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/archive/data/default/testtb-testExportWithTargetName/0dce21880e3bd38446fdcc09c01710de/cf/a920b916b2314b8b96cff521fbd3be33 2023-10-02 16:03:22,618 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/.tmp/data/default/testtb-testExportWithTargetName/a405b86bbfbe0589c4f6da2d89902060/cf/84c7c73fa1094a0b830bb8d16c77af06 to hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/archive/data/default/testtb-testExportWithTargetName/a405b86bbfbe0589c4f6da2d89902060/cf/84c7c73fa1094a0b830bb8d16c77af06 2023-10-02 16:03:22,624 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/.tmp/data/default/testtb-testExportWithTargetName/0dce21880e3bd38446fdcc09c01710de/recovered.edits/9.seqid to hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/archive/data/default/testtb-testExportWithTargetName/0dce21880e3bd38446fdcc09c01710de/recovered.edits/9.seqid 2023-10-02 16:03:22,625 DEBUG [HFileArchiver-5] backup.HFileArchiver(596): Deleted hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/.tmp/data/default/testtb-testExportWithTargetName/0dce21880e3bd38446fdcc09c01710de 2023-10-02 16:03:22,626 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/.tmp/data/default/testtb-testExportWithTargetName/a405b86bbfbe0589c4f6da2d89902060/recovered.edits/9.seqid to hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/archive/data/default/testtb-testExportWithTargetName/a405b86bbfbe0589c4f6da2d89902060/recovered.edits/9.seqid 2023-10-02 16:03:22,627 DEBUG [HFileArchiver-6] backup.HFileArchiver(596): Deleted hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/.tmp/data/default/testtb-testExportWithTargetName/a405b86bbfbe0589c4f6da2d89902060 2023-10-02 16:03:22,627 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testtb-testExportWithTargetName regions 2023-10-02 16:03:22,627 DEBUG [PEWorker-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71 2023-10-02 16:03:22,629 DEBUG [PEWorker-5] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf] 2023-10-02 16:03:22,634 DEBUG [PEWorker-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b20231002bf2da138d7cd4e96ac7e2fad9703961b to hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/archive/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b20231002bf2da138d7cd4e96ac7e2fad9703961b 2023-10-02 16:03:22,636 DEBUG [PEWorker-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e202310022438e72623544a229a50066abe4d72f9 to hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/archive/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e202310022438e72623544a229a50066abe4d72f9 2023-10-02 16:03:22,637 DEBUG [PEWorker-5] backup.HFileArchiver(596): Deleted hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71 2023-10-02 16:03:22,641 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=26, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-10-02 16:03:22,675 WARN [PEWorker-5] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportWithTargetName from hbase:meta 2023-10-02 16:03:22,682 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportWithTargetName' descriptor. 2023-10-02 16:03:22,688 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=26, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-10-02 16:03:22,688 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportWithTargetName' from region states. 2023-10-02 16:03:22,688 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportWithTargetName,,1696262571263.0dce21880e3bd38446fdcc09c01710de.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1696262602688"}]},"ts":"9223372036854775807"} 2023-10-02 16:03:22,688 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportWithTargetName,1,1696262571263.a405b86bbfbe0589c4f6da2d89902060.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1696262602688"}]},"ts":"9223372036854775807"} 2023-10-02 16:03:22,692 INFO [PEWorker-5] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-10-02 16:03:22,692 DEBUG [PEWorker-5] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 0dce21880e3bd38446fdcc09c01710de, NAME => 'testtb-testExportWithTargetName,,1696262571263.0dce21880e3bd38446fdcc09c01710de.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => a405b86bbfbe0589c4f6da2d89902060, NAME => 'testtb-testExportWithTargetName,1,1696262571263.a405b86bbfbe0589c4f6da2d89902060.', STARTKEY => '1', ENDKEY => ''}] 2023-10-02 16:03:22,692 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportWithTargetName' as deleted. 2023-10-02 16:03:22,692 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1696262602692"}]},"ts":"9223372036854775807"} 2023-10-02 16:03:22,701 INFO [PEWorker-5] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportWithTargetName state from META 2023-10-02 16:03:22,704 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(130): Finished pid=26, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-10-02 16:03:22,707 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=26, state=SUCCESS; DeleteTableProcedure table=testtb-testExportWithTargetName in 140 msec 2023-10-02 16:03:22,707 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44227] master.MasterRpcServices(1230): Checking to see if procedure is done pid=26 2023-10-02 16:03:22,710 INFO [Listener at jenkins-hbase4.apache.org/32975] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportWithTargetName, procId: 26 completed 2023-10-02 16:03:22,735 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44227] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportWithTargetName" 2023-10-02 16:03:22,741 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44227] snapshot.SnapshotManager(335): Deleting snapshot: emptySnaptb0-testExportWithTargetName 2023-10-02 16:03:22,748 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44227] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportWithTargetName" 2023-10-02 16:03:22,751 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44227] snapshot.SnapshotManager(335): Deleting snapshot: snaptb0-testExportWithTargetName 2023-10-02 16:03:22,802 INFO [Listener at jenkins-hbase4.apache.org/32975] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testExportWithTargetName Thread=744 (was 700) Potentially hanging thread: hconnection-0x646a4964-shared-pool-10 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-3 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x646a4964-shared-pool-12 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (337744187) connection to jenkins-hbase4.apache.org/172.31.14.131:36437 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ec4ab044-456e-ce77-098f-f91b72a3e0ab/cluster_a1e9014f-f81d-2e22-2bb2-f7ceda69c14c/dfs/data/data6/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ContainersLauncher #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: member: 'jenkins-hbase4.apache.org,43801,1696262558835' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ContainersLauncher #0 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.read1(BufferedReader.java:212) java.io.BufferedReader.read(BufferedReader.java:286) org.apache.hadoop.util.Shell$ShellCommandExecutor.parseExecResult(Shell.java:1229) org.apache.hadoop.util.Shell.runCommand(Shell.java:984) org.apache.hadoop.util.Shell.run(Shell.java:884) org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:1216) org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor.launchContainer(DefaultContainerExecutor.java:294) org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.launchContainer(ContainerLaunch.java:442) org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:293) org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:97) java.util.concurrent.FutureTask.run(FutureTask.java:266) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-1288 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: (jenkins-hbase4.apache.org,44227,1696262556745)-proc-coordinator-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: htable-pool-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Container metrics unregistration java.lang.Object.wait(Native Method) java.util.TimerThread.mainLoop(Timer.java:552) java.util.TimerThread.run(Timer.java:505) Potentially hanging thread: hconnection-0x646a4964-shared-pool-9 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ec4ab044-456e-ce77-098f-f91b72a3e0ab/cluster_a1e9014f-f81d-2e22-2bb2-f7ceda69c14c/dfs/data/data4/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-3-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ec4ab044-456e-ce77-098f-f91b72a3e0ab/cluster_a1e9014f-f81d-2e22-2bb2-f7ceda69c14c/dfs/data/data1/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ec4ab044-456e-ce77-098f-f91b72a3e0ab/cluster_a1e9014f-f81d-2e22-2bb2-f7ceda69c14c/dfs/data/data5/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: member: 'jenkins-hbase4.apache.org,42303,1696262558956' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ec4ab044-456e-ce77-098f-f91b72a3e0ab/cluster_a1e9014f-f81d-2e22-2bb2-f7ceda69c14c/dfs/data/data2/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MutableQuantiles-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_95248091_17 at /127.0.0.1:39366 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_95248091_17 at /127.0.0.1:44664 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: htable-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x646a4964-shared-pool-11 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (337744187) connection to localhost/127.0.0.1:42119 from jenkins.hfs.0 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-237273801_1 at /127.0.0.1:39338 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-5 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_95248091_17 at /127.0.0.1:45442 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: member: 'jenkins-hbase4.apache.org,37455,1696262558909' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-3-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-6 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (337744187) connection to jenkins-hbase4.apache.org/172.31.14.131:32975 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-2 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ec4ab044-456e-ce77-098f-f91b72a3e0ab/cluster_a1e9014f-f81d-2e22-2bb2-f7ceda69c14c/dfs/data/data3/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=913 (was 903) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=743 (was 500) - SystemLoadAverage LEAK? -, ProcessCount=197 (was 194) - ProcessCount LEAK? -, AvailableMemoryMB=1654 (was 253) - AvailableMemoryMB LEAK? - 2023-10-02 16:03:22,803 WARN [Listener at jenkins-hbase4.apache.org/32975] hbase.ResourceChecker(130): Thread=744 is superior to 500 2023-10-02 16:03:22,837 INFO [Listener at jenkins-hbase4.apache.org/32975] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testExportFileSystemState Thread=744, OpenFileDescriptor=913, MaxFileDescriptor=60000, SystemLoadAverage=743, ProcessCount=197, AvailableMemoryMB=1654 2023-10-02 16:03:22,837 WARN [Listener at jenkins-hbase4.apache.org/32975] hbase.ResourceChecker(130): Thread=744 is superior to 500 2023-10-02 16:03:22,840 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44227] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-10-02 16:03:22,845 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44227] procedure2.ProcedureExecutor(1028): Stored pid=27, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemState 2023-10-02 16:03:22,853 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_PRE_OPERATION 2023-10-02 16:03:22,855 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44227] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemState" procId is: 27 2023-10-02 16:03:22,857 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-10-02 16:03:22,859 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44227] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-10-02 16:03:22,867 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/.tmp/data/default/testtb-testExportFileSystemState/b59ba9dd49e5dc36ea7b791aa7aba65a 2023-10-02 16:03:22,867 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/.tmp/data/default/testtb-testExportFileSystemState/9d4d6a0fc331dee62a0e47d9a2e1e68b 2023-10-02 16:03:22,868 DEBUG [HFileArchiver-7] backup.HFileArchiver(153): Directory hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/.tmp/data/default/testtb-testExportFileSystemState/b59ba9dd49e5dc36ea7b791aa7aba65a empty. 2023-10-02 16:03:22,868 DEBUG [HFileArchiver-8] backup.HFileArchiver(153): Directory hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/.tmp/data/default/testtb-testExportFileSystemState/9d4d6a0fc331dee62a0e47d9a2e1e68b empty. 2023-10-02 16:03:22,869 DEBUG [HFileArchiver-7] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/.tmp/data/default/testtb-testExportFileSystemState/b59ba9dd49e5dc36ea7b791aa7aba65a 2023-10-02 16:03:22,870 DEBUG [HFileArchiver-8] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/.tmp/data/default/testtb-testExportFileSystemState/9d4d6a0fc331dee62a0e47d9a2e1e68b 2023-10-02 16:03:22,870 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemState regions 2023-10-02 16:03:22,905 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/.tmp/data/default/testtb-testExportFileSystemState/.tabledesc/.tableinfo.0000000001 2023-10-02 16:03:22,907 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(7675): creating {ENCODED => b59ba9dd49e5dc36ea7b791aa7aba65a, NAME => 'testtb-testExportFileSystemState,,1696262602840.b59ba9dd49e5dc36ea7b791aa7aba65a.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/.tmp 2023-10-02 16:03:22,910 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(7675): creating {ENCODED => 9d4d6a0fc331dee62a0e47d9a2e1e68b, NAME => 'testtb-testExportFileSystemState,1,1696262602840.9d4d6a0fc331dee62a0e47d9a2e1e68b.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/.tmp 2023-10-02 16:03:22,961 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,1,1696262602840.9d4d6a0fc331dee62a0e47d9a2e1e68b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-02 16:03:22,962 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1604): Closing 9d4d6a0fc331dee62a0e47d9a2e1e68b, disabling compactions & flushes 2023-10-02 16:03:22,962 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,1,1696262602840.9d4d6a0fc331dee62a0e47d9a2e1e68b. 2023-10-02 16:03:22,962 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44227] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-10-02 16:03:22,962 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,1,1696262602840.9d4d6a0fc331dee62a0e47d9a2e1e68b. 2023-10-02 16:03:22,968 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,1,1696262602840.9d4d6a0fc331dee62a0e47d9a2e1e68b. after waiting 0 ms 2023-10-02 16:03:22,968 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,1,1696262602840.9d4d6a0fc331dee62a0e47d9a2e1e68b. 2023-10-02 16:03:22,969 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,1,1696262602840.9d4d6a0fc331dee62a0e47d9a2e1e68b. 2023-10-02 16:03:22,969 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1558): Region close journal for 9d4d6a0fc331dee62a0e47d9a2e1e68b: 2023-10-02 16:03:22,970 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,,1696262602840.b59ba9dd49e5dc36ea7b791aa7aba65a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-02 16:03:22,970 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1604): Closing b59ba9dd49e5dc36ea7b791aa7aba65a, disabling compactions & flushes 2023-10-02 16:03:22,970 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,,1696262602840.b59ba9dd49e5dc36ea7b791aa7aba65a. 2023-10-02 16:03:22,970 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,,1696262602840.b59ba9dd49e5dc36ea7b791aa7aba65a. 2023-10-02 16:03:22,970 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,,1696262602840.b59ba9dd49e5dc36ea7b791aa7aba65a. after waiting 0 ms 2023-10-02 16:03:22,971 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,,1696262602840.b59ba9dd49e5dc36ea7b791aa7aba65a. 2023-10-02 16:03:22,971 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,,1696262602840.b59ba9dd49e5dc36ea7b791aa7aba65a. 2023-10-02 16:03:22,971 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1558): Region close journal for b59ba9dd49e5dc36ea7b791aa7aba65a: 2023-10-02 16:03:22,974 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_ADD_TO_META 2023-10-02 16:03:22,975 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,1,1696262602840.9d4d6a0fc331dee62a0e47d9a2e1e68b.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1696262602975"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696262602975"}]},"ts":"1696262602975"} 2023-10-02 16:03:22,975 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,,1696262602840.b59ba9dd49e5dc36ea7b791aa7aba65a.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1696262602975"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696262602975"}]},"ts":"1696262602975"} 2023-10-02 16:03:22,978 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-10-02 16:03:22,980 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-10-02 16:03:22,980 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696262602980"}]},"ts":"1696262602980"} 2023-10-02 16:03:22,989 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=ENABLING in hbase:meta 2023-10-02 16:03:22,996 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-10-02 16:03:22,998 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-10-02 16:03:22,999 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-10-02 16:03:22,999 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-10-02 16:03:22,999 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-10-02 16:03:22,999 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=b59ba9dd49e5dc36ea7b791aa7aba65a, ASSIGN}, {pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=9d4d6a0fc331dee62a0e47d9a2e1e68b, ASSIGN}] 2023-10-02 16:03:23,003 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=b59ba9dd49e5dc36ea7b791aa7aba65a, ASSIGN 2023-10-02 16:03:23,003 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=9d4d6a0fc331dee62a0e47d9a2e1e68b, ASSIGN 2023-10-02 16:03:23,005 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=9d4d6a0fc331dee62a0e47d9a2e1e68b, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,42303,1696262558956; forceNewPlan=false, retain=false 2023-10-02 16:03:23,005 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=b59ba9dd49e5dc36ea7b791aa7aba65a, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,43801,1696262558835; forceNewPlan=false, retain=false 2023-10-02 16:03:23,157 INFO [jenkins-hbase4:44227] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-10-02 16:03:23,161 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=28 updating hbase:meta row=b59ba9dd49e5dc36ea7b791aa7aba65a, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,43801,1696262558835 2023-10-02 16:03:23,161 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,,1696262602840.b59ba9dd49e5dc36ea7b791aa7aba65a.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1696262603161"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696262603161"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696262603161"}]},"ts":"1696262603161"} 2023-10-02 16:03:23,165 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=29 updating hbase:meta row=9d4d6a0fc331dee62a0e47d9a2e1e68b, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,42303,1696262558956 2023-10-02 16:03:23,165 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,1,1696262602840.9d4d6a0fc331dee62a0e47d9a2e1e68b.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1696262603165"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696262603165"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696262603165"}]},"ts":"1696262603165"} 2023-10-02 16:03:23,165 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44227] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-10-02 16:03:23,168 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=30, ppid=28, state=RUNNABLE; OpenRegionProcedure b59ba9dd49e5dc36ea7b791aa7aba65a, server=jenkins-hbase4.apache.org,43801,1696262558835}] 2023-10-02 16:03:23,170 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=31, ppid=29, state=RUNNABLE; OpenRegionProcedure 9d4d6a0fc331dee62a0e47d9a2e1e68b, server=jenkins-hbase4.apache.org,42303,1696262558956}] 2023-10-02 16:03:23,333 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemState,,1696262602840.b59ba9dd49e5dc36ea7b791aa7aba65a. 2023-10-02 16:03:23,334 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => b59ba9dd49e5dc36ea7b791aa7aba65a, NAME => 'testtb-testExportFileSystemState,,1696262602840.b59ba9dd49e5dc36ea7b791aa7aba65a.', STARTKEY => '', ENDKEY => '1'} 2023-10-02 16:03:23,334 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemState,1,1696262602840.9d4d6a0fc331dee62a0e47d9a2e1e68b. 2023-10-02 16:03:23,334 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemState,,1696262602840.b59ba9dd49e5dc36ea7b791aa7aba65a. service=AccessControlService 2023-10-02 16:03:23,334 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 9d4d6a0fc331dee62a0e47d9a2e1e68b, NAME => 'testtb-testExportFileSystemState,1,1696262602840.9d4d6a0fc331dee62a0e47d9a2e1e68b.', STARTKEY => '1', ENDKEY => ''} 2023-10-02 16:03:23,334 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-10-02 16:03:23,335 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemState b59ba9dd49e5dc36ea7b791aa7aba65a 2023-10-02 16:03:23,335 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,,1696262602840.b59ba9dd49e5dc36ea7b791aa7aba65a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-02 16:03:23,335 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for b59ba9dd49e5dc36ea7b791aa7aba65a 2023-10-02 16:03:23,335 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for b59ba9dd49e5dc36ea7b791aa7aba65a 2023-10-02 16:03:23,335 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemState,1,1696262602840.9d4d6a0fc331dee62a0e47d9a2e1e68b. service=AccessControlService 2023-10-02 16:03:23,335 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-10-02 16:03:23,335 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemState 9d4d6a0fc331dee62a0e47d9a2e1e68b 2023-10-02 16:03:23,335 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,1,1696262602840.9d4d6a0fc331dee62a0e47d9a2e1e68b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-02 16:03:23,335 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 9d4d6a0fc331dee62a0e47d9a2e1e68b 2023-10-02 16:03:23,335 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 9d4d6a0fc331dee62a0e47d9a2e1e68b 2023-10-02 16:03:23,336 INFO [StoreOpener-b59ba9dd49e5dc36ea7b791aa7aba65a-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region b59ba9dd49e5dc36ea7b791aa7aba65a 2023-10-02 16:03:23,337 INFO [StoreOpener-9d4d6a0fc331dee62a0e47d9a2e1e68b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 9d4d6a0fc331dee62a0e47d9a2e1e68b 2023-10-02 16:03:23,338 DEBUG [StoreOpener-b59ba9dd49e5dc36ea7b791aa7aba65a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/data/default/testtb-testExportFileSystemState/b59ba9dd49e5dc36ea7b791aa7aba65a/cf 2023-10-02 16:03:23,338 DEBUG [StoreOpener-b59ba9dd49e5dc36ea7b791aa7aba65a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/data/default/testtb-testExportFileSystemState/b59ba9dd49e5dc36ea7b791aa7aba65a/cf 2023-10-02 16:03:23,339 DEBUG [StoreOpener-9d4d6a0fc331dee62a0e47d9a2e1e68b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/data/default/testtb-testExportFileSystemState/9d4d6a0fc331dee62a0e47d9a2e1e68b/cf 2023-10-02 16:03:23,339 INFO [StoreOpener-b59ba9dd49e5dc36ea7b791aa7aba65a-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region b59ba9dd49e5dc36ea7b791aa7aba65a columnFamilyName cf 2023-10-02 16:03:23,339 DEBUG [StoreOpener-9d4d6a0fc331dee62a0e47d9a2e1e68b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/data/default/testtb-testExportFileSystemState/9d4d6a0fc331dee62a0e47d9a2e1e68b/cf 2023-10-02 16:03:23,339 INFO [StoreOpener-9d4d6a0fc331dee62a0e47d9a2e1e68b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 9d4d6a0fc331dee62a0e47d9a2e1e68b columnFamilyName cf 2023-10-02 16:03:23,340 INFO [StoreOpener-b59ba9dd49e5dc36ea7b791aa7aba65a-1] regionserver.HStore(310): Store=b59ba9dd49e5dc36ea7b791aa7aba65a/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-02 16:03:23,343 INFO [StoreOpener-9d4d6a0fc331dee62a0e47d9a2e1e68b-1] regionserver.HStore(310): Store=9d4d6a0fc331dee62a0e47d9a2e1e68b/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-02 16:03:23,344 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/data/default/testtb-testExportFileSystemState/b59ba9dd49e5dc36ea7b791aa7aba65a 2023-10-02 16:03:23,345 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/data/default/testtb-testExportFileSystemState/b59ba9dd49e5dc36ea7b791aa7aba65a 2023-10-02 16:03:23,345 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/data/default/testtb-testExportFileSystemState/9d4d6a0fc331dee62a0e47d9a2e1e68b 2023-10-02 16:03:23,345 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/data/default/testtb-testExportFileSystemState/9d4d6a0fc331dee62a0e47d9a2e1e68b 2023-10-02 16:03:23,349 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for b59ba9dd49e5dc36ea7b791aa7aba65a 2023-10-02 16:03:23,349 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 9d4d6a0fc331dee62a0e47d9a2e1e68b 2023-10-02 16:03:23,357 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/data/default/testtb-testExportFileSystemState/9d4d6a0fc331dee62a0e47d9a2e1e68b/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-02 16:03:23,358 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/data/default/testtb-testExportFileSystemState/b59ba9dd49e5dc36ea7b791aa7aba65a/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-02 16:03:23,358 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 9d4d6a0fc331dee62a0e47d9a2e1e68b; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71378018, jitterRate=0.0636153519153595}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-10-02 16:03:23,358 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 9d4d6a0fc331dee62a0e47d9a2e1e68b: 2023-10-02 16:03:23,359 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened b59ba9dd49e5dc36ea7b791aa7aba65a; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60198160, jitterRate=-0.10297751426696777}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-10-02 16:03:23,359 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for b59ba9dd49e5dc36ea7b791aa7aba65a: 2023-10-02 16:03:23,360 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemState,1,1696262602840.9d4d6a0fc331dee62a0e47d9a2e1e68b., pid=31, masterSystemTime=1696262603330 2023-10-02 16:03:23,360 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemState,,1696262602840.b59ba9dd49e5dc36ea7b791aa7aba65a., pid=30, masterSystemTime=1696262603329 2023-10-02 16:03:23,362 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemState,1,1696262602840.9d4d6a0fc331dee62a0e47d9a2e1e68b. 2023-10-02 16:03:23,362 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemState,1,1696262602840.9d4d6a0fc331dee62a0e47d9a2e1e68b. 2023-10-02 16:03:23,363 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=29 updating hbase:meta row=9d4d6a0fc331dee62a0e47d9a2e1e68b, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,42303,1696262558956 2023-10-02 16:03:23,363 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemState,,1696262602840.b59ba9dd49e5dc36ea7b791aa7aba65a. 2023-10-02 16:03:23,363 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemState,,1696262602840.b59ba9dd49e5dc36ea7b791aa7aba65a. 2023-10-02 16:03:23,363 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemState,1,1696262602840.9d4d6a0fc331dee62a0e47d9a2e1e68b.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1696262603363"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1696262603363"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1696262603363"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1696262603363"}]},"ts":"1696262603363"} 2023-10-02 16:03:23,364 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=28 updating hbase:meta row=b59ba9dd49e5dc36ea7b791aa7aba65a, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,43801,1696262558835 2023-10-02 16:03:23,364 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemState,,1696262602840.b59ba9dd49e5dc36ea7b791aa7aba65a.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1696262603364"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1696262603364"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1696262603364"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1696262603364"}]},"ts":"1696262603364"} 2023-10-02 16:03:23,369 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=31, resume processing ppid=29 2023-10-02 16:03:23,371 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=31, ppid=29, state=SUCCESS; OpenRegionProcedure 9d4d6a0fc331dee62a0e47d9a2e1e68b, server=jenkins-hbase4.apache.org,42303,1696262558956 in 195 msec 2023-10-02 16:03:23,377 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=30, resume processing ppid=28 2023-10-02 16:03:23,379 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=30, ppid=28, state=SUCCESS; OpenRegionProcedure b59ba9dd49e5dc36ea7b791aa7aba65a, server=jenkins-hbase4.apache.org,43801,1696262558835 in 199 msec 2023-10-02 16:03:23,380 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=29, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=9d4d6a0fc331dee62a0e47d9a2e1e68b, ASSIGN in 372 msec 2023-10-02 16:03:23,382 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=28, resume processing ppid=27 2023-10-02 16:03:23,382 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=28, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=b59ba9dd49e5dc36ea7b791aa7aba65a, ASSIGN in 380 msec 2023-10-02 16:03:23,383 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-10-02 16:03:23,383 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696262603383"}]},"ts":"1696262603383"} 2023-10-02 16:03:23,385 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=ENABLED in hbase:meta 2023-10-02 16:03:23,388 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_POST_OPERATION 2023-10-02 16:03:23,389 DEBUG [PEWorker-5] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemState jenkins: RWXCA 2023-10-02 16:03:23,391 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=42303] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemState], kv [jenkins: RWXCA] 2023-10-02 16:03:23,394 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): regionserver:37455-0x10107dfc1490002, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-02 16:03:23,394 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): regionserver:43801-0x10107dfc1490001, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-02 16:03:23,394 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): master:44227-0x10107dfc1490000, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-02 16:03:23,394 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): regionserver:42303-0x10107dfc1490003, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-02 16:03:23,396 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-10-02 16:03:23,396 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-10-02 16:03:23,396 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-10-02 16:03:23,396 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-10-02 16:03:23,398 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=27, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemState in 553 msec 2023-10-02 16:03:23,467 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44227] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-10-02 16:03:23,468 INFO [Listener at jenkins-hbase4.apache.org/32975] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemState, procId: 27 completed 2023-10-02 16:03:23,471 DEBUG [Listener at jenkins-hbase4.apache.org/32975] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemState 2023-10-02 16:03:23,472 DEBUG [Listener at jenkins-hbase4.apache.org/32975] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemState,,1696262602840.b59ba9dd49e5dc36ea7b791aa7aba65a. 2023-10-02 16:03:23,475 INFO [Listener at jenkins-hbase4.apache.org/32975] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-10-02 16:03:23,500 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44227] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-10-02 16:03:23,500 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44227] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1696262603500 (current time:1696262603500). 2023-10-02 16:03:23,501 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44227] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-10-02 16:03:23,502 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44227] zookeeper.ReadOnlyZKClient(139): Connect 0x142107ba to 127.0.0.1:50210 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-02 16:03:23,516 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44227] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3773e204, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-02 16:03:23,518 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44227] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-02 16:03:23,523 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:57678, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-02 16:03:23,525 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44227] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x142107ba to 127.0.0.1:50210 2023-10-02 16:03:23,525 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44227] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-02 16:03:23,527 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44227] zookeeper.ReadOnlyZKClient(139): Connect 0x09801843 to 127.0.0.1:50210 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-02 16:03:23,536 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44227] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1500c21e, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-02 16:03:23,541 DEBUG [hconnection-0x3d4b6178-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-02 16:03:23,543 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:57680, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-02 16:03:23,552 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44227] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x09801843 to 127.0.0.1:50210 2023-10-02 16:03:23,552 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44227] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-02 16:03:23,552 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44227] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemState], kv [jenkins: RWXCA] 2023-10-02 16:03:23,553 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44227] snapshot.SnapshotManager(637): No existing snapshot, attempting snapshot... 2023-10-02 16:03:23,554 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44227] snapshot.SnapshotManager(684): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-10-02 16:03:23,558 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44227] snapshot.SnapshotManager(519): Unable to retrieve ACL status for path: hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/.hbase-snapshot, current working dir path: hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState org.apache.hadoop.hdfs.protocol.AclException: The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.ipc.RemoteException.instantiateException(RemoteException.java:121) at org.apache.hadoop.ipc.RemoteException.unwrapRemoteException(RemoteException.java:88) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2736) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2294) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2291) at org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81) at org.apache.hadoop.hdfs.DistributedFileSystem.getAclStatus(DistributedFileSystem.java:2291) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.updateWorkingDirAclsIfRequired(SnapshotManager.java:517) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.prepareToTakeSnapshot(SnapshotManager.java:490) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.snapshotEnabledTable(SnapshotManager.java:559) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshotInternal(SnapshotManager.java:687) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshot(SnapshotManager.java:623) at org.apache.hadoop.hbase.master.MasterRpcServices.snapshot(MasterRpcServices.java:1588) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) Caused by: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.hdfs.protocol.AclException): The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at org.apache.hadoop.ipc.Client.getRpcResponse(Client.java:1540) at org.apache.hadoop.ipc.Client.call(Client.java:1486) at org.apache.hadoop.ipc.Client.call(Client.java:1385) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:232) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:118) at com.sun.proxy.$Proxy32.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.getAclStatus(ClientNamenodeProtocolTranslatorPB.java:1385) at sun.reflect.GeneratedMethodAccessor63.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:422) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeMethod(RetryInvocationHandler.java:165) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invoke(RetryInvocationHandler.java:157) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeOnce(RetryInvocationHandler.java:95) at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:359) at com.sun.proxy.$Proxy35.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor63.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2734) ... 15 more 2023-10-02 16:03:23,561 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44227] procedure2.ProcedureExecutor(1028): Stored pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-10-02 16:03:23,562 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-10-02 16:03:23,564 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=32, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1696263203564 2023-10-02 16:03:23,564 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState 2023-10-02 16:03:23,566 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44227] snapshot.SnapshotManager(689): Started snapshot: { ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-10-02 16:03:23,567 DEBUG [Listener at jenkins-hbase4.apache.org/32975] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-10-02 16:03:23,567 DEBUG [Listener at jenkins-hbase4.apache.org/32975] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-10-02 16:03:23,568 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=33, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-10-02 16:03:23,569 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=32, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-10-02 16:03:23,572 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=32, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE in 11 msec 2023-10-02 16:03:23,573 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=33, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-10-02 16:03:23,574 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=33, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED; timeout=600000, timestamp=1696263203574 2023-10-02 16:03:23,667 DEBUG [Listener at jenkins-hbase4.apache.org/32975] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-02 16:03:23,669 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44227] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-10-02 16:03:23,669 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44227] snapshot.SnapshotManager(406): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-10-02 16:03:23,669 DEBUG [Listener at jenkins-hbase4.apache.org/32975] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-10-02 16:03:23,869 DEBUG [Listener at jenkins-hbase4.apache.org/32975] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-02 16:03:23,871 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44227] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-10-02 16:03:23,871 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44227] snapshot.SnapshotManager(406): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-10-02 16:03:23,871 DEBUG [Listener at jenkins-hbase4.apache.org/32975] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-10-02 16:03:24,011 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportFileSystemState 2023-10-02 16:03:24,012 INFO [(jenkins-hbase4.apache.org,44227,1696262556745)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportFileSystemState' 2023-10-02 16:03:24,012 DEBUG [(jenkins-hbase4.apache.org,44227,1696262556745)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-02 16:03:24,012 DEBUG [(jenkins-hbase4.apache.org,44227,1696262556745)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' 2023-10-02 16:03:24,012 DEBUG [(jenkins-hbase4.apache.org,44227,1696262556745)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportFileSystemState', kicking off acquire phase on members. 2023-10-02 16:03:24,012 DEBUG [(jenkins-hbase4.apache.org,44227,1696262556745)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44227-0x10107dfc1490000, quorum=127.0.0.1:50210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-10-02 16:03:24,012 DEBUG [(jenkins-hbase4.apache.org,44227,1696262556745)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-10-02 16:03:24,015 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): regionserver:37455-0x10107dfc1490002, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-02 16:03:24,015 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): regionserver:42303-0x10107dfc1490003, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-02 16:03:24,015 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-02 16:03:24,015 DEBUG [(jenkins-hbase4.apache.org,44227,1696262556745)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,42303,1696262558956 2023-10-02 16:03:24,015 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-02 16:03:24,016 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-02 16:03:24,015 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-02 16:03:24,016 DEBUG [(jenkins-hbase4.apache.org,44227,1696262556745)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44227-0x10107dfc1490000, quorum=127.0.0.1:50210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,42303,1696262558956 2023-10-02 16:03:24,016 DEBUG [(jenkins-hbase4.apache.org,44227,1696262556745)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43801,1696262558835 2023-10-02 16:03:24,016 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-10-02 16:03:24,016 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-10-02 16:03:24,017 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42303-0x10107dfc1490003, quorum=127.0.0.1:50210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-10-02 16:03:24,017 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): regionserver:43801-0x10107dfc1490001, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-02 16:03:24,017 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-02 16:03:24,017 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-02 16:03:24,017 DEBUG [(jenkins-hbase4.apache.org,44227,1696262556745)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44227-0x10107dfc1490000, quorum=127.0.0.1:50210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43801,1696262558835 2023-10-02 16:03:24,017 DEBUG [(jenkins-hbase4.apache.org,44227,1696262556745)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-02 16:03:24,017 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37455-0x10107dfc1490002, quorum=127.0.0.1:50210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-10-02 16:03:24,017 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 174 2023-10-02 16:03:24,017 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-10-02 16:03:24,017 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-10-02 16:03:24,017 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-10-02 16:03:24,018 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 174 2023-10-02 16:03:24,018 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-10-02 16:03:24,018 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-10-02 16:03:24,018 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemState 2023-10-02 16:03:24,019 DEBUG [member: 'jenkins-hbase4.apache.org,42303,1696262558956' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemState' with timeout 300000ms 2023-10-02 16:03:24,019 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemState 2023-10-02 16:03:24,019 DEBUG [member: 'jenkins-hbase4.apache.org,42303,1696262558956' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-02 16:03:24,019 DEBUG [member: 'jenkins-hbase4.apache.org,37455,1696262558909' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemState' with timeout 300000ms 2023-10-02 16:03:24,019 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43801-0x10107dfc1490001, quorum=127.0.0.1:50210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-10-02 16:03:24,021 DEBUG [member: 'jenkins-hbase4.apache.org,37455,1696262558909' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-02 16:03:24,023 DEBUG [member: 'jenkins-hbase4.apache.org,42303,1696262558956' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' stage 2023-10-02 16:03:24,023 DEBUG [member: 'jenkins-hbase4.apache.org,37455,1696262558909' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' stage 2023-10-02 16:03:24,023 DEBUG [member: 'jenkins-hbase4.apache.org,37455,1696262558909' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally acquired 2023-10-02 16:03:24,023 DEBUG [member: 'jenkins-hbase4.apache.org,42303,1696262558956' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally acquired 2023-10-02 16:03:24,023 DEBUG [member: 'jenkins-hbase4.apache.org,42303,1696262558956' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42303,1696262558956' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemState) in zk 2023-10-02 16:03:24,023 DEBUG [member: 'jenkins-hbase4.apache.org,37455,1696262558909' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37455,1696262558909' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemState) in zk 2023-10-02 16:03:24,023 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 174 2023-10-02 16:03:24,023 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-10-02 16:03:24,023 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-10-02 16:03:24,024 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemState 2023-10-02 16:03:24,024 DEBUG [member: 'jenkins-hbase4.apache.org,43801,1696262558835' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemState' with timeout 300000ms 2023-10-02 16:03:24,024 DEBUG [member: 'jenkins-hbase4.apache.org,43801,1696262558835' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-02 16:03:24,025 DEBUG [member: 'jenkins-hbase4.apache.org,43801,1696262558835' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' stage 2023-10-02 16:03:24,025 DEBUG [member: 'jenkins-hbase4.apache.org,43801,1696262558835' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally acquired 2023-10-02 16:03:24,025 DEBUG [member: 'jenkins-hbase4.apache.org,43801,1696262558835' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43801,1696262558835' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemState) in zk 2023-10-02 16:03:24,026 DEBUG [member: 'jenkins-hbase4.apache.org,37455,1696262558909' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-10-02 16:03:24,041 DEBUG [member: 'jenkins-hbase4.apache.org,42303,1696262558956' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-10-02 16:03:24,041 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): master:44227-0x10107dfc1490000, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,42303,1696262558956 2023-10-02 16:03:24,041 DEBUG [member: 'jenkins-hbase4.apache.org,37455,1696262558909' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37455-0x10107dfc1490002, quorum=127.0.0.1:50210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-10-02 16:03:24,042 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,42303,1696262558956 2023-10-02 16:03:24,042 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-02 16:03:24,042 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-02 16:03:24,042 DEBUG [member: 'jenkins-hbase4.apache.org,37455,1696262558909' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-02 16:03:24,043 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): master:44227-0x10107dfc1490000, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43801,1696262558835 2023-10-02 16:03:24,043 DEBUG [member: 'jenkins-hbase4.apache.org,42303,1696262558956' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42303-0x10107dfc1490003, quorum=127.0.0.1:50210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-10-02 16:03:24,043 DEBUG [member: 'jenkins-hbase4.apache.org,43801,1696262558835' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-10-02 16:03:24,043 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-02 16:03:24,043 DEBUG [member: 'jenkins-hbase4.apache.org,42303,1696262558956' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-02 16:03:24,043 DEBUG [member: 'jenkins-hbase4.apache.org,43801,1696262558835' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43801-0x10107dfc1490001, quorum=127.0.0.1:50210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-10-02 16:03:24,043 DEBUG [member: 'jenkins-hbase4.apache.org,43801,1696262558835' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-02 16:03:24,043 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-02 16:03:24,044 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-10-02 16:03:24,044 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37455,1696262558909 2023-10-02 16:03:24,045 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42303,1696262558956 2023-10-02 16:03:24,045 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43801,1696262558835 2023-10-02 16:03:24,045 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-02 16:03:24,046 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,42303,1696262558956' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemState' on coordinator 2023-10-02 16:03:24,046 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@45809fc1[Count = 1] remaining members to acquire global barrier 2023-10-02 16:03:24,046 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43801,1696262558835 2023-10-02 16:03:24,046 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-02 16:03:24,046 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-02 16:03:24,046 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-02 16:03:24,047 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-02 16:03:24,047 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-10-02 16:03:24,047 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37455,1696262558909 2023-10-02 16:03:24,047 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42303,1696262558956 2023-10-02 16:03:24,048 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43801,1696262558835 2023-10-02 16:03:24,048 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-02 16:03:24,049 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43801,1696262558835' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemState' on coordinator 2023-10-02 16:03:24,049 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@45809fc1[Count = 0] remaining members to acquire global barrier 2023-10-02 16:03:24,049 DEBUG [(jenkins-hbase4.apache.org,44227,1696262556745)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportFileSystemState' starting 'in-barrier' execution. 2023-10-02 16:03:24,049 DEBUG [(jenkins-hbase4.apache.org,44227,1696262556745)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-10-02 16:03:24,050 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): regionserver:37455-0x10107dfc1490002, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-10-02 16:03:24,050 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): regionserver:42303-0x10107dfc1490003, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-10-02 16:03:24,050 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-10-02 16:03:24,050 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-10-02 16:03:24,050 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): regionserver:43801-0x10107dfc1490001, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-10-02 16:03:24,050 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-10-02 16:03:24,050 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-10-02 16:03:24,050 DEBUG [member: 'jenkins-hbase4.apache.org,42303,1696262558956' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-10-02 16:03:24,050 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-10-02 16:03:24,050 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-10-02 16:03:24,051 DEBUG [member: 'jenkins-hbase4.apache.org,37455,1696262558909' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-10-02 16:03:24,051 DEBUG [member: 'jenkins-hbase4.apache.org,43801,1696262558835' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-10-02 16:03:24,051 DEBUG [member: 'jenkins-hbase4.apache.org,37455,1696262558909' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally completed 2023-10-02 16:03:24,051 DEBUG [member: 'jenkins-hbase4.apache.org,37455,1696262558909' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,37455,1696262558909' in zk 2023-10-02 16:03:24,051 DEBUG [member: 'jenkins-hbase4.apache.org,42303,1696262558956' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-02 16:03:24,051 DEBUG [member: 'jenkins-hbase4.apache.org,42303,1696262558956' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-02 16:03:24,051 DEBUG [member: 'jenkins-hbase4.apache.org,43801,1696262558835' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-02 16:03:24,051 DEBUG [member: 'jenkins-hbase4.apache.org,43801,1696262558835' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-02 16:03:24,051 DEBUG [rs(jenkins-hbase4.apache.org,42303,1696262558956)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,1,1696262602840.9d4d6a0fc331dee62a0e47d9a2e1e68b. 2023-10-02 16:03:24,051 DEBUG [rs(jenkins-hbase4.apache.org,43801,1696262558835)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,,1696262602840.b59ba9dd49e5dc36ea7b791aa7aba65a. 2023-10-02 16:03:24,051 DEBUG [rs(jenkins-hbase4.apache.org,42303,1696262558956)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,1,1696262602840.9d4d6a0fc331dee62a0e47d9a2e1e68b. started... 2023-10-02 16:03:24,051 DEBUG [rs(jenkins-hbase4.apache.org,43801,1696262558835)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,,1696262602840.b59ba9dd49e5dc36ea7b791aa7aba65a. started... 2023-10-02 16:03:24,053 DEBUG [rs(jenkins-hbase4.apache.org,43801,1696262558835)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for b59ba9dd49e5dc36ea7b791aa7aba65a: 2023-10-02 16:03:24,053 DEBUG [rs(jenkins-hbase4.apache.org,42303,1696262558956)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 9d4d6a0fc331dee62a0e47d9a2e1e68b: 2023-10-02 16:03:24,053 DEBUG [rs(jenkins-hbase4.apache.org,43801,1696262558835)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,,1696262602840.b59ba9dd49e5dc36ea7b791aa7aba65a.' region-info for snapshot=emptySnaptb0-testExportFileSystemState 2023-10-02 16:03:24,053 DEBUG [rs(jenkins-hbase4.apache.org,42303,1696262558956)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,1,1696262602840.9d4d6a0fc331dee62a0e47d9a2e1e68b.' region-info for snapshot=emptySnaptb0-testExportFileSystemState 2023-10-02 16:03:24,053 DEBUG [rs(jenkins-hbase4.apache.org,43801,1696262558835)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-02 16:03:24,053 DEBUG [rs(jenkins-hbase4.apache.org,43801,1696262558835)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-10-02 16:03:24,053 DEBUG [rs(jenkins-hbase4.apache.org,42303,1696262558956)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-02 16:03:24,054 DEBUG [rs(jenkins-hbase4.apache.org,42303,1696262558956)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-10-02 16:03:24,061 DEBUG [(jenkins-hbase4.apache.org,44227,1696262556745)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44227-0x10107dfc1490000, quorum=127.0.0.1:50210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,42303,1696262558956 2023-10-02 16:03:24,062 DEBUG [member: 'jenkins-hbase4.apache.org,37455,1696262558909' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemState' has notified controller of completion 2023-10-02 16:03:24,062 DEBUG [(jenkins-hbase4.apache.org,44227,1696262556745)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44227-0x10107dfc1490000, quorum=127.0.0.1:50210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43801,1696262558835 2023-10-02 16:03:24,062 DEBUG [(jenkins-hbase4.apache.org,44227,1696262556745)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-02 16:03:24,062 DEBUG [member: 'jenkins-hbase4.apache.org,37455,1696262558909' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-02 16:03:24,062 DEBUG [member: 'jenkins-hbase4.apache.org,37455,1696262558909' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemState' completed. 2023-10-02 16:03:24,081 DEBUG [rs(jenkins-hbase4.apache.org,43801,1696262558835)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,,1696262602840.b59ba9dd49e5dc36ea7b791aa7aba65a. completed. 2023-10-02 16:03:24,081 DEBUG [rs(jenkins-hbase4.apache.org,43801,1696262558835)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,,1696262602840.b59ba9dd49e5dc36ea7b791aa7aba65a. 2023-10-02 16:03:24,081 DEBUG [member: 'jenkins-hbase4.apache.org,43801,1696262558835' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-02 16:03:24,081 DEBUG [member: 'jenkins-hbase4.apache.org,43801,1696262558835' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-02 16:03:24,081 DEBUG [member: 'jenkins-hbase4.apache.org,43801,1696262558835' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,43801,1696262558835 2023-10-02 16:03:24,081 DEBUG [member: 'jenkins-hbase4.apache.org,43801,1696262558835' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally completed 2023-10-02 16:03:24,081 DEBUG [member: 'jenkins-hbase4.apache.org,43801,1696262558835' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,43801,1696262558835' in zk 2023-10-02 16:03:24,085 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): master:44227-0x10107dfc1490000, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43801,1696262558835 2023-10-02 16:03:24,085 DEBUG [member: 'jenkins-hbase4.apache.org,43801,1696262558835' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemState' has notified controller of completion 2023-10-02 16:03:24,085 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43801,1696262558835 2023-10-02 16:03:24,085 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-02 16:03:24,085 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-02 16:03:24,085 DEBUG [member: 'jenkins-hbase4.apache.org,43801,1696262558835' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-02 16:03:24,085 DEBUG [member: 'jenkins-hbase4.apache.org,43801,1696262558835' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemState' completed. 2023-10-02 16:03:24,087 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-02 16:03:24,088 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-02 16:03:24,088 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-10-02 16:03:24,089 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37455,1696262558909 2023-10-02 16:03:24,089 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42303,1696262558956 2023-10-02 16:03:24,090 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43801,1696262558835 2023-10-02 16:03:24,090 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-02 16:03:24,091 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-10-02 16:03:24,091 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37455,1696262558909 2023-10-02 16:03:24,093 DEBUG [rs(jenkins-hbase4.apache.org,42303,1696262558956)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,1,1696262602840.9d4d6a0fc331dee62a0e47d9a2e1e68b. completed. 2023-10-02 16:03:24,093 DEBUG [rs(jenkins-hbase4.apache.org,42303,1696262558956)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,1,1696262602840.9d4d6a0fc331dee62a0e47d9a2e1e68b. 2023-10-02 16:03:24,093 DEBUG [member: 'jenkins-hbase4.apache.org,42303,1696262558956' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-02 16:03:24,093 DEBUG [member: 'jenkins-hbase4.apache.org,42303,1696262558956' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-02 16:03:24,093 DEBUG [member: 'jenkins-hbase4.apache.org,42303,1696262558956' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,42303,1696262558956 2023-10-02 16:03:24,093 DEBUG [member: 'jenkins-hbase4.apache.org,42303,1696262558956' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally completed 2023-10-02 16:03:24,093 DEBUG [member: 'jenkins-hbase4.apache.org,42303,1696262558956' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,42303,1696262558956' in zk 2023-10-02 16:03:24,096 DEBUG [member: 'jenkins-hbase4.apache.org,42303,1696262558956' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemState' has notified controller of completion 2023-10-02 16:03:24,096 DEBUG [member: 'jenkins-hbase4.apache.org,42303,1696262558956' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-02 16:03:24,096 DEBUG [member: 'jenkins-hbase4.apache.org,42303,1696262558956' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemState' completed. 2023-10-02 16:03:24,101 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43801,1696262558835 2023-10-02 16:03:24,101 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): master:44227-0x10107dfc1490000, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,42303,1696262558956 2023-10-02 16:03:24,102 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,43801,1696262558835': 2023-10-02 16:03:24,102 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43801,1696262558835' released barrier for procedure'emptySnaptb0-testExportFileSystemState', counting down latch. Waiting for 1 more 2023-10-02 16:03:24,102 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,42303,1696262558956 2023-10-02 16:03:24,102 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-02 16:03:24,102 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-02 16:03:24,102 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-02 16:03:24,103 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-02 16:03:24,103 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-10-02 16:03:24,103 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37455,1696262558909 2023-10-02 16:03:24,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42303,1696262558956 2023-10-02 16:03:24,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43801,1696262558835 2023-10-02 16:03:24,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-02 16:03:24,105 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-10-02 16:03:24,105 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37455,1696262558909 2023-10-02 16:03:24,105 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42303,1696262558956 2023-10-02 16:03:24,106 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43801,1696262558835 2023-10-02 16:03:24,106 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,42303,1696262558956': 2023-10-02 16:03:24,107 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,42303,1696262558956' released barrier for procedure'emptySnaptb0-testExportFileSystemState', counting down latch. Waiting for 0 more 2023-10-02 16:03:24,107 INFO [(jenkins-hbase4.apache.org,44227,1696262556745)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportFileSystemState' execution completed 2023-10-02 16:03:24,107 DEBUG [(jenkins-hbase4.apache.org,44227,1696262556745)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-02 16:03:24,107 DEBUG [(jenkins-hbase4.apache.org,44227,1696262556745)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-02 16:03:24,107 DEBUG [(jenkins-hbase4.apache.org,44227,1696262556745)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportFileSystemState 2023-10-02 16:03:24,107 INFO [(jenkins-hbase4.apache.org,44227,1696262556745)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-10-02 16:03:24,109 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): regionserver:37455-0x10107dfc1490002, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-10-02 16:03:24,109 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): regionserver:42303-0x10107dfc1490003, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-10-02 16:03:24,109 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): regionserver:37455-0x10107dfc1490002, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-02 16:03:24,109 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): regionserver:42303-0x10107dfc1490003, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-02 16:03:24,109 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-10-02 16:03:24,109 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): master:44227-0x10107dfc1490000, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-10-02 16:03:24,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-10-02 16:03:24,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-10-02 16:03:24,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-02 16:03:24,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-02 16:03:24,109 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-10-02 16:03:24,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-10-02 16:03:24,109 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): regionserver:43801-0x10107dfc1490001, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-10-02 16:03:24,109 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): regionserver:43801-0x10107dfc1490001, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-02 16:03:24,109 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-10-02 16:03:24,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-10-02 16:03:24,110 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-02 16:03:24,110 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-02 16:03:24,110 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-02 16:03:24,110 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-02 16:03:24,111 DEBUG [(jenkins-hbase4.apache.org,44227,1696262556745)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44227-0x10107dfc1490000, quorum=127.0.0.1:50210, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37455,1696262558909 2023-10-02 16:03:24,110 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-02 16:03:24,111 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-10-02 16:03:24,111 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-02 16:03:24,111 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-02 16:03:24,111 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-10-02 16:03:24,111 DEBUG [(jenkins-hbase4.apache.org,44227,1696262556745)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44227-0x10107dfc1490000, quorum=127.0.0.1:50210, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,42303,1696262558956 2023-10-02 16:03:24,111 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-10-02 16:03:24,112 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-10-02 16:03:24,112 DEBUG [(jenkins-hbase4.apache.org,44227,1696262556745)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44227-0x10107dfc1490000, quorum=127.0.0.1:50210, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43801,1696262558835 2023-10-02 16:03:24,112 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-02 16:03:24,113 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-10-02 16:03:24,113 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37455,1696262558909 2023-10-02 16:03:24,114 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42303,1696262558956 2023-10-02 16:03:24,114 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43801,1696262558835 2023-10-02 16:03:24,114 DEBUG [(jenkins-hbase4.apache.org,44227,1696262556745)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44227-0x10107dfc1490000, quorum=127.0.0.1:50210, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37455,1696262558909 2023-10-02 16:03:24,115 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-02 16:03:24,115 DEBUG [(jenkins-hbase4.apache.org,44227,1696262556745)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44227-0x10107dfc1490000, quorum=127.0.0.1:50210, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,42303,1696262558956 2023-10-02 16:03:24,115 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-10-02 16:03:24,115 DEBUG [(jenkins-hbase4.apache.org,44227,1696262556745)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44227-0x10107dfc1490000, quorum=127.0.0.1:50210, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43801,1696262558835 2023-10-02 16:03:24,116 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37455,1696262558909 2023-10-02 16:03:24,116 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42303,1696262558956 2023-10-02 16:03:24,116 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43801,1696262558835 2023-10-02 16:03:24,119 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): master:44227-0x10107dfc1490000, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43801,1696262558835 2023-10-02 16:03:24,119 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): regionserver:37455-0x10107dfc1490002, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-02 16:03:24,119 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): master:44227-0x10107dfc1490000, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-10-02 16:03:24,119 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-02 16:03:24,119 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-02 16:03:24,119 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): master:44227-0x10107dfc1490000, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,42303,1696262558956 2023-10-02 16:03:24,119 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): regionserver:37455-0x10107dfc1490002, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-02 16:03:24,119 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): master:44227-0x10107dfc1490000, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37455,1696262558909 2023-10-02 16:03:24,120 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): regionserver:42303-0x10107dfc1490003, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-02 16:03:24,120 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): master:44227-0x10107dfc1490000, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-10-02 16:03:24,120 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-02 16:03:24,120 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-02 16:03:24,120 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): master:44227-0x10107dfc1490000, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43801,1696262558835 2023-10-02 16:03:24,120 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): master:44227-0x10107dfc1490000, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-10-02 16:03:24,120 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): regionserver:43801-0x10107dfc1490001, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-02 16:03:24,120 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): master:44227-0x10107dfc1490000, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,42303,1696262558956 2023-10-02 16:03:24,120 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-02 16:03:24,120 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): regionserver:42303-0x10107dfc1490003, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-02 16:03:24,120 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-02 16:03:24,120 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): master:44227-0x10107dfc1490000, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37455,1696262558909 2023-10-02 16:03:24,120 DEBUG [(jenkins-hbase4.apache.org,44227,1696262556745)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-02 16:03:24,120 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): regionserver:43801-0x10107dfc1490001, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-02 16:03:24,120 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportFileSystemState 2023-10-02 16:03:24,120 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): master:44227-0x10107dfc1490000, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-10-02 16:03:24,121 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemState 2023-10-02 16:03:24,120 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-02 16:03:24,121 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-02 16:03:24,121 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): master:44227-0x10107dfc1490000, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-10-02 16:03:24,123 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 8c2558c0b59bb3a4e2e578c2c8e8915d, NAME => 'testtb-testExportFileSystemState,.mob,0.8c2558c0b59bb3a4e2e578c2c8e8915d.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testExportFileSystemState 2023-10-02 16:03:24,123 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-02 16:03:24,123 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-02 16:03:24,121 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-02 16:03:24,123 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-10-02 16:03:24,123 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-02 16:03:24,124 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-10-02 16:03:24,136 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportFileSystemState 2023-10-02 16:03:24,137 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState 2023-10-02 16:03:24,166 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState to hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/.hbase-snapshot/emptySnaptb0-testExportFileSystemState 2023-10-02 16:03:24,167 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed 2023-10-02 16:03:24,167 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState 2023-10-02 16:03:24,167 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState 2023-10-02 16:03:24,167 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState at 1696262603564Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemState at 1696262604136 (+572 ms)Consolidate snapshot: emptySnaptb0-testExportFileSystemState at 1696262604136Loading Region manifests for emptySnaptb0-testExportFileSystemState at 1696262604136Writing data manifest for emptySnaptb0-testExportFileSystemState at 1696262604141 (+5 ms)Verifying snapshot: emptySnaptb0-testExportFileSystemState at 1696262604158 (+17 ms)Snapshot emptySnaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed at 1696262604167 (+9 ms) 2023-10-02 16:03:24,170 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=33, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-10-02 16:03:24,172 DEBUG [Listener at jenkins-hbase4.apache.org/32975] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-02 16:03:24,174 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=33, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED in 605 msec 2023-10-02 16:03:24,175 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44227] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-10-02 16:03:24,175 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44227] snapshot.SnapshotManager(403): Snapshot '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-10-02 16:03:24,178 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43801] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemState,,1696262602840.b59ba9dd49e5dc36ea7b791aa7aba65a. with WAL disabled. Data may be lost in the event of a crash. 2023-10-02 16:03:24,181 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42303] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemState,1,1696262602840.9d4d6a0fc331dee62a0e47d9a2e1e68b. with WAL disabled. Data may be lost in the event of a crash. 2023-10-02 16:03:24,185 DEBUG [Listener at jenkins-hbase4.apache.org/32975] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemState 2023-10-02 16:03:24,185 DEBUG [Listener at jenkins-hbase4.apache.org/32975] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemState,,1696262602840.b59ba9dd49e5dc36ea7b791aa7aba65a. 2023-10-02 16:03:24,185 INFO [Listener at jenkins-hbase4.apache.org/32975] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-10-02 16:03:24,202 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44227] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-10-02 16:03:24,202 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44227] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1696262604202 (current time:1696262604202). 2023-10-02 16:03:24,202 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44227] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-10-02 16:03:24,203 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44227] zookeeper.ReadOnlyZKClient(139): Connect 0x38870402 to 127.0.0.1:50210 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-02 16:03:24,212 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44227] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@42ae8adb, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-02 16:03:24,214 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44227] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-02 16:03:24,217 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:57690, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-02 16:03:24,219 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44227] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x38870402 to 127.0.0.1:50210 2023-10-02 16:03:24,219 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44227] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-02 16:03:24,221 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44227] zookeeper.ReadOnlyZKClient(139): Connect 0x3df1f93e to 127.0.0.1:50210 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-02 16:03:24,230 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44227] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@b18f0a5, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-02 16:03:24,232 DEBUG [hconnection-0x59cf7ba1-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-02 16:03:24,236 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:57704, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-02 16:03:24,241 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44227] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x3df1f93e to 127.0.0.1:50210 2023-10-02 16:03:24,241 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44227] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-02 16:03:24,241 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44227] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemState], kv [jenkins: RWXCA] 2023-10-02 16:03:24,242 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44227] snapshot.SnapshotManager(637): No existing snapshot, attempting snapshot... 2023-10-02 16:03:24,242 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44227] snapshot.SnapshotManager(684): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-10-02 16:03:24,245 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44227] snapshot.SnapshotManager(519): Unable to retrieve ACL status for path: hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/.hbase-snapshot, current working dir path: hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState org.apache.hadoop.hdfs.protocol.AclException: The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.ipc.RemoteException.instantiateException(RemoteException.java:121) at org.apache.hadoop.ipc.RemoteException.unwrapRemoteException(RemoteException.java:88) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2736) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2294) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2291) at org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81) at org.apache.hadoop.hdfs.DistributedFileSystem.getAclStatus(DistributedFileSystem.java:2291) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.updateWorkingDirAclsIfRequired(SnapshotManager.java:517) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.prepareToTakeSnapshot(SnapshotManager.java:490) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.snapshotEnabledTable(SnapshotManager.java:559) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshotInternal(SnapshotManager.java:687) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshot(SnapshotManager.java:623) at org.apache.hadoop.hbase.master.MasterRpcServices.snapshot(MasterRpcServices.java:1588) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) Caused by: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.hdfs.protocol.AclException): The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at org.apache.hadoop.ipc.Client.getRpcResponse(Client.java:1540) at org.apache.hadoop.ipc.Client.call(Client.java:1486) at org.apache.hadoop.ipc.Client.call(Client.java:1385) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:232) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:118) at com.sun.proxy.$Proxy32.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.getAclStatus(ClientNamenodeProtocolTranslatorPB.java:1385) at sun.reflect.GeneratedMethodAccessor63.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:422) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeMethod(RetryInvocationHandler.java:165) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invoke(RetryInvocationHandler.java:157) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeOnce(RetryInvocationHandler.java:95) at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:359) at com.sun.proxy.$Proxy35.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor63.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor63.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor63.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor63.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor63.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2734) ... 15 more 2023-10-02 16:03:24,247 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44227] procedure2.ProcedureExecutor(1028): Stored pid=34, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-10-02 16:03:24,248 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=34, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-10-02 16:03:24,249 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=34, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1696263204249 2023-10-02 16:03:24,249 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState 2023-10-02 16:03:24,249 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44227] snapshot.SnapshotManager(689): Started snapshot: { ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-10-02 16:03:24,250 DEBUG [Listener at jenkins-hbase4.apache.org/32975] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-10-02 16:03:24,251 DEBUG [Listener at jenkins-hbase4.apache.org/32975] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-10-02 16:03:24,254 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=34, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-10-02 16:03:24,254 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=35, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-10-02 16:03:24,256 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=34, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE in 8 msec 2023-10-02 16:03:24,257 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=35, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-10-02 16:03:24,257 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=35, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED; timeout=600000, timestamp=1696263204257 2023-10-02 16:03:24,273 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemState 2023-10-02 16:03:24,273 INFO [(jenkins-hbase4.apache.org,44227,1696262556745)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemState' 2023-10-02 16:03:24,273 DEBUG [(jenkins-hbase4.apache.org,44227,1696262556745)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-02 16:03:24,275 DEBUG [(jenkins-hbase4.apache.org,44227,1696262556745)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemState' starting 'acquire' 2023-10-02 16:03:24,275 DEBUG [(jenkins-hbase4.apache.org,44227,1696262556745)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemState', kicking off acquire phase on members. 2023-10-02 16:03:24,276 DEBUG [(jenkins-hbase4.apache.org,44227,1696262556745)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44227-0x10107dfc1490000, quorum=127.0.0.1:50210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-10-02 16:03:24,276 DEBUG [(jenkins-hbase4.apache.org,44227,1696262556745)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-10-02 16:03:24,278 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): regionserver:42303-0x10107dfc1490003, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-02 16:03:24,278 DEBUG [(jenkins-hbase4.apache.org,44227,1696262556745)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,42303,1696262558956 2023-10-02 16:03:24,278 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-02 16:03:24,278 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): regionserver:43801-0x10107dfc1490001, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-02 16:03:24,278 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-02 16:03:24,278 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-02 16:03:24,278 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-02 16:03:24,280 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): regionserver:37455-0x10107dfc1490002, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-02 16:03:24,280 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-02 16:03:24,280 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-02 16:03:24,280 DEBUG [(jenkins-hbase4.apache.org,44227,1696262556745)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44227-0x10107dfc1490000, quorum=127.0.0.1:50210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,42303,1696262558956 2023-10-02 16:03:24,280 DEBUG [(jenkins-hbase4.apache.org,44227,1696262556745)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43801,1696262558835 2023-10-02 16:03:24,281 DEBUG [(jenkins-hbase4.apache.org,44227,1696262556745)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44227-0x10107dfc1490000, quorum=127.0.0.1:50210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43801,1696262558835 2023-10-02 16:03:24,281 DEBUG [(jenkins-hbase4.apache.org,44227,1696262556745)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-02 16:03:24,281 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-10-02 16:03:24,281 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-10-02 16:03:24,281 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-10-02 16:03:24,281 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37455-0x10107dfc1490002, quorum=127.0.0.1:50210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-10-02 16:03:24,281 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43801-0x10107dfc1490001, quorum=127.0.0.1:50210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-10-02 16:03:24,282 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42303-0x10107dfc1490003, quorum=127.0.0.1:50210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-10-02 16:03:24,282 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 169 2023-10-02 16:03:24,282 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-10-02 16:03:24,282 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 169 2023-10-02 16:03:24,282 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-10-02 16:03:24,282 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-10-02 16:03:24,282 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-10-02 16:03:24,282 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemState 2023-10-02 16:03:24,282 DEBUG [member: 'jenkins-hbase4.apache.org,37455,1696262558909' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemState' with timeout 300000ms 2023-10-02 16:03:24,282 DEBUG [member: 'jenkins-hbase4.apache.org,37455,1696262558909' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-02 16:03:24,282 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 169 2023-10-02 16:03:24,284 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemState 2023-10-02 16:03:24,284 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-10-02 16:03:24,284 DEBUG [member: 'jenkins-hbase4.apache.org,37455,1696262558909' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemState' starting 'acquire' stage 2023-10-02 16:03:24,284 DEBUG [member: 'jenkins-hbase4.apache.org,37455,1696262558909' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemState' locally acquired 2023-10-02 16:03:24,284 DEBUG [member: 'jenkins-hbase4.apache.org,43801,1696262558835' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemState' with timeout 300000ms 2023-10-02 16:03:24,284 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-10-02 16:03:24,284 DEBUG [member: 'jenkins-hbase4.apache.org,37455,1696262558909' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37455,1696262558909' joining acquired barrier for procedure (snaptb0-testExportFileSystemState) in zk 2023-10-02 16:03:24,284 DEBUG [member: 'jenkins-hbase4.apache.org,43801,1696262558835' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-02 16:03:24,286 DEBUG [member: 'jenkins-hbase4.apache.org,43801,1696262558835' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemState' starting 'acquire' stage 2023-10-02 16:03:24,286 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemState 2023-10-02 16:03:24,286 DEBUG [member: 'jenkins-hbase4.apache.org,43801,1696262558835' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemState' locally acquired 2023-10-02 16:03:24,286 DEBUG [member: 'jenkins-hbase4.apache.org,43801,1696262558835' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43801,1696262558835' joining acquired barrier for procedure (snaptb0-testExportFileSystemState) in zk 2023-10-02 16:03:24,286 DEBUG [member: 'jenkins-hbase4.apache.org,42303,1696262558956' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemState' with timeout 300000ms 2023-10-02 16:03:24,286 DEBUG [member: 'jenkins-hbase4.apache.org,42303,1696262558956' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-02 16:03:24,287 DEBUG [member: 'jenkins-hbase4.apache.org,42303,1696262558956' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemState' starting 'acquire' stage 2023-10-02 16:03:24,287 DEBUG [member: 'jenkins-hbase4.apache.org,42303,1696262558956' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemState' locally acquired 2023-10-02 16:03:24,287 DEBUG [member: 'jenkins-hbase4.apache.org,42303,1696262558956' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42303,1696262558956' joining acquired barrier for procedure (snaptb0-testExportFileSystemState) in zk 2023-10-02 16:03:24,288 DEBUG [member: 'jenkins-hbase4.apache.org,37455,1696262558909' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-10-02 16:03:24,289 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): master:44227-0x10107dfc1490000, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43801,1696262558835 2023-10-02 16:03:24,289 DEBUG [member: 'jenkins-hbase4.apache.org,43801,1696262558835' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-10-02 16:03:24,289 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43801,1696262558835 2023-10-02 16:03:24,289 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-02 16:03:24,289 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-02 16:03:24,289 DEBUG [member: 'jenkins-hbase4.apache.org,37455,1696262558909' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37455-0x10107dfc1490002, quorum=127.0.0.1:50210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-10-02 16:03:24,289 DEBUG [member: 'jenkins-hbase4.apache.org,37455,1696262558909' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-02 16:03:24,289 DEBUG [member: 'jenkins-hbase4.apache.org,42303,1696262558956' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-10-02 16:03:24,290 DEBUG [member: 'jenkins-hbase4.apache.org,43801,1696262558835' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43801-0x10107dfc1490001, quorum=127.0.0.1:50210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-10-02 16:03:24,289 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): master:44227-0x10107dfc1490000, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,42303,1696262558956 2023-10-02 16:03:24,290 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-02 16:03:24,290 DEBUG [member: 'jenkins-hbase4.apache.org,43801,1696262558835' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-02 16:03:24,290 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-02 16:03:24,290 DEBUG [member: 'jenkins-hbase4.apache.org,42303,1696262558956' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42303-0x10107dfc1490003, quorum=127.0.0.1:50210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-10-02 16:03:24,290 DEBUG [member: 'jenkins-hbase4.apache.org,42303,1696262558956' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-02 16:03:24,290 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-10-02 16:03:24,291 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37455,1696262558909 2023-10-02 16:03:24,291 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42303,1696262558956 2023-10-02 16:03:24,291 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43801,1696262558835 2023-10-02 16:03:24,292 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-02 16:03:24,292 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43801,1696262558835' joining acquired barrier for procedure 'snaptb0-testExportFileSystemState' on coordinator 2023-10-02 16:03:24,292 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1452c6c7[Count = 1] remaining members to acquire global barrier 2023-10-02 16:03:24,292 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,42303,1696262558956 2023-10-02 16:03:24,292 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-02 16:03:24,292 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-02 16:03:24,293 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-02 16:03:24,293 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-02 16:03:24,293 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-10-02 16:03:24,294 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37455,1696262558909 2023-10-02 16:03:24,294 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42303,1696262558956 2023-10-02 16:03:24,295 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43801,1696262558835 2023-10-02 16:03:24,295 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-02 16:03:24,295 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,42303,1696262558956' joining acquired barrier for procedure 'snaptb0-testExportFileSystemState' on coordinator 2023-10-02 16:03:24,295 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1452c6c7[Count = 0] remaining members to acquire global barrier 2023-10-02 16:03:24,295 DEBUG [(jenkins-hbase4.apache.org,44227,1696262556745)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemState' starting 'in-barrier' execution. 2023-10-02 16:03:24,295 DEBUG [(jenkins-hbase4.apache.org,44227,1696262556745)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-10-02 16:03:24,297 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): regionserver:42303-0x10107dfc1490003, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-10-02 16:03:24,297 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): regionserver:37455-0x10107dfc1490002, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-10-02 16:03:24,297 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-10-02 16:03:24,298 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-10-02 16:03:24,298 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-10-02 16:03:24,297 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): regionserver:43801-0x10107dfc1490001, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-10-02 16:03:24,298 DEBUG [member: 'jenkins-hbase4.apache.org,37455,1696262558909' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-10-02 16:03:24,298 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-10-02 16:03:24,298 DEBUG [(jenkins-hbase4.apache.org,44227,1696262556745)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44227-0x10107dfc1490000, quorum=127.0.0.1:50210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43801,1696262558835 2023-10-02 16:03:24,298 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-10-02 16:03:24,298 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-10-02 16:03:24,298 DEBUG [member: 'jenkins-hbase4.apache.org,37455,1696262558909' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemState' locally completed 2023-10-02 16:03:24,298 DEBUG [member: 'jenkins-hbase4.apache.org,43801,1696262558835' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-10-02 16:03:24,298 DEBUG [member: 'jenkins-hbase4.apache.org,37455,1696262558909' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,37455,1696262558909' in zk 2023-10-02 16:03:24,298 DEBUG [member: 'jenkins-hbase4.apache.org,42303,1696262558956' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-10-02 16:03:24,298 DEBUG [(jenkins-hbase4.apache.org,44227,1696262556745)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44227-0x10107dfc1490000, quorum=127.0.0.1:50210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,42303,1696262558956 2023-10-02 16:03:24,298 DEBUG [(jenkins-hbase4.apache.org,44227,1696262556745)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-02 16:03:24,300 DEBUG [member: 'jenkins-hbase4.apache.org,37455,1696262558909' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemState' has notified controller of completion 2023-10-02 16:03:24,300 DEBUG [member: 'jenkins-hbase4.apache.org,37455,1696262558909' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-02 16:03:24,300 DEBUG [member: 'jenkins-hbase4.apache.org,37455,1696262558909' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemState' completed. 2023-10-02 16:03:24,305 DEBUG [member: 'jenkins-hbase4.apache.org,43801,1696262558835' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-02 16:03:24,307 DEBUG [rs(jenkins-hbase4.apache.org,43801,1696262558835)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,,1696262602840.b59ba9dd49e5dc36ea7b791aa7aba65a. 2023-10-02 16:03:24,307 DEBUG [member: 'jenkins-hbase4.apache.org,43801,1696262558835' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-02 16:03:24,307 DEBUG [member: 'jenkins-hbase4.apache.org,42303,1696262558956' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-02 16:03:24,307 DEBUG [member: 'jenkins-hbase4.apache.org,42303,1696262558956' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-02 16:03:24,307 DEBUG [rs(jenkins-hbase4.apache.org,42303,1696262558956)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,1,1696262602840.9d4d6a0fc331dee62a0e47d9a2e1e68b. 2023-10-02 16:03:24,307 DEBUG [rs(jenkins-hbase4.apache.org,43801,1696262558835)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,,1696262602840.b59ba9dd49e5dc36ea7b791aa7aba65a. started... 2023-10-02 16:03:24,307 DEBUG [rs(jenkins-hbase4.apache.org,42303,1696262558956)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,1,1696262602840.9d4d6a0fc331dee62a0e47d9a2e1e68b. started... 2023-10-02 16:03:24,307 INFO [rs(jenkins-hbase4.apache.org,43801,1696262558835)-snapshot-pool-0] regionserver.HRegion(2745): Flushing b59ba9dd49e5dc36ea7b791aa7aba65a 1/1 column families, dataSize=266 B heapSize=832 B 2023-10-02 16:03:24,308 INFO [rs(jenkins-hbase4.apache.org,42303,1696262558956)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 9d4d6a0fc331dee62a0e47d9a2e1e68b 1/1 column families, dataSize=3.00 KB heapSize=6.72 KB 2023-10-02 16:03:24,351 DEBUG [Listener at jenkins-hbase4.apache.org/32975] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-02 16:03:24,352 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44227] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-10-02 16:03:24,352 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44227] snapshot.SnapshotManager(406): Snapshoting '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-10-02 16:03:24,352 DEBUG [Listener at jenkins-hbase4.apache.org/32975] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-10-02 16:03:24,380 INFO [rs(jenkins-hbase4.apache.org,42303,1696262558956)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023100215646220dbe94e098e3013a37627ef97 to hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b2023100215646220dbe94e098e3013a37627ef97 2023-10-02 16:03:24,389 INFO [rs(jenkins-hbase4.apache.org,43801,1696262558835)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023100218269611b0864caba01d501c947e0198 to hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e2023100218269611b0864caba01d501c947e0198 2023-10-02 16:03:24,406 INFO [rs(jenkins-hbase4.apache.org,42303,1696262558956)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=3.0 K, hasBloomFilter=true, into tmp file hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/data/default/testtb-testExportFileSystemState/9d4d6a0fc331dee62a0e47d9a2e1e68b/.tmp/cf/a9dacbb9b9e642959d94f88f89439d3d 2023-10-02 16:03:24,420 DEBUG [rs(jenkins-hbase4.apache.org,42303,1696262558956)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/data/default/testtb-testExportFileSystemState/9d4d6a0fc331dee62a0e47d9a2e1e68b/.tmp/cf/a9dacbb9b9e642959d94f88f89439d3d as hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/data/default/testtb-testExportFileSystemState/9d4d6a0fc331dee62a0e47d9a2e1e68b/cf/a9dacbb9b9e642959d94f88f89439d3d 2023-10-02 16:03:24,428 INFO [rs(jenkins-hbase4.apache.org,42303,1696262558956)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/data/default/testtb-testExportFileSystemState/9d4d6a0fc331dee62a0e47d9a2e1e68b/cf/a9dacbb9b9e642959d94f88f89439d3d, entries=46, sequenceid=6, filesize=12.7 K 2023-10-02 16:03:24,449 INFO [rs(jenkins-hbase4.apache.org,42303,1696262558956)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.00 KB/3070, heapSize ~6.70 KB/6864, currentSize=0 B/0 for 9d4d6a0fc331dee62a0e47d9a2e1e68b in 142ms, sequenceid=6, compaction requested=false 2023-10-02 16:03:24,449 DEBUG [rs(jenkins-hbase4.apache.org,42303,1696262558956)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemState' 2023-10-02 16:03:24,450 DEBUG [rs(jenkins-hbase4.apache.org,42303,1696262558956)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 9d4d6a0fc331dee62a0e47d9a2e1e68b: 2023-10-02 16:03:24,451 DEBUG [rs(jenkins-hbase4.apache.org,42303,1696262558956)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,1,1696262602840.9d4d6a0fc331dee62a0e47d9a2e1e68b.' region-info for snapshot=snaptb0-testExportFileSystemState 2023-10-02 16:03:24,451 DEBUG [rs(jenkins-hbase4.apache.org,42303,1696262558956)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-02 16:03:24,451 DEBUG [rs(jenkins-hbase4.apache.org,42303,1696262558956)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/data/default/testtb-testExportFileSystemState/9d4d6a0fc331dee62a0e47d9a2e1e68b/cf/a9dacbb9b9e642959d94f88f89439d3d] hfiles 2023-10-02 16:03:24,451 DEBUG [rs(jenkins-hbase4.apache.org,42303,1696262558956)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/data/default/testtb-testExportFileSystemState/9d4d6a0fc331dee62a0e47d9a2e1e68b/cf/a9dacbb9b9e642959d94f88f89439d3d for snapshot=snaptb0-testExportFileSystemState 2023-10-02 16:03:24,459 INFO [rs(jenkins-hbase4.apache.org,43801,1696262558835)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=266, hasBloomFilter=true, into tmp file hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/data/default/testtb-testExportFileSystemState/b59ba9dd49e5dc36ea7b791aa7aba65a/.tmp/cf/0f4d642fec494dd984227aef8a1058e5 2023-10-02 16:03:24,492 DEBUG [rs(jenkins-hbase4.apache.org,43801,1696262558835)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/data/default/testtb-testExportFileSystemState/b59ba9dd49e5dc36ea7b791aa7aba65a/.tmp/cf/0f4d642fec494dd984227aef8a1058e5 as hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/data/default/testtb-testExportFileSystemState/b59ba9dd49e5dc36ea7b791aa7aba65a/cf/0f4d642fec494dd984227aef8a1058e5 2023-10-02 16:03:24,510 INFO [rs(jenkins-hbase4.apache.org,43801,1696262558835)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/data/default/testtb-testExportFileSystemState/b59ba9dd49e5dc36ea7b791aa7aba65a/cf/0f4d642fec494dd984227aef8a1058e5, entries=4, sequenceid=6, filesize=5.6 K 2023-10-02 16:03:24,511 INFO [rs(jenkins-hbase4.apache.org,43801,1696262558835)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~266 B/266, heapSize ~816 B/816, currentSize=0 B/0 for b59ba9dd49e5dc36ea7b791aa7aba65a in 204ms, sequenceid=6, compaction requested=false 2023-10-02 16:03:24,511 DEBUG [rs(jenkins-hbase4.apache.org,42303,1696262558956)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,1,1696262602840.9d4d6a0fc331dee62a0e47d9a2e1e68b. completed. 2023-10-02 16:03:24,513 DEBUG [rs(jenkins-hbase4.apache.org,42303,1696262558956)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,1,1696262602840.9d4d6a0fc331dee62a0e47d9a2e1e68b. 2023-10-02 16:03:24,514 DEBUG [member: 'jenkins-hbase4.apache.org,42303,1696262558956' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-02 16:03:24,514 DEBUG [rs(jenkins-hbase4.apache.org,43801,1696262558835)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for b59ba9dd49e5dc36ea7b791aa7aba65a: 2023-10-02 16:03:24,514 DEBUG [rs(jenkins-hbase4.apache.org,43801,1696262558835)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,,1696262602840.b59ba9dd49e5dc36ea7b791aa7aba65a.' region-info for snapshot=snaptb0-testExportFileSystemState 2023-10-02 16:03:24,514 DEBUG [rs(jenkins-hbase4.apache.org,43801,1696262558835)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-02 16:03:24,514 DEBUG [rs(jenkins-hbase4.apache.org,43801,1696262558835)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/data/default/testtb-testExportFileSystemState/b59ba9dd49e5dc36ea7b791aa7aba65a/cf/0f4d642fec494dd984227aef8a1058e5] hfiles 2023-10-02 16:03:24,514 DEBUG [rs(jenkins-hbase4.apache.org,43801,1696262558835)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/data/default/testtb-testExportFileSystemState/b59ba9dd49e5dc36ea7b791aa7aba65a/cf/0f4d642fec494dd984227aef8a1058e5 for snapshot=snaptb0-testExportFileSystemState 2023-10-02 16:03:24,514 DEBUG [member: 'jenkins-hbase4.apache.org,42303,1696262558956' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-02 16:03:24,514 DEBUG [member: 'jenkins-hbase4.apache.org,42303,1696262558956' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,42303,1696262558956 2023-10-02 16:03:24,514 DEBUG [member: 'jenkins-hbase4.apache.org,42303,1696262558956' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemState' locally completed 2023-10-02 16:03:24,515 DEBUG [member: 'jenkins-hbase4.apache.org,42303,1696262558956' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,42303,1696262558956' in zk 2023-10-02 16:03:24,521 DEBUG [member: 'jenkins-hbase4.apache.org,42303,1696262558956' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemState' has notified controller of completion 2023-10-02 16:03:24,521 DEBUG [member: 'jenkins-hbase4.apache.org,42303,1696262558956' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-02 16:03:24,521 DEBUG [member: 'jenkins-hbase4.apache.org,42303,1696262558956' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemState' completed. 2023-10-02 16:03:24,523 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): master:44227-0x10107dfc1490000, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,42303,1696262558956 2023-10-02 16:03:24,523 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,42303,1696262558956 2023-10-02 16:03:24,523 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-02 16:03:24,523 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-02 16:03:24,525 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-02 16:03:24,526 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-02 16:03:24,526 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-10-02 16:03:24,526 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37455,1696262558909 2023-10-02 16:03:24,527 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42303,1696262558956 2023-10-02 16:03:24,527 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43801,1696262558835 2023-10-02 16:03:24,531 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-02 16:03:24,531 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-10-02 16:03:24,532 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37455,1696262558909 2023-10-02 16:03:24,532 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42303,1696262558956 2023-10-02 16:03:24,533 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,42303,1696262558956': 2023-10-02 16:03:24,533 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,42303,1696262558956' released barrier for procedure'snaptb0-testExportFileSystemState', counting down latch. Waiting for 1 more 2023-10-02 16:03:24,553 DEBUG [Listener at jenkins-hbase4.apache.org/32975] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-02 16:03:24,562 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44227] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-10-02 16:03:24,562 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44227] snapshot.SnapshotManager(406): Snapshoting '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-10-02 16:03:24,562 DEBUG [Listener at jenkins-hbase4.apache.org/32975] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-10-02 16:03:24,862 DEBUG [Listener at jenkins-hbase4.apache.org/32975] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-02 16:03:24,864 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44227] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-10-02 16:03:24,864 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44227] snapshot.SnapshotManager(406): Snapshoting '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-10-02 16:03:24,865 DEBUG [Listener at jenkins-hbase4.apache.org/32975] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-10-02 16:03:25,006 DEBUG [rs(jenkins-hbase4.apache.org,43801,1696262558835)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,,1696262602840.b59ba9dd49e5dc36ea7b791aa7aba65a. completed. 2023-10-02 16:03:25,007 DEBUG [rs(jenkins-hbase4.apache.org,43801,1696262558835)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,,1696262602840.b59ba9dd49e5dc36ea7b791aa7aba65a. 2023-10-02 16:03:25,007 DEBUG [member: 'jenkins-hbase4.apache.org,43801,1696262558835' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-02 16:03:25,007 DEBUG [member: 'jenkins-hbase4.apache.org,43801,1696262558835' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-02 16:03:25,007 DEBUG [member: 'jenkins-hbase4.apache.org,43801,1696262558835' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,43801,1696262558835 2023-10-02 16:03:25,007 DEBUG [member: 'jenkins-hbase4.apache.org,43801,1696262558835' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemState' locally completed 2023-10-02 16:03:25,007 DEBUG [member: 'jenkins-hbase4.apache.org,43801,1696262558835' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,43801,1696262558835' in zk 2023-10-02 16:03:25,010 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): master:44227-0x10107dfc1490000, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43801,1696262558835 2023-10-02 16:03:25,010 DEBUG [member: 'jenkins-hbase4.apache.org,43801,1696262558835' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemState' has notified controller of completion 2023-10-02 16:03:25,010 DEBUG [member: 'jenkins-hbase4.apache.org,43801,1696262558835' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-02 16:03:25,010 DEBUG [member: 'jenkins-hbase4.apache.org,43801,1696262558835' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemState' completed. 2023-10-02 16:03:25,026 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43801,1696262558835 2023-10-02 16:03:25,026 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-02 16:03:25,026 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-02 16:03:25,027 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-02 16:03:25,028 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-02 16:03:25,028 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-10-02 16:03:25,028 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37455,1696262558909 2023-10-02 16:03:25,029 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42303,1696262558956 2023-10-02 16:03:25,029 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43801,1696262558835 2023-10-02 16:03:25,030 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-02 16:03:25,030 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-10-02 16:03:25,033 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37455,1696262558909 2023-10-02 16:03:25,034 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42303,1696262558956 2023-10-02 16:03:25,036 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43801,1696262558835 2023-10-02 16:03:25,049 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,43801,1696262558835': 2023-10-02 16:03:25,049 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43801,1696262558835' released barrier for procedure'snaptb0-testExportFileSystemState', counting down latch. Waiting for 0 more 2023-10-02 16:03:25,053 INFO [(jenkins-hbase4.apache.org,44227,1696262556745)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemState' execution completed 2023-10-02 16:03:25,053 DEBUG [(jenkins-hbase4.apache.org,44227,1696262556745)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-02 16:03:25,053 DEBUG [(jenkins-hbase4.apache.org,44227,1696262556745)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-02 16:03:25,053 DEBUG [(jenkins-hbase4.apache.org,44227,1696262556745)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemState 2023-10-02 16:03:25,053 INFO [(jenkins-hbase4.apache.org,44227,1696262556745)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-10-02 16:03:25,121 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): regionserver:37455-0x10107dfc1490002, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-10-02 16:03:25,121 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): master:44227-0x10107dfc1490000, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-10-02 16:03:25,121 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-10-02 16:03:25,121 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-10-02 16:03:25,121 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): regionserver:37455-0x10107dfc1490002, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-02 16:03:25,122 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-10-02 16:03:25,122 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-02 16:03:25,122 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-02 16:03:25,121 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): regionserver:42303-0x10107dfc1490003, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-10-02 16:03:25,122 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): regionserver:42303-0x10107dfc1490003, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-02 16:03:25,123 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): regionserver:43801-0x10107dfc1490001, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-10-02 16:03:25,123 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): regionserver:43801-0x10107dfc1490001, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-02 16:03:25,123 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-10-02 16:03:25,123 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-10-02 16:03:25,124 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-02 16:03:25,125 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-02 16:03:25,127 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-10-02 16:03:25,127 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-10-02 16:03:25,127 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-02 16:03:25,127 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-02 16:03:25,131 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-02 16:03:25,131 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-10-02 16:03:25,132 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-10-02 16:03:25,133 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-02 16:03:25,133 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-02 16:03:25,137 DEBUG [(jenkins-hbase4.apache.org,44227,1696262556745)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44227-0x10107dfc1490000, quorum=127.0.0.1:50210, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37455,1696262558909 2023-10-02 16:03:25,141 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-10-02 16:03:25,142 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-10-02 16:03:25,145 DEBUG [(jenkins-hbase4.apache.org,44227,1696262556745)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44227-0x10107dfc1490000, quorum=127.0.0.1:50210, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,42303,1696262558956 2023-10-02 16:03:25,161 DEBUG [(jenkins-hbase4.apache.org,44227,1696262556745)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44227-0x10107dfc1490000, quorum=127.0.0.1:50210, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43801,1696262558835 2023-10-02 16:03:25,165 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-02 16:03:25,177 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-10-02 16:03:25,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37455,1696262558909 2023-10-02 16:03:25,213 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42303,1696262558956 2023-10-02 16:03:25,225 DEBUG [(jenkins-hbase4.apache.org,44227,1696262556745)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44227-0x10107dfc1490000, quorum=127.0.0.1:50210, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37455,1696262558909 2023-10-02 16:03:25,225 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43801,1696262558835 2023-10-02 16:03:25,229 DEBUG [(jenkins-hbase4.apache.org,44227,1696262556745)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44227-0x10107dfc1490000, quorum=127.0.0.1:50210, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,42303,1696262558956 2023-10-02 16:03:25,233 DEBUG [(jenkins-hbase4.apache.org,44227,1696262556745)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44227-0x10107dfc1490000, quorum=127.0.0.1:50210, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43801,1696262558835 2023-10-02 16:03:25,233 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-02 16:03:25,244 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-10-02 16:03:25,244 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37455,1696262558909 2023-10-02 16:03:25,245 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42303,1696262558956 2023-10-02 16:03:25,245 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43801,1696262558835 2023-10-02 16:03:25,251 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): master:44227-0x10107dfc1490000, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43801,1696262558835 2023-10-02 16:03:25,251 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): master:44227-0x10107dfc1490000, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-10-02 16:03:25,251 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): master:44227-0x10107dfc1490000, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,42303,1696262558956 2023-10-02 16:03:25,251 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): master:44227-0x10107dfc1490000, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37455,1696262558909 2023-10-02 16:03:25,251 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): master:44227-0x10107dfc1490000, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-10-02 16:03:25,251 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): master:44227-0x10107dfc1490000, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43801,1696262558835 2023-10-02 16:03:25,251 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): master:44227-0x10107dfc1490000, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-10-02 16:03:25,251 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): master:44227-0x10107dfc1490000, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,42303,1696262558956 2023-10-02 16:03:25,251 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): master:44227-0x10107dfc1490000, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37455,1696262558909 2023-10-02 16:03:25,251 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): master:44227-0x10107dfc1490000, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-10-02 16:03:25,251 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): master:44227-0x10107dfc1490000, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-10-02 16:03:25,251 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): regionserver:43801-0x10107dfc1490001, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-02 16:03:25,251 DEBUG [(jenkins-hbase4.apache.org,44227,1696262556745)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-02 16:03:25,251 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-02 16:03:25,251 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemState 2023-10-02 16:03:25,251 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemState 2023-10-02 16:03:25,252 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): regionserver:42303-0x10107dfc1490003, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-02 16:03:25,252 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): regionserver:42303-0x10107dfc1490003, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-02 16:03:25,251 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): regionserver:43801-0x10107dfc1490001, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-02 16:03:25,252 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 8c2558c0b59bb3a4e2e578c2c8e8915d, NAME => 'testtb-testExportFileSystemState,.mob,0.8c2558c0b59bb3a4e2e578c2c8e8915d.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testExportFileSystemState 2023-10-02 16:03:25,261 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-10-02 16:03:25,251 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-02 16:03:25,257 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): regionserver:37455-0x10107dfc1490002, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-02 16:03:25,262 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): regionserver:37455-0x10107dfc1490002, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-02 16:03:25,262 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-02 16:03:25,262 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-02 16:03:25,252 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-02 16:03:25,262 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-02 16:03:25,265 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-02 16:03:25,265 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-02 16:03:25,265 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-02 16:03:25,265 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-02 16:03:25,265 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-02 16:03:25,265 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-02 16:03:25,266 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b2023100215646220dbe94e098e3013a37627ef97, hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e2023100218269611b0864caba01d501c947e0198] mob files 2023-10-02 16:03:25,266 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b2023100215646220dbe94e098e3013a37627ef97 2023-10-02 16:03:25,266 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e2023100218269611b0864caba01d501c947e0198 2023-10-02 16:03:25,365 DEBUG [Listener at jenkins-hbase4.apache.org/32975] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-02 16:03:25,370 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44227] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-10-02 16:03:25,370 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44227] snapshot.SnapshotManager(406): Snapshoting '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-10-02 16:03:25,370 DEBUG [Listener at jenkins-hbase4.apache.org/32975] client.HBaseAdmin(2428): (#5) Sleeping: 1000ms while waiting for snapshot completion. 2023-10-02 16:03:25,381 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemState 2023-10-02 16:03:25,385 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-10-02 16:03:26,040 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState to hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/.hbase-snapshot/snaptb0-testExportFileSystemState 2023-10-02 16:03:26,050 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed 2023-10-02 16:03:26,050 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-10-02 16:03:26,057 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-10-02 16:03:26,057 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState at 1696262604249Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemState at 1696262605381 (+1132 ms)Consolidate snapshot: snaptb0-testExportFileSystemState at 1696262605381Loading Region manifests for snaptb0-testExportFileSystemState at 1696262605381Writing data manifest for snaptb0-testExportFileSystemState at 1696262605437 (+56 ms)Verifying snapshot: snaptb0-testExportFileSystemState at 1696262605980 (+543 ms)Snapshot snaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed at 1696262606050 (+70 ms) 2023-10-02 16:03:26,086 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=35, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-10-02 16:03:26,105 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696262569087_0001_000001 (auth:SIMPLE) 2023-10-02 16:03:26,128 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=35, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED in 1.8360 sec 2023-10-02 16:03:26,370 DEBUG [Listener at jenkins-hbase4.apache.org/32975] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-02 16:03:26,372 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44227] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-10-02 16:03:26,372 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44227] snapshot.SnapshotManager(403): Snapshot '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-10-02 16:03:26,373 INFO [Listener at jenkins-hbase4.apache.org/32975] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/export-test/export-1696262606373 2023-10-02 16:03:26,373 INFO [Listener at jenkins-hbase4.apache.org/32975] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:42119, tgtDir=hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/export-test/export-1696262606373, rawTgtDir=hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/export-test/export-1696262606373, srcFsUri=hdfs://localhost:42119, srcDir=hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af 2023-10-02 16:03:26,448 DEBUG [Listener at jenkins-hbase4.apache.org/32975] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:42119, inputRoot=hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af 2023-10-02 16:03:26,449 DEBUG [Listener at jenkins-hbase4.apache.org/32975] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-232678131_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/export-test/export-1696262606373, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/export-test/export-1696262606373/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-10-02 16:03:26,449 INFO [Listener at jenkins-hbase4.apache.org/32975] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:42119, inputRoot=hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af, snapshotDir=hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/.hbase-snapshot/snaptb0-testExportFileSystemState. 2023-10-02 16:03:26,537 INFO [Listener at jenkins-hbase4.apache.org/32975] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/.hbase-snapshot/snaptb0-testExportFileSystemState to hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/export-test/export-1696262606373/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-10-02 16:03:26,834 DEBUG [Listener at jenkins-hbase4.apache.org/32975] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-10-02 16:03:26,835 DEBUG [Listener at jenkins-hbase4.apache.org/32975] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-10-02 16:03:26,836 DEBUG [Listener at jenkins-hbase4.apache.org/32975] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-10-02 16:03:26,836 DEBUG [Listener at jenkins-hbase4.apache.org/32975] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-10-02 16:03:27,951 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-10-02 16:03:28,222 DEBUG [Listener at jenkins-hbase4.apache.org/32975] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ec4ab044-456e-ce77-098f-f91b72a3e0ab/hadoop-7416016201527015879.jar 2023-10-02 16:03:28,224 DEBUG [Listener at jenkins-hbase4.apache.org/32975] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-10-02 16:03:28,225 DEBUG [Listener at jenkins-hbase4.apache.org/32975] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-10-02 16:03:28,320 DEBUG [Listener at jenkins-hbase4.apache.org/32975] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ec4ab044-456e-ce77-098f-f91b72a3e0ab/hadoop-125192143103486313.jar 2023-10-02 16:03:28,321 DEBUG [Listener at jenkins-hbase4.apache.org/32975] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-10-02 16:03:28,321 DEBUG [Listener at jenkins-hbase4.apache.org/32975] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-10-02 16:03:28,322 DEBUG [Listener at jenkins-hbase4.apache.org/32975] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-10-02 16:03:28,322 DEBUG [Listener at jenkins-hbase4.apache.org/32975] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-10-02 16:03:28,322 DEBUG [Listener at jenkins-hbase4.apache.org/32975] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-10-02 16:03:28,323 DEBUG [Listener at jenkins-hbase4.apache.org/32975] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-10-02 16:03:28,323 DEBUG [Listener at jenkins-hbase4.apache.org/32975] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-10-02 16:03:28,323 DEBUG [Listener at jenkins-hbase4.apache.org/32975] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-10-02 16:03:28,324 DEBUG [Listener at jenkins-hbase4.apache.org/32975] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-10-02 16:03:28,324 DEBUG [Listener at jenkins-hbase4.apache.org/32975] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-10-02 16:03:28,324 DEBUG [Listener at jenkins-hbase4.apache.org/32975] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-10-02 16:03:28,325 DEBUG [Listener at jenkins-hbase4.apache.org/32975] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-10-02 16:03:28,326 DEBUG [Listener at jenkins-hbase4.apache.org/32975] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-10-02 16:03:28,326 DEBUG [Listener at jenkins-hbase4.apache.org/32975] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-10-02 16:03:28,327 DEBUG [Listener at jenkins-hbase4.apache.org/32975] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-10-02 16:03:28,327 DEBUG [Listener at jenkins-hbase4.apache.org/32975] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-10-02 16:03:28,328 DEBUG [Listener at jenkins-hbase4.apache.org/32975] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-02 16:03:28,329 DEBUG [Listener at jenkins-hbase4.apache.org/32975] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-02 16:03:28,330 DEBUG [Listener at jenkins-hbase4.apache.org/32975] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-10-02 16:03:28,330 DEBUG [Listener at jenkins-hbase4.apache.org/32975] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-02 16:03:28,330 DEBUG [Listener at jenkins-hbase4.apache.org/32975] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-02 16:03:28,331 DEBUG [Listener at jenkins-hbase4.apache.org/32975] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-10-02 16:03:28,332 DEBUG [Listener at jenkins-hbase4.apache.org/32975] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-10-02 16:03:30,994 WARN [Listener at jenkins-hbase4.apache.org/32975] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-10-02 16:03:31,006 INFO [Listener at jenkins-hbase4.apache.org/32975] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportFileSystemState' hfile list 2023-10-02 16:03:31,010 DEBUG [Listener at jenkins-hbase4.apache.org/32975] snapshot.ExportSnapshot(671): export split=0 size=30.9 K 2023-10-02 16:03:31,530 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-10-02 16:03:31,530 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-10-02 16:03:31,630 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696262569087_0002_000001 (auth:SIMPLE) 2023-10-02 16:03:36,942 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696262569087_0002_000001 (auth:SIMPLE) 2023-10-02 16:03:39,228 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696262569087_0002_000001 (auth:SIMPLE) 2023-10-02 16:03:43,752 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696262569087_0002_000001 (auth:SIMPLE) 2023-10-02 16:03:45,708 INFO [Listener at jenkins-hbase4.apache.org/32975] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-10-02 16:03:45,710 INFO [Listener at jenkins-hbase4.apache.org/32975] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-10-02 16:03:45,720 INFO [Listener at jenkins-hbase4.apache.org/32975] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testExportFileSystemState 2023-10-02 16:03:45,720 INFO [Listener at jenkins-hbase4.apache.org/32975] snapshot.TestExportSnapshot(279): Exported snapshot 2023-10-02 16:03:45,723 INFO [Listener at jenkins-hbase4.apache.org/32975] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-10-02 16:03:45,723 DEBUG [Listener at jenkins-hbase4.apache.org/32975] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_95248091_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/.hbase-snapshot/snaptb0-testExportFileSystemState at hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/.hbase-snapshot/snaptb0-testExportFileSystemState 2023-10-02 16:03:45,723 DEBUG [Listener at jenkins-hbase4.apache.org/32975] snapshot.TestExportSnapshot(367): hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/.hbase-snapshot/snaptb0-testExportFileSystemState/.snapshotinfo 2023-10-02 16:03:45,724 DEBUG [Listener at jenkins-hbase4.apache.org/32975] snapshot.TestExportSnapshot(367): hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/.hbase-snapshot/snaptb0-testExportFileSystemState/data.manifest 2023-10-02 16:03:45,724 DEBUG [Listener at jenkins-hbase4.apache.org/32975] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_95248091_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/export-test/export-1696262606373/.hbase-snapshot/snaptb0-testExportFileSystemState at hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/export-test/export-1696262606373/.hbase-snapshot/snaptb0-testExportFileSystemState 2023-10-02 16:03:45,724 DEBUG [Listener at jenkins-hbase4.apache.org/32975] snapshot.TestExportSnapshot(367): hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/export-test/export-1696262606373/.hbase-snapshot/snaptb0-testExportFileSystemState/.snapshotinfo 2023-10-02 16:03:45,724 DEBUG [Listener at jenkins-hbase4.apache.org/32975] snapshot.TestExportSnapshot(367): hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/export-test/export-1696262606373/.hbase-snapshot/snaptb0-testExportFileSystemState/data.manifest 2023-10-02 16:03:45,742 INFO [Listener at jenkins-hbase4.apache.org/32975] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemState 2023-10-02 16:03:45,743 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44227] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemState 2023-10-02 16:03:45,749 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44227] procedure2.ProcedureExecutor(1028): Stored pid=36, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemState 2023-10-02 16:03:45,755 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44227] master.MasterRpcServices(1230): Checking to see if procedure is done pid=36 2023-10-02 16:03:45,760 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696262625760"}]},"ts":"1696262625760"} 2023-10-02 16:03:45,764 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=DISABLING in hbase:meta 2023-10-02 16:03:45,766 INFO [PEWorker-2] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemState to state=DISABLING 2023-10-02 16:03:45,767 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=37, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=b59ba9dd49e5dc36ea7b791aa7aba65a, UNASSIGN}, {pid=38, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=9d4d6a0fc331dee62a0e47d9a2e1e68b, UNASSIGN}] 2023-10-02 16:03:45,772 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=37, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=b59ba9dd49e5dc36ea7b791aa7aba65a, UNASSIGN 2023-10-02 16:03:45,772 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=38, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=9d4d6a0fc331dee62a0e47d9a2e1e68b, UNASSIGN 2023-10-02 16:03:45,774 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=38 updating hbase:meta row=9d4d6a0fc331dee62a0e47d9a2e1e68b, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,42303,1696262558956 2023-10-02 16:03:45,774 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=37 updating hbase:meta row=b59ba9dd49e5dc36ea7b791aa7aba65a, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,43801,1696262558835 2023-10-02 16:03:45,774 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,1,1696262602840.9d4d6a0fc331dee62a0e47d9a2e1e68b.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1696262625773"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696262625773"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696262625773"}]},"ts":"1696262625773"} 2023-10-02 16:03:45,774 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,,1696262602840.b59ba9dd49e5dc36ea7b791aa7aba65a.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1696262625773"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696262625773"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696262625773"}]},"ts":"1696262625773"} 2023-10-02 16:03:45,777 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=39, ppid=38, state=RUNNABLE; CloseRegionProcedure 9d4d6a0fc331dee62a0e47d9a2e1e68b, server=jenkins-hbase4.apache.org,42303,1696262558956}] 2023-10-02 16:03:45,779 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=40, ppid=37, state=RUNNABLE; CloseRegionProcedure b59ba9dd49e5dc36ea7b791aa7aba65a, server=jenkins-hbase4.apache.org,43801,1696262558835}] 2023-10-02 16:03:45,857 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44227] master.MasterRpcServices(1230): Checking to see if procedure is done pid=36 2023-10-02 16:03:45,936 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 9d4d6a0fc331dee62a0e47d9a2e1e68b 2023-10-02 16:03:45,937 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 9d4d6a0fc331dee62a0e47d9a2e1e68b, disabling compactions & flushes 2023-10-02 16:03:45,937 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,1,1696262602840.9d4d6a0fc331dee62a0e47d9a2e1e68b. 2023-10-02 16:03:45,937 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,1,1696262602840.9d4d6a0fc331dee62a0e47d9a2e1e68b. 2023-10-02 16:03:45,937 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,1,1696262602840.9d4d6a0fc331dee62a0e47d9a2e1e68b. after waiting 0 ms 2023-10-02 16:03:45,937 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,1,1696262602840.9d4d6a0fc331dee62a0e47d9a2e1e68b. 2023-10-02 16:03:45,937 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close b59ba9dd49e5dc36ea7b791aa7aba65a 2023-10-02 16:03:45,938 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing b59ba9dd49e5dc36ea7b791aa7aba65a, disabling compactions & flushes 2023-10-02 16:03:45,938 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,,1696262602840.b59ba9dd49e5dc36ea7b791aa7aba65a. 2023-10-02 16:03:45,938 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,,1696262602840.b59ba9dd49e5dc36ea7b791aa7aba65a. 2023-10-02 16:03:45,938 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,,1696262602840.b59ba9dd49e5dc36ea7b791aa7aba65a. after waiting 0 ms 2023-10-02 16:03:45,938 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,,1696262602840.b59ba9dd49e5dc36ea7b791aa7aba65a. 2023-10-02 16:03:45,974 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/data/default/testtb-testExportFileSystemState/b59ba9dd49e5dc36ea7b791aa7aba65a/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-10-02 16:03:45,975 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-10-02 16:03:45,979 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,,1696262602840.b59ba9dd49e5dc36ea7b791aa7aba65a. 2023-10-02 16:03:45,980 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for b59ba9dd49e5dc36ea7b791aa7aba65a: 2023-10-02 16:03:45,981 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/data/default/testtb-testExportFileSystemState/9d4d6a0fc331dee62a0e47d9a2e1e68b/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-10-02 16:03:45,988 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-10-02 16:03:45,993 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed b59ba9dd49e5dc36ea7b791aa7aba65a 2023-10-02 16:03:45,994 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,1,1696262602840.9d4d6a0fc331dee62a0e47d9a2e1e68b. 2023-10-02 16:03:45,994 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 9d4d6a0fc331dee62a0e47d9a2e1e68b: 2023-10-02 16:03:45,995 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=37 updating hbase:meta row=b59ba9dd49e5dc36ea7b791aa7aba65a, regionState=CLOSED 2023-10-02 16:03:45,995 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,,1696262602840.b59ba9dd49e5dc36ea7b791aa7aba65a.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1696262625995"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696262625995"}]},"ts":"1696262625995"} 2023-10-02 16:03:45,997 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 9d4d6a0fc331dee62a0e47d9a2e1e68b 2023-10-02 16:03:45,998 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=38 updating hbase:meta row=9d4d6a0fc331dee62a0e47d9a2e1e68b, regionState=CLOSED 2023-10-02 16:03:45,998 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,1,1696262602840.9d4d6a0fc331dee62a0e47d9a2e1e68b.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1696262625998"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696262625998"}]},"ts":"1696262625998"} 2023-10-02 16:03:46,001 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=40, resume processing ppid=37 2023-10-02 16:03:46,001 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=40, ppid=37, state=SUCCESS; CloseRegionProcedure b59ba9dd49e5dc36ea7b791aa7aba65a, server=jenkins-hbase4.apache.org,43801,1696262558835 in 219 msec 2023-10-02 16:03:46,003 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=39, resume processing ppid=38 2023-10-02 16:03:46,003 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=39, ppid=38, state=SUCCESS; CloseRegionProcedure 9d4d6a0fc331dee62a0e47d9a2e1e68b, server=jenkins-hbase4.apache.org,42303,1696262558956 in 223 msec 2023-10-02 16:03:46,004 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=37, ppid=36, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=b59ba9dd49e5dc36ea7b791aa7aba65a, UNASSIGN in 234 msec 2023-10-02 16:03:46,005 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=38, resume processing ppid=36 2023-10-02 16:03:46,005 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=38, ppid=36, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=9d4d6a0fc331dee62a0e47d9a2e1e68b, UNASSIGN in 236 msec 2023-10-02 16:03:46,006 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696262626006"}]},"ts":"1696262626006"} 2023-10-02 16:03:46,008 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=DISABLED in hbase:meta 2023-10-02 16:03:46,009 INFO [PEWorker-4] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemState to state=DISABLED 2023-10-02 16:03:46,017 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=36, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemState in 265 msec 2023-10-02 16:03:46,059 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44227] master.MasterRpcServices(1230): Checking to see if procedure is done pid=36 2023-10-02 16:03:46,059 INFO [Listener at jenkins-hbase4.apache.org/32975] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemState, procId: 36 completed 2023-10-02 16:03:46,060 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44227] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemState 2023-10-02 16:03:46,062 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44227] procedure2.ProcedureExecutor(1028): Stored pid=41, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-10-02 16:03:46,066 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=41, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-10-02 16:03:46,066 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44227] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemState 2023-10-02 16:03:46,068 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=41, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-10-02 16:03:46,070 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=42303] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemState 2023-10-02 16:03:46,075 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): regionserver:37455-0x10107dfc1490002, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-10-02 16:03:46,075 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): regionserver:43801-0x10107dfc1490001, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-10-02 16:03:46,076 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): regionserver:42303-0x10107dfc1490003, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-10-02 16:03:46,076 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): master:44227-0x10107dfc1490000, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-10-02 16:03:46,076 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-10-02 16:03:46,077 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-10-02 16:03:46,077 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-10-02 16:03:46,077 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-10-02 16:03:46,082 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): regionserver:43801-0x10107dfc1490001, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-10-02 16:03:46,082 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): regionserver:42303-0x10107dfc1490003, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-10-02 16:03:46,082 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): regionserver:43801-0x10107dfc1490001, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-02 16:03:46,082 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): regionserver:42303-0x10107dfc1490003, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-02 16:03:46,082 DEBUG [HFileArchiver-9] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/.tmp/data/default/testtb-testExportFileSystemState/b59ba9dd49e5dc36ea7b791aa7aba65a 2023-10-02 16:03:46,083 DEBUG [HFileArchiver-10] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/.tmp/data/default/testtb-testExportFileSystemState/9d4d6a0fc331dee62a0e47d9a2e1e68b 2023-10-02 16:03:46,083 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): regionserver:37455-0x10107dfc1490002, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-10-02 16:03:46,083 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): regionserver:37455-0x10107dfc1490002, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-02 16:03:46,083 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): master:44227-0x10107dfc1490000, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-10-02 16:03:46,083 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): master:44227-0x10107dfc1490000, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-02 16:03:46,085 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44227] master.MasterRpcServices(1230): Checking to see if procedure is done pid=41 2023-10-02 16:03:46,094 DEBUG [HFileArchiver-10] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/.tmp/data/default/testtb-testExportFileSystemState/9d4d6a0fc331dee62a0e47d9a2e1e68b/cf, FileablePath, hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/.tmp/data/default/testtb-testExportFileSystemState/9d4d6a0fc331dee62a0e47d9a2e1e68b/recovered.edits] 2023-10-02 16:03:46,095 DEBUG [HFileArchiver-9] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/.tmp/data/default/testtb-testExportFileSystemState/b59ba9dd49e5dc36ea7b791aa7aba65a/cf, FileablePath, hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/.tmp/data/default/testtb-testExportFileSystemState/b59ba9dd49e5dc36ea7b791aa7aba65a/recovered.edits] 2023-10-02 16:03:46,105 DEBUG [HFileArchiver-10] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/.tmp/data/default/testtb-testExportFileSystemState/9d4d6a0fc331dee62a0e47d9a2e1e68b/cf/a9dacbb9b9e642959d94f88f89439d3d to hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/archive/data/default/testtb-testExportFileSystemState/9d4d6a0fc331dee62a0e47d9a2e1e68b/cf/a9dacbb9b9e642959d94f88f89439d3d 2023-10-02 16:03:46,105 DEBUG [HFileArchiver-9] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/.tmp/data/default/testtb-testExportFileSystemState/b59ba9dd49e5dc36ea7b791aa7aba65a/cf/0f4d642fec494dd984227aef8a1058e5 to hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/archive/data/default/testtb-testExportFileSystemState/b59ba9dd49e5dc36ea7b791aa7aba65a/cf/0f4d642fec494dd984227aef8a1058e5 2023-10-02 16:03:46,110 DEBUG [HFileArchiver-10] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/.tmp/data/default/testtb-testExportFileSystemState/9d4d6a0fc331dee62a0e47d9a2e1e68b/recovered.edits/9.seqid to hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/archive/data/default/testtb-testExportFileSystemState/9d4d6a0fc331dee62a0e47d9a2e1e68b/recovered.edits/9.seqid 2023-10-02 16:03:46,112 DEBUG [HFileArchiver-9] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/.tmp/data/default/testtb-testExportFileSystemState/b59ba9dd49e5dc36ea7b791aa7aba65a/recovered.edits/9.seqid to hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/archive/data/default/testtb-testExportFileSystemState/b59ba9dd49e5dc36ea7b791aa7aba65a/recovered.edits/9.seqid 2023-10-02 16:03:46,114 DEBUG [HFileArchiver-9] backup.HFileArchiver(596): Deleted hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/.tmp/data/default/testtb-testExportFileSystemState/b59ba9dd49e5dc36ea7b791aa7aba65a 2023-10-02 16:03:46,114 DEBUG [HFileArchiver-10] backup.HFileArchiver(596): Deleted hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/.tmp/data/default/testtb-testExportFileSystemState/9d4d6a0fc331dee62a0e47d9a2e1e68b 2023-10-02 16:03:46,114 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemState regions 2023-10-02 16:03:46,114 DEBUG [PEWorker-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d 2023-10-02 16:03:46,115 DEBUG [PEWorker-1] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf] 2023-10-02 16:03:46,125 DEBUG [PEWorker-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b2023100215646220dbe94e098e3013a37627ef97 to hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/archive/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b2023100215646220dbe94e098e3013a37627ef97 2023-10-02 16:03:46,127 DEBUG [PEWorker-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e2023100218269611b0864caba01d501c947e0198 to hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/archive/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e2023100218269611b0864caba01d501c947e0198 2023-10-02 16:03:46,128 DEBUG [PEWorker-1] backup.HFileArchiver(596): Deleted hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d 2023-10-02 16:03:46,132 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=41, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-10-02 16:03:46,135 WARN [PEWorker-1] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportFileSystemState from hbase:meta 2023-10-02 16:03:46,142 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemState' descriptor. 2023-10-02 16:03:46,143 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=41, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-10-02 16:03:46,144 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemState' from region states. 2023-10-02 16:03:46,144 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemState,,1696262602840.b59ba9dd49e5dc36ea7b791aa7aba65a.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1696262626144"}]},"ts":"9223372036854775807"} 2023-10-02 16:03:46,144 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemState,1,1696262602840.9d4d6a0fc331dee62a0e47d9a2e1e68b.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1696262626144"}]},"ts":"9223372036854775807"} 2023-10-02 16:03:46,148 INFO [PEWorker-1] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-10-02 16:03:46,148 DEBUG [PEWorker-1] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => b59ba9dd49e5dc36ea7b791aa7aba65a, NAME => 'testtb-testExportFileSystemState,,1696262602840.b59ba9dd49e5dc36ea7b791aa7aba65a.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 9d4d6a0fc331dee62a0e47d9a2e1e68b, NAME => 'testtb-testExportFileSystemState,1,1696262602840.9d4d6a0fc331dee62a0e47d9a2e1e68b.', STARTKEY => '1', ENDKEY => ''}] 2023-10-02 16:03:46,148 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemState' as deleted. 2023-10-02 16:03:46,148 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1696262626148"}]},"ts":"9223372036854775807"} 2023-10-02 16:03:46,153 INFO [PEWorker-1] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemState state from META 2023-10-02 16:03:46,156 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(130): Finished pid=41, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-10-02 16:03:46,158 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=41, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemState in 96 msec 2023-10-02 16:03:46,187 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44227] master.MasterRpcServices(1230): Checking to see if procedure is done pid=41 2023-10-02 16:03:46,189 INFO [Listener at jenkins-hbase4.apache.org/32975] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemState, procId: 41 completed 2023-10-02 16:03:46,198 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44227] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportFileSystemState" 2023-10-02 16:03:46,200 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44227] snapshot.SnapshotManager(335): Deleting snapshot: emptySnaptb0-testExportFileSystemState 2023-10-02 16:03:46,201 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44227] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemState" 2023-10-02 16:03:46,203 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44227] snapshot.SnapshotManager(335): Deleting snapshot: snaptb0-testExportFileSystemState 2023-10-02 16:03:46,238 INFO [Listener at jenkins-hbase4.apache.org/32975] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testExportFileSystemState Thread=743 (was 744), OpenFileDescriptor=912 (was 913), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=740 (was 743), ProcessCount=197 (was 197), AvailableMemoryMB=1087 (was 1654) 2023-10-02 16:03:46,239 WARN [Listener at jenkins-hbase4.apache.org/32975] hbase.ResourceChecker(130): Thread=743 is superior to 500 2023-10-02 16:03:46,265 INFO [Listener at jenkins-hbase4.apache.org/32975] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testConsecutiveExports Thread=743, OpenFileDescriptor=912, MaxFileDescriptor=60000, SystemLoadAverage=740, ProcessCount=197, AvailableMemoryMB=1086 2023-10-02 16:03:46,266 WARN [Listener at jenkins-hbase4.apache.org/32975] hbase.ResourceChecker(130): Thread=743 is superior to 500 2023-10-02 16:03:46,268 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44227] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testConsecutiveExports', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-10-02 16:03:46,269 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44227] procedure2.ProcedureExecutor(1028): Stored pid=42, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testConsecutiveExports 2023-10-02 16:03:46,272 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_PRE_OPERATION 2023-10-02 16:03:46,274 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44227] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testConsecutiveExports" procId is: 42 2023-10-02 16:03:46,275 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-10-02 16:03:46,278 DEBUG [HFileArchiver-11] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/.tmp/data/default/testtb-testConsecutiveExports/15c7559507cb6c3ab40d162bcd5ad2cd 2023-10-02 16:03:46,280 DEBUG [HFileArchiver-11] backup.HFileArchiver(153): Directory hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/.tmp/data/default/testtb-testConsecutiveExports/15c7559507cb6c3ab40d162bcd5ad2cd empty. 2023-10-02 16:03:46,280 DEBUG [HFileArchiver-12] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/.tmp/data/default/testtb-testConsecutiveExports/c41b1d234039fe8c4dd0cf12f07b1cb7 2023-10-02 16:03:46,280 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44227] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-10-02 16:03:46,281 DEBUG [HFileArchiver-11] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/.tmp/data/default/testtb-testConsecutiveExports/15c7559507cb6c3ab40d162bcd5ad2cd 2023-10-02 16:03:46,281 DEBUG [HFileArchiver-12] backup.HFileArchiver(153): Directory hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/.tmp/data/default/testtb-testConsecutiveExports/c41b1d234039fe8c4dd0cf12f07b1cb7 empty. 2023-10-02 16:03:46,281 DEBUG [HFileArchiver-12] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/.tmp/data/default/testtb-testConsecutiveExports/c41b1d234039fe8c4dd0cf12f07b1cb7 2023-10-02 16:03:46,281 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testtb-testConsecutiveExports regions 2023-10-02 16:03:46,293 DEBUG [PEWorker-5] util.FSTableDescriptors(570): Wrote into hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/.tmp/data/default/testtb-testConsecutiveExports/.tabledesc/.tableinfo.0000000001 2023-10-02 16:03:46,294 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(7675): creating {ENCODED => 15c7559507cb6c3ab40d162bcd5ad2cd, NAME => 'testtb-testConsecutiveExports,,1696262626267.15c7559507cb6c3ab40d162bcd5ad2cd.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testConsecutiveExports', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/.tmp 2023-10-02 16:03:46,294 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(7675): creating {ENCODED => c41b1d234039fe8c4dd0cf12f07b1cb7, NAME => 'testtb-testConsecutiveExports,1,1696262626267.c41b1d234039fe8c4dd0cf12f07b1cb7.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testConsecutiveExports', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/.tmp 2023-10-02 16:03:46,321 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,,1696262626267.15c7559507cb6c3ab40d162bcd5ad2cd.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-02 16:03:46,322 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1604): Closing 15c7559507cb6c3ab40d162bcd5ad2cd, disabling compactions & flushes 2023-10-02 16:03:46,322 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,,1696262626267.15c7559507cb6c3ab40d162bcd5ad2cd. 2023-10-02 16:03:46,322 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,,1696262626267.15c7559507cb6c3ab40d162bcd5ad2cd. 2023-10-02 16:03:46,322 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,,1696262626267.15c7559507cb6c3ab40d162bcd5ad2cd. after waiting 0 ms 2023-10-02 16:03:46,322 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,,1696262626267.15c7559507cb6c3ab40d162bcd5ad2cd. 2023-10-02 16:03:46,322 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,,1696262626267.15c7559507cb6c3ab40d162bcd5ad2cd. 2023-10-02 16:03:46,322 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1558): Region close journal for 15c7559507cb6c3ab40d162bcd5ad2cd: 2023-10-02 16:03:46,324 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,1,1696262626267.c41b1d234039fe8c4dd0cf12f07b1cb7.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-02 16:03:46,329 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1604): Closing c41b1d234039fe8c4dd0cf12f07b1cb7, disabling compactions & flushes 2023-10-02 16:03:46,329 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,1,1696262626267.c41b1d234039fe8c4dd0cf12f07b1cb7. 2023-10-02 16:03:46,330 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,1,1696262626267.c41b1d234039fe8c4dd0cf12f07b1cb7. 2023-10-02 16:03:46,330 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,1,1696262626267.c41b1d234039fe8c4dd0cf12f07b1cb7. after waiting 0 ms 2023-10-02 16:03:46,330 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,1,1696262626267.c41b1d234039fe8c4dd0cf12f07b1cb7. 2023-10-02 16:03:46,330 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,1,1696262626267.c41b1d234039fe8c4dd0cf12f07b1cb7. 2023-10-02 16:03:46,330 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1558): Region close journal for c41b1d234039fe8c4dd0cf12f07b1cb7: 2023-10-02 16:03:46,333 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_ADD_TO_META 2023-10-02 16:03:46,334 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,,1696262626267.15c7559507cb6c3ab40d162bcd5ad2cd.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1696262626334"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696262626334"}]},"ts":"1696262626334"} 2023-10-02 16:03:46,334 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,1,1696262626267.c41b1d234039fe8c4dd0cf12f07b1cb7.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1696262626334"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696262626334"}]},"ts":"1696262626334"} 2023-10-02 16:03:46,340 INFO [PEWorker-5] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-10-02 16:03:46,346 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-10-02 16:03:46,346 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696262626346"}]},"ts":"1696262626346"} 2023-10-02 16:03:46,348 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=ENABLING in hbase:meta 2023-10-02 16:03:46,351 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-10-02 16:03:46,353 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-10-02 16:03:46,353 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-10-02 16:03:46,353 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-10-02 16:03:46,353 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-10-02 16:03:46,354 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=43, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=15c7559507cb6c3ab40d162bcd5ad2cd, ASSIGN}, {pid=44, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=c41b1d234039fe8c4dd0cf12f07b1cb7, ASSIGN}] 2023-10-02 16:03:46,357 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=44, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=c41b1d234039fe8c4dd0cf12f07b1cb7, ASSIGN 2023-10-02 16:03:46,357 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=43, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=15c7559507cb6c3ab40d162bcd5ad2cd, ASSIGN 2023-10-02 16:03:46,359 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=44, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=c41b1d234039fe8c4dd0cf12f07b1cb7, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,42303,1696262558956; forceNewPlan=false, retain=false 2023-10-02 16:03:46,359 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=43, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=15c7559507cb6c3ab40d162bcd5ad2cd, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,37455,1696262558909; forceNewPlan=false, retain=false 2023-10-02 16:03:46,382 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44227] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-10-02 16:03:46,510 INFO [jenkins-hbase4:44227] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-10-02 16:03:46,512 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=44 updating hbase:meta row=c41b1d234039fe8c4dd0cf12f07b1cb7, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,42303,1696262558956 2023-10-02 16:03:46,512 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=43 updating hbase:meta row=15c7559507cb6c3ab40d162bcd5ad2cd, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,37455,1696262558909 2023-10-02 16:03:46,513 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,1,1696262626267.c41b1d234039fe8c4dd0cf12f07b1cb7.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1696262626512"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696262626512"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696262626512"}]},"ts":"1696262626512"} 2023-10-02 16:03:46,513 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,,1696262626267.15c7559507cb6c3ab40d162bcd5ad2cd.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1696262626512"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696262626512"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696262626512"}]},"ts":"1696262626512"} 2023-10-02 16:03:46,515 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=45, ppid=44, state=RUNNABLE; OpenRegionProcedure c41b1d234039fe8c4dd0cf12f07b1cb7, server=jenkins-hbase4.apache.org,42303,1696262558956}] 2023-10-02 16:03:46,516 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=46, ppid=43, state=RUNNABLE; OpenRegionProcedure 15c7559507cb6c3ab40d162bcd5ad2cd, server=jenkins-hbase4.apache.org,37455,1696262558909}] 2023-10-02 16:03:46,583 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44227] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-10-02 16:03:46,670 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,37455,1696262558909 2023-10-02 16:03:46,670 DEBUG [RSProcedureDispatcher-pool-1] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-10-02 16:03:46,675 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:54394, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-10-02 16:03:46,676 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testConsecutiveExports,1,1696262626267.c41b1d234039fe8c4dd0cf12f07b1cb7. 2023-10-02 16:03:46,676 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => c41b1d234039fe8c4dd0cf12f07b1cb7, NAME => 'testtb-testConsecutiveExports,1,1696262626267.c41b1d234039fe8c4dd0cf12f07b1cb7.', STARTKEY => '1', ENDKEY => ''} 2023-10-02 16:03:46,676 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testConsecutiveExports,1,1696262626267.c41b1d234039fe8c4dd0cf12f07b1cb7. service=AccessControlService 2023-10-02 16:03:46,678 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-10-02 16:03:46,678 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testConsecutiveExports c41b1d234039fe8c4dd0cf12f07b1cb7 2023-10-02 16:03:46,678 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,1,1696262626267.c41b1d234039fe8c4dd0cf12f07b1cb7.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-02 16:03:46,678 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for c41b1d234039fe8c4dd0cf12f07b1cb7 2023-10-02 16:03:46,678 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for c41b1d234039fe8c4dd0cf12f07b1cb7 2023-10-02 16:03:46,680 INFO [StoreOpener-c41b1d234039fe8c4dd0cf12f07b1cb7-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region c41b1d234039fe8c4dd0cf12f07b1cb7 2023-10-02 16:03:46,683 DEBUG [StoreOpener-c41b1d234039fe8c4dd0cf12f07b1cb7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/data/default/testtb-testConsecutiveExports/c41b1d234039fe8c4dd0cf12f07b1cb7/cf 2023-10-02 16:03:46,683 DEBUG [StoreOpener-c41b1d234039fe8c4dd0cf12f07b1cb7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/data/default/testtb-testConsecutiveExports/c41b1d234039fe8c4dd0cf12f07b1cb7/cf 2023-10-02 16:03:46,684 INFO [StoreOpener-c41b1d234039fe8c4dd0cf12f07b1cb7-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region c41b1d234039fe8c4dd0cf12f07b1cb7 columnFamilyName cf 2023-10-02 16:03:46,685 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testConsecutiveExports,,1696262626267.15c7559507cb6c3ab40d162bcd5ad2cd. 2023-10-02 16:03:46,685 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 15c7559507cb6c3ab40d162bcd5ad2cd, NAME => 'testtb-testConsecutiveExports,,1696262626267.15c7559507cb6c3ab40d162bcd5ad2cd.', STARTKEY => '', ENDKEY => '1'} 2023-10-02 16:03:46,685 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testConsecutiveExports,,1696262626267.15c7559507cb6c3ab40d162bcd5ad2cd. service=AccessControlService 2023-10-02 16:03:46,685 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-10-02 16:03:46,686 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testConsecutiveExports 15c7559507cb6c3ab40d162bcd5ad2cd 2023-10-02 16:03:46,686 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,,1696262626267.15c7559507cb6c3ab40d162bcd5ad2cd.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-02 16:03:46,686 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 15c7559507cb6c3ab40d162bcd5ad2cd 2023-10-02 16:03:46,686 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 15c7559507cb6c3ab40d162bcd5ad2cd 2023-10-02 16:03:46,686 INFO [StoreOpener-c41b1d234039fe8c4dd0cf12f07b1cb7-1] regionserver.HStore(310): Store=c41b1d234039fe8c4dd0cf12f07b1cb7/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-02 16:03:46,688 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/data/default/testtb-testConsecutiveExports/c41b1d234039fe8c4dd0cf12f07b1cb7 2023-10-02 16:03:46,689 INFO [StoreOpener-15c7559507cb6c3ab40d162bcd5ad2cd-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 15c7559507cb6c3ab40d162bcd5ad2cd 2023-10-02 16:03:46,689 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/data/default/testtb-testConsecutiveExports/c41b1d234039fe8c4dd0cf12f07b1cb7 2023-10-02 16:03:46,690 DEBUG [StoreOpener-15c7559507cb6c3ab40d162bcd5ad2cd-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/data/default/testtb-testConsecutiveExports/15c7559507cb6c3ab40d162bcd5ad2cd/cf 2023-10-02 16:03:46,690 DEBUG [StoreOpener-15c7559507cb6c3ab40d162bcd5ad2cd-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/data/default/testtb-testConsecutiveExports/15c7559507cb6c3ab40d162bcd5ad2cd/cf 2023-10-02 16:03:46,691 INFO [StoreOpener-15c7559507cb6c3ab40d162bcd5ad2cd-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 15c7559507cb6c3ab40d162bcd5ad2cd columnFamilyName cf 2023-10-02 16:03:46,693 INFO [StoreOpener-15c7559507cb6c3ab40d162bcd5ad2cd-1] regionserver.HStore(310): Store=15c7559507cb6c3ab40d162bcd5ad2cd/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-02 16:03:46,693 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for c41b1d234039fe8c4dd0cf12f07b1cb7 2023-10-02 16:03:46,695 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/data/default/testtb-testConsecutiveExports/15c7559507cb6c3ab40d162bcd5ad2cd 2023-10-02 16:03:46,696 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/data/default/testtb-testConsecutiveExports/15c7559507cb6c3ab40d162bcd5ad2cd 2023-10-02 16:03:46,698 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/data/default/testtb-testConsecutiveExports/c41b1d234039fe8c4dd0cf12f07b1cb7/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-02 16:03:46,698 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened c41b1d234039fe8c4dd0cf12f07b1cb7; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64916686, jitterRate=-0.03266599774360657}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-10-02 16:03:46,699 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for c41b1d234039fe8c4dd0cf12f07b1cb7: 2023-10-02 16:03:46,700 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testConsecutiveExports,1,1696262626267.c41b1d234039fe8c4dd0cf12f07b1cb7., pid=45, masterSystemTime=1696262626667 2023-10-02 16:03:46,703 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=44 updating hbase:meta row=c41b1d234039fe8c4dd0cf12f07b1cb7, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,42303,1696262558956 2023-10-02 16:03:46,703 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testConsecutiveExports,1,1696262626267.c41b1d234039fe8c4dd0cf12f07b1cb7.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1696262626703"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1696262626703"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1696262626703"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1696262626703"}]},"ts":"1696262626703"} 2023-10-02 16:03:46,705 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testConsecutiveExports,1,1696262626267.c41b1d234039fe8c4dd0cf12f07b1cb7. 2023-10-02 16:03:46,705 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testConsecutiveExports,1,1696262626267.c41b1d234039fe8c4dd0cf12f07b1cb7. 2023-10-02 16:03:46,709 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=45, resume processing ppid=44 2023-10-02 16:03:46,711 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=45, ppid=44, state=SUCCESS; OpenRegionProcedure c41b1d234039fe8c4dd0cf12f07b1cb7, server=jenkins-hbase4.apache.org,42303,1696262558956 in 191 msec 2023-10-02 16:03:46,717 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 15c7559507cb6c3ab40d162bcd5ad2cd 2023-10-02 16:03:46,719 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=44, ppid=42, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=c41b1d234039fe8c4dd0cf12f07b1cb7, ASSIGN in 359 msec 2023-10-02 16:03:46,723 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/data/default/testtb-testConsecutiveExports/15c7559507cb6c3ab40d162bcd5ad2cd/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-02 16:03:46,724 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 15c7559507cb6c3ab40d162bcd5ad2cd; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70566598, jitterRate=0.05152425169944763}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-10-02 16:03:46,724 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 15c7559507cb6c3ab40d162bcd5ad2cd: 2023-10-02 16:03:46,725 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testConsecutiveExports,,1696262626267.15c7559507cb6c3ab40d162bcd5ad2cd., pid=46, masterSystemTime=1696262626670 2023-10-02 16:03:46,731 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testConsecutiveExports,,1696262626267.15c7559507cb6c3ab40d162bcd5ad2cd. 2023-10-02 16:03:46,732 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testConsecutiveExports,,1696262626267.15c7559507cb6c3ab40d162bcd5ad2cd. 2023-10-02 16:03:46,734 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=43 updating hbase:meta row=15c7559507cb6c3ab40d162bcd5ad2cd, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,37455,1696262558909 2023-10-02 16:03:46,734 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testConsecutiveExports,,1696262626267.15c7559507cb6c3ab40d162bcd5ad2cd.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1696262626734"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1696262626734"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1696262626734"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1696262626734"}]},"ts":"1696262626734"} 2023-10-02 16:03:46,745 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=46, resume processing ppid=43 2023-10-02 16:03:46,745 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=46, ppid=43, state=SUCCESS; OpenRegionProcedure 15c7559507cb6c3ab40d162bcd5ad2cd, server=jenkins-hbase4.apache.org,37455,1696262558909 in 224 msec 2023-10-02 16:03:46,748 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=43, resume processing ppid=42 2023-10-02 16:03:46,748 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=43, ppid=42, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=15c7559507cb6c3ab40d162bcd5ad2cd, ASSIGN in 392 msec 2023-10-02 16:03:46,749 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-10-02 16:03:46,750 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696262626750"}]},"ts":"1696262626750"} 2023-10-02 16:03:46,757 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=ENABLED in hbase:meta 2023-10-02 16:03:46,766 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_POST_OPERATION 2023-10-02 16:03:46,767 DEBUG [PEWorker-1] access.PermissionStorage(175): Writing permission with rowKey testtb-testConsecutiveExports jenkins: RWXCA 2023-10-02 16:03:46,774 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=42303] access.PermissionStorage(611): Read acl: entry[testtb-testConsecutiveExports], kv [jenkins: RWXCA] 2023-10-02 16:03:46,778 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): regionserver:37455-0x10107dfc1490002, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-02 16:03:46,778 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): regionserver:43801-0x10107dfc1490001, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-02 16:03:46,778 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): regionserver:42303-0x10107dfc1490003, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-02 16:03:46,778 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): master:44227-0x10107dfc1490000, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-02 16:03:46,780 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-10-02 16:03:46,781 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-10-02 16:03:46,781 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-10-02 16:03:46,781 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-10-02 16:03:46,788 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=42, state=SUCCESS; CreateTableProcedure table=testtb-testConsecutiveExports in 517 msec 2023-10-02 16:03:46,885 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44227] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-10-02 16:03:46,885 INFO [Listener at jenkins-hbase4.apache.org/32975] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testConsecutiveExports, procId: 42 completed 2023-10-02 16:03:46,888 DEBUG [Listener at jenkins-hbase4.apache.org/32975] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testConsecutiveExports 2023-10-02 16:03:46,888 DEBUG [Listener at jenkins-hbase4.apache.org/32975] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testConsecutiveExports,,1696262626267.15c7559507cb6c3ab40d162bcd5ad2cd. 2023-10-02 16:03:46,890 INFO [Listener at jenkins-hbase4.apache.org/32975] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-10-02 16:03:46,899 DEBUG [hconnection-0x1eb93e1b-shared-pool-16] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-02 16:03:46,907 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:54406, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-02 16:03:46,914 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44227] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-10-02 16:03:46,915 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44227] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1696262626915 (current time:1696262626915). 2023-10-02 16:03:46,915 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44227] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-10-02 16:03:46,917 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44227] zookeeper.ReadOnlyZKClient(139): Connect 0x429551b9 to 127.0.0.1:50210 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-02 16:03:46,928 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44227] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@426e8c45, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-02 16:03:46,930 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44227] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-02 16:03:46,934 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:44518, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-02 16:03:46,935 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44227] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x429551b9 to 127.0.0.1:50210 2023-10-02 16:03:46,935 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44227] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-02 16:03:46,937 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44227] zookeeper.ReadOnlyZKClient(139): Connect 0x34cba978 to 127.0.0.1:50210 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-02 16:03:46,945 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44227] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5cbb3ec1, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-02 16:03:46,949 DEBUG [hconnection-0x6a818db7-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-02 16:03:46,950 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:44524, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-02 16:03:46,958 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44227] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x34cba978 to 127.0.0.1:50210 2023-10-02 16:03:46,958 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44227] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-02 16:03:46,958 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44227] access.PermissionStorage(611): Read acl: entry[testtb-testConsecutiveExports], kv [jenkins: RWXCA] 2023-10-02 16:03:46,959 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44227] snapshot.SnapshotManager(637): No existing snapshot, attempting snapshot... 2023-10-02 16:03:46,959 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44227] snapshot.SnapshotManager(684): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-10-02 16:03:46,963 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44227] snapshot.SnapshotManager(519): Unable to retrieve ACL status for path: hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/.hbase-snapshot, current working dir path: hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports org.apache.hadoop.hdfs.protocol.AclException: The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.ipc.RemoteException.instantiateException(RemoteException.java:121) at org.apache.hadoop.ipc.RemoteException.unwrapRemoteException(RemoteException.java:88) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2736) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2294) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2291) at org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81) at org.apache.hadoop.hdfs.DistributedFileSystem.getAclStatus(DistributedFileSystem.java:2291) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.updateWorkingDirAclsIfRequired(SnapshotManager.java:517) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.prepareToTakeSnapshot(SnapshotManager.java:490) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.snapshotEnabledTable(SnapshotManager.java:559) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshotInternal(SnapshotManager.java:687) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshot(SnapshotManager.java:623) at org.apache.hadoop.hbase.master.MasterRpcServices.snapshot(MasterRpcServices.java:1588) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) Caused by: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.hdfs.protocol.AclException): The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at org.apache.hadoop.ipc.Client.getRpcResponse(Client.java:1540) at org.apache.hadoop.ipc.Client.call(Client.java:1486) at org.apache.hadoop.ipc.Client.call(Client.java:1385) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:232) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:118) at com.sun.proxy.$Proxy32.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.getAclStatus(ClientNamenodeProtocolTranslatorPB.java:1385) at sun.reflect.GeneratedMethodAccessor63.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:422) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeMethod(RetryInvocationHandler.java:165) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invoke(RetryInvocationHandler.java:157) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeOnce(RetryInvocationHandler.java:95) at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:359) at com.sun.proxy.$Proxy35.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor63.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor63.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor63.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor63.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor63.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2734) ... 15 more 2023-10-02 16:03:46,964 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44227] procedure2.ProcedureExecutor(1028): Stored pid=47, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-10-02 16:03:46,966 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=47, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-10-02 16:03:46,967 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=47, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE; timeout=600000, timestamp=1696263226967 2023-10-02 16:03:46,967 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44227] snapshot.SnapshotManager(689): Started snapshot: { ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-10-02 16:03:46,967 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports 2023-10-02 16:03:46,969 DEBUG [Listener at jenkins-hbase4.apache.org/32975] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-10-02 16:03:46,969 DEBUG [Listener at jenkins-hbase4.apache.org/32975] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-10-02 16:03:46,971 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=47, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-10-02 16:03:46,971 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=48, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-10-02 16:03:46,972 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=47, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE in 8 msec 2023-10-02 16:03:46,973 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=48, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-10-02 16:03:46,985 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=48, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED; timeout=600000, timestamp=1696263226985 2023-10-02 16:03:47,056 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testConsecutiveExports 2023-10-02 16:03:47,056 INFO [(jenkins-hbase4.apache.org,44227,1696262556745)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testConsecutiveExports' 2023-10-02 16:03:47,056 DEBUG [(jenkins-hbase4.apache.org,44227,1696262556745)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-02 16:03:47,057 DEBUG [(jenkins-hbase4.apache.org,44227,1696262556745)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' 2023-10-02 16:03:47,057 DEBUG [(jenkins-hbase4.apache.org,44227,1696262556745)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testConsecutiveExports', kicking off acquire phase on members. 2023-10-02 16:03:47,058 DEBUG [(jenkins-hbase4.apache.org,44227,1696262556745)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44227-0x10107dfc1490000, quorum=127.0.0.1:50210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-10-02 16:03:47,058 DEBUG [(jenkins-hbase4.apache.org,44227,1696262556745)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-10-02 16:03:47,059 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): regionserver:43801-0x10107dfc1490001, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-02 16:03:47,059 DEBUG [(jenkins-hbase4.apache.org,44227,1696262556745)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,42303,1696262558956 2023-10-02 16:03:47,059 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-02 16:03:47,059 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): regionserver:42303-0x10107dfc1490003, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-02 16:03:47,059 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-02 16:03:47,059 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-02 16:03:47,059 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): regionserver:37455-0x10107dfc1490002, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-02 16:03:47,059 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-02 16:03:47,060 DEBUG [(jenkins-hbase4.apache.org,44227,1696262556745)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44227-0x10107dfc1490000, quorum=127.0.0.1:50210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,42303,1696262558956 2023-10-02 16:03:47,060 DEBUG [(jenkins-hbase4.apache.org,44227,1696262556745)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37455,1696262558909 2023-10-02 16:03:47,059 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-02 16:03:47,060 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-02 16:03:47,060 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-10-02 16:03:47,060 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-10-02 16:03:47,060 DEBUG [(jenkins-hbase4.apache.org,44227,1696262556745)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44227-0x10107dfc1490000, quorum=127.0.0.1:50210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37455,1696262558909 2023-10-02 16:03:47,060 DEBUG [(jenkins-hbase4.apache.org,44227,1696262556745)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-02 16:03:47,060 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-10-02 16:03:47,060 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43801-0x10107dfc1490001, quorum=127.0.0.1:50210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-10-02 16:03:47,060 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42303-0x10107dfc1490003, quorum=127.0.0.1:50210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-10-02 16:03:47,061 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 165 2023-10-02 16:03:47,061 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37455-0x10107dfc1490002, quorum=127.0.0.1:50210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-10-02 16:03:47,061 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 165 2023-10-02 16:03:47,061 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-10-02 16:03:47,061 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-10-02 16:03:47,061 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-10-02 16:03:47,061 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-10-02 16:03:47,061 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 165 2023-10-02 16:03:47,061 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-10-02 16:03:47,061 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testConsecutiveExports 2023-10-02 16:03:47,062 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-10-02 16:03:47,062 DEBUG [member: 'jenkins-hbase4.apache.org,43801,1696262558835' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testConsecutiveExports' with timeout 300000ms 2023-10-02 16:03:47,062 DEBUG [member: 'jenkins-hbase4.apache.org,43801,1696262558835' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-02 16:03:47,063 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testConsecutiveExports 2023-10-02 16:03:47,065 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testConsecutiveExports 2023-10-02 16:03:47,065 DEBUG [member: 'jenkins-hbase4.apache.org,42303,1696262558956' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testConsecutiveExports' with timeout 300000ms 2023-10-02 16:03:47,065 DEBUG [member: 'jenkins-hbase4.apache.org,37455,1696262558909' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testConsecutiveExports' with timeout 300000ms 2023-10-02 16:03:47,065 DEBUG [member: 'jenkins-hbase4.apache.org,42303,1696262558956' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-02 16:03:47,065 DEBUG [member: 'jenkins-hbase4.apache.org,37455,1696262558909' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-02 16:03:47,066 DEBUG [member: 'jenkins-hbase4.apache.org,42303,1696262558956' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' stage 2023-10-02 16:03:47,069 DEBUG [member: 'jenkins-hbase4.apache.org,42303,1696262558956' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally acquired 2023-10-02 16:03:47,064 DEBUG [member: 'jenkins-hbase4.apache.org,43801,1696262558835' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' stage 2023-10-02 16:03:47,069 DEBUG [member: 'jenkins-hbase4.apache.org,42303,1696262558956' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42303,1696262558956' joining acquired barrier for procedure (emptySnaptb0-testConsecutiveExports) in zk 2023-10-02 16:03:47,069 DEBUG [member: 'jenkins-hbase4.apache.org,37455,1696262558909' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' stage 2023-10-02 16:03:47,070 DEBUG [member: 'jenkins-hbase4.apache.org,37455,1696262558909' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally acquired 2023-10-02 16:03:47,070 DEBUG [member: 'jenkins-hbase4.apache.org,37455,1696262558909' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37455,1696262558909' joining acquired barrier for procedure (emptySnaptb0-testConsecutiveExports) in zk 2023-10-02 16:03:47,069 DEBUG [Listener at jenkins-hbase4.apache.org/32975] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-02 16:03:47,070 DEBUG [member: 'jenkins-hbase4.apache.org,43801,1696262558835' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally acquired 2023-10-02 16:03:47,070 DEBUG [member: 'jenkins-hbase4.apache.org,43801,1696262558835' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43801,1696262558835' joining acquired barrier for procedure (emptySnaptb0-testConsecutiveExports) in zk 2023-10-02 16:03:47,071 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44227] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-10-02 16:03:47,071 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44227] snapshot.SnapshotManager(406): Snapshoting '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' is still in progress! 2023-10-02 16:03:47,071 DEBUG [Listener at jenkins-hbase4.apache.org/32975] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-10-02 16:03:47,073 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): master:44227-0x10107dfc1490000, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,42303,1696262558956 2023-10-02 16:03:47,073 DEBUG [member: 'jenkins-hbase4.apache.org,42303,1696262558956' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-10-02 16:03:47,073 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,42303,1696262558956 2023-10-02 16:03:47,073 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-02 16:03:47,073 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-02 16:03:47,073 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): master:44227-0x10107dfc1490000, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37455,1696262558909 2023-10-02 16:03:47,073 DEBUG [member: 'jenkins-hbase4.apache.org,37455,1696262558909' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-10-02 16:03:47,073 DEBUG [member: 'jenkins-hbase4.apache.org,42303,1696262558956' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42303-0x10107dfc1490003, quorum=127.0.0.1:50210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-10-02 16:03:47,074 DEBUG [member: 'jenkins-hbase4.apache.org,42303,1696262558956' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-02 16:03:47,074 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-02 16:03:47,074 DEBUG [member: 'jenkins-hbase4.apache.org,43801,1696262558835' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-10-02 16:03:47,074 DEBUG [member: 'jenkins-hbase4.apache.org,37455,1696262558909' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37455-0x10107dfc1490002, quorum=127.0.0.1:50210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-10-02 16:03:47,075 DEBUG [member: 'jenkins-hbase4.apache.org,37455,1696262558909' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-02 16:03:47,075 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-02 16:03:47,075 DEBUG [member: 'jenkins-hbase4.apache.org,43801,1696262558835' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43801-0x10107dfc1490001, quorum=127.0.0.1:50210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-10-02 16:03:47,075 DEBUG [member: 'jenkins-hbase4.apache.org,43801,1696262558835' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-02 16:03:47,075 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-10-02 16:03:47,075 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37455,1696262558909 2023-10-02 16:03:47,076 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42303,1696262558956 2023-10-02 16:03:47,076 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43801,1696262558835 2023-10-02 16:03:47,076 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-02 16:03:47,077 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,42303,1696262558956' joining acquired barrier for procedure 'emptySnaptb0-testConsecutiveExports' on coordinator 2023-10-02 16:03:47,077 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@68ddfe83[Count = 1] remaining members to acquire global barrier 2023-10-02 16:03:47,077 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37455,1696262558909 2023-10-02 16:03:47,077 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-02 16:03:47,077 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-02 16:03:47,077 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-02 16:03:47,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-02 16:03:47,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-10-02 16:03:47,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37455,1696262558909 2023-10-02 16:03:47,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42303,1696262558956 2023-10-02 16:03:47,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43801,1696262558835 2023-10-02 16:03:47,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-02 16:03:47,079 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,37455,1696262558909' joining acquired barrier for procedure 'emptySnaptb0-testConsecutiveExports' on coordinator 2023-10-02 16:03:47,080 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@68ddfe83[Count = 0] remaining members to acquire global barrier 2023-10-02 16:03:47,080 DEBUG [(jenkins-hbase4.apache.org,44227,1696262556745)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testConsecutiveExports' starting 'in-barrier' execution. 2023-10-02 16:03:47,080 DEBUG [(jenkins-hbase4.apache.org,44227,1696262556745)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-10-02 16:03:47,092 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): regionserver:42303-0x10107dfc1490003, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-10-02 16:03:47,092 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): regionserver:43801-0x10107dfc1490001, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-10-02 16:03:47,092 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): regionserver:37455-0x10107dfc1490002, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-10-02 16:03:47,092 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-10-02 16:03:47,092 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-10-02 16:03:47,092 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-10-02 16:03:47,092 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-10-02 16:03:47,092 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-10-02 16:03:47,093 DEBUG [member: 'jenkins-hbase4.apache.org,37455,1696262558909' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-10-02 16:03:47,093 DEBUG [member: 'jenkins-hbase4.apache.org,42303,1696262558956' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-10-02 16:03:47,092 DEBUG [(jenkins-hbase4.apache.org,44227,1696262556745)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44227-0x10107dfc1490000, quorum=127.0.0.1:50210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,42303,1696262558956 2023-10-02 16:03:47,092 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-10-02 16:03:47,093 DEBUG [member: 'jenkins-hbase4.apache.org,43801,1696262558835' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-10-02 16:03:47,093 DEBUG [member: 'jenkins-hbase4.apache.org,37455,1696262558909' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-02 16:03:47,093 DEBUG [rs(jenkins-hbase4.apache.org,37455,1696262558909)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,,1696262626267.15c7559507cb6c3ab40d162bcd5ad2cd. 2023-10-02 16:03:47,093 DEBUG [member: 'jenkins-hbase4.apache.org,43801,1696262558835' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally completed 2023-10-02 16:03:47,093 DEBUG [rs(jenkins-hbase4.apache.org,37455,1696262558909)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,,1696262626267.15c7559507cb6c3ab40d162bcd5ad2cd. started... 2023-10-02 16:03:47,093 DEBUG [member: 'jenkins-hbase4.apache.org,42303,1696262558956' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-02 16:03:47,093 DEBUG [member: 'jenkins-hbase4.apache.org,43801,1696262558835' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,43801,1696262558835' in zk 2023-10-02 16:03:47,093 DEBUG [rs(jenkins-hbase4.apache.org,42303,1696262558956)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,1,1696262626267.c41b1d234039fe8c4dd0cf12f07b1cb7. 2023-10-02 16:03:47,093 DEBUG [member: 'jenkins-hbase4.apache.org,37455,1696262558909' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-02 16:03:47,093 DEBUG [rs(jenkins-hbase4.apache.org,42303,1696262558956)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,1,1696262626267.c41b1d234039fe8c4dd0cf12f07b1cb7. started... 2023-10-02 16:03:47,093 DEBUG [(jenkins-hbase4.apache.org,44227,1696262556745)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44227-0x10107dfc1490000, quorum=127.0.0.1:50210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37455,1696262558909 2023-10-02 16:03:47,093 DEBUG [(jenkins-hbase4.apache.org,44227,1696262556745)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-02 16:03:47,093 DEBUG [member: 'jenkins-hbase4.apache.org,42303,1696262558956' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-02 16:03:47,095 DEBUG [rs(jenkins-hbase4.apache.org,42303,1696262558956)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for c41b1d234039fe8c4dd0cf12f07b1cb7: 2023-10-02 16:03:47,093 DEBUG [rs(jenkins-hbase4.apache.org,37455,1696262558909)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 15c7559507cb6c3ab40d162bcd5ad2cd: 2023-10-02 16:03:47,095 DEBUG [rs(jenkins-hbase4.apache.org,37455,1696262558909)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,,1696262626267.15c7559507cb6c3ab40d162bcd5ad2cd.' region-info for snapshot=emptySnaptb0-testConsecutiveExports 2023-10-02 16:03:47,095 DEBUG [rs(jenkins-hbase4.apache.org,42303,1696262558956)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,1,1696262626267.c41b1d234039fe8c4dd0cf12f07b1cb7.' region-info for snapshot=emptySnaptb0-testConsecutiveExports 2023-10-02 16:03:47,096 DEBUG [rs(jenkins-hbase4.apache.org,37455,1696262558909)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-02 16:03:47,096 DEBUG [rs(jenkins-hbase4.apache.org,42303,1696262558956)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-02 16:03:47,097 DEBUG [rs(jenkins-hbase4.apache.org,37455,1696262558909)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-10-02 16:03:47,097 DEBUG [rs(jenkins-hbase4.apache.org,42303,1696262558956)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-10-02 16:03:47,098 DEBUG [member: 'jenkins-hbase4.apache.org,43801,1696262558835' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testConsecutiveExports' has notified controller of completion 2023-10-02 16:03:47,098 DEBUG [member: 'jenkins-hbase4.apache.org,43801,1696262558835' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-02 16:03:47,098 DEBUG [member: 'jenkins-hbase4.apache.org,43801,1696262558835' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testConsecutiveExports' completed. 2023-10-02 16:03:47,127 DEBUG [rs(jenkins-hbase4.apache.org,42303,1696262558956)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,1,1696262626267.c41b1d234039fe8c4dd0cf12f07b1cb7. completed. 2023-10-02 16:03:47,127 DEBUG [rs(jenkins-hbase4.apache.org,42303,1696262558956)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,1,1696262626267.c41b1d234039fe8c4dd0cf12f07b1cb7. 2023-10-02 16:03:47,127 DEBUG [member: 'jenkins-hbase4.apache.org,42303,1696262558956' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-02 16:03:47,127 DEBUG [member: 'jenkins-hbase4.apache.org,42303,1696262558956' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-02 16:03:47,127 DEBUG [member: 'jenkins-hbase4.apache.org,42303,1696262558956' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,42303,1696262558956 2023-10-02 16:03:47,127 DEBUG [member: 'jenkins-hbase4.apache.org,42303,1696262558956' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally completed 2023-10-02 16:03:47,127 DEBUG [member: 'jenkins-hbase4.apache.org,42303,1696262558956' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,42303,1696262558956' in zk 2023-10-02 16:03:47,127 DEBUG [rs(jenkins-hbase4.apache.org,37455,1696262558909)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,,1696262626267.15c7559507cb6c3ab40d162bcd5ad2cd. completed. 2023-10-02 16:03:47,128 DEBUG [rs(jenkins-hbase4.apache.org,37455,1696262558909)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,,1696262626267.15c7559507cb6c3ab40d162bcd5ad2cd. 2023-10-02 16:03:47,128 DEBUG [member: 'jenkins-hbase4.apache.org,37455,1696262558909' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-02 16:03:47,128 DEBUG [member: 'jenkins-hbase4.apache.org,37455,1696262558909' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-02 16:03:47,128 DEBUG [member: 'jenkins-hbase4.apache.org,37455,1696262558909' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,37455,1696262558909 2023-10-02 16:03:47,128 DEBUG [member: 'jenkins-hbase4.apache.org,37455,1696262558909' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally completed 2023-10-02 16:03:47,128 DEBUG [member: 'jenkins-hbase4.apache.org,37455,1696262558909' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,37455,1696262558909' in zk 2023-10-02 16:03:47,129 DEBUG [member: 'jenkins-hbase4.apache.org,37455,1696262558909' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testConsecutiveExports' has notified controller of completion 2023-10-02 16:03:47,129 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): master:44227-0x10107dfc1490000, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37455,1696262558909 2023-10-02 16:03:47,129 DEBUG [member: 'jenkins-hbase4.apache.org,37455,1696262558909' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-02 16:03:47,130 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37455,1696262558909 2023-10-02 16:03:47,131 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-02 16:03:47,131 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-02 16:03:47,130 DEBUG [member: 'jenkins-hbase4.apache.org,37455,1696262558909' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testConsecutiveExports' completed. 2023-10-02 16:03:47,132 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): master:44227-0x10107dfc1490000, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,42303,1696262558956 2023-10-02 16:03:47,132 DEBUG [member: 'jenkins-hbase4.apache.org,42303,1696262558956' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testConsecutiveExports' has notified controller of completion 2023-10-02 16:03:47,132 DEBUG [member: 'jenkins-hbase4.apache.org,42303,1696262558956' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-02 16:03:47,132 DEBUG [member: 'jenkins-hbase4.apache.org,42303,1696262558956' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testConsecutiveExports' completed. 2023-10-02 16:03:47,132 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-02 16:03:47,134 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-02 16:03:47,134 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testConsecutiveExports' 2023-10-02 16:03:47,140 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-10-02 16:03:47,140 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37455,1696262558909 2023-10-02 16:03:47,140 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42303,1696262558956 2023-10-02 16:03:47,141 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43801,1696262558835 2023-10-02 16:03:47,141 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-02 16:03:47,142 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-10-02 16:03:47,142 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37455,1696262558909 2023-10-02 16:03:47,142 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42303,1696262558956 2023-10-02 16:03:47,142 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43801,1696262558835 2023-10-02 16:03:47,143 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,37455,1696262558909': 2023-10-02 16:03:47,143 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,37455,1696262558909' released barrier for procedure'emptySnaptb0-testConsecutiveExports', counting down latch. Waiting for 1 more 2023-10-02 16:03:47,143 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,42303,1696262558956 2023-10-02 16:03:47,143 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-02 16:03:47,143 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-02 16:03:47,145 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-02 16:03:47,145 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-02 16:03:47,146 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-10-02 16:03:47,146 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37455,1696262558909 2023-10-02 16:03:47,146 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42303,1696262558956 2023-10-02 16:03:47,146 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43801,1696262558835 2023-10-02 16:03:47,147 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-02 16:03:47,147 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-10-02 16:03:47,147 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37455,1696262558909 2023-10-02 16:03:47,148 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42303,1696262558956 2023-10-02 16:03:47,148 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43801,1696262558835 2023-10-02 16:03:47,149 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,42303,1696262558956': 2023-10-02 16:03:47,149 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,42303,1696262558956' released barrier for procedure'emptySnaptb0-testConsecutiveExports', counting down latch. Waiting for 0 more 2023-10-02 16:03:47,149 INFO [(jenkins-hbase4.apache.org,44227,1696262556745)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testConsecutiveExports' execution completed 2023-10-02 16:03:47,149 DEBUG [(jenkins-hbase4.apache.org,44227,1696262556745)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-02 16:03:47,149 DEBUG [(jenkins-hbase4.apache.org,44227,1696262556745)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-02 16:03:47,149 DEBUG [(jenkins-hbase4.apache.org,44227,1696262556745)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testConsecutiveExports 2023-10-02 16:03:47,149 INFO [(jenkins-hbase4.apache.org,44227,1696262556745)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testConsecutiveExportsincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-10-02 16:03:47,152 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): regionserver:42303-0x10107dfc1490003, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-10-02 16:03:47,152 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): regionserver:43801-0x10107dfc1490001, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-10-02 16:03:47,152 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): regionserver:42303-0x10107dfc1490003, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-02 16:03:47,152 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): regionserver:43801-0x10107dfc1490001, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-02 16:03:47,152 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-10-02 16:03:47,152 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): master:44227-0x10107dfc1490000, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-10-02 16:03:47,152 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): regionserver:37455-0x10107dfc1490002, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-10-02 16:03:47,152 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-10-02 16:03:47,152 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-10-02 16:03:47,152 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-02 16:03:47,152 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-02 16:03:47,152 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): regionserver:37455-0x10107dfc1490002, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-02 16:03:47,152 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-10-02 16:03:47,152 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-10-02 16:03:47,153 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-10-02 16:03:47,152 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-10-02 16:03:47,153 DEBUG [(jenkins-hbase4.apache.org,44227,1696262556745)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44227-0x10107dfc1490000, quorum=127.0.0.1:50210, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37455,1696262558909 2023-10-02 16:03:47,153 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-02 16:03:47,153 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-02 16:03:47,153 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-02 16:03:47,153 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-02 16:03:47,153 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-02 16:03:47,153 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-02 16:03:47,153 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-02 16:03:47,153 DEBUG [(jenkins-hbase4.apache.org,44227,1696262556745)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44227-0x10107dfc1490000, quorum=127.0.0.1:50210, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,42303,1696262558956 2023-10-02 16:03:47,154 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-10-02 16:03:47,154 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-10-02 16:03:47,154 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-10-02 16:03:47,154 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-10-02 16:03:47,154 DEBUG [(jenkins-hbase4.apache.org,44227,1696262556745)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44227-0x10107dfc1490000, quorum=127.0.0.1:50210, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43801,1696262558835 2023-10-02 16:03:47,154 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-02 16:03:47,155 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-10-02 16:03:47,155 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37455,1696262558909 2023-10-02 16:03:47,155 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42303,1696262558956 2023-10-02 16:03:47,156 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43801,1696262558835 2023-10-02 16:03:47,156 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-02 16:03:47,156 DEBUG [(jenkins-hbase4.apache.org,44227,1696262556745)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44227-0x10107dfc1490000, quorum=127.0.0.1:50210, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37455,1696262558909 2023-10-02 16:03:47,156 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-10-02 16:03:47,157 DEBUG [(jenkins-hbase4.apache.org,44227,1696262556745)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44227-0x10107dfc1490000, quorum=127.0.0.1:50210, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,42303,1696262558956 2023-10-02 16:03:47,157 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37455,1696262558909 2023-10-02 16:03:47,157 DEBUG [(jenkins-hbase4.apache.org,44227,1696262556745)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44227-0x10107dfc1490000, quorum=127.0.0.1:50210, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43801,1696262558835 2023-10-02 16:03:47,157 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42303,1696262558956 2023-10-02 16:03:47,157 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43801,1696262558835 2023-10-02 16:03:47,160 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): regionserver:43801-0x10107dfc1490001, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-02 16:03:47,160 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): regionserver:43801-0x10107dfc1490001, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-02 16:03:47,160 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): regionserver:37455-0x10107dfc1490002, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-02 16:03:47,160 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-02 16:03:47,160 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-02 16:03:47,160 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-02 16:03:47,160 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-02 16:03:47,160 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): regionserver:37455-0x10107dfc1490002, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-02 16:03:47,160 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): regionserver:42303-0x10107dfc1490003, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-02 16:03:47,160 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): master:44227-0x10107dfc1490000, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43801,1696262558835 2023-10-02 16:03:47,160 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testConsecutiveExports 2023-10-02 16:03:47,160 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): master:44227-0x10107dfc1490000, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-10-02 16:03:47,161 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-02 16:03:47,160 DEBUG [(jenkins-hbase4.apache.org,44227,1696262556745)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-02 16:03:47,160 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): regionserver:42303-0x10107dfc1490003, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-02 16:03:47,161 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-02 16:03:47,161 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-02 16:03:47,161 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-02 16:03:47,161 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): master:44227-0x10107dfc1490000, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,42303,1696262558956 2023-10-02 16:03:47,161 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testConsecutiveExports 2023-10-02 16:03:47,162 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): master:44227-0x10107dfc1490000, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37455,1696262558909 2023-10-02 16:03:47,163 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): master:44227-0x10107dfc1490000, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-10-02 16:03:47,163 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): master:44227-0x10107dfc1490000, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43801,1696262558835 2023-10-02 16:03:47,163 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => c7b48a2e62736c517f8bfa7d64fc37ac, NAME => 'testtb-testConsecutiveExports,.mob,0.c7b48a2e62736c517f8bfa7d64fc37ac.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testConsecutiveExports 2023-10-02 16:03:47,162 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-02 16:03:47,161 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-02 16:03:47,163 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-10-02 16:03:47,163 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): master:44227-0x10107dfc1490000, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-10-02 16:03:47,163 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): master:44227-0x10107dfc1490000, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,42303,1696262558956 2023-10-02 16:03:47,163 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): master:44227-0x10107dfc1490000, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37455,1696262558909 2023-10-02 16:03:47,163 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): master:44227-0x10107dfc1490000, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-10-02 16:03:47,163 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): master:44227-0x10107dfc1490000, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-10-02 16:03:47,164 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-10-02 16:03:47,178 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-02 16:03:47,178 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-02 16:03:47,185 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testConsecutiveExports 2023-10-02 16:03:47,189 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports 2023-10-02 16:03:47,237 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports to hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/.hbase-snapshot/emptySnaptb0-testConsecutiveExports 2023-10-02 16:03:47,238 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed 2023-10-02 16:03:47,238 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports 2023-10-02 16:03:47,238 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports 2023-10-02 16:03:47,238 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports at 1696262626967Completed referencing HFiles for the mob region of table: testtb-testConsecutiveExports at 1696262627185 (+218 ms)Consolidate snapshot: emptySnaptb0-testConsecutiveExports at 1696262627185Loading Region manifests for emptySnaptb0-testConsecutiveExports at 1696262627186 (+1 ms)Writing data manifest for emptySnaptb0-testConsecutiveExports at 1696262627203 (+17 ms)Verifying snapshot: emptySnaptb0-testConsecutiveExports at 1696262627230 (+27 ms)Snapshot emptySnaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed at 1696262627238 (+8 ms) 2023-10-02 16:03:47,244 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=48, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-10-02 16:03:47,249 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=48, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED in 275 msec 2023-10-02 16:03:47,271 DEBUG [Listener at jenkins-hbase4.apache.org/32975] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-02 16:03:47,274 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44227] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-10-02 16:03:47,274 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44227] snapshot.SnapshotManager(403): Snapshot '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' has completed, notifying client. 2023-10-02 16:03:47,282 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37455] regionserver.HRegion(8805): writing data to region testtb-testConsecutiveExports,,1696262626267.15c7559507cb6c3ab40d162bcd5ad2cd. with WAL disabled. Data may be lost in the event of a crash. 2023-10-02 16:03:47,286 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42303] regionserver.HRegion(8805): writing data to region testtb-testConsecutiveExports,1,1696262626267.c41b1d234039fe8c4dd0cf12f07b1cb7. with WAL disabled. Data may be lost in the event of a crash. 2023-10-02 16:03:47,291 DEBUG [Listener at jenkins-hbase4.apache.org/32975] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testConsecutiveExports 2023-10-02 16:03:47,291 DEBUG [Listener at jenkins-hbase4.apache.org/32975] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testConsecutiveExports,,1696262626267.15c7559507cb6c3ab40d162bcd5ad2cd. 2023-10-02 16:03:47,291 INFO [Listener at jenkins-hbase4.apache.org/32975] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-10-02 16:03:47,309 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44227] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-10-02 16:03:47,309 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44227] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1696262627309 (current time:1696262627309). 2023-10-02 16:03:47,309 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44227] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-10-02 16:03:47,310 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44227] zookeeper.ReadOnlyZKClient(139): Connect 0x69ac3598 to 127.0.0.1:50210 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-02 16:03:47,329 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44227] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1d326a2f, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-02 16:03:47,332 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44227] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-02 16:03:47,335 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:44538, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-02 16:03:47,337 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44227] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x69ac3598 to 127.0.0.1:50210 2023-10-02 16:03:47,337 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44227] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-02 16:03:47,338 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44227] zookeeper.ReadOnlyZKClient(139): Connect 0x7de1f8fe to 127.0.0.1:50210 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-02 16:03:47,363 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44227] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@75e9022f, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-02 16:03:47,447 DEBUG [hconnection-0x7b847daf-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-02 16:03:47,451 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:44546, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-02 16:03:47,460 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44227] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7de1f8fe to 127.0.0.1:50210 2023-10-02 16:03:47,460 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44227] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-02 16:03:47,460 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44227] access.PermissionStorage(611): Read acl: entry[testtb-testConsecutiveExports], kv [jenkins: RWXCA] 2023-10-02 16:03:47,461 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44227] snapshot.SnapshotManager(637): No existing snapshot, attempting snapshot... 2023-10-02 16:03:47,461 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44227] snapshot.SnapshotManager(684): Table enabled, starting distributed snapshots for { ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-10-02 16:03:47,465 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44227] snapshot.SnapshotManager(519): Unable to retrieve ACL status for path: hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/.hbase-snapshot, current working dir path: hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports org.apache.hadoop.hdfs.protocol.AclException: The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.ipc.RemoteException.instantiateException(RemoteException.java:121) at org.apache.hadoop.ipc.RemoteException.unwrapRemoteException(RemoteException.java:88) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2736) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2294) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2291) at org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81) at org.apache.hadoop.hdfs.DistributedFileSystem.getAclStatus(DistributedFileSystem.java:2291) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.updateWorkingDirAclsIfRequired(SnapshotManager.java:517) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.prepareToTakeSnapshot(SnapshotManager.java:490) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.snapshotEnabledTable(SnapshotManager.java:559) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshotInternal(SnapshotManager.java:687) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshot(SnapshotManager.java:623) at org.apache.hadoop.hbase.master.MasterRpcServices.snapshot(MasterRpcServices.java:1588) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) Caused by: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.hdfs.protocol.AclException): The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at org.apache.hadoop.ipc.Client.getRpcResponse(Client.java:1540) at org.apache.hadoop.ipc.Client.call(Client.java:1486) at org.apache.hadoop.ipc.Client.call(Client.java:1385) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:232) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:118) at com.sun.proxy.$Proxy32.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.getAclStatus(ClientNamenodeProtocolTranslatorPB.java:1385) at sun.reflect.GeneratedMethodAccessor63.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:422) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeMethod(RetryInvocationHandler.java:165) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invoke(RetryInvocationHandler.java:157) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeOnce(RetryInvocationHandler.java:95) at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:359) at com.sun.proxy.$Proxy35.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor63.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor63.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor63.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor63.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor63.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2734) ... 15 more 2023-10-02 16:03:47,467 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44227] procedure2.ProcedureExecutor(1028): Stored pid=49, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-10-02 16:03:47,469 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=49, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-10-02 16:03:47,470 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=49, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE; timeout=600000, timestamp=1696263227470 2023-10-02 16:03:47,470 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44227] snapshot.SnapshotManager(689): Started snapshot: { ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-10-02 16:03:47,470 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports 2023-10-02 16:03:47,470 DEBUG [Listener at jenkins-hbase4.apache.org/32975] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-10-02 16:03:47,470 DEBUG [Listener at jenkins-hbase4.apache.org/32975] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-10-02 16:03:47,476 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=49, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-10-02 16:03:47,477 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=50, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-10-02 16:03:47,478 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=49, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE in 10 msec 2023-10-02 16:03:47,479 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=50, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-10-02 16:03:47,479 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=50, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED; timeout=600000, timestamp=1696263227479 2023-10-02 16:03:47,491 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testConsecutiveExports 2023-10-02 16:03:47,491 INFO [(jenkins-hbase4.apache.org,44227,1696262556745)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testConsecutiveExports' 2023-10-02 16:03:47,491 DEBUG [(jenkins-hbase4.apache.org,44227,1696262556745)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-02 16:03:47,493 DEBUG [(jenkins-hbase4.apache.org,44227,1696262556745)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testConsecutiveExports' starting 'acquire' 2023-10-02 16:03:47,493 DEBUG [(jenkins-hbase4.apache.org,44227,1696262556745)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testConsecutiveExports', kicking off acquire phase on members. 2023-10-02 16:03:47,494 DEBUG [(jenkins-hbase4.apache.org,44227,1696262556745)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44227-0x10107dfc1490000, quorum=127.0.0.1:50210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-10-02 16:03:47,494 DEBUG [(jenkins-hbase4.apache.org,44227,1696262556745)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-10-02 16:03:47,495 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): regionserver:43801-0x10107dfc1490001, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-02 16:03:47,495 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): regionserver:42303-0x10107dfc1490003, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-02 16:03:47,496 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-02 16:03:47,496 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-02 16:03:47,496 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): regionserver:37455-0x10107dfc1490002, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-02 16:03:47,496 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-02 16:03:47,496 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-02 16:03:47,496 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-02 16:03:47,496 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-02 16:03:47,496 DEBUG [(jenkins-hbase4.apache.org,44227,1696262556745)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,42303,1696262558956 2023-10-02 16:03:47,496 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-10-02 16:03:47,496 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-10-02 16:03:47,496 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-10-02 16:03:47,497 DEBUG [(jenkins-hbase4.apache.org,44227,1696262556745)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44227-0x10107dfc1490000, quorum=127.0.0.1:50210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,42303,1696262558956 2023-10-02 16:03:47,497 DEBUG [(jenkins-hbase4.apache.org,44227,1696262556745)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37455,1696262558909 2023-10-02 16:03:47,497 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43801-0x10107dfc1490001, quorum=127.0.0.1:50210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-10-02 16:03:47,497 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42303-0x10107dfc1490003, quorum=127.0.0.1:50210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-10-02 16:03:47,497 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37455-0x10107dfc1490002, quorum=127.0.0.1:50210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-10-02 16:03:47,498 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 160 2023-10-02 16:03:47,498 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-10-02 16:03:47,498 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-10-02 16:03:47,498 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 160 2023-10-02 16:03:47,498 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-10-02 16:03:47,498 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-10-02 16:03:47,499 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 160 2023-10-02 16:03:47,499 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-10-02 16:03:47,499 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-10-02 16:03:47,499 DEBUG [(jenkins-hbase4.apache.org,44227,1696262556745)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44227-0x10107dfc1490000, quorum=127.0.0.1:50210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37455,1696262558909 2023-10-02 16:03:47,499 DEBUG [(jenkins-hbase4.apache.org,44227,1696262556745)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-02 16:03:47,499 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testConsecutiveExports 2023-10-02 16:03:47,499 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testConsecutiveExports 2023-10-02 16:03:47,499 DEBUG [member: 'jenkins-hbase4.apache.org,42303,1696262558956' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testConsecutiveExports' with timeout 300000ms 2023-10-02 16:03:47,499 DEBUG [member: 'jenkins-hbase4.apache.org,42303,1696262558956' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-02 16:03:47,499 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testConsecutiveExports 2023-10-02 16:03:47,499 DEBUG [member: 'jenkins-hbase4.apache.org,43801,1696262558835' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testConsecutiveExports' with timeout 300000ms 2023-10-02 16:03:47,501 DEBUG [member: 'jenkins-hbase4.apache.org,43801,1696262558835' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-02 16:03:47,501 DEBUG [member: 'jenkins-hbase4.apache.org,37455,1696262558909' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testConsecutiveExports' with timeout 300000ms 2023-10-02 16:03:47,501 DEBUG [member: 'jenkins-hbase4.apache.org,37455,1696262558909' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-02 16:03:47,501 DEBUG [member: 'jenkins-hbase4.apache.org,42303,1696262558956' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testConsecutiveExports' starting 'acquire' stage 2023-10-02 16:03:47,503 DEBUG [member: 'jenkins-hbase4.apache.org,43801,1696262558835' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testConsecutiveExports' starting 'acquire' stage 2023-10-02 16:03:47,504 DEBUG [member: 'jenkins-hbase4.apache.org,43801,1696262558835' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testConsecutiveExports' locally acquired 2023-10-02 16:03:47,504 DEBUG [member: 'jenkins-hbase4.apache.org,43801,1696262558835' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43801,1696262558835' joining acquired barrier for procedure (snaptb0-testConsecutiveExports) in zk 2023-10-02 16:03:47,502 DEBUG [member: 'jenkins-hbase4.apache.org,37455,1696262558909' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testConsecutiveExports' starting 'acquire' stage 2023-10-02 16:03:47,504 DEBUG [member: 'jenkins-hbase4.apache.org,42303,1696262558956' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testConsecutiveExports' locally acquired 2023-10-02 16:03:47,504 DEBUG [member: 'jenkins-hbase4.apache.org,37455,1696262558909' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testConsecutiveExports' locally acquired 2023-10-02 16:03:47,504 DEBUG [member: 'jenkins-hbase4.apache.org,42303,1696262558956' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42303,1696262558956' joining acquired barrier for procedure (snaptb0-testConsecutiveExports) in zk 2023-10-02 16:03:47,504 DEBUG [member: 'jenkins-hbase4.apache.org,37455,1696262558909' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37455,1696262558909' joining acquired barrier for procedure (snaptb0-testConsecutiveExports) in zk 2023-10-02 16:03:47,506 DEBUG [member: 'jenkins-hbase4.apache.org,37455,1696262558909' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-10-02 16:03:47,506 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): master:44227-0x10107dfc1490000, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37455,1696262558909 2023-10-02 16:03:47,506 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37455,1696262558909 2023-10-02 16:03:47,506 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-02 16:03:47,506 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-02 16:03:47,508 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): master:44227-0x10107dfc1490000, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,42303,1696262558956 2023-10-02 16:03:47,508 DEBUG [member: 'jenkins-hbase4.apache.org,42303,1696262558956' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-10-02 16:03:47,508 DEBUG [member: 'jenkins-hbase4.apache.org,43801,1696262558835' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-10-02 16:03:47,508 DEBUG [member: 'jenkins-hbase4.apache.org,37455,1696262558909' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37455-0x10107dfc1490002, quorum=127.0.0.1:50210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-10-02 16:03:47,508 DEBUG [member: 'jenkins-hbase4.apache.org,37455,1696262558909' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-02 16:03:47,508 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-02 16:03:47,509 DEBUG [member: 'jenkins-hbase4.apache.org,43801,1696262558835' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43801-0x10107dfc1490001, quorum=127.0.0.1:50210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-10-02 16:03:47,509 DEBUG [member: 'jenkins-hbase4.apache.org,43801,1696262558835' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-02 16:03:47,509 DEBUG [member: 'jenkins-hbase4.apache.org,42303,1696262558956' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42303-0x10107dfc1490003, quorum=127.0.0.1:50210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-10-02 16:03:47,509 DEBUG [member: 'jenkins-hbase4.apache.org,42303,1696262558956' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-02 16:03:47,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-02 16:03:47,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-10-02 16:03:47,510 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37455,1696262558909 2023-10-02 16:03:47,510 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42303,1696262558956 2023-10-02 16:03:47,510 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43801,1696262558835 2023-10-02 16:03:47,510 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-02 16:03:47,511 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,37455,1696262558909' joining acquired barrier for procedure 'snaptb0-testConsecutiveExports' on coordinator 2023-10-02 16:03:47,511 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5d95f8b6[Count = 1] remaining members to acquire global barrier 2023-10-02 16:03:47,511 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,42303,1696262558956 2023-10-02 16:03:47,511 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-02 16:03:47,511 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-02 16:03:47,511 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-02 16:03:47,511 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-02 16:03:47,512 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-10-02 16:03:47,512 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37455,1696262558909 2023-10-02 16:03:47,512 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42303,1696262558956 2023-10-02 16:03:47,513 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43801,1696262558835 2023-10-02 16:03:47,513 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-02 16:03:47,513 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,42303,1696262558956' joining acquired barrier for procedure 'snaptb0-testConsecutiveExports' on coordinator 2023-10-02 16:03:47,513 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5d95f8b6[Count = 0] remaining members to acquire global barrier 2023-10-02 16:03:47,513 DEBUG [(jenkins-hbase4.apache.org,44227,1696262556745)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testConsecutiveExports' starting 'in-barrier' execution. 2023-10-02 16:03:47,513 DEBUG [(jenkins-hbase4.apache.org,44227,1696262556745)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-10-02 16:03:47,515 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): regionserver:37455-0x10107dfc1490002, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-10-02 16:03:47,515 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): regionserver:42303-0x10107dfc1490003, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-10-02 16:03:47,515 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-10-02 16:03:47,515 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-10-02 16:03:47,515 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-10-02 16:03:47,515 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): regionserver:43801-0x10107dfc1490001, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-10-02 16:03:47,515 DEBUG [member: 'jenkins-hbase4.apache.org,42303,1696262558956' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-10-02 16:03:47,515 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-10-02 16:03:47,515 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-10-02 16:03:47,515 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-10-02 16:03:47,515 DEBUG [(jenkins-hbase4.apache.org,44227,1696262556745)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44227-0x10107dfc1490000, quorum=127.0.0.1:50210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37455,1696262558909 2023-10-02 16:03:47,515 DEBUG [member: 'jenkins-hbase4.apache.org,43801,1696262558835' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-10-02 16:03:47,515 DEBUG [rs(jenkins-hbase4.apache.org,42303,1696262558956)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,1,1696262626267.c41b1d234039fe8c4dd0cf12f07b1cb7. 2023-10-02 16:03:47,515 DEBUG [member: 'jenkins-hbase4.apache.org,37455,1696262558909' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-10-02 16:03:47,515 DEBUG [rs(jenkins-hbase4.apache.org,42303,1696262558956)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,1,1696262626267.c41b1d234039fe8c4dd0cf12f07b1cb7. started... 2023-10-02 16:03:47,516 DEBUG [(jenkins-hbase4.apache.org,44227,1696262556745)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44227-0x10107dfc1490000, quorum=127.0.0.1:50210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,42303,1696262558956 2023-10-02 16:03:47,516 DEBUG [(jenkins-hbase4.apache.org,44227,1696262556745)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-02 16:03:47,516 DEBUG [member: 'jenkins-hbase4.apache.org,37455,1696262558909' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-02 16:03:47,516 DEBUG [member: 'jenkins-hbase4.apache.org,37455,1696262558909' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-02 16:03:47,515 DEBUG [member: 'jenkins-hbase4.apache.org,42303,1696262558956' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-02 16:03:47,516 DEBUG [rs(jenkins-hbase4.apache.org,37455,1696262558909)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,,1696262626267.15c7559507cb6c3ab40d162bcd5ad2cd. 2023-10-02 16:03:47,516 INFO [rs(jenkins-hbase4.apache.org,42303,1696262558956)-snapshot-pool-0] regionserver.HRegion(2745): Flushing c41b1d234039fe8c4dd0cf12f07b1cb7 1/1 column families, dataSize=3.06 KB heapSize=6.86 KB 2023-10-02 16:03:47,516 DEBUG [member: 'jenkins-hbase4.apache.org,42303,1696262558956' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-02 16:03:47,515 DEBUG [member: 'jenkins-hbase4.apache.org,43801,1696262558835' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testConsecutiveExports' locally completed 2023-10-02 16:03:47,516 DEBUG [rs(jenkins-hbase4.apache.org,37455,1696262558909)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,,1696262626267.15c7559507cb6c3ab40d162bcd5ad2cd. started... 2023-10-02 16:03:47,516 DEBUG [member: 'jenkins-hbase4.apache.org,43801,1696262558835' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,43801,1696262558835' in zk 2023-10-02 16:03:47,516 INFO [rs(jenkins-hbase4.apache.org,37455,1696262558909)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 15c7559507cb6c3ab40d162bcd5ad2cd 1/1 column families, dataSize=199 B heapSize=688 B 2023-10-02 16:03:47,518 DEBUG [member: 'jenkins-hbase4.apache.org,43801,1696262558835' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testConsecutiveExports' has notified controller of completion 2023-10-02 16:03:47,518 DEBUG [member: 'jenkins-hbase4.apache.org,43801,1696262558835' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-02 16:03:47,518 DEBUG [member: 'jenkins-hbase4.apache.org,43801,1696262558835' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testConsecutiveExports' completed. 2023-10-02 16:03:47,549 INFO [rs(jenkins-hbase4.apache.org,37455,1696262558909)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231002ab83f25ca0b844a99a075763049e1876 to hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e20231002ab83f25ca0b844a99a075763049e1876 2023-10-02 16:03:47,568 INFO [rs(jenkins-hbase4.apache.org,37455,1696262558909)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=199, hasBloomFilter=true, into tmp file hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/data/default/testtb-testConsecutiveExports/15c7559507cb6c3ab40d162bcd5ad2cd/.tmp/cf/89d5e0f09f074615906d434f777540ea 2023-10-02 16:03:47,570 DEBUG [Listener at jenkins-hbase4.apache.org/32975] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-02 16:03:47,573 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44227] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-10-02 16:03:47,573 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44227] snapshot.SnapshotManager(406): Snapshoting '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' is still in progress! 2023-10-02 16:03:47,574 DEBUG [Listener at jenkins-hbase4.apache.org/32975] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-10-02 16:03:47,579 DEBUG [rs(jenkins-hbase4.apache.org,37455,1696262558909)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/data/default/testtb-testConsecutiveExports/15c7559507cb6c3ab40d162bcd5ad2cd/.tmp/cf/89d5e0f09f074615906d434f777540ea as hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/data/default/testtb-testConsecutiveExports/15c7559507cb6c3ab40d162bcd5ad2cd/cf/89d5e0f09f074615906d434f777540ea 2023-10-02 16:03:47,586 INFO [rs(jenkins-hbase4.apache.org,37455,1696262558909)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/data/default/testtb-testConsecutiveExports/15c7559507cb6c3ab40d162bcd5ad2cd/cf/89d5e0f09f074615906d434f777540ea, entries=3, sequenceid=6, filesize=5.4 K 2023-10-02 16:03:47,587 INFO [rs(jenkins-hbase4.apache.org,37455,1696262558909)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~199 B/199, heapSize ~672 B/672, currentSize=0 B/0 for 15c7559507cb6c3ab40d162bcd5ad2cd in 71ms, sequenceid=6, compaction requested=false 2023-10-02 16:03:47,589 DEBUG [rs(jenkins-hbase4.apache.org,37455,1696262558909)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 15c7559507cb6c3ab40d162bcd5ad2cd: 2023-10-02 16:03:47,589 DEBUG [rs(jenkins-hbase4.apache.org,37455,1696262558909)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,,1696262626267.15c7559507cb6c3ab40d162bcd5ad2cd.' region-info for snapshot=snaptb0-testConsecutiveExports 2023-10-02 16:03:47,589 DEBUG [rs(jenkins-hbase4.apache.org,37455,1696262558909)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-02 16:03:47,590 DEBUG [rs(jenkins-hbase4.apache.org,37455,1696262558909)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/data/default/testtb-testConsecutiveExports/15c7559507cb6c3ab40d162bcd5ad2cd/cf/89d5e0f09f074615906d434f777540ea] hfiles 2023-10-02 16:03:47,590 DEBUG [rs(jenkins-hbase4.apache.org,37455,1696262558909)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/data/default/testtb-testConsecutiveExports/15c7559507cb6c3ab40d162bcd5ad2cd/cf/89d5e0f09f074615906d434f777540ea for snapshot=snaptb0-testConsecutiveExports 2023-10-02 16:03:47,603 DEBUG [rs(jenkins-hbase4.apache.org,37455,1696262558909)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,,1696262626267.15c7559507cb6c3ab40d162bcd5ad2cd. completed. 2023-10-02 16:03:47,603 DEBUG [rs(jenkins-hbase4.apache.org,37455,1696262558909)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,,1696262626267.15c7559507cb6c3ab40d162bcd5ad2cd. 2023-10-02 16:03:47,603 DEBUG [member: 'jenkins-hbase4.apache.org,37455,1696262558909' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-02 16:03:47,605 DEBUG [member: 'jenkins-hbase4.apache.org,37455,1696262558909' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-02 16:03:47,605 DEBUG [member: 'jenkins-hbase4.apache.org,37455,1696262558909' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,37455,1696262558909 2023-10-02 16:03:47,605 DEBUG [member: 'jenkins-hbase4.apache.org,37455,1696262558909' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testConsecutiveExports' locally completed 2023-10-02 16:03:47,605 DEBUG [member: 'jenkins-hbase4.apache.org,37455,1696262558909' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,37455,1696262558909' in zk 2023-10-02 16:03:47,607 DEBUG [member: 'jenkins-hbase4.apache.org,37455,1696262558909' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testConsecutiveExports' has notified controller of completion 2023-10-02 16:03:47,607 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): master:44227-0x10107dfc1490000, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37455,1696262558909 2023-10-02 16:03:47,607 DEBUG [member: 'jenkins-hbase4.apache.org,37455,1696262558909' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-02 16:03:47,607 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37455,1696262558909 2023-10-02 16:03:47,608 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-02 16:03:47,608 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-02 16:03:47,607 DEBUG [member: 'jenkins-hbase4.apache.org,37455,1696262558909' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testConsecutiveExports' completed. 2023-10-02 16:03:47,609 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-02 16:03:47,609 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-02 16:03:47,610 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-10-02 16:03:47,610 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37455,1696262558909 2023-10-02 16:03:47,610 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42303,1696262558956 2023-10-02 16:03:47,610 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43801,1696262558835 2023-10-02 16:03:47,611 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-02 16:03:47,611 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-10-02 16:03:47,611 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37455,1696262558909 2023-10-02 16:03:47,611 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43801,1696262558835 2023-10-02 16:03:47,612 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,37455,1696262558909': 2023-10-02 16:03:47,612 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,37455,1696262558909' released barrier for procedure'snaptb0-testConsecutiveExports', counting down latch. Waiting for 1 more 2023-10-02 16:03:47,774 DEBUG [Listener at jenkins-hbase4.apache.org/32975] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-02 16:03:47,775 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44227] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-10-02 16:03:47,775 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44227] snapshot.SnapshotManager(406): Snapshoting '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' is still in progress! 2023-10-02 16:03:47,776 DEBUG [Listener at jenkins-hbase4.apache.org/32975] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-10-02 16:03:47,968 INFO [rs(jenkins-hbase4.apache.org,42303,1696262558956)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20231002237f8a47a8d24980bc7f51c7b4f5ccd7 to hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b20231002237f8a47a8d24980bc7f51c7b4f5ccd7 2023-10-02 16:03:47,977 INFO [rs(jenkins-hbase4.apache.org,42303,1696262558956)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=3.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/data/default/testtb-testConsecutiveExports/c41b1d234039fe8c4dd0cf12f07b1cb7/.tmp/cf/710d7b0d3a5245c38a196c7467f88b9b 2023-10-02 16:03:47,983 DEBUG [rs(jenkins-hbase4.apache.org,42303,1696262558956)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/data/default/testtb-testConsecutiveExports/c41b1d234039fe8c4dd0cf12f07b1cb7/.tmp/cf/710d7b0d3a5245c38a196c7467f88b9b as hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/data/default/testtb-testConsecutiveExports/c41b1d234039fe8c4dd0cf12f07b1cb7/cf/710d7b0d3a5245c38a196c7467f88b9b 2023-10-02 16:03:47,989 INFO [rs(jenkins-hbase4.apache.org,42303,1696262558956)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/data/default/testtb-testConsecutiveExports/c41b1d234039fe8c4dd0cf12f07b1cb7/cf/710d7b0d3a5245c38a196c7467f88b9b, entries=47, sequenceid=6, filesize=12.7 K 2023-10-02 16:03:47,991 INFO [rs(jenkins-hbase4.apache.org,42303,1696262558956)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.06 KB/3137, heapSize ~6.84 KB/7008, currentSize=0 B/0 for c41b1d234039fe8c4dd0cf12f07b1cb7 in 474ms, sequenceid=6, compaction requested=false 2023-10-02 16:03:47,991 DEBUG [rs(jenkins-hbase4.apache.org,42303,1696262558956)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for c41b1d234039fe8c4dd0cf12f07b1cb7: 2023-10-02 16:03:47,991 DEBUG [rs(jenkins-hbase4.apache.org,42303,1696262558956)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,1,1696262626267.c41b1d234039fe8c4dd0cf12f07b1cb7.' region-info for snapshot=snaptb0-testConsecutiveExports 2023-10-02 16:03:47,991 DEBUG [rs(jenkins-hbase4.apache.org,42303,1696262558956)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-02 16:03:47,991 DEBUG [rs(jenkins-hbase4.apache.org,42303,1696262558956)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/data/default/testtb-testConsecutiveExports/c41b1d234039fe8c4dd0cf12f07b1cb7/cf/710d7b0d3a5245c38a196c7467f88b9b] hfiles 2023-10-02 16:03:47,991 DEBUG [rs(jenkins-hbase4.apache.org,42303,1696262558956)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/data/default/testtb-testConsecutiveExports/c41b1d234039fe8c4dd0cf12f07b1cb7/cf/710d7b0d3a5245c38a196c7467f88b9b for snapshot=snaptb0-testConsecutiveExports 2023-10-02 16:03:48,005 DEBUG [rs(jenkins-hbase4.apache.org,42303,1696262558956)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,1,1696262626267.c41b1d234039fe8c4dd0cf12f07b1cb7. completed. 2023-10-02 16:03:48,005 DEBUG [rs(jenkins-hbase4.apache.org,42303,1696262558956)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,1,1696262626267.c41b1d234039fe8c4dd0cf12f07b1cb7. 2023-10-02 16:03:48,006 DEBUG [member: 'jenkins-hbase4.apache.org,42303,1696262558956' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-02 16:03:48,007 DEBUG [member: 'jenkins-hbase4.apache.org,42303,1696262558956' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-02 16:03:48,007 DEBUG [member: 'jenkins-hbase4.apache.org,42303,1696262558956' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,42303,1696262558956 2023-10-02 16:03:48,007 DEBUG [member: 'jenkins-hbase4.apache.org,42303,1696262558956' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testConsecutiveExports' locally completed 2023-10-02 16:03:48,007 DEBUG [member: 'jenkins-hbase4.apache.org,42303,1696262558956' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,42303,1696262558956' in zk 2023-10-02 16:03:48,013 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): master:44227-0x10107dfc1490000, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,42303,1696262558956 2023-10-02 16:03:48,013 DEBUG [member: 'jenkins-hbase4.apache.org,42303,1696262558956' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testConsecutiveExports' has notified controller of completion 2023-10-02 16:03:48,013 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,42303,1696262558956 2023-10-02 16:03:48,013 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-02 16:03:48,013 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-02 16:03:48,013 DEBUG [member: 'jenkins-hbase4.apache.org,42303,1696262558956' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-02 16:03:48,014 DEBUG [member: 'jenkins-hbase4.apache.org,42303,1696262558956' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testConsecutiveExports' completed. 2023-10-02 16:03:48,015 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-02 16:03:48,016 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-02 16:03:48,016 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-10-02 16:03:48,016 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37455,1696262558909 2023-10-02 16:03:48,016 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42303,1696262558956 2023-10-02 16:03:48,017 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43801,1696262558835 2023-10-02 16:03:48,017 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-02 16:03:48,017 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-10-02 16:03:48,018 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37455,1696262558909 2023-10-02 16:03:48,018 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42303,1696262558956 2023-10-02 16:03:48,018 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43801,1696262558835 2023-10-02 16:03:48,019 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,42303,1696262558956': 2023-10-02 16:03:48,019 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,42303,1696262558956' released barrier for procedure'snaptb0-testConsecutiveExports', counting down latch. Waiting for 0 more 2023-10-02 16:03:48,019 INFO [(jenkins-hbase4.apache.org,44227,1696262556745)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testConsecutiveExports' execution completed 2023-10-02 16:03:48,019 DEBUG [(jenkins-hbase4.apache.org,44227,1696262556745)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-02 16:03:48,019 DEBUG [(jenkins-hbase4.apache.org,44227,1696262556745)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-02 16:03:48,019 DEBUG [(jenkins-hbase4.apache.org,44227,1696262556745)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testConsecutiveExports 2023-10-02 16:03:48,019 INFO [(jenkins-hbase4.apache.org,44227,1696262556745)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testConsecutiveExportsincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-10-02 16:03:48,021 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): master:44227-0x10107dfc1490000, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-10-02 16:03:48,021 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): regionserver:37455-0x10107dfc1490002, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-10-02 16:03:48,021 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-10-02 16:03:48,021 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): regionserver:37455-0x10107dfc1490002, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-02 16:03:48,021 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-02 16:03:48,021 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-10-02 16:03:48,021 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): regionserver:43801-0x10107dfc1490001, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-10-02 16:03:48,021 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): regionserver:42303-0x10107dfc1490003, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-10-02 16:03:48,021 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-10-02 16:03:48,021 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): regionserver:43801-0x10107dfc1490001, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-02 16:03:48,021 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-10-02 16:03:48,021 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-02 16:03:48,022 DEBUG [(jenkins-hbase4.apache.org,44227,1696262556745)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44227-0x10107dfc1490000, quorum=127.0.0.1:50210, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37455,1696262558909 2023-10-02 16:03:48,021 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-10-02 16:03:48,021 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-10-02 16:03:48,022 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-10-02 16:03:48,021 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): regionserver:42303-0x10107dfc1490003, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-02 16:03:48,022 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-02 16:03:48,022 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-02 16:03:48,022 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-02 16:03:48,022 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-02 16:03:48,023 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-02 16:03:48,023 DEBUG [(jenkins-hbase4.apache.org,44227,1696262556745)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44227-0x10107dfc1490000, quorum=127.0.0.1:50210, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,42303,1696262558956 2023-10-02 16:03:48,023 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-10-02 16:03:48,023 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-10-02 16:03:48,023 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-10-02 16:03:48,024 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-02 16:03:48,024 DEBUG [(jenkins-hbase4.apache.org,44227,1696262556745)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44227-0x10107dfc1490000, quorum=127.0.0.1:50210, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43801,1696262558835 2023-10-02 16:03:48,024 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-10-02 16:03:48,025 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-02 16:03:48,025 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-02 16:03:48,025 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37455,1696262558909 2023-10-02 16:03:48,025 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-10-02 16:03:48,025 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42303,1696262558956 2023-10-02 16:03:48,027 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43801,1696262558835 2023-10-02 16:03:48,028 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-02 16:03:48,028 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-10-02 16:03:48,029 DEBUG [(jenkins-hbase4.apache.org,44227,1696262556745)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44227-0x10107dfc1490000, quorum=127.0.0.1:50210, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37455,1696262558909 2023-10-02 16:03:48,029 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37455,1696262558909 2023-10-02 16:03:48,029 DEBUG [(jenkins-hbase4.apache.org,44227,1696262556745)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44227-0x10107dfc1490000, quorum=127.0.0.1:50210, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,42303,1696262558956 2023-10-02 16:03:48,029 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42303,1696262558956 2023-10-02 16:03:48,029 DEBUG [(jenkins-hbase4.apache.org,44227,1696262556745)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44227-0x10107dfc1490000, quorum=127.0.0.1:50210, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43801,1696262558835 2023-10-02 16:03:48,030 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43801,1696262558835 2023-10-02 16:03:48,041 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): regionserver:43801-0x10107dfc1490001, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-02 16:03:48,041 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): regionserver:37455-0x10107dfc1490002, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-02 16:03:48,041 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): regionserver:37455-0x10107dfc1490002, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-02 16:03:48,041 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): regionserver:43801-0x10107dfc1490001, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-02 16:03:48,041 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-02 16:03:48,041 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-02 16:03:48,041 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-02 16:03:48,041 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-02 16:03:48,041 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): master:44227-0x10107dfc1490000, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43801,1696262558835 2023-10-02 16:03:48,042 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): master:44227-0x10107dfc1490000, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-10-02 16:03:48,042 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): master:44227-0x10107dfc1490000, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,42303,1696262558956 2023-10-02 16:03:48,042 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): master:44227-0x10107dfc1490000, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37455,1696262558909 2023-10-02 16:03:48,042 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): master:44227-0x10107dfc1490000, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-10-02 16:03:48,042 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): master:44227-0x10107dfc1490000, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43801,1696262558835 2023-10-02 16:03:48,042 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): master:44227-0x10107dfc1490000, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-10-02 16:03:48,042 DEBUG [(jenkins-hbase4.apache.org,44227,1696262556745)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-02 16:03:48,042 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testConsecutiveExports 2023-10-02 16:03:48,042 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testConsecutiveExports 2023-10-02 16:03:48,041 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): regionserver:42303-0x10107dfc1490003, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-02 16:03:48,044 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => c7b48a2e62736c517f8bfa7d64fc37ac, NAME => 'testtb-testConsecutiveExports,.mob,0.c7b48a2e62736c517f8bfa7d64fc37ac.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testConsecutiveExports 2023-10-02 16:03:48,044 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-02 16:03:48,042 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): master:44227-0x10107dfc1490000, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,42303,1696262558956 2023-10-02 16:03:48,044 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-10-02 16:03:48,044 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-02 16:03:48,044 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): regionserver:42303-0x10107dfc1490003, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-02 16:03:48,044 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): master:44227-0x10107dfc1490000, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37455,1696262558909 2023-10-02 16:03:48,044 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): master:44227-0x10107dfc1490000, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-10-02 16:03:48,044 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): master:44227-0x10107dfc1490000, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-10-02 16:03:48,045 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-02 16:03:48,045 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-02 16:03:48,045 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-02 16:03:48,045 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-02 16:03:48,045 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-02 16:03:48,045 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-02 16:03:48,045 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b20231002237f8a47a8d24980bc7f51c7b4f5ccd7, hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e20231002ab83f25ca0b844a99a075763049e1876] mob files 2023-10-02 16:03:48,046 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b20231002237f8a47a8d24980bc7f51c7b4f5ccd7 2023-10-02 16:03:48,046 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e20231002ab83f25ca0b844a99a075763049e1876 2023-10-02 16:03:48,062 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testConsecutiveExports 2023-10-02 16:03:48,063 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-10-02 16:03:48,076 DEBUG [Listener at jenkins-hbase4.apache.org/32975] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-02 16:03:48,079 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44227] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-10-02 16:03:48,079 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44227] snapshot.SnapshotManager(406): Snapshoting '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' is still in progress! 2023-10-02 16:03:48,079 DEBUG [Listener at jenkins-hbase4.apache.org/32975] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-10-02 16:03:48,097 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports to hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-10-02 16:03:48,098 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed 2023-10-02 16:03:48,098 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-10-02 16:03:48,098 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-10-02 16:03:48,098 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports at 1696262627470Completed referencing HFiles for the mob region of table: testtb-testConsecutiveExports at 1696262628062 (+592 ms)Consolidate snapshot: snaptb0-testConsecutiveExports at 1696262628062Loading Region manifests for snaptb0-testConsecutiveExports at 1696262628062Writing data manifest for snaptb0-testConsecutiveExports at 1696262628067 (+5 ms)Verifying snapshot: snaptb0-testConsecutiveExports at 1696262628089 (+22 ms)Snapshot snaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed at 1696262628098 (+9 ms) 2023-10-02 16:03:48,103 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=50, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-10-02 16:03:48,105 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=50, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED in 629 msec 2023-10-02 16:03:48,579 DEBUG [Listener at jenkins-hbase4.apache.org/32975] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-02 16:03:48,586 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44227] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-10-02 16:03:48,586 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44227] snapshot.SnapshotManager(403): Snapshot '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' has completed, notifying client. 2023-10-02 16:03:48,586 INFO [Listener at jenkins-hbase4.apache.org/32975] snapshot.TestExportSnapshot(389): Local export destination path: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ec4ab044-456e-ce77-098f-f91b72a3e0ab/local-export-1696262628586 2023-10-02 16:03:48,586 INFO [Listener at jenkins-hbase4.apache.org/32975] snapshot.TestExportSnapshot(255): tgtFsUri=file:///, tgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ec4ab044-456e-ce77-098f-f91b72a3e0ab/local-export-1696262628586, rawTgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ec4ab044-456e-ce77-098f-f91b72a3e0ab/local-export-1696262628586, srcFsUri=hdfs://localhost:42119, srcDir=hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af 2023-10-02 16:03:48,609 DEBUG [Listener at jenkins-hbase4.apache.org/32975] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:42119, inputRoot=hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af 2023-10-02 16:03:48,609 DEBUG [Listener at jenkins-hbase4.apache.org/32975] snapshot.ExportSnapshot(999): outputFs=org.apache.hadoop.fs.LocalFileSystem@56ec3d7, outputRoot=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ec4ab044-456e-ce77-098f-f91b72a3e0ab/local-export-1696262628586, skipTmp=false, initialOutputSnapshotDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ec4ab044-456e-ce77-098f-f91b72a3e0ab/local-export-1696262628586/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-10-02 16:03:48,609 INFO [Listener at jenkins-hbase4.apache.org/32975] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:42119, inputRoot=hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af, snapshotDir=hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/.hbase-snapshot/snaptb0-testConsecutiveExports. 2023-10-02 16:03:48,620 INFO [Listener at jenkins-hbase4.apache.org/32975] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/.hbase-snapshot/snaptb0-testConsecutiveExports to file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ec4ab044-456e-ce77-098f-f91b72a3e0ab/local-export-1696262628586/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-10-02 16:03:48,634 DEBUG [Listener at jenkins-hbase4.apache.org/32975] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-10-02 16:03:48,635 DEBUG [Listener at jenkins-hbase4.apache.org/32975] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-10-02 16:03:48,635 DEBUG [Listener at jenkins-hbase4.apache.org/32975] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-10-02 16:03:48,635 DEBUG [Listener at jenkins-hbase4.apache.org/32975] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-10-02 16:03:49,613 DEBUG [Listener at jenkins-hbase4.apache.org/32975] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ec4ab044-456e-ce77-098f-f91b72a3e0ab/hadoop-4133197140072709531.jar 2023-10-02 16:03:49,613 DEBUG [Listener at jenkins-hbase4.apache.org/32975] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-10-02 16:03:49,614 DEBUG [Listener at jenkins-hbase4.apache.org/32975] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-10-02 16:03:49,684 DEBUG [Listener at jenkins-hbase4.apache.org/32975] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ec4ab044-456e-ce77-098f-f91b72a3e0ab/hadoop-1154806030806428964.jar 2023-10-02 16:03:49,684 DEBUG [Listener at jenkins-hbase4.apache.org/32975] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-10-02 16:03:49,684 DEBUG [Listener at jenkins-hbase4.apache.org/32975] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-10-02 16:03:49,685 DEBUG [Listener at jenkins-hbase4.apache.org/32975] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-10-02 16:03:49,685 DEBUG [Listener at jenkins-hbase4.apache.org/32975] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-10-02 16:03:49,686 DEBUG [Listener at jenkins-hbase4.apache.org/32975] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-10-02 16:03:49,686 DEBUG [Listener at jenkins-hbase4.apache.org/32975] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-10-02 16:03:49,686 DEBUG [Listener at jenkins-hbase4.apache.org/32975] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-10-02 16:03:49,687 DEBUG [Listener at jenkins-hbase4.apache.org/32975] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-10-02 16:03:49,687 DEBUG [Listener at jenkins-hbase4.apache.org/32975] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-10-02 16:03:49,688 DEBUG [Listener at jenkins-hbase4.apache.org/32975] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-10-02 16:03:49,688 DEBUG [Listener at jenkins-hbase4.apache.org/32975] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-10-02 16:03:49,688 DEBUG [Listener at jenkins-hbase4.apache.org/32975] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-10-02 16:03:49,689 DEBUG [Listener at jenkins-hbase4.apache.org/32975] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-10-02 16:03:49,689 DEBUG [Listener at jenkins-hbase4.apache.org/32975] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-10-02 16:03:49,689 DEBUG [Listener at jenkins-hbase4.apache.org/32975] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-10-02 16:03:49,690 DEBUG [Listener at jenkins-hbase4.apache.org/32975] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-10-02 16:03:49,691 DEBUG [Listener at jenkins-hbase4.apache.org/32975] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-02 16:03:49,691 DEBUG [Listener at jenkins-hbase4.apache.org/32975] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-02 16:03:49,692 DEBUG [Listener at jenkins-hbase4.apache.org/32975] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-10-02 16:03:49,692 DEBUG [Listener at jenkins-hbase4.apache.org/32975] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-02 16:03:49,692 DEBUG [Listener at jenkins-hbase4.apache.org/32975] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-02 16:03:49,692 DEBUG [Listener at jenkins-hbase4.apache.org/32975] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-10-02 16:03:49,693 DEBUG [Listener at jenkins-hbase4.apache.org/32975] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-10-02 16:03:49,998 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696262569087_0002_000001 (auth:SIMPLE) 2023-10-02 16:03:51,635 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-10-02 16:03:52,576 WARN [Listener at jenkins-hbase4.apache.org/32975] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-10-02 16:03:52,580 INFO [Listener at jenkins-hbase4.apache.org/32975] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testConsecutiveExports' hfile list 2023-10-02 16:03:52,584 DEBUG [Listener at jenkins-hbase4.apache.org/32975] snapshot.ExportSnapshot(671): export split=0 size=30.8 K 2023-10-02 16:03:53,071 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-10-02 16:03:53,071 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-10-02 16:03:53,676 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696262569087_0003_000001 (auth:SIMPLE) 2023-10-02 16:03:58,195 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696262569087_0003_000001 (auth:SIMPLE) 2023-10-02 16:04:00,442 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696262569087_0003_000001 (auth:SIMPLE) 2023-10-02 16:04:05,228 INFO [Listener at jenkins-hbase4.apache.org/32975] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-10-02 16:04:05,228 INFO [Listener at jenkins-hbase4.apache.org/32975] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-10-02 16:04:05,233 INFO [Listener at jenkins-hbase4.apache.org/32975] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testConsecutiveExports 2023-10-02 16:04:05,234 INFO [Listener at jenkins-hbase4.apache.org/32975] snapshot.TestExportSnapshot(279): Exported snapshot 2023-10-02 16:04:05,234 INFO [Listener at jenkins-hbase4.apache.org/32975] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-10-02 16:04:05,234 DEBUG [Listener at jenkins-hbase4.apache.org/32975] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_95248091_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/.hbase-snapshot/snaptb0-testConsecutiveExports at hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-10-02 16:04:05,237 DEBUG [Listener at jenkins-hbase4.apache.org/32975] snapshot.TestExportSnapshot(367): hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-10-02 16:04:05,237 DEBUG [Listener at jenkins-hbase4.apache.org/32975] snapshot.TestExportSnapshot(367): hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-10-02 16:04:05,237 DEBUG [Listener at jenkins-hbase4.apache.org/32975] snapshot.TestExportSnapshot(362): List files in org.apache.hadoop.fs.LocalFileSystem@6ebe584e in root file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ec4ab044-456e-ce77-098f-f91b72a3e0ab/local-export-1696262628586/.hbase-snapshot/snaptb0-testConsecutiveExports at file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ec4ab044-456e-ce77-098f-f91b72a3e0ab/local-export-1696262628586/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-10-02 16:04:05,238 DEBUG [Listener at jenkins-hbase4.apache.org/32975] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ec4ab044-456e-ce77-098f-f91b72a3e0ab/local-export-1696262628586/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-10-02 16:04:05,238 DEBUG [Listener at jenkins-hbase4.apache.org/32975] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ec4ab044-456e-ce77-098f-f91b72a3e0ab/local-export-1696262628586/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-10-02 16:04:05,239 INFO [Listener at jenkins-hbase4.apache.org/32975] snapshot.TestExportSnapshot(255): tgtFsUri=file:///, tgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ec4ab044-456e-ce77-098f-f91b72a3e0ab/local-export-1696262628586, rawTgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ec4ab044-456e-ce77-098f-f91b72a3e0ab/local-export-1696262628586, srcFsUri=hdfs://localhost:42119, srcDir=hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af 2023-10-02 16:04:05,273 DEBUG [Listener at jenkins-hbase4.apache.org/32975] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:42119, inputRoot=hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af 2023-10-02 16:04:05,274 DEBUG [Listener at jenkins-hbase4.apache.org/32975] snapshot.ExportSnapshot(999): outputFs=org.apache.hadoop.fs.LocalFileSystem@3e24d417, outputRoot=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ec4ab044-456e-ce77-098f-f91b72a3e0ab/local-export-1696262628586, skipTmp=false, initialOutputSnapshotDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ec4ab044-456e-ce77-098f-f91b72a3e0ab/local-export-1696262628586/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-10-02 16:04:05,274 INFO [Listener at jenkins-hbase4.apache.org/32975] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:42119, inputRoot=hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af, snapshotDir=hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/.hbase-snapshot/snaptb0-testConsecutiveExports. 2023-10-02 16:04:05,291 INFO [Listener at jenkins-hbase4.apache.org/32975] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/.hbase-snapshot/snaptb0-testConsecutiveExports to file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ec4ab044-456e-ce77-098f-f91b72a3e0ab/local-export-1696262628586/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-10-02 16:04:05,306 DEBUG [Listener at jenkins-hbase4.apache.org/32975] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-10-02 16:04:05,307 DEBUG [Listener at jenkins-hbase4.apache.org/32975] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-10-02 16:04:05,308 DEBUG [Listener at jenkins-hbase4.apache.org/32975] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-10-02 16:04:05,308 DEBUG [Listener at jenkins-hbase4.apache.org/32975] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-10-02 16:04:06,343 DEBUG [Listener at jenkins-hbase4.apache.org/32975] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ec4ab044-456e-ce77-098f-f91b72a3e0ab/hadoop-8893210533433879232.jar 2023-10-02 16:04:06,343 DEBUG [Listener at jenkins-hbase4.apache.org/32975] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-10-02 16:04:06,343 DEBUG [Listener at jenkins-hbase4.apache.org/32975] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-10-02 16:04:06,411 DEBUG [Listener at jenkins-hbase4.apache.org/32975] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ec4ab044-456e-ce77-098f-f91b72a3e0ab/hadoop-5670210185430725276.jar 2023-10-02 16:04:06,412 DEBUG [Listener at jenkins-hbase4.apache.org/32975] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-10-02 16:04:06,412 DEBUG [Listener at jenkins-hbase4.apache.org/32975] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-10-02 16:04:06,413 DEBUG [Listener at jenkins-hbase4.apache.org/32975] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-10-02 16:04:06,413 DEBUG [Listener at jenkins-hbase4.apache.org/32975] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-10-02 16:04:06,414 DEBUG [Listener at jenkins-hbase4.apache.org/32975] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-10-02 16:04:06,414 DEBUG [Listener at jenkins-hbase4.apache.org/32975] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-10-02 16:04:06,414 DEBUG [Listener at jenkins-hbase4.apache.org/32975] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-10-02 16:04:06,415 DEBUG [Listener at jenkins-hbase4.apache.org/32975] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-10-02 16:04:06,415 DEBUG [Listener at jenkins-hbase4.apache.org/32975] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-10-02 16:04:06,416 DEBUG [Listener at jenkins-hbase4.apache.org/32975] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-10-02 16:04:06,416 DEBUG [Listener at jenkins-hbase4.apache.org/32975] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-10-02 16:04:06,416 DEBUG [Listener at jenkins-hbase4.apache.org/32975] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-10-02 16:04:06,417 DEBUG [Listener at jenkins-hbase4.apache.org/32975] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-10-02 16:04:06,417 DEBUG [Listener at jenkins-hbase4.apache.org/32975] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-10-02 16:04:06,417 DEBUG [Listener at jenkins-hbase4.apache.org/32975] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-10-02 16:04:06,418 DEBUG [Listener at jenkins-hbase4.apache.org/32975] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-10-02 16:04:06,419 DEBUG [Listener at jenkins-hbase4.apache.org/32975] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-02 16:04:06,419 DEBUG [Listener at jenkins-hbase4.apache.org/32975] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-02 16:04:06,420 DEBUG [Listener at jenkins-hbase4.apache.org/32975] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-10-02 16:04:06,420 DEBUG [Listener at jenkins-hbase4.apache.org/32975] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-02 16:04:06,420 DEBUG [Listener at jenkins-hbase4.apache.org/32975] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-02 16:04:06,421 DEBUG [Listener at jenkins-hbase4.apache.org/32975] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-10-02 16:04:06,421 DEBUG [Listener at jenkins-hbase4.apache.org/32975] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-10-02 16:04:08,048 WARN [Listener at jenkins-hbase4.apache.org/32975] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-10-02 16:04:08,052 INFO [Listener at jenkins-hbase4.apache.org/32975] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testConsecutiveExports' hfile list 2023-10-02 16:04:08,055 DEBUG [Listener at jenkins-hbase4.apache.org/32975] snapshot.ExportSnapshot(671): export split=0 size=30.8 K 2023-10-02 16:04:09,571 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-10-02 16:04:09,571 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-10-02 16:04:09,575 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696262569087_0003_000001 (auth:SIMPLE) 2023-10-02 16:04:10,017 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696262569087_0004_000001 (auth:SIMPLE) 2023-10-02 16:04:15,960 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696262569087_0004_000001 (auth:SIMPLE) 2023-10-02 16:04:18,297 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696262569087_0004_000001 (auth:SIMPLE) 2023-10-02 16:04:24,888 INFO [Listener at jenkins-hbase4.apache.org/32975] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-10-02 16:04:24,888 INFO [Listener at jenkins-hbase4.apache.org/32975] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-10-02 16:04:24,892 INFO [Listener at jenkins-hbase4.apache.org/32975] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testConsecutiveExports 2023-10-02 16:04:24,893 INFO [Listener at jenkins-hbase4.apache.org/32975] snapshot.TestExportSnapshot(279): Exported snapshot 2023-10-02 16:04:24,893 INFO [Listener at jenkins-hbase4.apache.org/32975] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-10-02 16:04:24,893 DEBUG [Listener at jenkins-hbase4.apache.org/32975] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_95248091_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/.hbase-snapshot/snaptb0-testConsecutiveExports at hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-10-02 16:04:24,897 DEBUG [Listener at jenkins-hbase4.apache.org/32975] snapshot.TestExportSnapshot(367): hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-10-02 16:04:24,897 DEBUG [Listener at jenkins-hbase4.apache.org/32975] snapshot.TestExportSnapshot(367): hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-10-02 16:04:24,897 DEBUG [Listener at jenkins-hbase4.apache.org/32975] snapshot.TestExportSnapshot(362): List files in org.apache.hadoop.fs.LocalFileSystem@6ebe584e in root file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ec4ab044-456e-ce77-098f-f91b72a3e0ab/local-export-1696262628586/.hbase-snapshot/snaptb0-testConsecutiveExports at file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ec4ab044-456e-ce77-098f-f91b72a3e0ab/local-export-1696262628586/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-10-02 16:04:24,897 DEBUG [Listener at jenkins-hbase4.apache.org/32975] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ec4ab044-456e-ce77-098f-f91b72a3e0ab/local-export-1696262628586/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-10-02 16:04:24,898 DEBUG [Listener at jenkins-hbase4.apache.org/32975] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ec4ab044-456e-ce77-098f-f91b72a3e0ab/local-export-1696262628586/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-10-02 16:04:24,916 INFO [Listener at jenkins-hbase4.apache.org/32975] client.HBaseAdmin$15(890): Started disable of testtb-testConsecutiveExports 2023-10-02 16:04:24,917 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44227] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testConsecutiveExports 2023-10-02 16:04:24,918 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44227] procedure2.ProcedureExecutor(1028): Stored pid=51, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testConsecutiveExports 2023-10-02 16:04:24,924 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696262664924"}]},"ts":"1696262664924"} 2023-10-02 16:04:24,925 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44227] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-10-02 16:04:24,933 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=DISABLING in hbase:meta 2023-10-02 16:04:24,936 INFO [PEWorker-2] procedure.DisableTableProcedure(293): Set testtb-testConsecutiveExports to state=DISABLING 2023-10-02 16:04:24,938 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=52, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=15c7559507cb6c3ab40d162bcd5ad2cd, UNASSIGN}, {pid=53, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=c41b1d234039fe8c4dd0cf12f07b1cb7, UNASSIGN}] 2023-10-02 16:04:24,939 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=53, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=c41b1d234039fe8c4dd0cf12f07b1cb7, UNASSIGN 2023-10-02 16:04:24,942 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=52, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=15c7559507cb6c3ab40d162bcd5ad2cd, UNASSIGN 2023-10-02 16:04:24,943 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=53 updating hbase:meta row=c41b1d234039fe8c4dd0cf12f07b1cb7, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,42303,1696262558956 2023-10-02 16:04:24,943 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,1,1696262626267.c41b1d234039fe8c4dd0cf12f07b1cb7.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1696262664943"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696262664943"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696262664943"}]},"ts":"1696262664943"} 2023-10-02 16:04:24,943 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=52 updating hbase:meta row=15c7559507cb6c3ab40d162bcd5ad2cd, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,37455,1696262558909 2023-10-02 16:04:24,944 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,,1696262626267.15c7559507cb6c3ab40d162bcd5ad2cd.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1696262664943"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696262664943"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696262664943"}]},"ts":"1696262664943"} 2023-10-02 16:04:24,946 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=54, ppid=53, state=RUNNABLE; CloseRegionProcedure c41b1d234039fe8c4dd0cf12f07b1cb7, server=jenkins-hbase4.apache.org,42303,1696262558956}] 2023-10-02 16:04:24,948 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=55, ppid=52, state=RUNNABLE; CloseRegionProcedure 15c7559507cb6c3ab40d162bcd5ad2cd, server=jenkins-hbase4.apache.org,37455,1696262558909}] 2023-10-02 16:04:25,026 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44227] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-10-02 16:04:25,100 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close c41b1d234039fe8c4dd0cf12f07b1cb7 2023-10-02 16:04:25,100 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing c41b1d234039fe8c4dd0cf12f07b1cb7, disabling compactions & flushes 2023-10-02 16:04:25,100 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,1,1696262626267.c41b1d234039fe8c4dd0cf12f07b1cb7. 2023-10-02 16:04:25,100 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,1,1696262626267.c41b1d234039fe8c4dd0cf12f07b1cb7. 2023-10-02 16:04:25,100 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,1,1696262626267.c41b1d234039fe8c4dd0cf12f07b1cb7. after waiting 0 ms 2023-10-02 16:04:25,100 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,1,1696262626267.c41b1d234039fe8c4dd0cf12f07b1cb7. 2023-10-02 16:04:25,105 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 15c7559507cb6c3ab40d162bcd5ad2cd 2023-10-02 16:04:25,106 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 15c7559507cb6c3ab40d162bcd5ad2cd, disabling compactions & flushes 2023-10-02 16:04:25,106 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,,1696262626267.15c7559507cb6c3ab40d162bcd5ad2cd. 2023-10-02 16:04:25,106 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,,1696262626267.15c7559507cb6c3ab40d162bcd5ad2cd. 2023-10-02 16:04:25,106 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,,1696262626267.15c7559507cb6c3ab40d162bcd5ad2cd. after waiting 0 ms 2023-10-02 16:04:25,106 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,,1696262626267.15c7559507cb6c3ab40d162bcd5ad2cd. 2023-10-02 16:04:25,118 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/data/default/testtb-testConsecutiveExports/c41b1d234039fe8c4dd0cf12f07b1cb7/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-10-02 16:04:25,119 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-10-02 16:04:25,121 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,1,1696262626267.c41b1d234039fe8c4dd0cf12f07b1cb7. 2023-10-02 16:04:25,121 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for c41b1d234039fe8c4dd0cf12f07b1cb7: 2023-10-02 16:04:25,124 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed c41b1d234039fe8c4dd0cf12f07b1cb7 2023-10-02 16:04:25,125 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/data/default/testtb-testConsecutiveExports/15c7559507cb6c3ab40d162bcd5ad2cd/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-10-02 16:04:25,125 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=53 updating hbase:meta row=c41b1d234039fe8c4dd0cf12f07b1cb7, regionState=CLOSED 2023-10-02 16:04:25,125 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,1,1696262626267.c41b1d234039fe8c4dd0cf12f07b1cb7.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1696262665125"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696262665125"}]},"ts":"1696262665125"} 2023-10-02 16:04:25,125 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-10-02 16:04:25,127 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,,1696262626267.15c7559507cb6c3ab40d162bcd5ad2cd. 2023-10-02 16:04:25,127 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 15c7559507cb6c3ab40d162bcd5ad2cd: 2023-10-02 16:04:25,131 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 15c7559507cb6c3ab40d162bcd5ad2cd 2023-10-02 16:04:25,131 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=52 updating hbase:meta row=15c7559507cb6c3ab40d162bcd5ad2cd, regionState=CLOSED 2023-10-02 16:04:25,132 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,,1696262626267.15c7559507cb6c3ab40d162bcd5ad2cd.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1696262665131"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696262665131"}]},"ts":"1696262665131"} 2023-10-02 16:04:25,134 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=54, resume processing ppid=53 2023-10-02 16:04:25,134 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=54, ppid=53, state=SUCCESS; CloseRegionProcedure c41b1d234039fe8c4dd0cf12f07b1cb7, server=jenkins-hbase4.apache.org,42303,1696262558956 in 185 msec 2023-10-02 16:04:25,137 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=55, resume processing ppid=52 2023-10-02 16:04:25,137 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=55, ppid=52, state=SUCCESS; CloseRegionProcedure 15c7559507cb6c3ab40d162bcd5ad2cd, server=jenkins-hbase4.apache.org,37455,1696262558909 in 185 msec 2023-10-02 16:04:25,138 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=53, ppid=51, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=c41b1d234039fe8c4dd0cf12f07b1cb7, UNASSIGN in 198 msec 2023-10-02 16:04:25,139 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=52, resume processing ppid=51 2023-10-02 16:04:25,139 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=52, ppid=51, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=15c7559507cb6c3ab40d162bcd5ad2cd, UNASSIGN in 201 msec 2023-10-02 16:04:25,140 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696262665140"}]},"ts":"1696262665140"} 2023-10-02 16:04:25,142 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=DISABLED in hbase:meta 2023-10-02 16:04:25,143 INFO [PEWorker-4] procedure.DisableTableProcedure(305): Set testtb-testConsecutiveExports to state=DISABLED 2023-10-02 16:04:25,145 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=51, state=SUCCESS; DisableTableProcedure table=testtb-testConsecutiveExports in 227 msec 2023-10-02 16:04:25,228 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44227] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-10-02 16:04:25,228 INFO [Listener at jenkins-hbase4.apache.org/32975] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testConsecutiveExports, procId: 51 completed 2023-10-02 16:04:25,229 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44227] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testConsecutiveExports 2023-10-02 16:04:25,231 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44227] procedure2.ProcedureExecutor(1028): Stored pid=56, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-10-02 16:04:25,234 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=56, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-10-02 16:04:25,234 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44227] access.PermissionStorage(259): Removing permissions of removed table testtb-testConsecutiveExports 2023-10-02 16:04:25,235 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=56, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-10-02 16:04:25,240 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=42303] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testConsecutiveExports 2023-10-02 16:04:25,249 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): master:44227-0x10107dfc1490000, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-10-02 16:04:25,249 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): regionserver:42303-0x10107dfc1490003, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-10-02 16:04:25,249 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/.tmp/data/default/testtb-testConsecutiveExports/15c7559507cb6c3ab40d162bcd5ad2cd 2023-10-02 16:04:25,249 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): regionserver:37455-0x10107dfc1490002, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-10-02 16:04:25,249 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): regionserver:43801-0x10107dfc1490001, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-10-02 16:04:25,251 DEBUG [HFileArchiver-14] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/.tmp/data/default/testtb-testConsecutiveExports/c41b1d234039fe8c4dd0cf12f07b1cb7 2023-10-02 16:04:25,253 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-10-02 16:04:25,253 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-10-02 16:04:25,255 DEBUG [HFileArchiver-13] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/.tmp/data/default/testtb-testConsecutiveExports/15c7559507cb6c3ab40d162bcd5ad2cd/cf, FileablePath, hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/.tmp/data/default/testtb-testConsecutiveExports/15c7559507cb6c3ab40d162bcd5ad2cd/recovered.edits] 2023-10-02 16:04:25,256 DEBUG [HFileArchiver-14] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/.tmp/data/default/testtb-testConsecutiveExports/c41b1d234039fe8c4dd0cf12f07b1cb7/cf, FileablePath, hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/.tmp/data/default/testtb-testConsecutiveExports/c41b1d234039fe8c4dd0cf12f07b1cb7/recovered.edits] 2023-10-02 16:04:25,257 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-10-02 16:04:25,257 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-10-02 16:04:25,257 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): regionserver:43801-0x10107dfc1490001, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-10-02 16:04:25,257 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): master:44227-0x10107dfc1490000, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-10-02 16:04:25,257 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): regionserver:42303-0x10107dfc1490003, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-10-02 16:04:25,257 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): master:44227-0x10107dfc1490000, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-02 16:04:25,257 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): regionserver:37455-0x10107dfc1490002, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-10-02 16:04:25,257 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): regionserver:37455-0x10107dfc1490002, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-02 16:04:25,257 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): regionserver:43801-0x10107dfc1490001, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-02 16:04:25,261 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44227] master.MasterRpcServices(1230): Checking to see if procedure is done pid=56 2023-10-02 16:04:25,257 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): regionserver:42303-0x10107dfc1490003, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-02 16:04:25,292 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/.tmp/data/default/testtb-testConsecutiveExports/15c7559507cb6c3ab40d162bcd5ad2cd/cf/89d5e0f09f074615906d434f777540ea to hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/archive/data/default/testtb-testConsecutiveExports/15c7559507cb6c3ab40d162bcd5ad2cd/cf/89d5e0f09f074615906d434f777540ea 2023-10-02 16:04:25,292 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/.tmp/data/default/testtb-testConsecutiveExports/c41b1d234039fe8c4dd0cf12f07b1cb7/cf/710d7b0d3a5245c38a196c7467f88b9b to hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/archive/data/default/testtb-testConsecutiveExports/c41b1d234039fe8c4dd0cf12f07b1cb7/cf/710d7b0d3a5245c38a196c7467f88b9b 2023-10-02 16:04:25,296 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/.tmp/data/default/testtb-testConsecutiveExports/15c7559507cb6c3ab40d162bcd5ad2cd/recovered.edits/9.seqid to hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/archive/data/default/testtb-testConsecutiveExports/15c7559507cb6c3ab40d162bcd5ad2cd/recovered.edits/9.seqid 2023-10-02 16:04:25,296 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/.tmp/data/default/testtb-testConsecutiveExports/c41b1d234039fe8c4dd0cf12f07b1cb7/recovered.edits/9.seqid to hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/archive/data/default/testtb-testConsecutiveExports/c41b1d234039fe8c4dd0cf12f07b1cb7/recovered.edits/9.seqid 2023-10-02 16:04:25,297 DEBUG [HFileArchiver-13] backup.HFileArchiver(596): Deleted hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/.tmp/data/default/testtb-testConsecutiveExports/15c7559507cb6c3ab40d162bcd5ad2cd 2023-10-02 16:04:25,297 DEBUG [HFileArchiver-14] backup.HFileArchiver(596): Deleted hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/.tmp/data/default/testtb-testConsecutiveExports/c41b1d234039fe8c4dd0cf12f07b1cb7 2023-10-02 16:04:25,297 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testtb-testConsecutiveExports regions 2023-10-02 16:04:25,298 DEBUG [PEWorker-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac 2023-10-02 16:04:25,298 DEBUG [PEWorker-1] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf] 2023-10-02 16:04:25,302 DEBUG [PEWorker-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b20231002237f8a47a8d24980bc7f51c7b4f5ccd7 to hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/archive/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b20231002237f8a47a8d24980bc7f51c7b4f5ccd7 2023-10-02 16:04:25,303 DEBUG [PEWorker-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e20231002ab83f25ca0b844a99a075763049e1876 to hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/archive/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e20231002ab83f25ca0b844a99a075763049e1876 2023-10-02 16:04:25,304 DEBUG [PEWorker-1] backup.HFileArchiver(596): Deleted hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac 2023-10-02 16:04:25,313 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=56, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-10-02 16:04:25,316 WARN [PEWorker-1] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testConsecutiveExports from hbase:meta 2023-10-02 16:04:25,318 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(421): Removing 'testtb-testConsecutiveExports' descriptor. 2023-10-02 16:04:25,320 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=56, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-10-02 16:04:25,320 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(411): Removing 'testtb-testConsecutiveExports' from region states. 2023-10-02 16:04:25,320 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testConsecutiveExports,,1696262626267.15c7559507cb6c3ab40d162bcd5ad2cd.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1696262665320"}]},"ts":"9223372036854775807"} 2023-10-02 16:04:25,321 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testConsecutiveExports,1,1696262626267.c41b1d234039fe8c4dd0cf12f07b1cb7.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1696262665320"}]},"ts":"9223372036854775807"} 2023-10-02 16:04:25,327 INFO [PEWorker-1] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-10-02 16:04:25,327 DEBUG [PEWorker-1] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 15c7559507cb6c3ab40d162bcd5ad2cd, NAME => 'testtb-testConsecutiveExports,,1696262626267.15c7559507cb6c3ab40d162bcd5ad2cd.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => c41b1d234039fe8c4dd0cf12f07b1cb7, NAME => 'testtb-testConsecutiveExports,1,1696262626267.c41b1d234039fe8c4dd0cf12f07b1cb7.', STARTKEY => '1', ENDKEY => ''}] 2023-10-02 16:04:25,327 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(415): Marking 'testtb-testConsecutiveExports' as deleted. 2023-10-02 16:04:25,327 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1696262665327"}]},"ts":"9223372036854775807"} 2023-10-02 16:04:25,335 INFO [PEWorker-1] hbase.MetaTableAccessor(1658): Deleted table testtb-testConsecutiveExports state from META 2023-10-02 16:04:25,348 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(130): Finished pid=56, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-10-02 16:04:25,352 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=56, state=SUCCESS; DeleteTableProcedure table=testtb-testConsecutiveExports in 120 msec 2023-10-02 16:04:25,367 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44227] master.MasterRpcServices(1230): Checking to see if procedure is done pid=56 2023-10-02 16:04:25,368 INFO [Listener at jenkins-hbase4.apache.org/32975] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testConsecutiveExports, procId: 56 completed 2023-10-02 16:04:25,382 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44227] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testConsecutiveExports" 2023-10-02 16:04:25,384 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44227] snapshot.SnapshotManager(335): Deleting snapshot: emptySnaptb0-testConsecutiveExports 2023-10-02 16:04:25,386 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44227] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testConsecutiveExports" 2023-10-02 16:04:25,394 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44227] snapshot.SnapshotManager(335): Deleting snapshot: snaptb0-testConsecutiveExports 2023-10-02 16:04:25,425 INFO [Listener at jenkins-hbase4.apache.org/32975] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testConsecutiveExports Thread=745 (was 743) Potentially hanging thread: ContainersLauncher #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LogDeleter #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1088) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_95248091_17 at /127.0.0.1:39454 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x646a4964-shared-pool-25 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_95248091_17 at /127.0.0.1:48812 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x646a4964-shared-pool-24 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x646a4964-shared-pool-23 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-4-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1161619918_1 at /127.0.0.1:43906 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LogDeleter #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1088) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #6 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-4 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-3326 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1161619918_1 at /127.0.0.1:58288 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-14 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-4-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-13 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_95248091_17 at /127.0.0.1:39616 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #4 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x646a4964-shared-pool-22 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (337744187) connection to jenkins-hbase4.apache.org/172.31.14.131:41375 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: LogDeleter #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1088) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #5 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=905 (was 912), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=646 (was 740), ProcessCount=197 (was 197), AvailableMemoryMB=613 (was 1086) 2023-10-02 16:04:25,426 WARN [Listener at jenkins-hbase4.apache.org/32975] hbase.ResourceChecker(130): Thread=745 is superior to 500 2023-10-02 16:04:25,447 INFO [Listener at jenkins-hbase4.apache.org/32975] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testExportFileSystemStateWithMergeRegion Thread=745, OpenFileDescriptor=905, MaxFileDescriptor=60000, SystemLoadAverage=646, ProcessCount=197, AvailableMemoryMB=613 2023-10-02 16:04:25,447 WARN [Listener at jenkins-hbase4.apache.org/32975] hbase.ResourceChecker(130): Thread=745 is superior to 500 2023-10-02 16:04:25,449 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44227] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemStateWithMergeRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-10-02 16:04:25,450 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44227] procedure2.ProcedureExecutor(1028): Stored pid=57, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-10-02 16:04:25,453 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_PRE_OPERATION 2023-10-02 16:04:25,453 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44227] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemStateWithMergeRegion" procId is: 57 2023-10-02 16:04:25,454 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-10-02 16:04:25,455 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44227] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-10-02 16:04:25,459 DEBUG [HFileArchiver-15] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/d7920f8f17fa984e6c290238c625f96f 2023-10-02 16:04:25,459 DEBUG [HFileArchiver-16] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/0fdc05f251cdc4f8f198d3c8ca559208 2023-10-02 16:04:25,460 DEBUG [HFileArchiver-15] backup.HFileArchiver(153): Directory hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/d7920f8f17fa984e6c290238c625f96f empty. 2023-10-02 16:04:25,460 DEBUG [HFileArchiver-16] backup.HFileArchiver(153): Directory hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/0fdc05f251cdc4f8f198d3c8ca559208 empty. 2023-10-02 16:04:25,460 DEBUG [HFileArchiver-15] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/d7920f8f17fa984e6c290238c625f96f 2023-10-02 16:04:25,460 DEBUG [HFileArchiver-16] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/0fdc05f251cdc4f8f198d3c8ca559208 2023-10-02 16:04:25,460 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion regions 2023-10-02 16:04:25,473 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/.tabledesc/.tableinfo.0000000001 2023-10-02 16:04:25,474 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(7675): creating {ENCODED => d7920f8f17fa984e6c290238c625f96f, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,,1696262665448.d7920f8f17fa984e6c290238c625f96f.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/.tmp 2023-10-02 16:04:25,474 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(7675): creating {ENCODED => 0fdc05f251cdc4f8f198d3c8ca559208, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,1,1696262665448.0fdc05f251cdc4f8f198d3c8ca559208.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/.tmp 2023-10-02 16:04:25,485 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,,1696262665448.d7920f8f17fa984e6c290238c625f96f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-02 16:04:25,485 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1604): Closing d7920f8f17fa984e6c290238c625f96f, disabling compactions & flushes 2023-10-02 16:04:25,485 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,,1696262665448.d7920f8f17fa984e6c290238c625f96f. 2023-10-02 16:04:25,485 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,,1696262665448.d7920f8f17fa984e6c290238c625f96f. 2023-10-02 16:04:25,486 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,,1696262665448.d7920f8f17fa984e6c290238c625f96f. after waiting 0 ms 2023-10-02 16:04:25,486 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,,1696262665448.d7920f8f17fa984e6c290238c625f96f. 2023-10-02 16:04:25,486 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,,1696262665448.d7920f8f17fa984e6c290238c625f96f. 2023-10-02 16:04:25,486 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1558): Region close journal for d7920f8f17fa984e6c290238c625f96f: 2023-10-02 16:04:25,493 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,1,1696262665448.0fdc05f251cdc4f8f198d3c8ca559208.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-02 16:04:25,493 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1604): Closing 0fdc05f251cdc4f8f198d3c8ca559208, disabling compactions & flushes 2023-10-02 16:04:25,494 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,1,1696262665448.0fdc05f251cdc4f8f198d3c8ca559208. 2023-10-02 16:04:25,494 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1696262665448.0fdc05f251cdc4f8f198d3c8ca559208. 2023-10-02 16:04:25,494 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1696262665448.0fdc05f251cdc4f8f198d3c8ca559208. after waiting 0 ms 2023-10-02 16:04:25,494 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,1,1696262665448.0fdc05f251cdc4f8f198d3c8ca559208. 2023-10-02 16:04:25,494 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,1,1696262665448.0fdc05f251cdc4f8f198d3c8ca559208. 2023-10-02 16:04:25,494 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1558): Region close journal for 0fdc05f251cdc4f8f198d3c8ca559208: 2023-10-02 16:04:25,497 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_ADD_TO_META 2023-10-02 16:04:25,498 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1696262665448.d7920f8f17fa984e6c290238c625f96f.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1696262665498"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696262665498"}]},"ts":"1696262665498"} 2023-10-02 16:04:25,498 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1696262665448.0fdc05f251cdc4f8f198d3c8ca559208.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1696262665498"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696262665498"}]},"ts":"1696262665498"} 2023-10-02 16:04:25,511 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-10-02 16:04:25,512 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-10-02 16:04:25,513 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696262665513"}]},"ts":"1696262665513"} 2023-10-02 16:04:25,514 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=ENABLING in hbase:meta 2023-10-02 16:04:25,520 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-10-02 16:04:25,525 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-10-02 16:04:25,525 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-10-02 16:04:25,526 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-10-02 16:04:25,526 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-10-02 16:04:25,526 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=58, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=d7920f8f17fa984e6c290238c625f96f, ASSIGN}, {pid=59, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=0fdc05f251cdc4f8f198d3c8ca559208, ASSIGN}] 2023-10-02 16:04:25,530 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=59, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=0fdc05f251cdc4f8f198d3c8ca559208, ASSIGN 2023-10-02 16:04:25,530 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=58, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=d7920f8f17fa984e6c290238c625f96f, ASSIGN 2023-10-02 16:04:25,556 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44227] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-10-02 16:04:25,563 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=59, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=0fdc05f251cdc4f8f198d3c8ca559208, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,42303,1696262558956; forceNewPlan=false, retain=false 2023-10-02 16:04:25,563 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=58, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=d7920f8f17fa984e6c290238c625f96f, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,37455,1696262558909; forceNewPlan=false, retain=false 2023-10-02 16:04:25,715 INFO [jenkins-hbase4:44227] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-10-02 16:04:25,719 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=58 updating hbase:meta row=d7920f8f17fa984e6c290238c625f96f, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,37455,1696262558909 2023-10-02 16:04:25,719 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1696262665448.d7920f8f17fa984e6c290238c625f96f.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1696262665719"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696262665719"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696262665719"}]},"ts":"1696262665719"} 2023-10-02 16:04:25,719 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=59 updating hbase:meta row=0fdc05f251cdc4f8f198d3c8ca559208, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,42303,1696262558956 2023-10-02 16:04:25,719 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1696262665448.0fdc05f251cdc4f8f198d3c8ca559208.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1696262665719"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696262665719"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696262665719"}]},"ts":"1696262665719"} 2023-10-02 16:04:25,723 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=60, ppid=58, state=RUNNABLE; OpenRegionProcedure d7920f8f17fa984e6c290238c625f96f, server=jenkins-hbase4.apache.org,37455,1696262558909}] 2023-10-02 16:04:25,724 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=61, ppid=59, state=RUNNABLE; OpenRegionProcedure 0fdc05f251cdc4f8f198d3c8ca559208, server=jenkins-hbase4.apache.org,42303,1696262558956}] 2023-10-02 16:04:25,758 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44227] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-10-02 16:04:25,879 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion,,1696262665448.d7920f8f17fa984e6c290238c625f96f. 2023-10-02 16:04:25,879 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => d7920f8f17fa984e6c290238c625f96f, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,,1696262665448.d7920f8f17fa984e6c290238c625f96f.', STARTKEY => '', ENDKEY => '1'} 2023-10-02 16:04:25,879 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion,1,1696262665448.0fdc05f251cdc4f8f198d3c8ca559208. 2023-10-02 16:04:25,879 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 0fdc05f251cdc4f8f198d3c8ca559208, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,1,1696262665448.0fdc05f251cdc4f8f198d3c8ca559208.', STARTKEY => '1', ENDKEY => ''} 2023-10-02 16:04:25,879 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion,,1696262665448.d7920f8f17fa984e6c290238c625f96f. service=AccessControlService 2023-10-02 16:04:25,879 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion,1,1696262665448.0fdc05f251cdc4f8f198d3c8ca559208. service=AccessControlService 2023-10-02 16:04:25,880 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-10-02 16:04:25,880 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-10-02 16:04:25,880 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion d7920f8f17fa984e6c290238c625f96f 2023-10-02 16:04:25,880 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion 0fdc05f251cdc4f8f198d3c8ca559208 2023-10-02 16:04:25,880 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,,1696262665448.d7920f8f17fa984e6c290238c625f96f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-02 16:04:25,880 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,1,1696262665448.0fdc05f251cdc4f8f198d3c8ca559208.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-02 16:04:25,880 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for d7920f8f17fa984e6c290238c625f96f 2023-10-02 16:04:25,880 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for d7920f8f17fa984e6c290238c625f96f 2023-10-02 16:04:25,880 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 0fdc05f251cdc4f8f198d3c8ca559208 2023-10-02 16:04:25,880 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 0fdc05f251cdc4f8f198d3c8ca559208 2023-10-02 16:04:25,881 INFO [StoreOpener-d7920f8f17fa984e6c290238c625f96f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region d7920f8f17fa984e6c290238c625f96f 2023-10-02 16:04:25,881 INFO [StoreOpener-0fdc05f251cdc4f8f198d3c8ca559208-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 0fdc05f251cdc4f8f198d3c8ca559208 2023-10-02 16:04:25,883 DEBUG [StoreOpener-0fdc05f251cdc4f8f198d3c8ca559208-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/data/default/testtb-testExportFileSystemStateWithMergeRegion/0fdc05f251cdc4f8f198d3c8ca559208/cf 2023-10-02 16:04:25,884 DEBUG [StoreOpener-0fdc05f251cdc4f8f198d3c8ca559208-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/data/default/testtb-testExportFileSystemStateWithMergeRegion/0fdc05f251cdc4f8f198d3c8ca559208/cf 2023-10-02 16:04:25,884 INFO [StoreOpener-0fdc05f251cdc4f8f198d3c8ca559208-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 0fdc05f251cdc4f8f198d3c8ca559208 columnFamilyName cf 2023-10-02 16:04:25,885 DEBUG [StoreOpener-d7920f8f17fa984e6c290238c625f96f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/data/default/testtb-testExportFileSystemStateWithMergeRegion/d7920f8f17fa984e6c290238c625f96f/cf 2023-10-02 16:04:25,885 DEBUG [StoreOpener-d7920f8f17fa984e6c290238c625f96f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/data/default/testtb-testExportFileSystemStateWithMergeRegion/d7920f8f17fa984e6c290238c625f96f/cf 2023-10-02 16:04:25,886 INFO [StoreOpener-d7920f8f17fa984e6c290238c625f96f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region d7920f8f17fa984e6c290238c625f96f columnFamilyName cf 2023-10-02 16:04:25,889 INFO [StoreOpener-0fdc05f251cdc4f8f198d3c8ca559208-1] regionserver.HStore(310): Store=0fdc05f251cdc4f8f198d3c8ca559208/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-02 16:04:25,889 INFO [StoreOpener-d7920f8f17fa984e6c290238c625f96f-1] regionserver.HStore(310): Store=d7920f8f17fa984e6c290238c625f96f/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-02 16:04:25,890 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/data/default/testtb-testExportFileSystemStateWithMergeRegion/0fdc05f251cdc4f8f198d3c8ca559208 2023-10-02 16:04:25,891 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/data/default/testtb-testExportFileSystemStateWithMergeRegion/d7920f8f17fa984e6c290238c625f96f 2023-10-02 16:04:25,891 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/data/default/testtb-testExportFileSystemStateWithMergeRegion/0fdc05f251cdc4f8f198d3c8ca559208 2023-10-02 16:04:25,891 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/data/default/testtb-testExportFileSystemStateWithMergeRegion/d7920f8f17fa984e6c290238c625f96f 2023-10-02 16:04:25,895 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for d7920f8f17fa984e6c290238c625f96f 2023-10-02 16:04:25,895 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 0fdc05f251cdc4f8f198d3c8ca559208 2023-10-02 16:04:25,905 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/data/default/testtb-testExportFileSystemStateWithMergeRegion/d7920f8f17fa984e6c290238c625f96f/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-02 16:04:25,905 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/data/default/testtb-testExportFileSystemStateWithMergeRegion/0fdc05f251cdc4f8f198d3c8ca559208/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-02 16:04:25,906 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened d7920f8f17fa984e6c290238c625f96f; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63130260, jitterRate=-0.05928581953048706}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-10-02 16:04:25,906 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for d7920f8f17fa984e6c290238c625f96f: 2023-10-02 16:04:25,906 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 0fdc05f251cdc4f8f198d3c8ca559208; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74436367, jitterRate=0.10918830335140228}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-10-02 16:04:25,906 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 0fdc05f251cdc4f8f198d3c8ca559208: 2023-10-02 16:04:25,907 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion,,1696262665448.d7920f8f17fa984e6c290238c625f96f., pid=60, masterSystemTime=1696262665875 2023-10-02 16:04:25,909 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion,1,1696262665448.0fdc05f251cdc4f8f198d3c8ca559208., pid=61, masterSystemTime=1696262665876 2023-10-02 16:04:25,910 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion,,1696262665448.d7920f8f17fa984e6c290238c625f96f. 2023-10-02 16:04:25,910 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion,,1696262665448.d7920f8f17fa984e6c290238c625f96f. 2023-10-02 16:04:25,911 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=58 updating hbase:meta row=d7920f8f17fa984e6c290238c625f96f, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,37455,1696262558909 2023-10-02 16:04:25,911 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1696262665448.d7920f8f17fa984e6c290238c625f96f.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1696262665911"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1696262665911"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1696262665911"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1696262665911"}]},"ts":"1696262665911"} 2023-10-02 16:04:25,911 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion,1,1696262665448.0fdc05f251cdc4f8f198d3c8ca559208. 2023-10-02 16:04:25,911 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion,1,1696262665448.0fdc05f251cdc4f8f198d3c8ca559208. 2023-10-02 16:04:25,912 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=59 updating hbase:meta row=0fdc05f251cdc4f8f198d3c8ca559208, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,42303,1696262558956 2023-10-02 16:04:25,912 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1696262665448.0fdc05f251cdc4f8f198d3c8ca559208.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1696262665912"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1696262665912"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1696262665912"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1696262665912"}]},"ts":"1696262665912"} 2023-10-02 16:04:25,918 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=60, resume processing ppid=58 2023-10-02 16:04:25,918 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=60, ppid=58, state=SUCCESS; OpenRegionProcedure d7920f8f17fa984e6c290238c625f96f, server=jenkins-hbase4.apache.org,37455,1696262558909 in 191 msec 2023-10-02 16:04:25,919 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=61, resume processing ppid=59 2023-10-02 16:04:25,919 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=61, ppid=59, state=SUCCESS; OpenRegionProcedure 0fdc05f251cdc4f8f198d3c8ca559208, server=jenkins-hbase4.apache.org,42303,1696262558956 in 190 msec 2023-10-02 16:04:25,921 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=58, ppid=57, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=d7920f8f17fa984e6c290238c625f96f, ASSIGN in 392 msec 2023-10-02 16:04:25,922 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=59, resume processing ppid=57 2023-10-02 16:04:25,922 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=59, ppid=57, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=0fdc05f251cdc4f8f198d3c8ca559208, ASSIGN in 393 msec 2023-10-02 16:04:25,923 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-10-02 16:04:25,924 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696262665923"}]},"ts":"1696262665923"} 2023-10-02 16:04:25,925 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=ENABLED in hbase:meta 2023-10-02 16:04:25,928 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_POST_OPERATION 2023-10-02 16:04:25,929 DEBUG [PEWorker-5] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemStateWithMergeRegion jenkins: RWXCA 2023-10-02 16:04:25,931 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=42303] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion], kv [jenkins: RWXCA] 2023-10-02 16:04:25,932 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): master:44227-0x10107dfc1490000, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-02 16:04:25,932 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): regionserver:37455-0x10107dfc1490002, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-02 16:04:25,932 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): regionserver:43801-0x10107dfc1490001, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-02 16:04:25,932 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): regionserver:42303-0x10107dfc1490003, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-02 16:04:25,935 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-10-02 16:04:25,936 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-10-02 16:04:25,936 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-10-02 16:04:25,937 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-10-02 16:04:25,938 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=57, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion in 486 msec 2023-10-02 16:04:26,059 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44227] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-10-02 16:04:26,060 INFO [Listener at jenkins-hbase4.apache.org/32975] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion, procId: 57 completed 2023-10-02 16:04:26,065 DEBUG [Listener at jenkins-hbase4.apache.org/32975] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithMergeRegion 2023-10-02 16:04:26,065 DEBUG [Listener at jenkins-hbase4.apache.org/32975] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithMergeRegion,,1696262665448.d7920f8f17fa984e6c290238c625f96f. 2023-10-02 16:04:26,067 INFO [Listener at jenkins-hbase4.apache.org/32975] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-10-02 16:04:26,091 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44227] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-10-02 16:04:26,091 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44227] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1696262666091 (current time:1696262666091). 2023-10-02 16:04:26,092 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44227] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-10-02 16:04:26,093 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44227] zookeeper.ReadOnlyZKClient(139): Connect 0x164d2c2b to 127.0.0.1:50210 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-02 16:04:26,105 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44227] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@410378ef, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-02 16:04:26,106 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44227] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-02 16:04:26,108 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:37090, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-02 16:04:26,109 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44227] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x164d2c2b to 127.0.0.1:50210 2023-10-02 16:04:26,109 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44227] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-02 16:04:26,110 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44227] zookeeper.ReadOnlyZKClient(139): Connect 0x043c2ff1 to 127.0.0.1:50210 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-02 16:04:26,119 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44227] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7bef6729, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-02 16:04:26,121 DEBUG [hconnection-0x2171acbb-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-02 16:04:26,125 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:37098, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-02 16:04:26,131 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44227] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x043c2ff1 to 127.0.0.1:50210 2023-10-02 16:04:26,131 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44227] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-02 16:04:26,131 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44227] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion], kv [jenkins: RWXCA] 2023-10-02 16:04:26,132 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44227] snapshot.SnapshotManager(637): No existing snapshot, attempting snapshot... 2023-10-02 16:04:26,132 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44227] snapshot.SnapshotManager(684): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-10-02 16:04:26,135 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44227] snapshot.SnapshotManager(519): Unable to retrieve ACL status for path: hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/.hbase-snapshot, current working dir path: hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion org.apache.hadoop.hdfs.protocol.AclException: The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.ipc.RemoteException.instantiateException(RemoteException.java:121) at org.apache.hadoop.ipc.RemoteException.unwrapRemoteException(RemoteException.java:88) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2736) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2294) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2291) at org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81) at org.apache.hadoop.hdfs.DistributedFileSystem.getAclStatus(DistributedFileSystem.java:2291) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.updateWorkingDirAclsIfRequired(SnapshotManager.java:517) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.prepareToTakeSnapshot(SnapshotManager.java:490) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.snapshotEnabledTable(SnapshotManager.java:559) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshotInternal(SnapshotManager.java:687) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshot(SnapshotManager.java:623) at org.apache.hadoop.hbase.master.MasterRpcServices.snapshot(MasterRpcServices.java:1588) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) Caused by: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.hdfs.protocol.AclException): The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at org.apache.hadoop.ipc.Client.getRpcResponse(Client.java:1540) at org.apache.hadoop.ipc.Client.call(Client.java:1486) at org.apache.hadoop.ipc.Client.call(Client.java:1385) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:232) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:118) at com.sun.proxy.$Proxy32.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.getAclStatus(ClientNamenodeProtocolTranslatorPB.java:1385) at sun.reflect.GeneratedMethodAccessor63.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:422) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeMethod(RetryInvocationHandler.java:165) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invoke(RetryInvocationHandler.java:157) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeOnce(RetryInvocationHandler.java:95) at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:359) at com.sun.proxy.$Proxy35.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor63.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor63.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor63.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor63.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor63.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2734) ... 15 more 2023-10-02 16:04:26,137 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44227] procedure2.ProcedureExecutor(1028): Stored pid=62, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-10-02 16:04:26,138 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=62, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-10-02 16:04:26,139 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=62, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE; timeout=600000, timestamp=1696263266139 2023-10-02 16:04:26,139 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44227] snapshot.SnapshotManager(689): Started snapshot: { ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-10-02 16:04:26,139 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion 2023-10-02 16:04:26,140 DEBUG [Listener at jenkins-hbase4.apache.org/32975] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-10-02 16:04:26,141 DEBUG [Listener at jenkins-hbase4.apache.org/32975] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-10-02 16:04:26,142 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=62, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-10-02 16:04:26,142 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=63, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-10-02 16:04:26,144 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=62, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE in 7 msec 2023-10-02 16:04:26,145 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=63, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-10-02 16:04:26,145 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=63, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED; timeout=600000, timestamp=1696263266145 2023-10-02 16:04:26,162 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 16:04:26,162 INFO [(jenkins-hbase4.apache.org,44227,1696262556745)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' 2023-10-02 16:04:26,162 DEBUG [(jenkins-hbase4.apache.org,44227,1696262556745)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-02 16:04:26,164 DEBUG [(jenkins-hbase4.apache.org,44227,1696262556745)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' 2023-10-02 16:04:26,164 DEBUG [(jenkins-hbase4.apache.org,44227,1696262556745)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion', kicking off acquire phase on members. 2023-10-02 16:04:26,164 DEBUG [(jenkins-hbase4.apache.org,44227,1696262556745)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44227-0x10107dfc1490000, quorum=127.0.0.1:50210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 16:04:26,164 DEBUG [(jenkins-hbase4.apache.org,44227,1696262556745)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 16:04:26,166 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): regionserver:37455-0x10107dfc1490002, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-02 16:04:26,166 DEBUG [(jenkins-hbase4.apache.org,44227,1696262556745)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,42303,1696262558956 2023-10-02 16:04:26,166 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-02 16:04:26,166 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): regionserver:42303-0x10107dfc1490003, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-02 16:04:26,166 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): regionserver:43801-0x10107dfc1490001, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-02 16:04:26,166 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-02 16:04:26,166 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-02 16:04:26,166 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-02 16:04:26,166 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-02 16:04:26,166 DEBUG [(jenkins-hbase4.apache.org,44227,1696262556745)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44227-0x10107dfc1490000, quorum=127.0.0.1:50210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,42303,1696262558956 2023-10-02 16:04:26,166 DEBUG [(jenkins-hbase4.apache.org,44227,1696262556745)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37455,1696262558909 2023-10-02 16:04:26,166 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-02 16:04:26,166 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 16:04:26,167 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 16:04:26,167 DEBUG [(jenkins-hbase4.apache.org,44227,1696262556745)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44227-0x10107dfc1490000, quorum=127.0.0.1:50210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37455,1696262558909 2023-10-02 16:04:26,167 DEBUG [(jenkins-hbase4.apache.org,44227,1696262556745)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-02 16:04:26,167 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37455-0x10107dfc1490002, quorum=127.0.0.1:50210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 16:04:26,168 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 219 2023-10-02 16:04:26,168 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 16:04:26,168 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-10-02 16:04:26,168 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 16:04:26,168 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43801-0x10107dfc1490001, quorum=127.0.0.1:50210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 16:04:26,168 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 16:04:26,168 DEBUG [member: 'jenkins-hbase4.apache.org,37455,1696262558909' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-10-02 16:04:26,168 DEBUG [member: 'jenkins-hbase4.apache.org,37455,1696262558909' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-02 16:04:26,170 DEBUG [member: 'jenkins-hbase4.apache.org,37455,1696262558909' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-10-02 16:04:26,170 DEBUG [member: 'jenkins-hbase4.apache.org,37455,1696262558909' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-10-02 16:04:26,170 DEBUG [member: 'jenkins-hbase4.apache.org,37455,1696262558909' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37455,1696262558909' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-10-02 16:04:26,170 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 219 2023-10-02 16:04:26,170 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 16:04:26,170 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-10-02 16:04:26,171 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42303-0x10107dfc1490003, quorum=127.0.0.1:50210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 16:04:26,171 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 16:04:26,171 DEBUG [member: 'jenkins-hbase4.apache.org,43801,1696262558835' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-10-02 16:04:26,171 DEBUG [member: 'jenkins-hbase4.apache.org,43801,1696262558835' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-02 16:04:26,172 DEBUG [member: 'jenkins-hbase4.apache.org,43801,1696262558835' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-10-02 16:04:26,172 DEBUG [member: 'jenkins-hbase4.apache.org,43801,1696262558835' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-10-02 16:04:26,172 DEBUG [member: 'jenkins-hbase4.apache.org,43801,1696262558835' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43801,1696262558835' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-10-02 16:04:26,173 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): master:44227-0x10107dfc1490000, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37455,1696262558909 2023-10-02 16:04:26,173 DEBUG [member: 'jenkins-hbase4.apache.org,37455,1696262558909' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 16:04:26,173 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37455,1696262558909 2023-10-02 16:04:26,173 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-02 16:04:26,173 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-02 16:04:26,173 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 219 2023-10-02 16:04:26,173 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 16:04:26,173 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-10-02 16:04:26,173 DEBUG [member: 'jenkins-hbase4.apache.org,37455,1696262558909' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37455-0x10107dfc1490002, quorum=127.0.0.1:50210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 16:04:26,173 DEBUG [member: 'jenkins-hbase4.apache.org,37455,1696262558909' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-02 16:04:26,173 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 16:04:26,174 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-02 16:04:26,174 DEBUG [member: 'jenkins-hbase4.apache.org,42303,1696262558956' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-10-02 16:04:26,174 DEBUG [member: 'jenkins-hbase4.apache.org,42303,1696262558956' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-02 16:04:26,175 DEBUG [member: 'jenkins-hbase4.apache.org,42303,1696262558956' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-10-02 16:04:26,175 DEBUG [member: 'jenkins-hbase4.apache.org,42303,1696262558956' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-10-02 16:04:26,175 DEBUG [member: 'jenkins-hbase4.apache.org,42303,1696262558956' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42303,1696262558956' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-10-02 16:04:26,175 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-02 16:04:26,175 DEBUG [member: 'jenkins-hbase4.apache.org,43801,1696262558835' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 16:04:26,176 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 16:04:26,176 DEBUG [member: 'jenkins-hbase4.apache.org,43801,1696262558835' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43801-0x10107dfc1490001, quorum=127.0.0.1:50210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 16:04:26,176 DEBUG [member: 'jenkins-hbase4.apache.org,43801,1696262558835' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-02 16:04:26,178 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): master:44227-0x10107dfc1490000, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,42303,1696262558956 2023-10-02 16:04:26,178 DEBUG [member: 'jenkins-hbase4.apache.org,42303,1696262558956' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 16:04:26,178 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37455,1696262558909 2023-10-02 16:04:26,179 DEBUG [member: 'jenkins-hbase4.apache.org,42303,1696262558956' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42303-0x10107dfc1490003, quorum=127.0.0.1:50210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 16:04:26,179 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42303,1696262558956 2023-10-02 16:04:26,179 DEBUG [member: 'jenkins-hbase4.apache.org,42303,1696262558956' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-02 16:04:26,179 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43801,1696262558835 2023-10-02 16:04:26,179 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-02 16:04:26,180 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,37455,1696262558909' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-10-02 16:04:26,180 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1c2a1a52[Count = 1] remaining members to acquire global barrier 2023-10-02 16:04:26,180 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,42303,1696262558956 2023-10-02 16:04:26,180 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-02 16:04:26,180 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-02 16:04:26,180 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-02 16:04:26,181 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-02 16:04:26,181 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 16:04:26,181 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37455,1696262558909 2023-10-02 16:04:26,182 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42303,1696262558956 2023-10-02 16:04:26,182 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43801,1696262558835 2023-10-02 16:04:26,182 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-02 16:04:26,183 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,42303,1696262558956' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-10-02 16:04:26,183 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1c2a1a52[Count = 0] remaining members to acquire global barrier 2023-10-02 16:04:26,183 DEBUG [(jenkins-hbase4.apache.org,44227,1696262556745)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'in-barrier' execution. 2023-10-02 16:04:26,183 DEBUG [(jenkins-hbase4.apache.org,44227,1696262556745)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 16:04:26,184 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): regionserver:37455-0x10107dfc1490002, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 16:04:26,184 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): regionserver:43801-0x10107dfc1490001, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 16:04:26,184 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 16:04:26,184 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): regionserver:42303-0x10107dfc1490003, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 16:04:26,184 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 16:04:26,184 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 16:04:26,185 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 16:04:26,185 DEBUG [member: 'jenkins-hbase4.apache.org,37455,1696262558909' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-10-02 16:04:26,185 DEBUG [(jenkins-hbase4.apache.org,44227,1696262556745)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44227-0x10107dfc1490000, quorum=127.0.0.1:50210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37455,1696262558909 2023-10-02 16:04:26,185 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 16:04:26,185 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 16:04:26,185 DEBUG [member: 'jenkins-hbase4.apache.org,42303,1696262558956' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-10-02 16:04:26,185 DEBUG [member: 'jenkins-hbase4.apache.org,37455,1696262558909' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-02 16:04:26,185 DEBUG [member: 'jenkins-hbase4.apache.org,37455,1696262558909' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-02 16:04:26,185 DEBUG [member: 'jenkins-hbase4.apache.org,43801,1696262558835' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-10-02 16:04:26,185 DEBUG [(jenkins-hbase4.apache.org,44227,1696262556745)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44227-0x10107dfc1490000, quorum=127.0.0.1:50210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,42303,1696262558956 2023-10-02 16:04:26,185 DEBUG [(jenkins-hbase4.apache.org,44227,1696262556745)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-02 16:04:26,186 DEBUG [rs(jenkins-hbase4.apache.org,42303,1696262558956)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1696262665448.0fdc05f251cdc4f8f198d3c8ca559208. 2023-10-02 16:04:26,186 DEBUG [rs(jenkins-hbase4.apache.org,42303,1696262558956)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1696262665448.0fdc05f251cdc4f8f198d3c8ca559208. started... 2023-10-02 16:04:26,185 DEBUG [rs(jenkins-hbase4.apache.org,37455,1696262558909)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1696262665448.d7920f8f17fa984e6c290238c625f96f. 2023-10-02 16:04:26,186 DEBUG [rs(jenkins-hbase4.apache.org,37455,1696262558909)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1696262665448.d7920f8f17fa984e6c290238c625f96f. started... 2023-10-02 16:04:26,187 DEBUG [rs(jenkins-hbase4.apache.org,37455,1696262558909)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for d7920f8f17fa984e6c290238c625f96f: 2023-10-02 16:04:26,185 DEBUG [member: 'jenkins-hbase4.apache.org,42303,1696262558956' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-02 16:04:26,187 DEBUG [member: 'jenkins-hbase4.apache.org,42303,1696262558956' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-02 16:04:26,185 DEBUG [member: 'jenkins-hbase4.apache.org,43801,1696262558835' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-10-02 16:04:26,187 DEBUG [member: 'jenkins-hbase4.apache.org,43801,1696262558835' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,43801,1696262558835' in zk 2023-10-02 16:04:26,187 DEBUG [rs(jenkins-hbase4.apache.org,37455,1696262558909)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,,1696262665448.d7920f8f17fa984e6c290238c625f96f.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 16:04:26,187 DEBUG [rs(jenkins-hbase4.apache.org,37455,1696262558909)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-02 16:04:26,187 DEBUG [rs(jenkins-hbase4.apache.org,37455,1696262558909)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-10-02 16:04:26,196 DEBUG [member: 'jenkins-hbase4.apache.org,43801,1696262558835' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-10-02 16:04:26,196 DEBUG [member: 'jenkins-hbase4.apache.org,43801,1696262558835' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-02 16:04:26,196 DEBUG [member: 'jenkins-hbase4.apache.org,43801,1696262558835' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-10-02 16:04:26,201 DEBUG [rs(jenkins-hbase4.apache.org,42303,1696262558956)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 0fdc05f251cdc4f8f198d3c8ca559208: 2023-10-02 16:04:26,201 DEBUG [rs(jenkins-hbase4.apache.org,42303,1696262558956)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,1,1696262665448.0fdc05f251cdc4f8f198d3c8ca559208.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 16:04:26,201 DEBUG [rs(jenkins-hbase4.apache.org,42303,1696262558956)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-02 16:04:26,201 DEBUG [rs(jenkins-hbase4.apache.org,42303,1696262558956)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-10-02 16:04:26,214 DEBUG [rs(jenkins-hbase4.apache.org,37455,1696262558909)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1696262665448.d7920f8f17fa984e6c290238c625f96f. completed. 2023-10-02 16:04:26,214 DEBUG [rs(jenkins-hbase4.apache.org,37455,1696262558909)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1696262665448.d7920f8f17fa984e6c290238c625f96f. 2023-10-02 16:04:26,214 DEBUG [member: 'jenkins-hbase4.apache.org,37455,1696262558909' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-02 16:04:26,214 DEBUG [member: 'jenkins-hbase4.apache.org,37455,1696262558909' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-02 16:04:26,214 DEBUG [member: 'jenkins-hbase4.apache.org,37455,1696262558909' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,37455,1696262558909 2023-10-02 16:04:26,214 DEBUG [member: 'jenkins-hbase4.apache.org,37455,1696262558909' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-10-02 16:04:26,214 DEBUG [member: 'jenkins-hbase4.apache.org,37455,1696262558909' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,37455,1696262558909' in zk 2023-10-02 16:04:26,217 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): master:44227-0x10107dfc1490000, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37455,1696262558909 2023-10-02 16:04:26,217 DEBUG [member: 'jenkins-hbase4.apache.org,37455,1696262558909' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-10-02 16:04:26,217 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37455,1696262558909 2023-10-02 16:04:26,218 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-02 16:04:26,218 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-02 16:04:26,218 DEBUG [member: 'jenkins-hbase4.apache.org,37455,1696262558909' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-02 16:04:26,218 DEBUG [member: 'jenkins-hbase4.apache.org,37455,1696262558909' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-10-02 16:04:26,218 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-02 16:04:26,218 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-02 16:04:26,219 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 16:04:26,219 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37455,1696262558909 2023-10-02 16:04:26,219 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42303,1696262558956 2023-10-02 16:04:26,219 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43801,1696262558835 2023-10-02 16:04:26,220 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-02 16:04:26,220 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 16:04:26,220 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37455,1696262558909 2023-10-02 16:04:26,221 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43801,1696262558835 2023-10-02 16:04:26,223 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,37455,1696262558909': 2023-10-02 16:04:26,224 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,37455,1696262558909' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 1 more 2023-10-02 16:04:26,241 DEBUG [Listener at jenkins-hbase4.apache.org/32975] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-02 16:04:26,242 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44227] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-10-02 16:04:26,242 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44227] snapshot.SnapshotManager(406): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-10-02 16:04:26,242 DEBUG [Listener at jenkins-hbase4.apache.org/32975] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-10-02 16:04:26,442 DEBUG [Listener at jenkins-hbase4.apache.org/32975] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-02 16:04:26,444 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44227] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-10-02 16:04:26,444 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44227] snapshot.SnapshotManager(406): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-10-02 16:04:26,444 DEBUG [Listener at jenkins-hbase4.apache.org/32975] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-10-02 16:04:26,627 DEBUG [rs(jenkins-hbase4.apache.org,42303,1696262558956)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1696262665448.0fdc05f251cdc4f8f198d3c8ca559208. completed. 2023-10-02 16:04:26,627 DEBUG [rs(jenkins-hbase4.apache.org,42303,1696262558956)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1696262665448.0fdc05f251cdc4f8f198d3c8ca559208. 2023-10-02 16:04:26,628 DEBUG [member: 'jenkins-hbase4.apache.org,42303,1696262558956' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-02 16:04:26,628 DEBUG [member: 'jenkins-hbase4.apache.org,42303,1696262558956' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-02 16:04:26,628 DEBUG [member: 'jenkins-hbase4.apache.org,42303,1696262558956' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,42303,1696262558956 2023-10-02 16:04:26,628 DEBUG [member: 'jenkins-hbase4.apache.org,42303,1696262558956' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-10-02 16:04:26,628 DEBUG [member: 'jenkins-hbase4.apache.org,42303,1696262558956' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,42303,1696262558956' in zk 2023-10-02 16:04:26,630 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): master:44227-0x10107dfc1490000, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,42303,1696262558956 2023-10-02 16:04:26,630 DEBUG [member: 'jenkins-hbase4.apache.org,42303,1696262558956' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-10-02 16:04:26,630 DEBUG [member: 'jenkins-hbase4.apache.org,42303,1696262558956' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-02 16:04:26,630 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,42303,1696262558956 2023-10-02 16:04:26,630 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-02 16:04:26,630 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-02 16:04:26,630 DEBUG [member: 'jenkins-hbase4.apache.org,42303,1696262558956' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-10-02 16:04:26,631 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-02 16:04:26,633 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-02 16:04:26,634 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 16:04:26,634 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37455,1696262558909 2023-10-02 16:04:26,634 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42303,1696262558956 2023-10-02 16:04:26,635 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43801,1696262558835 2023-10-02 16:04:26,635 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-02 16:04:26,635 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 16:04:26,636 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37455,1696262558909 2023-10-02 16:04:26,636 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42303,1696262558956 2023-10-02 16:04:26,636 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43801,1696262558835 2023-10-02 16:04:26,637 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,42303,1696262558956': 2023-10-02 16:04:26,637 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,42303,1696262558956' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 0 more 2023-10-02 16:04:26,637 INFO [(jenkins-hbase4.apache.org,44227,1696262556745)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' execution completed 2023-10-02 16:04:26,637 DEBUG [(jenkins-hbase4.apache.org,44227,1696262556745)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-02 16:04:26,637 DEBUG [(jenkins-hbase4.apache.org,44227,1696262556745)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-02 16:04:26,637 DEBUG [(jenkins-hbase4.apache.org,44227,1696262556745)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 16:04:26,638 INFO [(jenkins-hbase4.apache.org,44227,1696262556745)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportFileSystemStateWithMergeRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-10-02 16:04:26,639 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): master:44227-0x10107dfc1490000, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 16:04:26,640 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): regionserver:37455-0x10107dfc1490002, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 16:04:26,640 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): regionserver:42303-0x10107dfc1490003, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 16:04:26,640 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): regionserver:42303-0x10107dfc1490003, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-02 16:04:26,640 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 16:04:26,640 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 16:04:26,640 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): regionserver:37455-0x10107dfc1490002, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-02 16:04:26,640 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): regionserver:43801-0x10107dfc1490001, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 16:04:26,640 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): regionserver:43801-0x10107dfc1490001, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-02 16:04:26,640 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 16:04:26,640 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 16:04:26,640 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-02 16:04:26,640 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-02 16:04:26,640 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 16:04:26,640 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-02 16:04:26,640 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-02 16:04:26,640 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 16:04:26,641 DEBUG [(jenkins-hbase4.apache.org,44227,1696262556745)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44227-0x10107dfc1490000, quorum=127.0.0.1:50210, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37455,1696262558909 2023-10-02 16:04:26,641 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-02 16:04:26,641 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-02 16:04:26,641 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 16:04:26,641 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-02 16:04:26,641 DEBUG [(jenkins-hbase4.apache.org,44227,1696262556745)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44227-0x10107dfc1490000, quorum=127.0.0.1:50210, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,42303,1696262558956 2023-10-02 16:04:26,641 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-02 16:04:26,641 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 16:04:26,641 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 16:04:26,641 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-02 16:04:26,642 DEBUG [(jenkins-hbase4.apache.org,44227,1696262556745)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44227-0x10107dfc1490000, quorum=127.0.0.1:50210, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43801,1696262558835 2023-10-02 16:04:26,642 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 16:04:26,642 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 16:04:26,642 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-02 16:04:26,643 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 16:04:26,643 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37455,1696262558909 2023-10-02 16:04:26,643 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42303,1696262558956 2023-10-02 16:04:26,644 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43801,1696262558835 2023-10-02 16:04:26,644 DEBUG [(jenkins-hbase4.apache.org,44227,1696262556745)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44227-0x10107dfc1490000, quorum=127.0.0.1:50210, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37455,1696262558909 2023-10-02 16:04:26,644 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-02 16:04:26,644 DEBUG [(jenkins-hbase4.apache.org,44227,1696262556745)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44227-0x10107dfc1490000, quorum=127.0.0.1:50210, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,42303,1696262558956 2023-10-02 16:04:26,645 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 16:04:26,645 DEBUG [(jenkins-hbase4.apache.org,44227,1696262556745)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44227-0x10107dfc1490000, quorum=127.0.0.1:50210, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43801,1696262558835 2023-10-02 16:04:26,645 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37455,1696262558909 2023-10-02 16:04:26,645 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42303,1696262558956 2023-10-02 16:04:26,646 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43801,1696262558835 2023-10-02 16:04:26,649 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): regionserver:37455-0x10107dfc1490002, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-02 16:04:26,649 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): regionserver:37455-0x10107dfc1490002, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-02 16:04:26,649 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-02 16:04:26,649 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): master:44227-0x10107dfc1490000, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43801,1696262558835 2023-10-02 16:04:26,649 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-02 16:04:26,649 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): master:44227-0x10107dfc1490000, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 16:04:26,649 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): regionserver:43801-0x10107dfc1490001, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-02 16:04:26,649 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): regionserver:43801-0x10107dfc1490001, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-02 16:04:26,649 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): master:44227-0x10107dfc1490000, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,42303,1696262558956 2023-10-02 16:04:26,649 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): master:44227-0x10107dfc1490000, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37455,1696262558909 2023-10-02 16:04:26,649 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): master:44227-0x10107dfc1490000, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 16:04:26,649 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 16:04:26,649 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemStateWithMergeRegion 2023-10-02 16:04:26,649 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): regionserver:42303-0x10107dfc1490003, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-02 16:04:26,649 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => aaca68e56e63a701f5c1ec9dc2f0511c, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,.mob,0.aaca68e56e63a701f5c1ec9dc2f0511c.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 16:04:26,649 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): master:44227-0x10107dfc1490000, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43801,1696262558835 2023-10-02 16:04:26,649 DEBUG [(jenkins-hbase4.apache.org,44227,1696262556745)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-02 16:04:26,649 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-02 16:04:26,651 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-02 16:04:26,650 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): master:44227-0x10107dfc1490000, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 16:04:26,650 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-10-02 16:04:26,653 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-02 16:04:26,653 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-02 16:04:26,653 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-10-02 16:04:26,650 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-02 16:04:26,658 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-02 16:04:26,649 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-02 16:04:26,658 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-02 16:04:26,649 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): regionserver:42303-0x10107dfc1490003, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-02 16:04:26,652 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): master:44227-0x10107dfc1490000, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,42303,1696262558956 2023-10-02 16:04:26,659 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): master:44227-0x10107dfc1490000, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37455,1696262558909 2023-10-02 16:04:26,659 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): master:44227-0x10107dfc1490000, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 16:04:26,659 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): master:44227-0x10107dfc1490000, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 16:04:26,659 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-02 16:04:26,659 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-02 16:04:26,667 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 16:04:26,668 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 16:04:26,692 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion to hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/.hbase-snapshot/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 16:04:26,693 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed 2023-10-02 16:04:26,693 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 16:04:26,694 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 16:04:26,694 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion at 1696262666139Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemStateWithMergeRegion at 1696262666667 (+528 ms)Consolidate snapshot: emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1696262666667Loading Region manifests for emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1696262666667Writing data manifest for emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1696262666675 (+8 ms)Verifying snapshot: emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1696262666685 (+10 ms)Snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed at 1696262666693 (+8 ms) 2023-10-02 16:04:26,697 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=63, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-10-02 16:04:26,699 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=63, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED in 557 msec 2023-10-02 16:04:26,745 DEBUG [Listener at jenkins-hbase4.apache.org/32975] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-02 16:04:26,746 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44227] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-10-02 16:04:26,746 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44227] snapshot.SnapshotManager(403): Snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' has completed, notifying client. 2023-10-02 16:04:26,750 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37455] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithMergeRegion,,1696262665448.d7920f8f17fa984e6c290238c625f96f. with WAL disabled. Data may be lost in the event of a crash. 2023-10-02 16:04:26,752 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42303] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithMergeRegion,1,1696262665448.0fdc05f251cdc4f8f198d3c8ca559208. with WAL disabled. Data may be lost in the event of a crash. 2023-10-02 16:04:26,757 DEBUG [Listener at jenkins-hbase4.apache.org/32975] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithMergeRegion 2023-10-02 16:04:26,757 DEBUG [Listener at jenkins-hbase4.apache.org/32975] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithMergeRegion,,1696262665448.d7920f8f17fa984e6c290238c625f96f. 2023-10-02 16:04:26,758 INFO [Listener at jenkins-hbase4.apache.org/32975] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-10-02 16:04:26,776 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44227] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-10-02 16:04:26,776 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44227] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1696262666776 (current time:1696262666776). 2023-10-02 16:04:26,776 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44227] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-10-02 16:04:26,778 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44227] zookeeper.ReadOnlyZKClient(139): Connect 0x3b29f10a to 127.0.0.1:50210 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-02 16:04:26,801 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44227] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4144878a, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-02 16:04:26,803 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44227] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-02 16:04:26,807 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:37100, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-02 16:04:26,809 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44227] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x3b29f10a to 127.0.0.1:50210 2023-10-02 16:04:26,809 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44227] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-02 16:04:26,810 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44227] zookeeper.ReadOnlyZKClient(139): Connect 0x63859cd4 to 127.0.0.1:50210 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-02 16:04:26,827 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44227] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1750900f, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-02 16:04:26,914 DEBUG [hconnection-0x72cd3db8-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-02 16:04:26,916 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:37110, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-02 16:04:26,924 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44227] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x63859cd4 to 127.0.0.1:50210 2023-10-02 16:04:26,924 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44227] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-02 16:04:26,924 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44227] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion], kv [jenkins: RWXCA] 2023-10-02 16:04:26,925 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44227] snapshot.SnapshotManager(637): No existing snapshot, attempting snapshot... 2023-10-02 16:04:26,925 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44227] snapshot.SnapshotManager(684): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-10-02 16:04:26,929 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44227] snapshot.SnapshotManager(519): Unable to retrieve ACL status for path: hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/.hbase-snapshot, current working dir path: hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion org.apache.hadoop.hdfs.protocol.AclException: The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.ipc.RemoteException.instantiateException(RemoteException.java:121) at org.apache.hadoop.ipc.RemoteException.unwrapRemoteException(RemoteException.java:88) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2736) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2294) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2291) at org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81) at org.apache.hadoop.hdfs.DistributedFileSystem.getAclStatus(DistributedFileSystem.java:2291) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.updateWorkingDirAclsIfRequired(SnapshotManager.java:517) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.prepareToTakeSnapshot(SnapshotManager.java:490) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.snapshotEnabledTable(SnapshotManager.java:559) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshotInternal(SnapshotManager.java:687) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshot(SnapshotManager.java:623) at org.apache.hadoop.hbase.master.MasterRpcServices.snapshot(MasterRpcServices.java:1588) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) Caused by: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.hdfs.protocol.AclException): The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at org.apache.hadoop.ipc.Client.getRpcResponse(Client.java:1540) at org.apache.hadoop.ipc.Client.call(Client.java:1486) at org.apache.hadoop.ipc.Client.call(Client.java:1385) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:232) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:118) at com.sun.proxy.$Proxy32.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.getAclStatus(ClientNamenodeProtocolTranslatorPB.java:1385) at sun.reflect.GeneratedMethodAccessor63.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:422) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeMethod(RetryInvocationHandler.java:165) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invoke(RetryInvocationHandler.java:157) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeOnce(RetryInvocationHandler.java:95) at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:359) at com.sun.proxy.$Proxy35.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor63.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor63.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor63.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor63.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor63.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2734) ... 15 more 2023-10-02 16:04:26,931 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44227] procedure2.ProcedureExecutor(1028): Stored pid=64, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-10-02 16:04:26,933 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=64, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-10-02 16:04:26,934 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=64, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE; timeout=600000, timestamp=1696263266934 2023-10-02 16:04:26,934 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44227] snapshot.SnapshotManager(689): Started snapshot: { ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-10-02 16:04:26,934 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion 2023-10-02 16:04:26,935 DEBUG [Listener at jenkins-hbase4.apache.org/32975] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-10-02 16:04:26,935 DEBUG [Listener at jenkins-hbase4.apache.org/32975] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-10-02 16:04:26,938 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=64, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-10-02 16:04:26,938 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=65, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-10-02 16:04:26,939 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=64, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE in 8 msec 2023-10-02 16:04:26,940 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=65, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-10-02 16:04:26,941 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=65, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED; timeout=600000, timestamp=1696263266941 2023-10-02 16:04:26,951 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 16:04:26,951 INFO [(jenkins-hbase4.apache.org,44227,1696262556745)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' 2023-10-02 16:04:26,951 DEBUG [(jenkins-hbase4.apache.org,44227,1696262556745)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-02 16:04:26,953 DEBUG [(jenkins-hbase4.apache.org,44227,1696262556745)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' 2023-10-02 16:04:26,953 DEBUG [(jenkins-hbase4.apache.org,44227,1696262556745)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion', kicking off acquire phase on members. 2023-10-02 16:04:27,028 DEBUG [(jenkins-hbase4.apache.org,44227,1696262556745)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44227-0x10107dfc1490000, quorum=127.0.0.1:50210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 16:04:27,028 DEBUG [(jenkins-hbase4.apache.org,44227,1696262556745)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 16:04:27,030 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): regionserver:37455-0x10107dfc1490002, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-02 16:04:27,030 DEBUG [(jenkins-hbase4.apache.org,44227,1696262556745)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,42303,1696262558956 2023-10-02 16:04:27,030 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): regionserver:43801-0x10107dfc1490001, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-02 16:04:27,030 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-02 16:04:27,030 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): regionserver:42303-0x10107dfc1490003, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-02 16:04:27,030 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-02 16:04:27,030 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-02 16:04:27,030 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-02 16:04:27,030 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-02 16:04:27,030 DEBUG [(jenkins-hbase4.apache.org,44227,1696262556745)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44227-0x10107dfc1490000, quorum=127.0.0.1:50210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,42303,1696262558956 2023-10-02 16:04:27,030 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-02 16:04:27,030 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 16:04:27,030 DEBUG [(jenkins-hbase4.apache.org,44227,1696262556745)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37455,1696262558909 2023-10-02 16:04:27,031 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 16:04:27,031 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 16:04:27,031 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37455-0x10107dfc1490002, quorum=127.0.0.1:50210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 16:04:27,031 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43801-0x10107dfc1490001, quorum=127.0.0.1:50210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 16:04:27,031 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42303-0x10107dfc1490003, quorum=127.0.0.1:50210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 16:04:27,031 DEBUG [(jenkins-hbase4.apache.org,44227,1696262556745)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44227-0x10107dfc1490000, quorum=127.0.0.1:50210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37455,1696262558909 2023-10-02 16:04:27,031 DEBUG [(jenkins-hbase4.apache.org,44227,1696262556745)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-02 16:04:27,031 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 214 2023-10-02 16:04:27,031 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 16:04:27,032 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-10-02 16:04:27,032 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 214 2023-10-02 16:04:27,032 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 214 2023-10-02 16:04:27,032 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 16:04:27,032 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 16:04:27,032 DEBUG [member: 'jenkins-hbase4.apache.org,37455,1696262558909' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-10-02 16:04:27,032 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 16:04:27,032 DEBUG [member: 'jenkins-hbase4.apache.org,37455,1696262558909' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-02 16:04:27,032 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-10-02 16:04:27,034 DEBUG [member: 'jenkins-hbase4.apache.org,37455,1696262558909' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-10-02 16:04:27,034 DEBUG [member: 'jenkins-hbase4.apache.org,37455,1696262558909' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-10-02 16:04:27,034 DEBUG [member: 'jenkins-hbase4.apache.org,37455,1696262558909' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37455,1696262558909' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-10-02 16:04:27,034 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 16:04:27,034 DEBUG [member: 'jenkins-hbase4.apache.org,42303,1696262558956' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-10-02 16:04:27,035 DEBUG [member: 'jenkins-hbase4.apache.org,42303,1696262558956' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-02 16:04:27,038 DEBUG [Listener at jenkins-hbase4.apache.org/32975] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-02 16:04:27,032 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-10-02 16:04:27,039 DEBUG [member: 'jenkins-hbase4.apache.org,42303,1696262558956' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-10-02 16:04:27,039 DEBUG [member: 'jenkins-hbase4.apache.org,42303,1696262558956' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-10-02 16:04:27,039 DEBUG [member: 'jenkins-hbase4.apache.org,42303,1696262558956' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42303,1696262558956' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-10-02 16:04:27,039 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 16:04:27,040 DEBUG [member: 'jenkins-hbase4.apache.org,43801,1696262558835' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-10-02 16:04:27,040 DEBUG [member: 'jenkins-hbase4.apache.org,43801,1696262558835' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-02 16:04:27,041 DEBUG [member: 'jenkins-hbase4.apache.org,43801,1696262558835' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-10-02 16:04:27,041 DEBUG [member: 'jenkins-hbase4.apache.org,43801,1696262558835' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-10-02 16:04:27,041 DEBUG [member: 'jenkins-hbase4.apache.org,43801,1696262558835' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43801,1696262558835' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-10-02 16:04:27,041 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): master:44227-0x10107dfc1490000, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37455,1696262558909 2023-10-02 16:04:27,041 DEBUG [member: 'jenkins-hbase4.apache.org,37455,1696262558909' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 16:04:27,041 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37455,1696262558909 2023-10-02 16:04:27,041 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-02 16:04:27,041 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-02 16:04:27,041 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44227] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-10-02 16:04:27,041 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44227] snapshot.SnapshotManager(406): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-10-02 16:04:27,042 DEBUG [Listener at jenkins-hbase4.apache.org/32975] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-10-02 16:04:27,042 DEBUG [member: 'jenkins-hbase4.apache.org,37455,1696262558909' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37455-0x10107dfc1490002, quorum=127.0.0.1:50210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 16:04:27,042 DEBUG [member: 'jenkins-hbase4.apache.org,37455,1696262558909' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-02 16:04:27,042 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): master:44227-0x10107dfc1490000, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,42303,1696262558956 2023-10-02 16:04:27,042 DEBUG [member: 'jenkins-hbase4.apache.org,42303,1696262558956' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 16:04:27,044 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-02 16:04:27,044 DEBUG [member: 'jenkins-hbase4.apache.org,43801,1696262558835' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 16:04:27,044 DEBUG [member: 'jenkins-hbase4.apache.org,42303,1696262558956' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42303-0x10107dfc1490003, quorum=127.0.0.1:50210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 16:04:27,044 DEBUG [member: 'jenkins-hbase4.apache.org,42303,1696262558956' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-02 16:04:27,045 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-02 16:04:27,045 DEBUG [member: 'jenkins-hbase4.apache.org,43801,1696262558835' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43801-0x10107dfc1490001, quorum=127.0.0.1:50210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 16:04:27,045 DEBUG [member: 'jenkins-hbase4.apache.org,43801,1696262558835' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-02 16:04:27,045 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 16:04:27,045 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37455,1696262558909 2023-10-02 16:04:27,046 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42303,1696262558956 2023-10-02 16:04:27,046 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43801,1696262558835 2023-10-02 16:04:27,046 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-02 16:04:27,047 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,37455,1696262558909' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-10-02 16:04:27,047 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1e4c93ee[Count = 1] remaining members to acquire global barrier 2023-10-02 16:04:27,047 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,42303,1696262558956 2023-10-02 16:04:27,047 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-02 16:04:27,047 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-02 16:04:27,048 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-02 16:04:27,049 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-02 16:04:27,049 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 16:04:27,049 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37455,1696262558909 2023-10-02 16:04:27,050 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42303,1696262558956 2023-10-02 16:04:27,050 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43801,1696262558835 2023-10-02 16:04:27,050 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-02 16:04:27,051 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,42303,1696262558956' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-10-02 16:04:27,051 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1e4c93ee[Count = 0] remaining members to acquire global barrier 2023-10-02 16:04:27,051 DEBUG [(jenkins-hbase4.apache.org,44227,1696262556745)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'in-barrier' execution. 2023-10-02 16:04:27,051 DEBUG [(jenkins-hbase4.apache.org,44227,1696262556745)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 16:04:27,052 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): regionserver:43801-0x10107dfc1490001, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 16:04:27,052 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): regionserver:37455-0x10107dfc1490002, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 16:04:27,052 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): regionserver:42303-0x10107dfc1490003, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 16:04:27,052 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 16:04:27,052 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 16:04:27,052 DEBUG [(jenkins-hbase4.apache.org,44227,1696262556745)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44227-0x10107dfc1490000, quorum=127.0.0.1:50210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37455,1696262558909 2023-10-02 16:04:27,052 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 16:04:27,052 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 16:04:27,052 DEBUG [member: 'jenkins-hbase4.apache.org,37455,1696262558909' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-10-02 16:04:27,052 DEBUG [member: 'jenkins-hbase4.apache.org,43801,1696262558835' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-10-02 16:04:27,052 DEBUG [member: 'jenkins-hbase4.apache.org,43801,1696262558835' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-10-02 16:04:27,052 DEBUG [member: 'jenkins-hbase4.apache.org,43801,1696262558835' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,43801,1696262558835' in zk 2023-10-02 16:04:27,052 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 16:04:27,053 DEBUG [member: 'jenkins-hbase4.apache.org,37455,1696262558909' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-02 16:04:27,053 DEBUG [rs(jenkins-hbase4.apache.org,37455,1696262558909)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1696262665448.d7920f8f17fa984e6c290238c625f96f. 2023-10-02 16:04:27,053 DEBUG [rs(jenkins-hbase4.apache.org,37455,1696262558909)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1696262665448.d7920f8f17fa984e6c290238c625f96f. started... 2023-10-02 16:04:27,053 INFO [rs(jenkins-hbase4.apache.org,37455,1696262558909)-snapshot-pool-0] regionserver.HRegion(2745): Flushing d7920f8f17fa984e6c290238c625f96f 1/1 column families, dataSize=199 B heapSize=688 B 2023-10-02 16:04:27,053 DEBUG [(jenkins-hbase4.apache.org,44227,1696262556745)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44227-0x10107dfc1490000, quorum=127.0.0.1:50210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,42303,1696262558956 2023-10-02 16:04:27,053 DEBUG [(jenkins-hbase4.apache.org,44227,1696262556745)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-02 16:04:27,053 DEBUG [member: 'jenkins-hbase4.apache.org,37455,1696262558909' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-02 16:04:27,053 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 16:04:27,053 DEBUG [member: 'jenkins-hbase4.apache.org,42303,1696262558956' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-10-02 16:04:27,054 DEBUG [member: 'jenkins-hbase4.apache.org,42303,1696262558956' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-02 16:04:27,054 DEBUG [member: 'jenkins-hbase4.apache.org,42303,1696262558956' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-02 16:04:27,054 DEBUG [rs(jenkins-hbase4.apache.org,42303,1696262558956)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1696262665448.0fdc05f251cdc4f8f198d3c8ca559208. 2023-10-02 16:04:27,054 DEBUG [rs(jenkins-hbase4.apache.org,42303,1696262558956)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1696262665448.0fdc05f251cdc4f8f198d3c8ca559208. started... 2023-10-02 16:04:27,054 DEBUG [member: 'jenkins-hbase4.apache.org,43801,1696262558835' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-10-02 16:04:27,054 DEBUG [member: 'jenkins-hbase4.apache.org,43801,1696262558835' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-02 16:04:27,054 DEBUG [member: 'jenkins-hbase4.apache.org,43801,1696262558835' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-10-02 16:04:27,054 INFO [rs(jenkins-hbase4.apache.org,42303,1696262558956)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 0fdc05f251cdc4f8f198d3c8ca559208 1/1 column families, dataSize=3.06 KB heapSize=6.86 KB 2023-10-02 16:04:27,105 INFO [rs(jenkins-hbase4.apache.org,37455,1696262558909)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231002905158644dd446ee96ea642120fc2f64 to hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e20231002905158644dd446ee96ea642120fc2f64 2023-10-02 16:04:27,106 INFO [rs(jenkins-hbase4.apache.org,42303,1696262558956)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023100260964c82e617409dbb2cec52eeb505f2 to hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b2023100260964c82e617409dbb2cec52eeb505f2 2023-10-02 16:04:27,128 INFO [rs(jenkins-hbase4.apache.org,42303,1696262558956)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=3.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/data/default/testtb-testExportFileSystemStateWithMergeRegion/0fdc05f251cdc4f8f198d3c8ca559208/.tmp/cf/1dedbbd4d22b4a72970a5d85eab46877 2023-10-02 16:04:27,129 INFO [rs(jenkins-hbase4.apache.org,37455,1696262558909)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=199, hasBloomFilter=true, into tmp file hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/data/default/testtb-testExportFileSystemStateWithMergeRegion/d7920f8f17fa984e6c290238c625f96f/.tmp/cf/b31a286973254848a86bf2174fc9f405 2023-10-02 16:04:27,135 DEBUG [rs(jenkins-hbase4.apache.org,37455,1696262558909)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/data/default/testtb-testExportFileSystemStateWithMergeRegion/d7920f8f17fa984e6c290238c625f96f/.tmp/cf/b31a286973254848a86bf2174fc9f405 as hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/data/default/testtb-testExportFileSystemStateWithMergeRegion/d7920f8f17fa984e6c290238c625f96f/cf/b31a286973254848a86bf2174fc9f405 2023-10-02 16:04:27,140 DEBUG [rs(jenkins-hbase4.apache.org,42303,1696262558956)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/data/default/testtb-testExportFileSystemStateWithMergeRegion/0fdc05f251cdc4f8f198d3c8ca559208/.tmp/cf/1dedbbd4d22b4a72970a5d85eab46877 as hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/data/default/testtb-testExportFileSystemStateWithMergeRegion/0fdc05f251cdc4f8f198d3c8ca559208/cf/1dedbbd4d22b4a72970a5d85eab46877 2023-10-02 16:04:27,145 INFO [rs(jenkins-hbase4.apache.org,37455,1696262558909)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/data/default/testtb-testExportFileSystemStateWithMergeRegion/d7920f8f17fa984e6c290238c625f96f/cf/b31a286973254848a86bf2174fc9f405, entries=3, sequenceid=6, filesize=5.4 K 2023-10-02 16:04:27,155 INFO [rs(jenkins-hbase4.apache.org,42303,1696262558956)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/data/default/testtb-testExportFileSystemStateWithMergeRegion/0fdc05f251cdc4f8f198d3c8ca559208/cf/1dedbbd4d22b4a72970a5d85eab46877, entries=47, sequenceid=6, filesize=13.5 K 2023-10-02 16:04:27,156 INFO [rs(jenkins-hbase4.apache.org,42303,1696262558956)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.06 KB/3137, heapSize ~6.84 KB/7008, currentSize=0 B/0 for 0fdc05f251cdc4f8f198d3c8ca559208 in 102ms, sequenceid=6, compaction requested=false 2023-10-02 16:04:27,157 DEBUG [rs(jenkins-hbase4.apache.org,42303,1696262558956)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithMergeRegion' 2023-10-02 16:04:27,157 INFO [rs(jenkins-hbase4.apache.org,37455,1696262558909)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~199 B/199, heapSize ~672 B/672, currentSize=0 B/0 for d7920f8f17fa984e6c290238c625f96f in 104ms, sequenceid=6, compaction requested=false 2023-10-02 16:04:27,157 DEBUG [rs(jenkins-hbase4.apache.org,37455,1696262558909)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithMergeRegion' 2023-10-02 16:04:27,159 DEBUG [rs(jenkins-hbase4.apache.org,42303,1696262558956)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 0fdc05f251cdc4f8f198d3c8ca559208: 2023-10-02 16:04:27,162 DEBUG [rs(jenkins-hbase4.apache.org,37455,1696262558909)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for d7920f8f17fa984e6c290238c625f96f: 2023-10-02 16:04:27,162 DEBUG [rs(jenkins-hbase4.apache.org,42303,1696262558956)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,1,1696262665448.0fdc05f251cdc4f8f198d3c8ca559208.' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 16:04:27,162 DEBUG [rs(jenkins-hbase4.apache.org,37455,1696262558909)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,,1696262665448.d7920f8f17fa984e6c290238c625f96f.' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 16:04:27,162 DEBUG [rs(jenkins-hbase4.apache.org,42303,1696262558956)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-02 16:04:27,163 DEBUG [rs(jenkins-hbase4.apache.org,37455,1696262558909)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-02 16:04:27,163 DEBUG [rs(jenkins-hbase4.apache.org,42303,1696262558956)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/data/default/testtb-testExportFileSystemStateWithMergeRegion/0fdc05f251cdc4f8f198d3c8ca559208/cf/1dedbbd4d22b4a72970a5d85eab46877] hfiles 2023-10-02 16:04:27,163 DEBUG [rs(jenkins-hbase4.apache.org,37455,1696262558909)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/data/default/testtb-testExportFileSystemStateWithMergeRegion/d7920f8f17fa984e6c290238c625f96f/cf/b31a286973254848a86bf2174fc9f405] hfiles 2023-10-02 16:04:27,163 DEBUG [rs(jenkins-hbase4.apache.org,42303,1696262558956)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/data/default/testtb-testExportFileSystemStateWithMergeRegion/0fdc05f251cdc4f8f198d3c8ca559208/cf/1dedbbd4d22b4a72970a5d85eab46877 for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 16:04:27,163 DEBUG [rs(jenkins-hbase4.apache.org,37455,1696262558909)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/data/default/testtb-testExportFileSystemStateWithMergeRegion/d7920f8f17fa984e6c290238c625f96f/cf/b31a286973254848a86bf2174fc9f405 for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 16:04:27,179 DEBUG [rs(jenkins-hbase4.apache.org,42303,1696262558956)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1696262665448.0fdc05f251cdc4f8f198d3c8ca559208. completed. 2023-10-02 16:04:27,179 DEBUG [rs(jenkins-hbase4.apache.org,42303,1696262558956)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1696262665448.0fdc05f251cdc4f8f198d3c8ca559208. 2023-10-02 16:04:27,179 DEBUG [member: 'jenkins-hbase4.apache.org,42303,1696262558956' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-02 16:04:27,179 DEBUG [member: 'jenkins-hbase4.apache.org,42303,1696262558956' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-02 16:04:27,179 DEBUG [member: 'jenkins-hbase4.apache.org,42303,1696262558956' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,42303,1696262558956 2023-10-02 16:04:27,179 DEBUG [member: 'jenkins-hbase4.apache.org,42303,1696262558956' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-10-02 16:04:27,179 DEBUG [member: 'jenkins-hbase4.apache.org,42303,1696262558956' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,42303,1696262558956' in zk 2023-10-02 16:04:27,180 DEBUG [rs(jenkins-hbase4.apache.org,37455,1696262558909)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1696262665448.d7920f8f17fa984e6c290238c625f96f. completed. 2023-10-02 16:04:27,180 DEBUG [rs(jenkins-hbase4.apache.org,37455,1696262558909)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1696262665448.d7920f8f17fa984e6c290238c625f96f. 2023-10-02 16:04:27,180 DEBUG [member: 'jenkins-hbase4.apache.org,37455,1696262558909' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-02 16:04:27,180 DEBUG [member: 'jenkins-hbase4.apache.org,37455,1696262558909' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-02 16:04:27,180 DEBUG [member: 'jenkins-hbase4.apache.org,37455,1696262558909' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,37455,1696262558909 2023-10-02 16:04:27,180 DEBUG [member: 'jenkins-hbase4.apache.org,37455,1696262558909' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-10-02 16:04:27,180 DEBUG [member: 'jenkins-hbase4.apache.org,37455,1696262558909' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,37455,1696262558909' in zk 2023-10-02 16:04:27,182 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): master:44227-0x10107dfc1490000, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,42303,1696262558956 2023-10-02 16:04:27,182 DEBUG [member: 'jenkins-hbase4.apache.org,42303,1696262558956' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-10-02 16:04:27,182 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,42303,1696262558956 2023-10-02 16:04:27,182 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-02 16:04:27,182 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-02 16:04:27,182 DEBUG [member: 'jenkins-hbase4.apache.org,42303,1696262558956' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-02 16:04:27,182 DEBUG [member: 'jenkins-hbase4.apache.org,42303,1696262558956' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-10-02 16:04:27,188 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): master:44227-0x10107dfc1490000, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37455,1696262558909 2023-10-02 16:04:27,188 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-02 16:04:27,188 DEBUG [member: 'jenkins-hbase4.apache.org,37455,1696262558909' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-10-02 16:04:27,188 DEBUG [member: 'jenkins-hbase4.apache.org,37455,1696262558909' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-02 16:04:27,188 DEBUG [member: 'jenkins-hbase4.apache.org,37455,1696262558909' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-10-02 16:04:27,190 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-02 16:04:27,190 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 16:04:27,190 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37455,1696262558909 2023-10-02 16:04:27,191 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42303,1696262558956 2023-10-02 16:04:27,191 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43801,1696262558835 2023-10-02 16:04:27,191 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-02 16:04:27,191 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 16:04:27,192 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37455,1696262558909 2023-10-02 16:04:27,192 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42303,1696262558956 2023-10-02 16:04:27,192 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43801,1696262558835 2023-10-02 16:04:27,193 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,42303,1696262558956': 2023-10-02 16:04:27,193 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,42303,1696262558956' released barrier for procedure'snaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 1 more 2023-10-02 16:04:27,193 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37455,1696262558909 2023-10-02 16:04:27,193 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-02 16:04:27,193 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-02 16:04:27,193 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-02 16:04:27,194 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-02 16:04:27,194 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 16:04:27,194 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37455,1696262558909 2023-10-02 16:04:27,194 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42303,1696262558956 2023-10-02 16:04:27,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43801,1696262558835 2023-10-02 16:04:27,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-02 16:04:27,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 16:04:27,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37455,1696262558909 2023-10-02 16:04:27,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42303,1696262558956 2023-10-02 16:04:27,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43801,1696262558835 2023-10-02 16:04:27,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,37455,1696262558909': 2023-10-02 16:04:27,197 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,37455,1696262558909' released barrier for procedure'snaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 0 more 2023-10-02 16:04:27,197 INFO [(jenkins-hbase4.apache.org,44227,1696262556745)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' execution completed 2023-10-02 16:04:27,197 DEBUG [(jenkins-hbase4.apache.org,44227,1696262556745)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-02 16:04:27,197 DEBUG [(jenkins-hbase4.apache.org,44227,1696262556745)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-02 16:04:27,197 DEBUG [(jenkins-hbase4.apache.org,44227,1696262556745)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 16:04:27,197 INFO [(jenkins-hbase4.apache.org,44227,1696262556745)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateWithMergeRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-10-02 16:04:27,204 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): regionserver:37455-0x10107dfc1490002, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 16:04:27,204 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): regionserver:43801-0x10107dfc1490001, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 16:04:27,204 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): regionserver:42303-0x10107dfc1490003, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 16:04:27,204 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 16:04:27,204 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 16:04:27,204 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): regionserver:42303-0x10107dfc1490003, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-02 16:04:27,204 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): regionserver:43801-0x10107dfc1490001, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-02 16:04:27,204 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 16:04:27,204 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 16:04:27,204 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): regionserver:37455-0x10107dfc1490002, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-02 16:04:27,204 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): master:44227-0x10107dfc1490000, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 16:04:27,204 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 16:04:27,205 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 16:04:27,205 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-02 16:04:27,205 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-02 16:04:27,204 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 16:04:27,205 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-02 16:04:27,205 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-02 16:04:27,205 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-02 16:04:27,205 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-02 16:04:27,206 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 16:04:27,206 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 16:04:27,206 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-02 16:04:27,206 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-02 16:04:27,207 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 16:04:27,207 DEBUG [(jenkins-hbase4.apache.org,44227,1696262556745)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44227-0x10107dfc1490000, quorum=127.0.0.1:50210, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37455,1696262558909 2023-10-02 16:04:27,207 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-02 16:04:27,208 DEBUG [(jenkins-hbase4.apache.org,44227,1696262556745)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44227-0x10107dfc1490000, quorum=127.0.0.1:50210, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,42303,1696262558956 2023-10-02 16:04:27,208 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 16:04:27,208 DEBUG [(jenkins-hbase4.apache.org,44227,1696262556745)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44227-0x10107dfc1490000, quorum=127.0.0.1:50210, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43801,1696262558835 2023-10-02 16:04:27,208 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-02 16:04:27,209 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 16:04:27,209 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37455,1696262558909 2023-10-02 16:04:27,210 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42303,1696262558956 2023-10-02 16:04:27,210 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43801,1696262558835 2023-10-02 16:04:27,210 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-02 16:04:27,210 DEBUG [(jenkins-hbase4.apache.org,44227,1696262556745)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44227-0x10107dfc1490000, quorum=127.0.0.1:50210, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37455,1696262558909 2023-10-02 16:04:27,211 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 16:04:27,211 DEBUG [(jenkins-hbase4.apache.org,44227,1696262556745)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44227-0x10107dfc1490000, quorum=127.0.0.1:50210, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,42303,1696262558956 2023-10-02 16:04:27,211 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37455,1696262558909 2023-10-02 16:04:27,211 DEBUG [(jenkins-hbase4.apache.org,44227,1696262556745)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44227-0x10107dfc1490000, quorum=127.0.0.1:50210, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43801,1696262558835 2023-10-02 16:04:27,211 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42303,1696262558956 2023-10-02 16:04:27,212 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43801,1696262558835 2023-10-02 16:04:27,215 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): master:44227-0x10107dfc1490000, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43801,1696262558835 2023-10-02 16:04:27,215 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): master:44227-0x10107dfc1490000, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 16:04:27,215 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): master:44227-0x10107dfc1490000, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,42303,1696262558956 2023-10-02 16:04:27,215 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): regionserver:42303-0x10107dfc1490003, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-02 16:04:27,215 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): regionserver:42303-0x10107dfc1490003, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-02 16:04:27,215 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): regionserver:37455-0x10107dfc1490002, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-02 16:04:27,215 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-02 16:04:27,215 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-02 16:04:27,215 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): regionserver:43801-0x10107dfc1490001, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-02 16:04:27,215 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): master:44227-0x10107dfc1490000, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37455,1696262558909 2023-10-02 16:04:27,216 DEBUG [(jenkins-hbase4.apache.org,44227,1696262556745)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-02 16:04:27,215 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-02 16:04:27,216 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 16:04:27,216 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): master:44227-0x10107dfc1490000, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 16:04:27,218 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): regionserver:37455-0x10107dfc1490002, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-02 16:04:27,216 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-02 16:04:27,215 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): regionserver:43801-0x10107dfc1490001, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-02 16:04:27,218 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-02 16:04:27,218 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-02 16:04:27,218 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-02 16:04:27,218 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): master:44227-0x10107dfc1490000, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43801,1696262558835 2023-10-02 16:04:27,218 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): master:44227-0x10107dfc1490000, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 16:04:27,217 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemStateWithMergeRegion 2023-10-02 16:04:27,216 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-02 16:04:27,218 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => aaca68e56e63a701f5c1ec9dc2f0511c, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,.mob,0.aaca68e56e63a701f5c1ec9dc2f0511c.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 16:04:27,218 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-10-02 16:04:27,218 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-02 16:04:27,218 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-02 16:04:27,218 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): master:44227-0x10107dfc1490000, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,42303,1696262558956 2023-10-02 16:04:27,219 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): master:44227-0x10107dfc1490000, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37455,1696262558909 2023-10-02 16:04:27,219 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-02 16:04:27,219 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-02 16:04:27,219 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): master:44227-0x10107dfc1490000, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 16:04:27,219 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): master:44227-0x10107dfc1490000, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 16:04:27,219 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b2023100260964c82e617409dbb2cec52eeb505f2, hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e20231002905158644dd446ee96ea642120fc2f64] mob files 2023-10-02 16:04:27,220 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b2023100260964c82e617409dbb2cec52eeb505f2 2023-10-02 16:04:27,220 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e20231002905158644dd446ee96ea642120fc2f64 2023-10-02 16:04:27,231 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 16:04:27,232 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 16:04:27,242 DEBUG [Listener at jenkins-hbase4.apache.org/32975] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-02 16:04:27,243 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44227] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-10-02 16:04:27,243 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44227] snapshot.SnapshotManager(406): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-10-02 16:04:27,243 DEBUG [Listener at jenkins-hbase4.apache.org/32975] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-10-02 16:04:27,261 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion to hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 16:04:27,262 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed 2023-10-02 16:04:27,262 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 16:04:27,262 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 16:04:27,262 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion at 1696262666934Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemStateWithMergeRegion at 1696262667231 (+297 ms)Consolidate snapshot: snaptb0-testExportFileSystemStateWithMergeRegion at 1696262667231Loading Region manifests for snaptb0-testExportFileSystemStateWithMergeRegion at 1696262667231Writing data manifest for snaptb0-testExportFileSystemStateWithMergeRegion at 1696262667236 (+5 ms)Verifying snapshot: snaptb0-testExportFileSystemStateWithMergeRegion at 1696262667247 (+11 ms)Snapshot snaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed at 1696262667262 (+15 ms) 2023-10-02 16:04:27,265 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=65, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-10-02 16:04:27,267 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=65, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED in 329 msec 2023-10-02 16:04:27,544 DEBUG [Listener at jenkins-hbase4.apache.org/32975] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-02 16:04:27,545 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44227] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-10-02 16:04:27,545 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44227] snapshot.SnapshotManager(403): Snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' has completed, notifying client. 2023-10-02 16:04:27,588 DEBUG [Listener at jenkins-hbase4.apache.org/32975] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-10-02 16:04:27,592 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:44970, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-10-02 16:04:27,595 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37455] regionserver.CompactSplit(310): Interrupting running compactions because user switched off compactions 2023-10-02 16:04:27,596 DEBUG [Listener at jenkins-hbase4.apache.org/32975] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-10-02 16:04:27,603 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:37112, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-10-02 16:04:27,603 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42303] regionserver.CompactSplit(310): Interrupting running compactions because user switched off compactions 2023-10-02 16:04:27,604 DEBUG [Listener at jenkins-hbase4.apache.org/32975] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-10-02 16:04:27,607 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:41962, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-10-02 16:04:27,608 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43801] regionserver.CompactSplit(310): Interrupting running compactions because user switched off compactions 2023-10-02 16:04:27,611 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44227] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemStateWithMergeRegion-1', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-10-02 16:04:27,612 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44227] procedure2.ProcedureExecutor(1028): Stored pid=66, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-10-02 16:04:27,615 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_PRE_OPERATION 2023-10-02 16:04:27,615 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44227] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemStateWithMergeRegion-1" procId is: 66 2023-10-02 16:04:27,616 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-10-02 16:04:27,616 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44227] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-10-02 16:04:27,619 DEBUG [HFileArchiver-17] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/f4e8e41d186c31dbeea9929d34bd20db 2023-10-02 16:04:27,619 DEBUG [HFileArchiver-18] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/79a8c3e6fba6c6c73e80bcbb09e57cad 2023-10-02 16:04:27,620 DEBUG [HFileArchiver-17] backup.HFileArchiver(153): Directory hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/f4e8e41d186c31dbeea9929d34bd20db empty. 2023-10-02 16:04:27,620 DEBUG [HFileArchiver-18] backup.HFileArchiver(153): Directory hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/79a8c3e6fba6c6c73e80bcbb09e57cad empty. 2023-10-02 16:04:27,620 DEBUG [HFileArchiver-17] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/f4e8e41d186c31dbeea9929d34bd20db 2023-10-02 16:04:27,620 DEBUG [HFileArchiver-18] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/79a8c3e6fba6c6c73e80bcbb09e57cad 2023-10-02 16:04:27,620 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion-1 regions 2023-10-02 16:04:27,634 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/.tabledesc/.tableinfo.0000000001 2023-10-02 16:04:27,637 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(7675): creating {ENCODED => 79a8c3e6fba6c6c73e80bcbb09e57cad, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,2,1696262667610.79a8c3e6fba6c6c73e80bcbb09e57cad.', STARTKEY => '2', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion-1', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/.tmp 2023-10-02 16:04:27,637 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(7675): creating {ENCODED => f4e8e41d186c31dbeea9929d34bd20db, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1696262667610.f4e8e41d186c31dbeea9929d34bd20db.', STARTKEY => '', ENDKEY => '2'}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion-1', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/.tmp 2023-10-02 16:04:27,649 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,,1696262667610.f4e8e41d186c31dbeea9929d34bd20db.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-02 16:04:27,649 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1604): Closing f4e8e41d186c31dbeea9929d34bd20db, disabling compactions & flushes 2023-10-02 16:04:27,649 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,,1696262667610.f4e8e41d186c31dbeea9929d34bd20db. 2023-10-02 16:04:27,649 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1696262667610.f4e8e41d186c31dbeea9929d34bd20db. 2023-10-02 16:04:27,649 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1696262667610.f4e8e41d186c31dbeea9929d34bd20db. after waiting 0 ms 2023-10-02 16:04:27,649 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,,1696262667610.f4e8e41d186c31dbeea9929d34bd20db. 2023-10-02 16:04:27,649 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,,1696262667610.f4e8e41d186c31dbeea9929d34bd20db. 2023-10-02 16:04:27,649 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1558): Region close journal for f4e8e41d186c31dbeea9929d34bd20db: 2023-10-02 16:04:27,650 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,2,1696262667610.79a8c3e6fba6c6c73e80bcbb09e57cad.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-02 16:04:27,650 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1604): Closing 79a8c3e6fba6c6c73e80bcbb09e57cad, disabling compactions & flushes 2023-10-02 16:04:27,650 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,2,1696262667610.79a8c3e6fba6c6c73e80bcbb09e57cad. 2023-10-02 16:04:27,650 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1696262667610.79a8c3e6fba6c6c73e80bcbb09e57cad. 2023-10-02 16:04:27,650 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1696262667610.79a8c3e6fba6c6c73e80bcbb09e57cad. after waiting 0 ms 2023-10-02 16:04:27,650 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,2,1696262667610.79a8c3e6fba6c6c73e80bcbb09e57cad. 2023-10-02 16:04:27,650 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,2,1696262667610.79a8c3e6fba6c6c73e80bcbb09e57cad. 2023-10-02 16:04:27,650 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1558): Region close journal for 79a8c3e6fba6c6c73e80bcbb09e57cad: 2023-10-02 16:04:27,653 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_ADD_TO_META 2023-10-02 16:04:27,654 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1696262667610.f4e8e41d186c31dbeea9929d34bd20db.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1696262667654"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696262667654"}]},"ts":"1696262667654"} 2023-10-02 16:04:27,654 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1696262667610.79a8c3e6fba6c6c73e80bcbb09e57cad.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1696262667654"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696262667654"}]},"ts":"1696262667654"} 2023-10-02 16:04:27,657 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-10-02 16:04:27,658 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-10-02 16:04:27,658 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696262667658"}]},"ts":"1696262667658"} 2023-10-02 16:04:27,659 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=ENABLING in hbase:meta 2023-10-02 16:04:27,663 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-10-02 16:04:27,665 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-10-02 16:04:27,665 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-10-02 16:04:27,665 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-10-02 16:04:27,665 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-10-02 16:04:27,665 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=f4e8e41d186c31dbeea9929d34bd20db, ASSIGN}, {pid=68, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=79a8c3e6fba6c6c73e80bcbb09e57cad, ASSIGN}] 2023-10-02 16:04:27,669 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=f4e8e41d186c31dbeea9929d34bd20db, ASSIGN 2023-10-02 16:04:27,669 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=68, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=79a8c3e6fba6c6c73e80bcbb09e57cad, ASSIGN 2023-10-02 16:04:27,670 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=f4e8e41d186c31dbeea9929d34bd20db, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,43801,1696262558835; forceNewPlan=false, retain=false 2023-10-02 16:04:27,670 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=68, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=79a8c3e6fba6c6c73e80bcbb09e57cad, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,37455,1696262558909; forceNewPlan=false, retain=false 2023-10-02 16:04:27,718 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44227] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-10-02 16:04:27,820 INFO [jenkins-hbase4:44227] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-10-02 16:04:27,824 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=68 updating hbase:meta row=79a8c3e6fba6c6c73e80bcbb09e57cad, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,37455,1696262558909 2023-10-02 16:04:27,824 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=f4e8e41d186c31dbeea9929d34bd20db, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,43801,1696262558835 2023-10-02 16:04:27,824 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1696262667610.79a8c3e6fba6c6c73e80bcbb09e57cad.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1696262667824"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696262667824"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696262667824"}]},"ts":"1696262667824"} 2023-10-02 16:04:27,825 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1696262667610.f4e8e41d186c31dbeea9929d34bd20db.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1696262667824"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696262667824"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696262667824"}]},"ts":"1696262667824"} 2023-10-02 16:04:27,827 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=69, ppid=68, state=RUNNABLE; OpenRegionProcedure 79a8c3e6fba6c6c73e80bcbb09e57cad, server=jenkins-hbase4.apache.org,37455,1696262558909}] 2023-10-02 16:04:27,828 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=70, ppid=67, state=RUNNABLE; OpenRegionProcedure f4e8e41d186c31dbeea9929d34bd20db, server=jenkins-hbase4.apache.org,43801,1696262558835}] 2023-10-02 16:04:27,919 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44227] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-10-02 16:04:27,987 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion-1,2,1696262667610.79a8c3e6fba6c6c73e80bcbb09e57cad. 2023-10-02 16:04:27,987 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 79a8c3e6fba6c6c73e80bcbb09e57cad, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,2,1696262667610.79a8c3e6fba6c6c73e80bcbb09e57cad.', STARTKEY => '2', ENDKEY => ''} 2023-10-02 16:04:27,988 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion-1,2,1696262667610.79a8c3e6fba6c6c73e80bcbb09e57cad. service=AccessControlService 2023-10-02 16:04:27,988 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-10-02 16:04:27,989 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion-1,,1696262667610.f4e8e41d186c31dbeea9929d34bd20db. 2023-10-02 16:04:27,989 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion-1 79a8c3e6fba6c6c73e80bcbb09e57cad 2023-10-02 16:04:27,989 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,2,1696262667610.79a8c3e6fba6c6c73e80bcbb09e57cad.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-02 16:04:27,989 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => f4e8e41d186c31dbeea9929d34bd20db, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1696262667610.f4e8e41d186c31dbeea9929d34bd20db.', STARTKEY => '', ENDKEY => '2'} 2023-10-02 16:04:27,989 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 79a8c3e6fba6c6c73e80bcbb09e57cad 2023-10-02 16:04:27,989 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 79a8c3e6fba6c6c73e80bcbb09e57cad 2023-10-02 16:04:27,989 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion-1,,1696262667610.f4e8e41d186c31dbeea9929d34bd20db. service=AccessControlService 2023-10-02 16:04:27,989 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-10-02 16:04:27,989 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion-1 f4e8e41d186c31dbeea9929d34bd20db 2023-10-02 16:04:27,990 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,,1696262667610.f4e8e41d186c31dbeea9929d34bd20db.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-02 16:04:27,990 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for f4e8e41d186c31dbeea9929d34bd20db 2023-10-02 16:04:27,990 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for f4e8e41d186c31dbeea9929d34bd20db 2023-10-02 16:04:27,991 INFO [StoreOpener-79a8c3e6fba6c6c73e80bcbb09e57cad-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 79a8c3e6fba6c6c73e80bcbb09e57cad 2023-10-02 16:04:27,991 INFO [StoreOpener-f4e8e41d186c31dbeea9929d34bd20db-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region f4e8e41d186c31dbeea9929d34bd20db 2023-10-02 16:04:27,993 DEBUG [StoreOpener-79a8c3e6fba6c6c73e80bcbb09e57cad-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/79a8c3e6fba6c6c73e80bcbb09e57cad/cf 2023-10-02 16:04:27,993 DEBUG [StoreOpener-f4e8e41d186c31dbeea9929d34bd20db-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/f4e8e41d186c31dbeea9929d34bd20db/cf 2023-10-02 16:04:27,993 DEBUG [StoreOpener-79a8c3e6fba6c6c73e80bcbb09e57cad-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/79a8c3e6fba6c6c73e80bcbb09e57cad/cf 2023-10-02 16:04:27,993 DEBUG [StoreOpener-f4e8e41d186c31dbeea9929d34bd20db-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/f4e8e41d186c31dbeea9929d34bd20db/cf 2023-10-02 16:04:27,994 INFO [StoreOpener-79a8c3e6fba6c6c73e80bcbb09e57cad-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 79a8c3e6fba6c6c73e80bcbb09e57cad columnFamilyName cf 2023-10-02 16:04:27,994 INFO [StoreOpener-f4e8e41d186c31dbeea9929d34bd20db-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region f4e8e41d186c31dbeea9929d34bd20db columnFamilyName cf 2023-10-02 16:04:27,994 INFO [StoreOpener-79a8c3e6fba6c6c73e80bcbb09e57cad-1] regionserver.HStore(310): Store=79a8c3e6fba6c6c73e80bcbb09e57cad/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-02 16:04:27,995 INFO [StoreOpener-f4e8e41d186c31dbeea9929d34bd20db-1] regionserver.HStore(310): Store=f4e8e41d186c31dbeea9929d34bd20db/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-02 16:04:27,996 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/79a8c3e6fba6c6c73e80bcbb09e57cad 2023-10-02 16:04:27,996 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/79a8c3e6fba6c6c73e80bcbb09e57cad 2023-10-02 16:04:27,996 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/f4e8e41d186c31dbeea9929d34bd20db 2023-10-02 16:04:27,997 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/f4e8e41d186c31dbeea9929d34bd20db 2023-10-02 16:04:28,000 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 79a8c3e6fba6c6c73e80bcbb09e57cad 2023-10-02 16:04:28,001 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for f4e8e41d186c31dbeea9929d34bd20db 2023-10-02 16:04:28,004 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/79a8c3e6fba6c6c73e80bcbb09e57cad/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-02 16:04:28,005 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 79a8c3e6fba6c6c73e80bcbb09e57cad; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60088486, jitterRate=-0.10461178421974182}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-10-02 16:04:28,005 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 79a8c3e6fba6c6c73e80bcbb09e57cad: 2023-10-02 16:04:28,009 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion-1,2,1696262667610.79a8c3e6fba6c6c73e80bcbb09e57cad., pid=69, masterSystemTime=1696262667979 2023-10-02 16:04:28,011 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion-1,2,1696262667610.79a8c3e6fba6c6c73e80bcbb09e57cad. 2023-10-02 16:04:28,011 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion-1,2,1696262667610.79a8c3e6fba6c6c73e80bcbb09e57cad. 2023-10-02 16:04:28,012 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/f4e8e41d186c31dbeea9929d34bd20db/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-02 16:04:28,012 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=68 updating hbase:meta row=79a8c3e6fba6c6c73e80bcbb09e57cad, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,37455,1696262558909 2023-10-02 16:04:28,013 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1696262667610.79a8c3e6fba6c6c73e80bcbb09e57cad.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1696262668012"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1696262668012"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1696262668012"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1696262668012"}]},"ts":"1696262668012"} 2023-10-02 16:04:28,013 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened f4e8e41d186c31dbeea9929d34bd20db; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68646370, jitterRate=0.022910624742507935}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-10-02 16:04:28,013 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for f4e8e41d186c31dbeea9929d34bd20db: 2023-10-02 16:04:28,015 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion-1,,1696262667610.f4e8e41d186c31dbeea9929d34bd20db., pid=70, masterSystemTime=1696262667980 2023-10-02 16:04:28,017 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion-1,,1696262667610.f4e8e41d186c31dbeea9929d34bd20db. 2023-10-02 16:04:28,017 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion-1,,1696262667610.f4e8e41d186c31dbeea9929d34bd20db. 2023-10-02 16:04:28,017 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=f4e8e41d186c31dbeea9929d34bd20db, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,43801,1696262558835 2023-10-02 16:04:28,018 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1696262667610.f4e8e41d186c31dbeea9929d34bd20db.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1696262668017"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1696262668017"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1696262668017"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1696262668017"}]},"ts":"1696262668017"} 2023-10-02 16:04:28,018 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=69, resume processing ppid=68 2023-10-02 16:04:28,018 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=69, ppid=68, state=SUCCESS; OpenRegionProcedure 79a8c3e6fba6c6c73e80bcbb09e57cad, server=jenkins-hbase4.apache.org,37455,1696262558909 in 188 msec 2023-10-02 16:04:28,020 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=68, ppid=66, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=79a8c3e6fba6c6c73e80bcbb09e57cad, ASSIGN in 353 msec 2023-10-02 16:04:28,024 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=70, resume processing ppid=67 2023-10-02 16:04:28,024 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=70, ppid=67, state=SUCCESS; OpenRegionProcedure f4e8e41d186c31dbeea9929d34bd20db, server=jenkins-hbase4.apache.org,43801,1696262558835 in 192 msec 2023-10-02 16:04:28,033 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=67, resume processing ppid=66 2023-10-02 16:04:28,033 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=67, ppid=66, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=f4e8e41d186c31dbeea9929d34bd20db, ASSIGN in 360 msec 2023-10-02 16:04:28,034 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-10-02 16:04:28,034 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696262668034"}]},"ts":"1696262668034"} 2023-10-02 16:04:28,036 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=ENABLED in hbase:meta 2023-10-02 16:04:28,039 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_POST_OPERATION 2023-10-02 16:04:28,040 DEBUG [PEWorker-3] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemStateWithMergeRegion-1 jenkins: RWXCA 2023-10-02 16:04:28,042 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=42303] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion-1], kv [jenkins: RWXCA] 2023-10-02 16:04:28,044 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): regionserver:37455-0x10107dfc1490002, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-02 16:04:28,044 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): regionserver:42303-0x10107dfc1490003, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-02 16:04:28,044 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): regionserver:43801-0x10107dfc1490001, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-02 16:04:28,045 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): master:44227-0x10107dfc1490000, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-02 16:04:28,047 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-10-02 16:04:28,047 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-10-02 16:04:28,047 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-10-02 16:04:28,047 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-10-02 16:04:28,047 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-10-02 16:04:28,047 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-10-02 16:04:28,048 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-10-02 16:04:28,048 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-10-02 16:04:28,049 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=66, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 in 435 msec 2023-10-02 16:04:28,221 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44227] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-10-02 16:04:28,221 INFO [Listener at jenkins-hbase4.apache.org/32975] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 66 completed 2023-10-02 16:04:28,251 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44227] master.HMaster$2(1952): Client=jenkins//172.31.14.131 merge regions f4e8e41d186c31dbeea9929d34bd20db, 79a8c3e6fba6c6c73e80bcbb09e57cad 2023-10-02 16:04:28,264 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44227] procedure2.ProcedureExecutor(1028): Stored pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[f4e8e41d186c31dbeea9929d34bd20db, 79a8c3e6fba6c6c73e80bcbb09e57cad], force=true 2023-10-02 16:04:28,266 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[f4e8e41d186c31dbeea9929d34bd20db, 79a8c3e6fba6c6c73e80bcbb09e57cad], force=true 2023-10-02 16:04:28,266 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[f4e8e41d186c31dbeea9929d34bd20db, 79a8c3e6fba6c6c73e80bcbb09e57cad], force=true 2023-10-02 16:04:28,266 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[f4e8e41d186c31dbeea9929d34bd20db, 79a8c3e6fba6c6c73e80bcbb09e57cad], force=true 2023-10-02 16:04:28,270 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44227] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-10-02 16:04:28,298 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=72, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=f4e8e41d186c31dbeea9929d34bd20db, UNASSIGN}, {pid=73, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=79a8c3e6fba6c6c73e80bcbb09e57cad, UNASSIGN}] 2023-10-02 16:04:28,301 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=72, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=f4e8e41d186c31dbeea9929d34bd20db, UNASSIGN 2023-10-02 16:04:28,302 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=73, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=79a8c3e6fba6c6c73e80bcbb09e57cad, UNASSIGN 2023-10-02 16:04:28,303 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=72 updating hbase:meta row=f4e8e41d186c31dbeea9929d34bd20db, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,43801,1696262558835 2023-10-02 16:04:28,303 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=73 updating hbase:meta row=79a8c3e6fba6c6c73e80bcbb09e57cad, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,37455,1696262558909 2023-10-02 16:04:28,303 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1696262667610.f4e8e41d186c31dbeea9929d34bd20db.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1696262668302"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696262668302"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696262668302"}]},"ts":"1696262668302"} 2023-10-02 16:04:28,303 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1696262667610.79a8c3e6fba6c6c73e80bcbb09e57cad.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1696262668302"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696262668302"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696262668302"}]},"ts":"1696262668302"} 2023-10-02 16:04:28,305 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=74, ppid=72, state=RUNNABLE; CloseRegionProcedure f4e8e41d186c31dbeea9929d34bd20db, server=jenkins-hbase4.apache.org,43801,1696262558835}] 2023-10-02 16:04:28,306 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=75, ppid=73, state=RUNNABLE; CloseRegionProcedure 79a8c3e6fba6c6c73e80bcbb09e57cad, server=jenkins-hbase4.apache.org,37455,1696262558909}] 2023-10-02 16:04:28,371 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44227] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-10-02 16:04:28,457 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 79a8c3e6fba6c6c73e80bcbb09e57cad 2023-10-02 16:04:28,457 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close f4e8e41d186c31dbeea9929d34bd20db 2023-10-02 16:04:28,460 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 79a8c3e6fba6c6c73e80bcbb09e57cad, disabling compactions & flushes 2023-10-02 16:04:28,461 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing f4e8e41d186c31dbeea9929d34bd20db, disabling compactions & flushes 2023-10-02 16:04:28,461 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,2,1696262667610.79a8c3e6fba6c6c73e80bcbb09e57cad. 2023-10-02 16:04:28,461 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,,1696262667610.f4e8e41d186c31dbeea9929d34bd20db. 2023-10-02 16:04:28,461 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1696262667610.79a8c3e6fba6c6c73e80bcbb09e57cad. 2023-10-02 16:04:28,461 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1696262667610.f4e8e41d186c31dbeea9929d34bd20db. 2023-10-02 16:04:28,462 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1696262667610.79a8c3e6fba6c6c73e80bcbb09e57cad. after waiting 0 ms 2023-10-02 16:04:28,462 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,2,1696262667610.79a8c3e6fba6c6c73e80bcbb09e57cad. 2023-10-02 16:04:28,462 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1696262667610.f4e8e41d186c31dbeea9929d34bd20db. after waiting 0 ms 2023-10-02 16:04:28,462 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 79a8c3e6fba6c6c73e80bcbb09e57cad 1/1 column families, dataSize=24 B heapSize=352 B 2023-10-02 16:04:28,462 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,,1696262667610.f4e8e41d186c31dbeea9929d34bd20db. 2023-10-02 16:04:28,462 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing f4e8e41d186c31dbeea9929d34bd20db 1/1 column families, dataSize=24 B heapSize=352 B 2023-10-02 16:04:28,483 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=24 B at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/f4e8e41d186c31dbeea9929d34bd20db/.tmp/cf/9ea63fe7b37a47d48cc0886a0bdafec3 2023-10-02 16:04:28,484 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=24 B at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/79a8c3e6fba6c6c73e80bcbb09e57cad/.tmp/cf/381aa86ea6df43419ef7980a5d1ff732 2023-10-02 16:04:28,493 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/f4e8e41d186c31dbeea9929d34bd20db/.tmp/cf/9ea63fe7b37a47d48cc0886a0bdafec3 as hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/f4e8e41d186c31dbeea9929d34bd20db/cf/9ea63fe7b37a47d48cc0886a0bdafec3 2023-10-02 16:04:28,498 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/79a8c3e6fba6c6c73e80bcbb09e57cad/.tmp/cf/381aa86ea6df43419ef7980a5d1ff732 as hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/79a8c3e6fba6c6c73e80bcbb09e57cad/cf/381aa86ea6df43419ef7980a5d1ff732 2023-10-02 16:04:28,500 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/f4e8e41d186c31dbeea9929d34bd20db/cf/9ea63fe7b37a47d48cc0886a0bdafec3, entries=1, sequenceid=5, filesize=4.7 K 2023-10-02 16:04:28,502 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~24 B/24, heapSize ~336 B/336, currentSize=0 B/0 for f4e8e41d186c31dbeea9929d34bd20db in 40ms, sequenceid=5, compaction requested=false 2023-10-02 16:04:28,502 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithMergeRegion-1' 2023-10-02 16:04:28,509 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/79a8c3e6fba6c6c73e80bcbb09e57cad/cf/381aa86ea6df43419ef7980a5d1ff732, entries=1, sequenceid=5, filesize=4.7 K 2023-10-02 16:04:28,510 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~24 B/24, heapSize ~336 B/336, currentSize=0 B/0 for 79a8c3e6fba6c6c73e80bcbb09e57cad in 48ms, sequenceid=5, compaction requested=false 2023-10-02 16:04:28,519 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/f4e8e41d186c31dbeea9929d34bd20db/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=1 2023-10-02 16:04:28,520 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-10-02 16:04:28,520 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,,1696262667610.f4e8e41d186c31dbeea9929d34bd20db. 2023-10-02 16:04:28,520 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for f4e8e41d186c31dbeea9929d34bd20db: 2023-10-02 16:04:28,521 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/79a8c3e6fba6c6c73e80bcbb09e57cad/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=1 2023-10-02 16:04:28,522 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-10-02 16:04:28,522 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,2,1696262667610.79a8c3e6fba6c6c73e80bcbb09e57cad. 2023-10-02 16:04:28,522 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 79a8c3e6fba6c6c73e80bcbb09e57cad: 2023-10-02 16:04:28,523 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=72 updating hbase:meta row=f4e8e41d186c31dbeea9929d34bd20db, regionState=CLOSED 2023-10-02 16:04:28,523 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1696262667610.f4e8e41d186c31dbeea9929d34bd20db.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1696262668523"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696262668523"}]},"ts":"1696262668523"} 2023-10-02 16:04:28,525 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed f4e8e41d186c31dbeea9929d34bd20db 2023-10-02 16:04:28,525 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 79a8c3e6fba6c6c73e80bcbb09e57cad 2023-10-02 16:04:28,526 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=73 updating hbase:meta row=79a8c3e6fba6c6c73e80bcbb09e57cad, regionState=CLOSED 2023-10-02 16:04:28,526 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1696262667610.79a8c3e6fba6c6c73e80bcbb09e57cad.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1696262668526"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696262668526"}]},"ts":"1696262668526"} 2023-10-02 16:04:28,528 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=74, resume processing ppid=72 2023-10-02 16:04:28,528 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=74, ppid=72, state=SUCCESS; CloseRegionProcedure f4e8e41d186c31dbeea9929d34bd20db, server=jenkins-hbase4.apache.org,43801,1696262558835 in 221 msec 2023-10-02 16:04:28,531 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=72, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=f4e8e41d186c31dbeea9929d34bd20db, UNASSIGN in 234 msec 2023-10-02 16:04:28,531 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=75, resume processing ppid=73 2023-10-02 16:04:28,531 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=75, ppid=73, state=SUCCESS; CloseRegionProcedure 79a8c3e6fba6c6c73e80bcbb09e57cad, server=jenkins-hbase4.apache.org,37455,1696262558909 in 222 msec 2023-10-02 16:04:28,533 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=73, resume processing ppid=71 2023-10-02 16:04:28,533 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=73, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=79a8c3e6fba6c6c73e80bcbb09e57cad, UNASSIGN in 234 msec 2023-10-02 16:04:28,573 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44227] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-10-02 16:04:28,595 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a335a48ab8099050de157d0f0734dbed/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=-1 2023-10-02 16:04:28,601 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1696262667610.f4e8e41d186c31dbeea9929d34bd20db.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"9223372036854775807"}]},"ts":"9223372036854775807"} 2023-10-02 16:04:28,601 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1696262667610.79a8c3e6fba6c6c73e80bcbb09e57cad.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"9223372036854775807"}]},"ts":"9223372036854775807"} 2023-10-02 16:04:28,601 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":7,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1696262667611.a335a48ab8099050de157d0f0734dbed.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"9223372036854775807"},{"qualifier":"merge0000","vlen":84,"tag":[],"timestamp":"9223372036854775807"},{"qualifier":"merge0001","vlen":84,"tag":[],"timestamp":"9223372036854775807"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"9223372036854775807"}]},"ts":"9223372036854775807"} 2023-10-02 16:04:28,671 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=76, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=a335a48ab8099050de157d0f0734dbed, ASSIGN}] 2023-10-02 16:04:28,673 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=76, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=a335a48ab8099050de157d0f0734dbed, ASSIGN 2023-10-02 16:04:28,674 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=76, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=a335a48ab8099050de157d0f0734dbed, ASSIGN; state=MERGED, location=jenkins-hbase4.apache.org,43801,1696262558835; forceNewPlan=false, retain=false 2023-10-02 16:04:28,824 INFO [jenkins-hbase4:44227] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-10-02 16:04:28,826 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=76 updating hbase:meta row=a335a48ab8099050de157d0f0734dbed, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,43801,1696262558835 2023-10-02 16:04:28,826 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1696262667611.a335a48ab8099050de157d0f0734dbed.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1696262668826"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696262668826"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696262668826"}]},"ts":"1696262668826"} 2023-10-02 16:04:28,828 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=77, ppid=76, state=RUNNABLE; OpenRegionProcedure a335a48ab8099050de157d0f0734dbed, server=jenkins-hbase4.apache.org,43801,1696262558835}] 2023-10-02 16:04:28,874 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44227] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-10-02 16:04:28,985 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion-1,,1696262667611.a335a48ab8099050de157d0f0734dbed. 2023-10-02 16:04:28,985 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => a335a48ab8099050de157d0f0734dbed, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1696262667611.a335a48ab8099050de157d0f0734dbed.', STARTKEY => '', ENDKEY => ''} 2023-10-02 16:04:28,986 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion-1,,1696262667611.a335a48ab8099050de157d0f0734dbed. service=AccessControlService 2023-10-02 16:04:28,986 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-10-02 16:04:28,986 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion-1 a335a48ab8099050de157d0f0734dbed 2023-10-02 16:04:28,986 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,,1696262667611.a335a48ab8099050de157d0f0734dbed.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-02 16:04:28,986 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for a335a48ab8099050de157d0f0734dbed 2023-10-02 16:04:28,986 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for a335a48ab8099050de157d0f0734dbed 2023-10-02 16:04:28,987 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(950): Rewriting .regioninfo file at: hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a335a48ab8099050de157d0f0734dbed/.regioninfo 2023-10-02 16:04:29,002 INFO [StoreOpener-a335a48ab8099050de157d0f0734dbed-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region a335a48ab8099050de157d0f0734dbed 2023-10-02 16:04:29,003 DEBUG [StoreOpener-a335a48ab8099050de157d0f0734dbed-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a335a48ab8099050de157d0f0734dbed/cf 2023-10-02 16:04:29,004 DEBUG [StoreOpener-a335a48ab8099050de157d0f0734dbed-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a335a48ab8099050de157d0f0734dbed/cf 2023-10-02 16:04:29,004 INFO [StoreOpener-a335a48ab8099050de157d0f0734dbed-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region a335a48ab8099050de157d0f0734dbed columnFamilyName cf 2023-10-02 16:04:29,038 DEBUG [StoreOpener-a335a48ab8099050de157d0f0734dbed-1] regionserver.HStore(539): loaded hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a335a48ab8099050de157d0f0734dbed/cf/381aa86ea6df43419ef7980a5d1ff732.79a8c3e6fba6c6c73e80bcbb09e57cad->hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/79a8c3e6fba6c6c73e80bcbb09e57cad/cf/381aa86ea6df43419ef7980a5d1ff732-top 2023-10-02 16:04:29,045 DEBUG [StoreOpener-a335a48ab8099050de157d0f0734dbed-1] regionserver.HStore(539): loaded hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a335a48ab8099050de157d0f0734dbed/cf/9ea63fe7b37a47d48cc0886a0bdafec3.f4e8e41d186c31dbeea9929d34bd20db->hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/f4e8e41d186c31dbeea9929d34bd20db/cf/9ea63fe7b37a47d48cc0886a0bdafec3-top 2023-10-02 16:04:29,046 INFO [StoreOpener-a335a48ab8099050de157d0f0734dbed-1] regionserver.HStore(310): Store=a335a48ab8099050de157d0f0734dbed/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-02 16:04:29,047 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a335a48ab8099050de157d0f0734dbed 2023-10-02 16:04:29,048 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a335a48ab8099050de157d0f0734dbed 2023-10-02 16:04:29,052 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for a335a48ab8099050de157d0f0734dbed 2023-10-02 16:04:29,053 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened a335a48ab8099050de157d0f0734dbed; next sequenceid=9; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65815388, jitterRate=-0.01927429437637329}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-10-02 16:04:29,053 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for a335a48ab8099050de157d0f0734dbed: 2023-10-02 16:04:29,054 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion-1,,1696262667611.a335a48ab8099050de157d0f0734dbed., pid=77, masterSystemTime=1696262668980 2023-10-02 16:04:29,055 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.CompactSplit(328): Ignoring compaction request for testtb-testExportFileSystemStateWithMergeRegion-1,,1696262667611.a335a48ab8099050de157d0f0734dbed.,because compaction is disabled. 2023-10-02 16:04:29,056 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion-1,,1696262667611.a335a48ab8099050de157d0f0734dbed. 2023-10-02 16:04:29,056 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion-1,,1696262667611.a335a48ab8099050de157d0f0734dbed. 2023-10-02 16:04:29,057 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=76 updating hbase:meta row=a335a48ab8099050de157d0f0734dbed, regionState=OPEN, openSeqNum=9, regionLocation=jenkins-hbase4.apache.org,43801,1696262558835 2023-10-02 16:04:29,057 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1696262667611.a335a48ab8099050de157d0f0734dbed.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1696262669057"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1696262669057"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1696262669057"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1696262669057"}]},"ts":"1696262669057"} 2023-10-02 16:04:29,060 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=77, resume processing ppid=76 2023-10-02 16:04:29,060 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=77, ppid=76, state=SUCCESS; OpenRegionProcedure a335a48ab8099050de157d0f0734dbed, server=jenkins-hbase4.apache.org,43801,1696262558835 in 231 msec 2023-10-02 16:04:29,062 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=76, resume processing ppid=71 2023-10-02 16:04:29,062 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=76, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=a335a48ab8099050de157d0f0734dbed, ASSIGN in 389 msec 2023-10-02 16:04:29,064 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=71, state=SUCCESS; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[f4e8e41d186c31dbeea9929d34bd20db, 79a8c3e6fba6c6c73e80bcbb09e57cad], force=true in 806 msec 2023-10-02 16:04:29,376 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44227] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-10-02 16:04:29,376 INFO [Listener at jenkins-hbase4.apache.org/32975] client.HBaseAdmin$TableFuture(3541): Operation: MERGE_REGIONS, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 71 completed 2023-10-02 16:04:29,377 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44227] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } 2023-10-02 16:04:29,377 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44227] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1696262669377 (current time:1696262669377). 2023-10-02 16:04:29,377 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44227] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-10-02 16:04:29,379 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44227] zookeeper.ReadOnlyZKClient(139): Connect 0x70271bd7 to 127.0.0.1:50210 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-02 16:04:29,388 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44227] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@117dd291, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-02 16:04:29,390 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44227] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-02 16:04:29,392 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:37118, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-02 16:04:29,393 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44227] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x70271bd7 to 127.0.0.1:50210 2023-10-02 16:04:29,393 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44227] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-02 16:04:29,395 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44227] zookeeper.ReadOnlyZKClient(139): Connect 0x09196c82 to 127.0.0.1:50210 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-02 16:04:29,403 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44227] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@412827d5, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-02 16:04:29,406 DEBUG [hconnection-0x3ebe9c3b-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-02 16:04:29,410 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:37130, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-02 16:04:29,417 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44227] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x09196c82 to 127.0.0.1:50210 2023-10-02 16:04:29,417 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44227] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-02 16:04:29,418 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44227] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion-1], kv [jenkins: RWXCA] 2023-10-02 16:04:29,418 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44227] snapshot.SnapshotManager(637): No existing snapshot, attempting snapshot... 2023-10-02 16:04:29,419 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44227] snapshot.SnapshotManager(684): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } 2023-10-02 16:04:29,423 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44227] snapshot.SnapshotManager(519): Unable to retrieve ACL status for path: hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/.hbase-snapshot, current working dir path: hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 org.apache.hadoop.hdfs.protocol.AclException: The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.ipc.RemoteException.instantiateException(RemoteException.java:121) at org.apache.hadoop.ipc.RemoteException.unwrapRemoteException(RemoteException.java:88) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2736) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2294) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2291) at org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81) at org.apache.hadoop.hdfs.DistributedFileSystem.getAclStatus(DistributedFileSystem.java:2291) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.updateWorkingDirAclsIfRequired(SnapshotManager.java:517) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.prepareToTakeSnapshot(SnapshotManager.java:490) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.snapshotEnabledTable(SnapshotManager.java:559) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshotInternal(SnapshotManager.java:687) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshot(SnapshotManager.java:623) at org.apache.hadoop.hbase.master.MasterRpcServices.snapshot(MasterRpcServices.java:1588) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) Caused by: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.hdfs.protocol.AclException): The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at org.apache.hadoop.ipc.Client.getRpcResponse(Client.java:1540) at org.apache.hadoop.ipc.Client.call(Client.java:1486) at org.apache.hadoop.ipc.Client.call(Client.java:1385) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:232) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:118) at com.sun.proxy.$Proxy32.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.getAclStatus(ClientNamenodeProtocolTranslatorPB.java:1385) at sun.reflect.GeneratedMethodAccessor63.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:422) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeMethod(RetryInvocationHandler.java:165) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invoke(RetryInvocationHandler.java:157) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeOnce(RetryInvocationHandler.java:95) at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:359) at com.sun.proxy.$Proxy35.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor63.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor63.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor63.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor63.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor63.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2734) ... 15 more 2023-10-02 16:04:29,425 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44227] procedure2.ProcedureExecutor(1028): Stored pid=78, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE 2023-10-02 16:04:29,427 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=78, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE 2023-10-02 16:04:29,428 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=78, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE; timeout=600000, timestamp=1696263269428 2023-10-02 16:04:29,433 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44227] snapshot.SnapshotManager(689): Started snapshot: { ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } 2023-10-02 16:04:29,433 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion-1 2023-10-02 16:04:29,433 DEBUG [Listener at jenkins-hbase4.apache.org/32975] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-10-02 16:04:29,434 DEBUG [Listener at jenkins-hbase4.apache.org/32975] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-10-02 16:04:29,440 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=78, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE 2023-10-02 16:04:29,441 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=79, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED 2023-10-02 16:04:29,446 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=78, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE in 17 msec 2023-10-02 16:04:29,448 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=79, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED 2023-10-02 16:04:29,449 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=79, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED; timeout=600000, timestamp=1696263269449 2023-10-02 16:04:29,468 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-02 16:04:29,468 INFO [(jenkins-hbase4.apache.org,44227,1696262556745)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' 2023-10-02 16:04:29,468 DEBUG [(jenkins-hbase4.apache.org,44227,1696262556745)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-02 16:04:29,470 DEBUG [(jenkins-hbase4.apache.org,44227,1696262556745)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' 2023-10-02 16:04:29,470 DEBUG [(jenkins-hbase4.apache.org,44227,1696262556745)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1', kicking off acquire phase on members. 2023-10-02 16:04:29,471 DEBUG [(jenkins-hbase4.apache.org,44227,1696262556745)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44227-0x10107dfc1490000, quorum=127.0.0.1:50210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-02 16:04:29,471 DEBUG [(jenkins-hbase4.apache.org,44227,1696262556745)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-02 16:04:29,472 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): regionserver:37455-0x10107dfc1490002, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-02 16:04:29,472 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-02 16:04:29,472 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-02 16:04:29,472 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): regionserver:43801-0x10107dfc1490001, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-02 16:04:29,473 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): regionserver:42303-0x10107dfc1490003, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-02 16:04:29,473 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-02 16:04:29,473 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-02 16:04:29,473 DEBUG [(jenkins-hbase4.apache.org,44227,1696262556745)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,43801,1696262558835 2023-10-02 16:04:29,473 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-02 16:04:29,473 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-02 16:04:29,477 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-02 16:04:29,477 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-02 16:04:29,477 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-02 16:04:29,477 DEBUG [(jenkins-hbase4.apache.org,44227,1696262556745)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44227-0x10107dfc1490000, quorum=127.0.0.1:50210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,43801,1696262558835 2023-10-02 16:04:29,478 DEBUG [(jenkins-hbase4.apache.org,44227,1696262556745)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-02 16:04:29,478 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42303-0x10107dfc1490003, quorum=127.0.0.1:50210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-02 16:04:29,478 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37455-0x10107dfc1490002, quorum=127.0.0.1:50210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-02 16:04:29,478 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43801-0x10107dfc1490001, quorum=127.0.0.1:50210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-02 16:04:29,478 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 220 2023-10-02 16:04:29,478 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-02 16:04:29,479 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 220 2023-10-02 16:04:29,479 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-02 16:04:29,479 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 from table testtb-testExportFileSystemStateWithMergeRegion-1 type FLUSH 2023-10-02 16:04:29,478 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 220 2023-10-02 16:04:29,479 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-02 16:04:29,479 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 from table testtb-testExportFileSystemStateWithMergeRegion-1 type FLUSH 2023-10-02 16:04:29,479 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 from table testtb-testExportFileSystemStateWithMergeRegion-1 type FLUSH 2023-10-02 16:04:29,481 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-02 16:04:29,481 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-02 16:04:29,481 DEBUG [member: 'jenkins-hbase4.apache.org,37455,1696262558909' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' with timeout 300000ms 2023-10-02 16:04:29,481 DEBUG [member: 'jenkins-hbase4.apache.org,37455,1696262558909' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-02 16:04:29,481 DEBUG [member: 'jenkins-hbase4.apache.org,43801,1696262558835' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' with timeout 300000ms 2023-10-02 16:04:29,481 DEBUG [member: 'jenkins-hbase4.apache.org,43801,1696262558835' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-02 16:04:29,490 DEBUG [member: 'jenkins-hbase4.apache.org,37455,1696262558909' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' stage 2023-10-02 16:04:29,490 DEBUG [member: 'jenkins-hbase4.apache.org,37455,1696262558909' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally acquired 2023-10-02 16:04:29,490 DEBUG [member: 'jenkins-hbase4.apache.org,37455,1696262558909' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37455,1696262558909' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion-1) in zk 2023-10-02 16:04:29,490 DEBUG [member: 'jenkins-hbase4.apache.org,43801,1696262558835' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' stage 2023-10-02 16:04:29,490 DEBUG [member: 'jenkins-hbase4.apache.org,43801,1696262558835' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally acquired 2023-10-02 16:04:29,490 DEBUG [member: 'jenkins-hbase4.apache.org,43801,1696262558835' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43801,1696262558835' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion-1) in zk 2023-10-02 16:04:29,490 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-02 16:04:29,490 DEBUG [member: 'jenkins-hbase4.apache.org,42303,1696262558956' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' with timeout 300000ms 2023-10-02 16:04:29,490 DEBUG [member: 'jenkins-hbase4.apache.org,42303,1696262558956' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-02 16:04:29,492 DEBUG [member: 'jenkins-hbase4.apache.org,42303,1696262558956' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' stage 2023-10-02 16:04:29,492 DEBUG [member: 'jenkins-hbase4.apache.org,42303,1696262558956' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally acquired 2023-10-02 16:04:29,492 DEBUG [member: 'jenkins-hbase4.apache.org,42303,1696262558956' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42303,1696262558956' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion-1) in zk 2023-10-02 16:04:29,495 DEBUG [member: 'jenkins-hbase4.apache.org,37455,1696262558909' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-02 16:04:29,495 DEBUG [member: 'jenkins-hbase4.apache.org,42303,1696262558956' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-02 16:04:29,495 DEBUG [member: 'jenkins-hbase4.apache.org,37455,1696262558909' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37455-0x10107dfc1490002, quorum=127.0.0.1:50210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-02 16:04:29,496 DEBUG [member: 'jenkins-hbase4.apache.org,43801,1696262558835' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-02 16:04:29,496 DEBUG [member: 'jenkins-hbase4.apache.org,37455,1696262558909' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-02 16:04:29,496 DEBUG [member: 'jenkins-hbase4.apache.org,43801,1696262558835' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43801-0x10107dfc1490001, quorum=127.0.0.1:50210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-02 16:04:29,496 DEBUG [member: 'jenkins-hbase4.apache.org,42303,1696262558956' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42303-0x10107dfc1490003, quorum=127.0.0.1:50210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-02 16:04:29,496 DEBUG [member: 'jenkins-hbase4.apache.org,42303,1696262558956' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-02 16:04:29,496 DEBUG [member: 'jenkins-hbase4.apache.org,43801,1696262558835' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-02 16:04:29,497 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): master:44227-0x10107dfc1490000, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,43801,1696262558835 2023-10-02 16:04:29,497 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,43801,1696262558835 2023-10-02 16:04:29,497 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-02 16:04:29,497 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-02 16:04:29,498 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-02 16:04:29,501 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-02 16:04:29,502 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-02 16:04:29,503 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37455,1696262558909 2023-10-02 16:04:29,503 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42303,1696262558956 2023-10-02 16:04:29,503 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43801,1696262558835 2023-10-02 16:04:29,504 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-02 16:04:29,504 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43801,1696262558835' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' on coordinator 2023-10-02 16:04:29,504 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@19e24f42[Count = 0] remaining members to acquire global barrier 2023-10-02 16:04:29,504 DEBUG [(jenkins-hbase4.apache.org,44227,1696262556745)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'in-barrier' execution. 2023-10-02 16:04:29,504 DEBUG [(jenkins-hbase4.apache.org,44227,1696262556745)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-02 16:04:29,506 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): regionserver:42303-0x10107dfc1490003, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-02 16:04:29,506 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): regionserver:37455-0x10107dfc1490002, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-02 16:04:29,506 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-02 16:04:29,506 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-02 16:04:29,506 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-02 16:04:29,506 DEBUG [member: 'jenkins-hbase4.apache.org,37455,1696262558909' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' received 'reached' from coordinator. 2023-10-02 16:04:29,506 DEBUG [member: 'jenkins-hbase4.apache.org,37455,1696262558909' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally completed 2023-10-02 16:04:29,506 DEBUG [member: 'jenkins-hbase4.apache.org,37455,1696262558909' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed for member 'jenkins-hbase4.apache.org,37455,1696262558909' in zk 2023-10-02 16:04:29,506 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-02 16:04:29,507 DEBUG [member: 'jenkins-hbase4.apache.org,42303,1696262558956' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' received 'reached' from coordinator. 2023-10-02 16:04:29,507 DEBUG [member: 'jenkins-hbase4.apache.org,42303,1696262558956' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally completed 2023-10-02 16:04:29,507 DEBUG [(jenkins-hbase4.apache.org,44227,1696262556745)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44227-0x10107dfc1490000, quorum=127.0.0.1:50210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,43801,1696262558835 2023-10-02 16:04:29,507 DEBUG [(jenkins-hbase4.apache.org,44227,1696262556745)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-02 16:04:29,507 DEBUG [member: 'jenkins-hbase4.apache.org,42303,1696262558956' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed for member 'jenkins-hbase4.apache.org,42303,1696262558956' in zk 2023-10-02 16:04:29,507 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): regionserver:43801-0x10107dfc1490001, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-02 16:04:29,507 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-02 16:04:29,508 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-02 16:04:29,508 DEBUG [member: 'jenkins-hbase4.apache.org,43801,1696262558835' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' received 'reached' from coordinator. 2023-10-02 16:04:29,508 DEBUG [member: 'jenkins-hbase4.apache.org,43801,1696262558835' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-02 16:04:29,508 DEBUG [member: 'jenkins-hbase4.apache.org,43801,1696262558835' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-02 16:04:29,508 DEBUG [rs(jenkins-hbase4.apache.org,43801,1696262558835)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion-1,,1696262667611.a335a48ab8099050de157d0f0734dbed. 2023-10-02 16:04:29,508 DEBUG [rs(jenkins-hbase4.apache.org,43801,1696262558835)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion-1,,1696262667611.a335a48ab8099050de157d0f0734dbed. started... 2023-10-02 16:04:29,510 DEBUG [rs(jenkins-hbase4.apache.org,43801,1696262558835)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for a335a48ab8099050de157d0f0734dbed: 2023-10-02 16:04:29,510 DEBUG [member: 'jenkins-hbase4.apache.org,37455,1696262558909' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' has notified controller of completion 2023-10-02 16:04:29,510 DEBUG [member: 'jenkins-hbase4.apache.org,37455,1696262558909' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-02 16:04:29,510 DEBUG [member: 'jenkins-hbase4.apache.org,37455,1696262558909' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed. 2023-10-02 16:04:29,512 DEBUG [rs(jenkins-hbase4.apache.org,43801,1696262558835)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion-1,,1696262667611.a335a48ab8099050de157d0f0734dbed.' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-02 16:04:29,512 DEBUG [rs(jenkins-hbase4.apache.org,43801,1696262558835)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-02 16:04:29,513 DEBUG [rs(jenkins-hbase4.apache.org,43801,1696262558835)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a335a48ab8099050de157d0f0734dbed/cf/381aa86ea6df43419ef7980a5d1ff732.79a8c3e6fba6c6c73e80bcbb09e57cad->hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/79a8c3e6fba6c6c73e80bcbb09e57cad/cf/381aa86ea6df43419ef7980a5d1ff732-top, hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a335a48ab8099050de157d0f0734dbed/cf/9ea63fe7b37a47d48cc0886a0bdafec3.f4e8e41d186c31dbeea9929d34bd20db->hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/f4e8e41d186c31dbeea9929d34bd20db/cf/9ea63fe7b37a47d48cc0886a0bdafec3-top] hfiles 2023-10-02 16:04:29,513 DEBUG [rs(jenkins-hbase4.apache.org,43801,1696262558835)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/2): hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a335a48ab8099050de157d0f0734dbed/cf/381aa86ea6df43419ef7980a5d1ff732.79a8c3e6fba6c6c73e80bcbb09e57cad for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-02 16:04:29,514 DEBUG [rs(jenkins-hbase4.apache.org,43801,1696262558835)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (2/2): hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a335a48ab8099050de157d0f0734dbed/cf/9ea63fe7b37a47d48cc0886a0bdafec3.f4e8e41d186c31dbeea9929d34bd20db for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-02 16:04:29,514 DEBUG [member: 'jenkins-hbase4.apache.org,42303,1696262558956' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' has notified controller of completion 2023-10-02 16:04:29,514 DEBUG [member: 'jenkins-hbase4.apache.org,42303,1696262558956' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-02 16:04:29,514 DEBUG [member: 'jenkins-hbase4.apache.org,42303,1696262558956' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed. 2023-10-02 16:04:29,534 DEBUG [Listener at jenkins-hbase4.apache.org/32975] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-02 16:04:29,535 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44227] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } is done 2023-10-02 16:04:29,535 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44227] snapshot.SnapshotManager(406): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }' is still in progress! 2023-10-02 16:04:29,535 DEBUG [Listener at jenkins-hbase4.apache.org/32975] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-10-02 16:04:29,545 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696262569087_0004_000001 (auth:SIMPLE) 2023-10-02 16:04:29,549 DEBUG [rs(jenkins-hbase4.apache.org,43801,1696262558835)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion-1,,1696262667611.a335a48ab8099050de157d0f0734dbed. completed. 2023-10-02 16:04:29,551 DEBUG [rs(jenkins-hbase4.apache.org,43801,1696262558835)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion-1,,1696262667611.a335a48ab8099050de157d0f0734dbed. 2023-10-02 16:04:29,551 DEBUG [member: 'jenkins-hbase4.apache.org,43801,1696262558835' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-02 16:04:29,551 DEBUG [member: 'jenkins-hbase4.apache.org,43801,1696262558835' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-02 16:04:29,551 DEBUG [member: 'jenkins-hbase4.apache.org,43801,1696262558835' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,43801,1696262558835 2023-10-02 16:04:29,551 DEBUG [member: 'jenkins-hbase4.apache.org,43801,1696262558835' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally completed 2023-10-02 16:04:29,551 DEBUG [member: 'jenkins-hbase4.apache.org,43801,1696262558835' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed for member 'jenkins-hbase4.apache.org,43801,1696262558835' in zk 2023-10-02 16:04:29,563 DEBUG [member: 'jenkins-hbase4.apache.org,43801,1696262558835' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' has notified controller of completion 2023-10-02 16:04:29,563 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): master:44227-0x10107dfc1490000, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,43801,1696262558835 2023-10-02 16:04:29,563 DEBUG [member: 'jenkins-hbase4.apache.org,43801,1696262558835' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-02 16:04:29,563 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,43801,1696262558835 2023-10-02 16:04:29,563 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-02 16:04:29,563 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-02 16:04:29,563 DEBUG [member: 'jenkins-hbase4.apache.org,43801,1696262558835' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed. 2023-10-02 16:04:29,566 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-02 16:04:29,566 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-02 16:04:29,567 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-02 16:04:29,567 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37455,1696262558909 2023-10-02 16:04:29,569 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42303,1696262558956 2023-10-02 16:04:29,573 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43801,1696262558835 2023-10-02 16:04:29,573 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-02 16:04:29,574 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-02 16:04:29,574 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37455,1696262558909 2023-10-02 16:04:29,575 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42303,1696262558956 2023-10-02 16:04:29,577 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43801,1696262558835 2023-10-02 16:04:29,581 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' member 'jenkins-hbase4.apache.org,43801,1696262558835': 2023-10-02 16:04:29,581 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43801,1696262558835' released barrier for procedure'snaptb0-testExportFileSystemStateWithMergeRegion-1', counting down latch. Waiting for 0 more 2023-10-02 16:04:29,581 INFO [(jenkins-hbase4.apache.org,44227,1696262556745)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' execution completed 2023-10-02 16:04:29,581 DEBUG [(jenkins-hbase4.apache.org,44227,1696262556745)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-02 16:04:29,581 DEBUG [(jenkins-hbase4.apache.org,44227,1696262556745)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-02 16:04:29,582 DEBUG [(jenkins-hbase4.apache.org,44227,1696262556745)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-02 16:04:29,582 INFO [(jenkins-hbase4.apache.org,44227,1696262556745)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateWithMergeRegion-1including nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-10-02 16:04:29,591 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): regionserver:37455-0x10107dfc1490002, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-02 16:04:29,591 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): regionserver:43801-0x10107dfc1490001, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-02 16:04:29,591 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-02 16:04:29,591 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-02 16:04:29,591 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-02 16:04:29,591 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): master:44227-0x10107dfc1490000, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-02 16:04:29,591 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-02 16:04:29,592 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-02 16:04:29,592 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-02 16:04:29,592 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-02 16:04:29,591 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): regionserver:43801-0x10107dfc1490001, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-02 16:04:29,591 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): regionserver:37455-0x10107dfc1490002, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-02 16:04:29,591 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): regionserver:42303-0x10107dfc1490003, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-02 16:04:29,592 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): regionserver:42303-0x10107dfc1490003, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-02 16:04:29,592 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-02 16:04:29,592 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-02 16:04:29,592 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-02 16:04:29,592 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-02 16:04:29,592 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-02 16:04:29,592 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-02 16:04:29,593 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-02 16:04:29,593 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-02 16:04:29,593 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-02 16:04:29,594 DEBUG [(jenkins-hbase4.apache.org,44227,1696262556745)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44227-0x10107dfc1490000, quorum=127.0.0.1:50210, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,37455,1696262558909 2023-10-02 16:04:29,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-02 16:04:29,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-02 16:04:29,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-02 16:04:29,597 DEBUG [(jenkins-hbase4.apache.org,44227,1696262556745)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44227-0x10107dfc1490000, quorum=127.0.0.1:50210, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,42303,1696262558956 2023-10-02 16:04:29,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-02 16:04:29,597 DEBUG [(jenkins-hbase4.apache.org,44227,1696262556745)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44227-0x10107dfc1490000, quorum=127.0.0.1:50210, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,43801,1696262558835 2023-10-02 16:04:29,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-02 16:04:29,598 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-02 16:04:29,600 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37455,1696262558909 2023-10-02 16:04:29,601 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42303,1696262558956 2023-10-02 16:04:29,601 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43801,1696262558835 2023-10-02 16:04:29,602 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-02 16:04:29,602 DEBUG [(jenkins-hbase4.apache.org,44227,1696262556745)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44227-0x10107dfc1490000, quorum=127.0.0.1:50210, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,37455,1696262558909 2023-10-02 16:04:29,602 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-02 16:04:29,602 DEBUG [(jenkins-hbase4.apache.org,44227,1696262556745)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44227-0x10107dfc1490000, quorum=127.0.0.1:50210, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,42303,1696262558956 2023-10-02 16:04:29,603 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37455,1696262558909 2023-10-02 16:04:29,603 DEBUG [(jenkins-hbase4.apache.org,44227,1696262556745)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44227-0x10107dfc1490000, quorum=127.0.0.1:50210, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,43801,1696262558835 2023-10-02 16:04:29,603 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42303,1696262558956 2023-10-02 16:04:29,603 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43801,1696262558835 2023-10-02 16:04:29,607 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): regionserver:37455-0x10107dfc1490002, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-02 16:04:29,607 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-02 16:04:29,607 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-02 16:04:29,607 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): regionserver:42303-0x10107dfc1490003, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-02 16:04:29,607 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): regionserver:42303-0x10107dfc1490003, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-02 16:04:29,608 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-02 16:04:29,608 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-02 16:04:29,608 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): regionserver:43801-0x10107dfc1490001, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-02 16:04:29,608 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): regionserver:43801-0x10107dfc1490001, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-02 16:04:29,608 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-02 16:04:29,608 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): regionserver:37455-0x10107dfc1490002, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-02 16:04:29,608 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-02 16:04:29,608 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): master:44227-0x10107dfc1490000, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,43801,1696262558835 2023-10-02 16:04:29,608 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): master:44227-0x10107dfc1490000, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-02 16:04:29,608 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): master:44227-0x10107dfc1490000, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,42303,1696262558956 2023-10-02 16:04:29,608 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): master:44227-0x10107dfc1490000, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,37455,1696262558909 2023-10-02 16:04:29,608 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): master:44227-0x10107dfc1490000, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-02 16:04:29,608 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): master:44227-0x10107dfc1490000, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,43801,1696262558835 2023-10-02 16:04:29,608 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-02 16:04:29,608 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-02 16:04:29,608 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): master:44227-0x10107dfc1490000, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-02 16:04:29,609 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): master:44227-0x10107dfc1490000, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,42303,1696262558956 2023-10-02 16:04:29,609 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): master:44227-0x10107dfc1490000, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,37455,1696262558909 2023-10-02 16:04:29,609 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): master:44227-0x10107dfc1490000, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-02 16:04:29,608 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-02 16:04:29,609 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-02 16:04:29,609 DEBUG [(jenkins-hbase4.apache.org,44227,1696262556745)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-02 16:04:29,609 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): master:44227-0x10107dfc1490000, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-02 16:04:29,609 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-02 16:04:29,609 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-02 16:04:29,609 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-02 16:04:29,609 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-02 16:04:29,617 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-02 16:04:29,668 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 to hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-02 16:04:29,669 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 of table testtb-testExportFileSystemStateWithMergeRegion-1 completed 2023-10-02 16:04:29,669 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-02 16:04:29,670 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-02 16:04:29,670 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion-1 at 1696262669433Consolidate snapshot: snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1696262669609 (+176 ms)Loading Region manifests for snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1696262669609Writing data manifest for snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1696262669626 (+17 ms)Verifying snapshot: snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1696262669656 (+30 ms)Snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 of table testtb-testExportFileSystemStateWithMergeRegion-1 completed at 1696262669669 (+13 ms) 2023-10-02 16:04:29,674 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=79, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED 2023-10-02 16:04:29,679 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=79, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED in 236 msec 2023-10-02 16:04:29,737 DEBUG [Listener at jenkins-hbase4.apache.org/32975] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-02 16:04:29,738 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44227] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } is done 2023-10-02 16:04:29,738 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44227] snapshot.SnapshotManager(403): Snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }' has completed, notifying client. 2023-10-02 16:04:29,739 INFO [Listener at jenkins-hbase4.apache.org/32975] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/export-test/export-1696262669739 2023-10-02 16:04:29,739 INFO [Listener at jenkins-hbase4.apache.org/32975] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:42119, tgtDir=hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/export-test/export-1696262669739, rawTgtDir=hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/export-test/export-1696262669739, srcFsUri=hdfs://localhost:42119, srcDir=hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af 2023-10-02 16:04:29,786 DEBUG [Listener at jenkins-hbase4.apache.org/32975] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:42119, inputRoot=hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af 2023-10-02 16:04:29,787 DEBUG [Listener at jenkins-hbase4.apache.org/32975] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_749454151_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/export-test/export-1696262669739, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/export-test/export-1696262669739/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-02 16:04:29,787 INFO [Listener at jenkins-hbase4.apache.org/32975] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:42119, inputRoot=hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af, snapshotDir=hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1. 2023-10-02 16:04:29,805 INFO [Listener at jenkins-hbase4.apache.org/32975] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 to hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/export-test/export-1696262669739/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-02 16:04:29,848 DEBUG [Listener at jenkins-hbase4.apache.org/32975] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-10-02 16:04:29,848 DEBUG [Listener at jenkins-hbase4.apache.org/32975] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-10-02 16:04:29,849 DEBUG [Listener at jenkins-hbase4.apache.org/32975] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-10-02 16:04:29,849 DEBUG [Listener at jenkins-hbase4.apache.org/32975] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-10-02 16:04:30,743 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-10-02 16:04:31,020 DEBUG [Listener at jenkins-hbase4.apache.org/32975] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ec4ab044-456e-ce77-098f-f91b72a3e0ab/hadoop-2228871970562573046.jar 2023-10-02 16:04:31,021 DEBUG [Listener at jenkins-hbase4.apache.org/32975] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-10-02 16:04:31,021 DEBUG [Listener at jenkins-hbase4.apache.org/32975] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-10-02 16:04:31,102 DEBUG [Listener at jenkins-hbase4.apache.org/32975] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ec4ab044-456e-ce77-098f-f91b72a3e0ab/hadoop-5626700961292372317.jar 2023-10-02 16:04:31,102 DEBUG [Listener at jenkins-hbase4.apache.org/32975] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-10-02 16:04:31,103 DEBUG [Listener at jenkins-hbase4.apache.org/32975] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-10-02 16:04:31,103 DEBUG [Listener at jenkins-hbase4.apache.org/32975] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-10-02 16:04:31,103 DEBUG [Listener at jenkins-hbase4.apache.org/32975] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-10-02 16:04:31,104 DEBUG [Listener at jenkins-hbase4.apache.org/32975] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-10-02 16:04:31,104 DEBUG [Listener at jenkins-hbase4.apache.org/32975] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-10-02 16:04:31,105 DEBUG [Listener at jenkins-hbase4.apache.org/32975] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-10-02 16:04:31,105 DEBUG [Listener at jenkins-hbase4.apache.org/32975] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-10-02 16:04:31,105 DEBUG [Listener at jenkins-hbase4.apache.org/32975] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-10-02 16:04:31,106 DEBUG [Listener at jenkins-hbase4.apache.org/32975] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-10-02 16:04:31,106 DEBUG [Listener at jenkins-hbase4.apache.org/32975] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-10-02 16:04:31,106 DEBUG [Listener at jenkins-hbase4.apache.org/32975] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-10-02 16:04:31,107 DEBUG [Listener at jenkins-hbase4.apache.org/32975] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-10-02 16:04:31,107 DEBUG [Listener at jenkins-hbase4.apache.org/32975] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-10-02 16:04:31,107 DEBUG [Listener at jenkins-hbase4.apache.org/32975] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-10-02 16:04:31,108 DEBUG [Listener at jenkins-hbase4.apache.org/32975] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-10-02 16:04:31,108 DEBUG [Listener at jenkins-hbase4.apache.org/32975] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-02 16:04:31,109 DEBUG [Listener at jenkins-hbase4.apache.org/32975] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-02 16:04:31,109 DEBUG [Listener at jenkins-hbase4.apache.org/32975] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-10-02 16:04:31,110 DEBUG [Listener at jenkins-hbase4.apache.org/32975] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-02 16:04:31,110 DEBUG [Listener at jenkins-hbase4.apache.org/32975] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-02 16:04:31,110 DEBUG [Listener at jenkins-hbase4.apache.org/32975] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-10-02 16:04:31,111 DEBUG [Listener at jenkins-hbase4.apache.org/32975] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-10-02 16:04:32,296 WARN [Listener at jenkins-hbase4.apache.org/32975] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-10-02 16:04:32,299 INFO [Listener at jenkins-hbase4.apache.org/32975] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportFileSystemStateWithMergeRegion-1' hfile list 2023-10-02 16:04:32,301 DEBUG [Listener at jenkins-hbase4.apache.org/32975] snapshot.ExportSnapshot(671): export split=0 size=9.5 K 2023-10-02 16:04:32,368 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-10-02 16:04:32,368 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-10-02 16:04:32,533 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696262569087_0005_000001 (auth:SIMPLE) 2023-10-02 16:04:37,107 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696262569087_0005_000001 (auth:SIMPLE) 2023-10-02 16:04:39,336 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696262569087_0005_000001 (auth:SIMPLE) 2023-10-02 16:04:42,039 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696262569087_0005_000001 (auth:SIMPLE) 2023-10-02 16:04:43,484 INFO [Listener at jenkins-hbase4.apache.org/32975] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-10-02 16:04:43,485 INFO [Listener at jenkins-hbase4.apache.org/32975] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-10-02 16:04:43,493 INFO [Listener at jenkins-hbase4.apache.org/32975] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-02 16:04:43,493 INFO [Listener at jenkins-hbase4.apache.org/32975] snapshot.TestExportSnapshot(279): Exported snapshot 2023-10-02 16:04:43,494 INFO [Listener at jenkins-hbase4.apache.org/32975] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-10-02 16:04:43,494 DEBUG [Listener at jenkins-hbase4.apache.org/32975] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_95248091_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 at hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-02 16:04:43,494 DEBUG [Listener at jenkins-hbase4.apache.org/32975] snapshot.TestExportSnapshot(367): hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/.snapshotinfo 2023-10-02 16:04:43,494 DEBUG [Listener at jenkins-hbase4.apache.org/32975] snapshot.TestExportSnapshot(367): hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/data.manifest 2023-10-02 16:04:43,495 DEBUG [Listener at jenkins-hbase4.apache.org/32975] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_95248091_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/export-test/export-1696262669739/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 at hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/export-test/export-1696262669739/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-02 16:04:43,495 DEBUG [Listener at jenkins-hbase4.apache.org/32975] snapshot.TestExportSnapshot(367): hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/export-test/export-1696262669739/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/.snapshotinfo 2023-10-02 16:04:43,495 DEBUG [Listener at jenkins-hbase4.apache.org/32975] snapshot.TestExportSnapshot(367): hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/export-test/export-1696262669739/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/data.manifest 2023-10-02 16:04:43,502 INFO [Listener at jenkins-hbase4.apache.org/32975] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemStateWithMergeRegion-1 2023-10-02 16:04:43,502 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44227] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemStateWithMergeRegion-1 2023-10-02 16:04:43,503 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44227] procedure2.ProcedureExecutor(1028): Stored pid=80, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-10-02 16:04:43,506 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44227] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-10-02 16:04:43,506 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696262683506"}]},"ts":"1696262683506"} 2023-10-02 16:04:43,508 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=DISABLING in hbase:meta 2023-10-02 16:04:43,509 INFO [PEWorker-2] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemStateWithMergeRegion-1 to state=DISABLING 2023-10-02 16:04:43,510 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=81, ppid=80, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=a335a48ab8099050de157d0f0734dbed, UNASSIGN}] 2023-10-02 16:04:43,511 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=81, ppid=80, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=a335a48ab8099050de157d0f0734dbed, UNASSIGN 2023-10-02 16:04:43,512 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=81 updating hbase:meta row=a335a48ab8099050de157d0f0734dbed, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,43801,1696262558835 2023-10-02 16:04:43,512 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1696262667611.a335a48ab8099050de157d0f0734dbed.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1696262683512"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696262683512"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696262683512"}]},"ts":"1696262683512"} 2023-10-02 16:04:43,515 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=82, ppid=81, state=RUNNABLE; CloseRegionProcedure a335a48ab8099050de157d0f0734dbed, server=jenkins-hbase4.apache.org,43801,1696262558835}] 2023-10-02 16:04:43,607 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44227] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-10-02 16:04:43,669 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close a335a48ab8099050de157d0f0734dbed 2023-10-02 16:04:43,669 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing a335a48ab8099050de157d0f0734dbed, disabling compactions & flushes 2023-10-02 16:04:43,669 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,,1696262667611.a335a48ab8099050de157d0f0734dbed. 2023-10-02 16:04:43,669 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1696262667611.a335a48ab8099050de157d0f0734dbed. 2023-10-02 16:04:43,669 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1696262667611.a335a48ab8099050de157d0f0734dbed. after waiting 0 ms 2023-10-02 16:04:43,669 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,,1696262667611.a335a48ab8099050de157d0f0734dbed. 2023-10-02 16:04:43,680 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a335a48ab8099050de157d0f0734dbed/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=8 2023-10-02 16:04:43,681 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-10-02 16:04:43,682 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,,1696262667611.a335a48ab8099050de157d0f0734dbed. 2023-10-02 16:04:43,682 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for a335a48ab8099050de157d0f0734dbed: 2023-10-02 16:04:43,683 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed a335a48ab8099050de157d0f0734dbed 2023-10-02 16:04:43,684 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=81 updating hbase:meta row=a335a48ab8099050de157d0f0734dbed, regionState=CLOSED 2023-10-02 16:04:43,684 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1696262667611.a335a48ab8099050de157d0f0734dbed.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1696262683683"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696262683683"}]},"ts":"1696262683683"} 2023-10-02 16:04:43,686 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=82, resume processing ppid=81 2023-10-02 16:04:43,687 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=82, ppid=81, state=SUCCESS; CloseRegionProcedure a335a48ab8099050de157d0f0734dbed, server=jenkins-hbase4.apache.org,43801,1696262558835 in 170 msec 2023-10-02 16:04:43,688 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=81, resume processing ppid=80 2023-10-02 16:04:43,688 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=81, ppid=80, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=a335a48ab8099050de157d0f0734dbed, UNASSIGN in 177 msec 2023-10-02 16:04:43,689 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696262683689"}]},"ts":"1696262683689"} 2023-10-02 16:04:43,690 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=DISABLED in hbase:meta 2023-10-02 16:04:43,692 INFO [PEWorker-4] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemStateWithMergeRegion-1 to state=DISABLED 2023-10-02 16:04:43,693 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=80, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 in 190 msec 2023-10-02 16:04:43,808 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44227] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-10-02 16:04:43,809 INFO [Listener at jenkins-hbase4.apache.org/32975] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 80 completed 2023-10-02 16:04:43,810 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44227] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemStateWithMergeRegion-1 2023-10-02 16:04:43,810 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44227] procedure2.ProcedureExecutor(1028): Stored pid=83, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-10-02 16:04:43,813 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=83, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-10-02 16:04:43,813 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44227] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemStateWithMergeRegion-1 2023-10-02 16:04:43,814 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=83, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-10-02 16:04:43,815 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=42303] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemStateWithMergeRegion-1 2023-10-02 16:04:43,819 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/79a8c3e6fba6c6c73e80bcbb09e57cad 2023-10-02 16:04:43,819 DEBUG [HFileArchiver-20] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/f4e8e41d186c31dbeea9929d34bd20db 2023-10-02 16:04:43,819 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): regionserver:43801-0x10107dfc1490001, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-10-02 16:04:43,819 DEBUG [HFileArchiver-19] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a335a48ab8099050de157d0f0734dbed 2023-10-02 16:04:43,819 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): regionserver:42303-0x10107dfc1490003, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-10-02 16:04:43,820 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): regionserver:37455-0x10107dfc1490002, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-10-02 16:04:43,820 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): master:44227-0x10107dfc1490000, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-10-02 16:04:43,820 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-10-02 16:04:43,820 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-10-02 16:04:43,820 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-10-02 16:04:43,820 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-10-02 16:04:43,822 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): regionserver:43801-0x10107dfc1490001, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-10-02 16:04:43,822 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): master:44227-0x10107dfc1490000, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-10-02 16:04:43,822 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): regionserver:37455-0x10107dfc1490002, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-10-02 16:04:43,822 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): regionserver:42303-0x10107dfc1490003, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-10-02 16:04:43,822 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): master:44227-0x10107dfc1490000, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-02 16:04:43,822 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): regionserver:43801-0x10107dfc1490001, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-02 16:04:43,822 DEBUG [HFileArchiver-13] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/79a8c3e6fba6c6c73e80bcbb09e57cad/cf, FileablePath, hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/79a8c3e6fba6c6c73e80bcbb09e57cad/recovered.edits] 2023-10-02 16:04:43,822 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): regionserver:42303-0x10107dfc1490003, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-02 16:04:43,822 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): regionserver:37455-0x10107dfc1490002, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-02 16:04:43,824 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-10-02 16:04:43,824 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-10-02 16:04:43,824 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-10-02 16:04:43,824 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-10-02 16:04:43,824 DEBUG [HFileArchiver-19] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a335a48ab8099050de157d0f0734dbed/cf, FileablePath, hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a335a48ab8099050de157d0f0734dbed/recovered.edits] 2023-10-02 16:04:43,825 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44227] master.MasterRpcServices(1230): Checking to see if procedure is done pid=83 2023-10-02 16:04:43,825 DEBUG [HFileArchiver-20] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/f4e8e41d186c31dbeea9929d34bd20db/cf, FileablePath, hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/f4e8e41d186c31dbeea9929d34bd20db/recovered.edits] 2023-10-02 16:04:43,828 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/79a8c3e6fba6c6c73e80bcbb09e57cad/cf/381aa86ea6df43419ef7980a5d1ff732 to hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/79a8c3e6fba6c6c73e80bcbb09e57cad/cf/381aa86ea6df43419ef7980a5d1ff732 2023-10-02 16:04:43,829 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a335a48ab8099050de157d0f0734dbed/cf/381aa86ea6df43419ef7980a5d1ff732.79a8c3e6fba6c6c73e80bcbb09e57cad to hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a335a48ab8099050de157d0f0734dbed/cf/381aa86ea6df43419ef7980a5d1ff732.79a8c3e6fba6c6c73e80bcbb09e57cad 2023-10-02 16:04:43,830 DEBUG [HFileArchiver-20] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/f4e8e41d186c31dbeea9929d34bd20db/cf/9ea63fe7b37a47d48cc0886a0bdafec3 to hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/f4e8e41d186c31dbeea9929d34bd20db/cf/9ea63fe7b37a47d48cc0886a0bdafec3 2023-10-02 16:04:43,831 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a335a48ab8099050de157d0f0734dbed/cf/9ea63fe7b37a47d48cc0886a0bdafec3.f4e8e41d186c31dbeea9929d34bd20db to hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a335a48ab8099050de157d0f0734dbed/cf/9ea63fe7b37a47d48cc0886a0bdafec3.f4e8e41d186c31dbeea9929d34bd20db 2023-10-02 16:04:43,832 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/79a8c3e6fba6c6c73e80bcbb09e57cad/recovered.edits/8.seqid to hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/79a8c3e6fba6c6c73e80bcbb09e57cad/recovered.edits/8.seqid 2023-10-02 16:04:43,832 DEBUG [HFileArchiver-13] backup.HFileArchiver(596): Deleted hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/79a8c3e6fba6c6c73e80bcbb09e57cad 2023-10-02 16:04:43,836 DEBUG [HFileArchiver-20] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/f4e8e41d186c31dbeea9929d34bd20db/recovered.edits/8.seqid to hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/f4e8e41d186c31dbeea9929d34bd20db/recovered.edits/8.seqid 2023-10-02 16:04:43,836 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a335a48ab8099050de157d0f0734dbed/recovered.edits/12.seqid to hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a335a48ab8099050de157d0f0734dbed/recovered.edits/12.seqid 2023-10-02 16:04:43,837 DEBUG [HFileArchiver-20] backup.HFileArchiver(596): Deleted hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/f4e8e41d186c31dbeea9929d34bd20db 2023-10-02 16:04:43,837 DEBUG [HFileArchiver-19] backup.HFileArchiver(596): Deleted hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a335a48ab8099050de157d0f0734dbed 2023-10-02 16:04:43,837 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion-1 regions 2023-10-02 16:04:43,839 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=83, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-10-02 16:04:43,842 WARN [PEWorker-2] procedure.DeleteTableProcedure(384): Deleting some vestigial 1 rows of testtb-testExportFileSystemStateWithMergeRegion-1 from hbase:meta 2023-10-02 16:04:43,845 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemStateWithMergeRegion-1' descriptor. 2023-10-02 16:04:43,847 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=83, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-10-02 16:04:43,847 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemStateWithMergeRegion-1' from region states. 2023-10-02 16:04:43,847 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1696262667611.a335a48ab8099050de157d0f0734dbed.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1696262683847"}]},"ts":"9223372036854775807"} 2023-10-02 16:04:43,850 INFO [PEWorker-2] hbase.MetaTableAccessor(1788): Deleted 1 regions from META 2023-10-02 16:04:43,850 DEBUG [PEWorker-2] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => a335a48ab8099050de157d0f0734dbed, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1696262667611.a335a48ab8099050de157d0f0734dbed.', STARTKEY => '', ENDKEY => ''}] 2023-10-02 16:04:43,850 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemStateWithMergeRegion-1' as deleted. 2023-10-02 16:04:43,851 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1696262683851"}]},"ts":"9223372036854775807"} 2023-10-02 16:04:43,855 INFO [PEWorker-2] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemStateWithMergeRegion-1 state from META 2023-10-02 16:04:43,858 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(130): Finished pid=83, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-10-02 16:04:43,859 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=83, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 in 48 msec 2023-10-02 16:04:43,926 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44227] master.MasterRpcServices(1230): Checking to see if procedure is done pid=83 2023-10-02 16:04:43,926 INFO [Listener at jenkins-hbase4.apache.org/32975] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 83 completed 2023-10-02 16:04:43,927 INFO [Listener at jenkins-hbase4.apache.org/32975] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemStateWithMergeRegion 2023-10-02 16:04:43,928 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44227] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemStateWithMergeRegion 2023-10-02 16:04:43,928 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44227] procedure2.ProcedureExecutor(1028): Stored pid=84, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-10-02 16:04:43,932 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44227] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-10-02 16:04:43,932 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696262683932"}]},"ts":"1696262683932"} 2023-10-02 16:04:43,934 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=DISABLING in hbase:meta 2023-10-02 16:04:43,936 INFO [PEWorker-3] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemStateWithMergeRegion to state=DISABLING 2023-10-02 16:04:43,936 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=85, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=d7920f8f17fa984e6c290238c625f96f, UNASSIGN}, {pid=86, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=0fdc05f251cdc4f8f198d3c8ca559208, UNASSIGN}] 2023-10-02 16:04:43,939 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=85, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=d7920f8f17fa984e6c290238c625f96f, UNASSIGN 2023-10-02 16:04:43,939 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=86, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=0fdc05f251cdc4f8f198d3c8ca559208, UNASSIGN 2023-10-02 16:04:43,940 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=85 updating hbase:meta row=d7920f8f17fa984e6c290238c625f96f, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,37455,1696262558909 2023-10-02 16:04:43,940 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=86 updating hbase:meta row=0fdc05f251cdc4f8f198d3c8ca559208, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,42303,1696262558956 2023-10-02 16:04:43,940 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1696262665448.d7920f8f17fa984e6c290238c625f96f.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1696262683940"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696262683940"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696262683940"}]},"ts":"1696262683940"} 2023-10-02 16:04:43,940 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1696262665448.0fdc05f251cdc4f8f198d3c8ca559208.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1696262683940"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696262683940"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696262683940"}]},"ts":"1696262683940"} 2023-10-02 16:04:43,942 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=87, ppid=85, state=RUNNABLE; CloseRegionProcedure d7920f8f17fa984e6c290238c625f96f, server=jenkins-hbase4.apache.org,37455,1696262558909}] 2023-10-02 16:04:43,943 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=88, ppid=86, state=RUNNABLE; CloseRegionProcedure 0fdc05f251cdc4f8f198d3c8ca559208, server=jenkins-hbase4.apache.org,42303,1696262558956}] 2023-10-02 16:04:44,033 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44227] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-10-02 16:04:44,094 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 0fdc05f251cdc4f8f198d3c8ca559208 2023-10-02 16:04:44,094 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close d7920f8f17fa984e6c290238c625f96f 2023-10-02 16:04:44,095 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 0fdc05f251cdc4f8f198d3c8ca559208, disabling compactions & flushes 2023-10-02 16:04:44,095 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,1,1696262665448.0fdc05f251cdc4f8f198d3c8ca559208. 2023-10-02 16:04:44,095 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1696262665448.0fdc05f251cdc4f8f198d3c8ca559208. 2023-10-02 16:04:44,095 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing d7920f8f17fa984e6c290238c625f96f, disabling compactions & flushes 2023-10-02 16:04:44,095 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1696262665448.0fdc05f251cdc4f8f198d3c8ca559208. after waiting 0 ms 2023-10-02 16:04:44,095 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,1,1696262665448.0fdc05f251cdc4f8f198d3c8ca559208. 2023-10-02 16:04:44,095 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,,1696262665448.d7920f8f17fa984e6c290238c625f96f. 2023-10-02 16:04:44,095 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,,1696262665448.d7920f8f17fa984e6c290238c625f96f. 2023-10-02 16:04:44,095 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,,1696262665448.d7920f8f17fa984e6c290238c625f96f. after waiting 0 ms 2023-10-02 16:04:44,095 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,,1696262665448.d7920f8f17fa984e6c290238c625f96f. 2023-10-02 16:04:44,109 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/data/default/testtb-testExportFileSystemStateWithMergeRegion/0fdc05f251cdc4f8f198d3c8ca559208/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-10-02 16:04:44,109 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/data/default/testtb-testExportFileSystemStateWithMergeRegion/d7920f8f17fa984e6c290238c625f96f/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-10-02 16:04:44,110 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-10-02 16:04:44,110 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-10-02 16:04:44,111 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,1,1696262665448.0fdc05f251cdc4f8f198d3c8ca559208. 2023-10-02 16:04:44,112 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,,1696262665448.d7920f8f17fa984e6c290238c625f96f. 2023-10-02 16:04:44,112 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 0fdc05f251cdc4f8f198d3c8ca559208: 2023-10-02 16:04:44,112 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for d7920f8f17fa984e6c290238c625f96f: 2023-10-02 16:04:44,114 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 0fdc05f251cdc4f8f198d3c8ca559208 2023-10-02 16:04:44,114 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=86 updating hbase:meta row=0fdc05f251cdc4f8f198d3c8ca559208, regionState=CLOSED 2023-10-02 16:04:44,115 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1696262665448.0fdc05f251cdc4f8f198d3c8ca559208.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1696262684114"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696262684114"}]},"ts":"1696262684114"} 2023-10-02 16:04:44,115 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed d7920f8f17fa984e6c290238c625f96f 2023-10-02 16:04:44,116 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=85 updating hbase:meta row=d7920f8f17fa984e6c290238c625f96f, regionState=CLOSED 2023-10-02 16:04:44,116 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1696262665448.d7920f8f17fa984e6c290238c625f96f.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1696262684116"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696262684116"}]},"ts":"1696262684116"} 2023-10-02 16:04:44,119 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=88, resume processing ppid=86 2023-10-02 16:04:44,119 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=88, ppid=86, state=SUCCESS; CloseRegionProcedure 0fdc05f251cdc4f8f198d3c8ca559208, server=jenkins-hbase4.apache.org,42303,1696262558956 in 173 msec 2023-10-02 16:04:44,120 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=87, resume processing ppid=85 2023-10-02 16:04:44,120 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=87, ppid=85, state=SUCCESS; CloseRegionProcedure d7920f8f17fa984e6c290238c625f96f, server=jenkins-hbase4.apache.org,37455,1696262558909 in 176 msec 2023-10-02 16:04:44,120 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=86, ppid=84, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=0fdc05f251cdc4f8f198d3c8ca559208, UNASSIGN in 183 msec 2023-10-02 16:04:44,121 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=85, resume processing ppid=84 2023-10-02 16:04:44,121 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=85, ppid=84, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=d7920f8f17fa984e6c290238c625f96f, UNASSIGN in 184 msec 2023-10-02 16:04:44,122 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696262684122"}]},"ts":"1696262684122"} 2023-10-02 16:04:44,124 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=DISABLED in hbase:meta 2023-10-02 16:04:44,126 INFO [PEWorker-2] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemStateWithMergeRegion to state=DISABLED 2023-10-02 16:04:44,127 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=84, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion in 198 msec 2023-10-02 16:04:44,234 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44227] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-10-02 16:04:44,235 INFO [Listener at jenkins-hbase4.apache.org/32975] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion, procId: 84 completed 2023-10-02 16:04:44,235 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44227] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemStateWithMergeRegion 2023-10-02 16:04:44,236 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44227] procedure2.ProcedureExecutor(1028): Stored pid=89, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-10-02 16:04:44,239 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=89, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-10-02 16:04:44,239 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44227] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemStateWithMergeRegion 2023-10-02 16:04:44,239 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=89, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-10-02 16:04:44,241 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=42303] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemStateWithMergeRegion 2023-10-02 16:04:44,243 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): master:44227-0x10107dfc1490000, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-10-02 16:04:44,243 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): regionserver:43801-0x10107dfc1490001, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-10-02 16:04:44,243 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): regionserver:37455-0x10107dfc1490002, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-10-02 16:04:44,243 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): regionserver:42303-0x10107dfc1490003, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-10-02 16:04:44,244 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-10-02 16:04:44,244 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-10-02 16:04:44,244 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-10-02 16:04:44,244 DEBUG [HFileArchiver-14] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/d7920f8f17fa984e6c290238c625f96f 2023-10-02 16:04:44,244 DEBUG [HFileArchiver-15] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/0fdc05f251cdc4f8f198d3c8ca559208 2023-10-02 16:04:44,244 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-10-02 16:04:44,245 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): master:44227-0x10107dfc1490000, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-10-02 16:04:44,245 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): master:44227-0x10107dfc1490000, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-02 16:04:44,245 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): regionserver:43801-0x10107dfc1490001, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-10-02 16:04:44,245 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): regionserver:37455-0x10107dfc1490002, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-10-02 16:04:44,245 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): regionserver:42303-0x10107dfc1490003, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-10-02 16:04:44,245 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): regionserver:43801-0x10107dfc1490001, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-02 16:04:44,246 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): regionserver:42303-0x10107dfc1490003, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-02 16:04:44,245 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): regionserver:37455-0x10107dfc1490002, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-02 16:04:44,247 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44227] master.MasterRpcServices(1230): Checking to see if procedure is done pid=89 2023-10-02 16:04:44,247 DEBUG [HFileArchiver-15] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/0fdc05f251cdc4f8f198d3c8ca559208/cf, FileablePath, hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/0fdc05f251cdc4f8f198d3c8ca559208/recovered.edits] 2023-10-02 16:04:44,247 DEBUG [HFileArchiver-14] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/d7920f8f17fa984e6c290238c625f96f/cf, FileablePath, hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/d7920f8f17fa984e6c290238c625f96f/recovered.edits] 2023-10-02 16:04:44,252 DEBUG [HFileArchiver-15] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/0fdc05f251cdc4f8f198d3c8ca559208/cf/1dedbbd4d22b4a72970a5d85eab46877 to hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/0fdc05f251cdc4f8f198d3c8ca559208/cf/1dedbbd4d22b4a72970a5d85eab46877 2023-10-02 16:04:44,253 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/d7920f8f17fa984e6c290238c625f96f/cf/b31a286973254848a86bf2174fc9f405 to hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/d7920f8f17fa984e6c290238c625f96f/cf/b31a286973254848a86bf2174fc9f405 2023-10-02 16:04:44,256 DEBUG [HFileArchiver-15] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/0fdc05f251cdc4f8f198d3c8ca559208/recovered.edits/9.seqid to hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/0fdc05f251cdc4f8f198d3c8ca559208/recovered.edits/9.seqid 2023-10-02 16:04:44,256 DEBUG [HFileArchiver-15] backup.HFileArchiver(596): Deleted hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/0fdc05f251cdc4f8f198d3c8ca559208 2023-10-02 16:04:44,257 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/d7920f8f17fa984e6c290238c625f96f/recovered.edits/9.seqid to hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/d7920f8f17fa984e6c290238c625f96f/recovered.edits/9.seqid 2023-10-02 16:04:44,257 DEBUG [HFileArchiver-14] backup.HFileArchiver(596): Deleted hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/d7920f8f17fa984e6c290238c625f96f 2023-10-02 16:04:44,257 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion regions 2023-10-02 16:04:44,258 DEBUG [PEWorker-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c 2023-10-02 16:04:44,259 DEBUG [PEWorker-1] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf] 2023-10-02 16:04:44,263 DEBUG [PEWorker-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b2023100260964c82e617409dbb2cec52eeb505f2 to hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b2023100260964c82e617409dbb2cec52eeb505f2 2023-10-02 16:04:44,264 DEBUG [PEWorker-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e20231002905158644dd446ee96ea642120fc2f64 to hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e20231002905158644dd446ee96ea642120fc2f64 2023-10-02 16:04:44,265 DEBUG [PEWorker-1] backup.HFileArchiver(596): Deleted hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c 2023-10-02 16:04:44,267 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=89, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-10-02 16:04:44,269 WARN [PEWorker-1] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportFileSystemStateWithMergeRegion from hbase:meta 2023-10-02 16:04:44,271 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemStateWithMergeRegion' descriptor. 2023-10-02 16:04:44,273 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=89, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-10-02 16:04:44,273 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemStateWithMergeRegion' from region states. 2023-10-02 16:04:44,273 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1696262665448.d7920f8f17fa984e6c290238c625f96f.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1696262684273"}]},"ts":"9223372036854775807"} 2023-10-02 16:04:44,273 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1696262665448.0fdc05f251cdc4f8f198d3c8ca559208.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1696262684273"}]},"ts":"9223372036854775807"} 2023-10-02 16:04:44,274 INFO [PEWorker-1] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-10-02 16:04:44,274 DEBUG [PEWorker-1] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => d7920f8f17fa984e6c290238c625f96f, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,,1696262665448.d7920f8f17fa984e6c290238c625f96f.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 0fdc05f251cdc4f8f198d3c8ca559208, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,1,1696262665448.0fdc05f251cdc4f8f198d3c8ca559208.', STARTKEY => '1', ENDKEY => ''}] 2023-10-02 16:04:44,275 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemStateWithMergeRegion' as deleted. 2023-10-02 16:04:44,275 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1696262684275"}]},"ts":"9223372036854775807"} 2023-10-02 16:04:44,276 INFO [PEWorker-1] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemStateWithMergeRegion state from META 2023-10-02 16:04:44,281 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(130): Finished pid=89, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-10-02 16:04:44,282 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=89, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion in 45 msec 2023-10-02 16:04:44,348 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44227] master.MasterRpcServices(1230): Checking to see if procedure is done pid=89 2023-10-02 16:04:44,349 INFO [Listener at jenkins-hbase4.apache.org/32975] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion, procId: 89 completed 2023-10-02 16:04:44,358 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44227] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportFileSystemStateWithMergeRegion" 2023-10-02 16:04:44,360 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44227] snapshot.SnapshotManager(335): Deleting snapshot: emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 16:04:44,361 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44227] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemStateWithMergeRegion" 2023-10-02 16:04:44,364 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44227] snapshot.SnapshotManager(335): Deleting snapshot: snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-02 16:04:44,366 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44227] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemStateWithMergeRegion-1" 2023-10-02 16:04:44,367 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44227] snapshot.SnapshotManager(335): Deleting snapshot: snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-02 16:04:44,398 INFO [Listener at jenkins-hbase4.apache.org/32975] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testExportFileSystemStateWithMergeRegion Thread=762 (was 745) Potentially hanging thread: hconnection-0x646a4964-shared-pool-30 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-4202 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_95248091_17 at /127.0.0.1:41982 [Waiting for operation #6] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (337744187) connection to jenkins-hbase4.apache.org/172.31.14.131:33009 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: HFileArchiver-17 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #7 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Parameter Sending Thread #3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x646a4964-shared-pool-35 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x646a4964-shared-pool-34 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-6 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_95248091_17 at /127.0.0.1:51506 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-16 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LogDeleter #3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1088) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-15 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-18 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x646a4964-shared-pool-31 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x646a4964-shared-pool-32 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-5 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_95248091_17 at /127.0.0.1:55084 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #8 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-19 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_355372752_1 at /127.0.0.1:55050 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x646a4964-shared-pool-33 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-7 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-20 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=896 (was 905), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=566 (was 646), ProcessCount=197 (was 197), AvailableMemoryMB=560 (was 613) 2023-10-02 16:04:44,398 WARN [Listener at jenkins-hbase4.apache.org/32975] hbase.ResourceChecker(130): Thread=762 is superior to 500 2023-10-02 16:04:44,422 INFO [Listener at jenkins-hbase4.apache.org/32975] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testEmptyExportFileSystemState Thread=762, OpenFileDescriptor=896, MaxFileDescriptor=60000, SystemLoadAverage=566, ProcessCount=197, AvailableMemoryMB=559 2023-10-02 16:04:44,423 WARN [Listener at jenkins-hbase4.apache.org/32975] hbase.ResourceChecker(130): Thread=762 is superior to 500 2023-10-02 16:04:44,425 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44227] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testEmptyExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-10-02 16:04:44,426 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44227] procedure2.ProcedureExecutor(1028): Stored pid=90, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testEmptyExportFileSystemState 2023-10-02 16:04:44,429 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_PRE_OPERATION 2023-10-02 16:04:44,429 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44227] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testEmptyExportFileSystemState" procId is: 90 2023-10-02 16:04:44,430 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-10-02 16:04:44,430 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44227] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-10-02 16:04:44,433 DEBUG [HFileArchiver-16] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/.tmp/data/default/testtb-testEmptyExportFileSystemState/2a3bec5fb5c7687d4cec38edb5f671c2 2023-10-02 16:04:44,433 DEBUG [HFileArchiver-17] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/.tmp/data/default/testtb-testEmptyExportFileSystemState/5d1d6d2f2061534012429095b2044752 2023-10-02 16:04:44,434 DEBUG [HFileArchiver-16] backup.HFileArchiver(153): Directory hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/.tmp/data/default/testtb-testEmptyExportFileSystemState/2a3bec5fb5c7687d4cec38edb5f671c2 empty. 2023-10-02 16:04:44,434 DEBUG [HFileArchiver-17] backup.HFileArchiver(153): Directory hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/.tmp/data/default/testtb-testEmptyExportFileSystemState/5d1d6d2f2061534012429095b2044752 empty. 2023-10-02 16:04:44,434 DEBUG [HFileArchiver-16] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/.tmp/data/default/testtb-testEmptyExportFileSystemState/2a3bec5fb5c7687d4cec38edb5f671c2 2023-10-02 16:04:44,434 DEBUG [HFileArchiver-17] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/.tmp/data/default/testtb-testEmptyExportFileSystemState/5d1d6d2f2061534012429095b2044752 2023-10-02 16:04:44,434 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testtb-testEmptyExportFileSystemState regions 2023-10-02 16:04:44,532 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44227] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-10-02 16:04:44,733 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44227] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-10-02 16:04:44,861 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/.tmp/data/default/testtb-testEmptyExportFileSystemState/.tabledesc/.tableinfo.0000000001 2023-10-02 16:04:44,862 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(7675): creating {ENCODED => 2a3bec5fb5c7687d4cec38edb5f671c2, NAME => 'testtb-testEmptyExportFileSystemState,,1696262684424.2a3bec5fb5c7687d4cec38edb5f671c2.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testEmptyExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/.tmp 2023-10-02 16:04:44,862 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(7675): creating {ENCODED => 5d1d6d2f2061534012429095b2044752, NAME => 'testtb-testEmptyExportFileSystemState,1,1696262684424.5d1d6d2f2061534012429095b2044752.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testEmptyExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/.tmp 2023-10-02 16:04:44,915 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,,1696262684424.2a3bec5fb5c7687d4cec38edb5f671c2.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-02 16:04:44,915 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1604): Closing 2a3bec5fb5c7687d4cec38edb5f671c2, disabling compactions & flushes 2023-10-02 16:04:44,915 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,,1696262684424.2a3bec5fb5c7687d4cec38edb5f671c2. 2023-10-02 16:04:44,915 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,,1696262684424.2a3bec5fb5c7687d4cec38edb5f671c2. 2023-10-02 16:04:44,915 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,,1696262684424.2a3bec5fb5c7687d4cec38edb5f671c2. after waiting 0 ms 2023-10-02 16:04:44,915 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,,1696262684424.2a3bec5fb5c7687d4cec38edb5f671c2. 2023-10-02 16:04:44,915 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,,1696262684424.2a3bec5fb5c7687d4cec38edb5f671c2. 2023-10-02 16:04:44,916 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1558): Region close journal for 2a3bec5fb5c7687d4cec38edb5f671c2: 2023-10-02 16:04:44,916 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,1,1696262684424.5d1d6d2f2061534012429095b2044752.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-02 16:04:44,916 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1604): Closing 5d1d6d2f2061534012429095b2044752, disabling compactions & flushes 2023-10-02 16:04:44,916 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,1,1696262684424.5d1d6d2f2061534012429095b2044752. 2023-10-02 16:04:44,916 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,1,1696262684424.5d1d6d2f2061534012429095b2044752. 2023-10-02 16:04:44,916 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,1,1696262684424.5d1d6d2f2061534012429095b2044752. after waiting 0 ms 2023-10-02 16:04:44,916 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,1,1696262684424.5d1d6d2f2061534012429095b2044752. 2023-10-02 16:04:44,916 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,1,1696262684424.5d1d6d2f2061534012429095b2044752. 2023-10-02 16:04:44,916 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1558): Region close journal for 5d1d6d2f2061534012429095b2044752: 2023-10-02 16:04:44,920 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_ADD_TO_META 2023-10-02 16:04:44,922 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,,1696262684424.2a3bec5fb5c7687d4cec38edb5f671c2.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1696262684921"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696262684921"}]},"ts":"1696262684921"} 2023-10-02 16:04:44,922 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,1,1696262684424.5d1d6d2f2061534012429095b2044752.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1696262684921"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696262684921"}]},"ts":"1696262684921"} 2023-10-02 16:04:44,924 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-10-02 16:04:44,925 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-10-02 16:04:44,925 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696262684925"}]},"ts":"1696262684925"} 2023-10-02 16:04:44,927 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=ENABLING in hbase:meta 2023-10-02 16:04:44,930 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-10-02 16:04:44,931 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-10-02 16:04:44,931 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-10-02 16:04:44,932 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-10-02 16:04:44,932 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-10-02 16:04:44,932 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=91, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=2a3bec5fb5c7687d4cec38edb5f671c2, ASSIGN}, {pid=92, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=5d1d6d2f2061534012429095b2044752, ASSIGN}] 2023-10-02 16:04:44,935 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=91, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=2a3bec5fb5c7687d4cec38edb5f671c2, ASSIGN 2023-10-02 16:04:44,935 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=92, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=5d1d6d2f2061534012429095b2044752, ASSIGN 2023-10-02 16:04:44,936 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=91, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=2a3bec5fb5c7687d4cec38edb5f671c2, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,37455,1696262558909; forceNewPlan=false, retain=false 2023-10-02 16:04:44,936 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=92, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=5d1d6d2f2061534012429095b2044752, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,42303,1696262558956; forceNewPlan=false, retain=false 2023-10-02 16:04:45,035 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44227] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-10-02 16:04:45,086 INFO [jenkins-hbase4:44227] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-10-02 16:04:45,090 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=92 updating hbase:meta row=5d1d6d2f2061534012429095b2044752, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,42303,1696262558956 2023-10-02 16:04:45,090 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=91 updating hbase:meta row=2a3bec5fb5c7687d4cec38edb5f671c2, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,37455,1696262558909 2023-10-02 16:04:45,090 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,1,1696262684424.5d1d6d2f2061534012429095b2044752.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1696262685090"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696262685090"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696262685090"}]},"ts":"1696262685090"} 2023-10-02 16:04:45,090 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,,1696262684424.2a3bec5fb5c7687d4cec38edb5f671c2.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1696262685090"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696262685090"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696262685090"}]},"ts":"1696262685090"} 2023-10-02 16:04:45,092 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=93, ppid=92, state=RUNNABLE; OpenRegionProcedure 5d1d6d2f2061534012429095b2044752, server=jenkins-hbase4.apache.org,42303,1696262558956}] 2023-10-02 16:04:45,094 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=94, ppid=91, state=RUNNABLE; OpenRegionProcedure 2a3bec5fb5c7687d4cec38edb5f671c2, server=jenkins-hbase4.apache.org,37455,1696262558909}] 2023-10-02 16:04:45,248 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testEmptyExportFileSystemState,1,1696262684424.5d1d6d2f2061534012429095b2044752. 2023-10-02 16:04:45,248 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 5d1d6d2f2061534012429095b2044752, NAME => 'testtb-testEmptyExportFileSystemState,1,1696262684424.5d1d6d2f2061534012429095b2044752.', STARTKEY => '1', ENDKEY => ''} 2023-10-02 16:04:45,248 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testEmptyExportFileSystemState,1,1696262684424.5d1d6d2f2061534012429095b2044752. service=AccessControlService 2023-10-02 16:04:45,249 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-10-02 16:04:45,249 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testEmptyExportFileSystemState 5d1d6d2f2061534012429095b2044752 2023-10-02 16:04:45,249 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,1,1696262684424.5d1d6d2f2061534012429095b2044752.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-02 16:04:45,249 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 5d1d6d2f2061534012429095b2044752 2023-10-02 16:04:45,249 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testEmptyExportFileSystemState,,1696262684424.2a3bec5fb5c7687d4cec38edb5f671c2. 2023-10-02 16:04:45,249 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 5d1d6d2f2061534012429095b2044752 2023-10-02 16:04:45,249 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 2a3bec5fb5c7687d4cec38edb5f671c2, NAME => 'testtb-testEmptyExportFileSystemState,,1696262684424.2a3bec5fb5c7687d4cec38edb5f671c2.', STARTKEY => '', ENDKEY => '1'} 2023-10-02 16:04:45,249 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testEmptyExportFileSystemState,,1696262684424.2a3bec5fb5c7687d4cec38edb5f671c2. service=AccessControlService 2023-10-02 16:04:45,249 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-10-02 16:04:45,250 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testEmptyExportFileSystemState 2a3bec5fb5c7687d4cec38edb5f671c2 2023-10-02 16:04:45,250 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,,1696262684424.2a3bec5fb5c7687d4cec38edb5f671c2.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-02 16:04:45,250 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 2a3bec5fb5c7687d4cec38edb5f671c2 2023-10-02 16:04:45,250 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 2a3bec5fb5c7687d4cec38edb5f671c2 2023-10-02 16:04:45,250 INFO [StoreOpener-5d1d6d2f2061534012429095b2044752-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 5d1d6d2f2061534012429095b2044752 2023-10-02 16:04:45,251 INFO [StoreOpener-2a3bec5fb5c7687d4cec38edb5f671c2-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 2a3bec5fb5c7687d4cec38edb5f671c2 2023-10-02 16:04:45,252 DEBUG [StoreOpener-5d1d6d2f2061534012429095b2044752-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/data/default/testtb-testEmptyExportFileSystemState/5d1d6d2f2061534012429095b2044752/cf 2023-10-02 16:04:45,252 DEBUG [StoreOpener-5d1d6d2f2061534012429095b2044752-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/data/default/testtb-testEmptyExportFileSystemState/5d1d6d2f2061534012429095b2044752/cf 2023-10-02 16:04:45,253 DEBUG [StoreOpener-2a3bec5fb5c7687d4cec38edb5f671c2-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/data/default/testtb-testEmptyExportFileSystemState/2a3bec5fb5c7687d4cec38edb5f671c2/cf 2023-10-02 16:04:45,253 DEBUG [StoreOpener-2a3bec5fb5c7687d4cec38edb5f671c2-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/data/default/testtb-testEmptyExportFileSystemState/2a3bec5fb5c7687d4cec38edb5f671c2/cf 2023-10-02 16:04:45,253 INFO [StoreOpener-5d1d6d2f2061534012429095b2044752-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 5d1d6d2f2061534012429095b2044752 columnFamilyName cf 2023-10-02 16:04:45,253 INFO [StoreOpener-2a3bec5fb5c7687d4cec38edb5f671c2-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 2a3bec5fb5c7687d4cec38edb5f671c2 columnFamilyName cf 2023-10-02 16:04:45,254 INFO [StoreOpener-5d1d6d2f2061534012429095b2044752-1] regionserver.HStore(310): Store=5d1d6d2f2061534012429095b2044752/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-02 16:04:45,255 INFO [StoreOpener-2a3bec5fb5c7687d4cec38edb5f671c2-1] regionserver.HStore(310): Store=2a3bec5fb5c7687d4cec38edb5f671c2/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-02 16:04:45,255 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/data/default/testtb-testEmptyExportFileSystemState/5d1d6d2f2061534012429095b2044752 2023-10-02 16:04:45,256 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/data/default/testtb-testEmptyExportFileSystemState/2a3bec5fb5c7687d4cec38edb5f671c2 2023-10-02 16:04:45,256 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/data/default/testtb-testEmptyExportFileSystemState/5d1d6d2f2061534012429095b2044752 2023-10-02 16:04:45,257 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/data/default/testtb-testEmptyExportFileSystemState/2a3bec5fb5c7687d4cec38edb5f671c2 2023-10-02 16:04:45,264 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 2a3bec5fb5c7687d4cec38edb5f671c2 2023-10-02 16:04:45,266 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 5d1d6d2f2061534012429095b2044752 2023-10-02 16:04:45,269 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/data/default/testtb-testEmptyExportFileSystemState/2a3bec5fb5c7687d4cec38edb5f671c2/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-02 16:04:45,270 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 2a3bec5fb5c7687d4cec38edb5f671c2; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74394168, jitterRate=0.1085594892501831}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-10-02 16:04:45,270 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 2a3bec5fb5c7687d4cec38edb5f671c2: 2023-10-02 16:04:45,271 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testEmptyExportFileSystemState,,1696262684424.2a3bec5fb5c7687d4cec38edb5f671c2., pid=94, masterSystemTime=1696262685246 2023-10-02 16:04:45,272 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testEmptyExportFileSystemState,,1696262684424.2a3bec5fb5c7687d4cec38edb5f671c2. 2023-10-02 16:04:45,272 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testEmptyExportFileSystemState,,1696262684424.2a3bec5fb5c7687d4cec38edb5f671c2. 2023-10-02 16:04:45,273 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/data/default/testtb-testEmptyExportFileSystemState/5d1d6d2f2061534012429095b2044752/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-02 16:04:45,273 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=91 updating hbase:meta row=2a3bec5fb5c7687d4cec38edb5f671c2, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,37455,1696262558909 2023-10-02 16:04:45,273 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 5d1d6d2f2061534012429095b2044752; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61337859, jitterRate=-0.0859946757555008}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-10-02 16:04:45,273 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testEmptyExportFileSystemState,,1696262684424.2a3bec5fb5c7687d4cec38edb5f671c2.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1696262685273"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1696262685273"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1696262685273"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1696262685273"}]},"ts":"1696262685273"} 2023-10-02 16:04:45,273 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 5d1d6d2f2061534012429095b2044752: 2023-10-02 16:04:45,274 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testEmptyExportFileSystemState,1,1696262684424.5d1d6d2f2061534012429095b2044752., pid=93, masterSystemTime=1696262685244 2023-10-02 16:04:45,276 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testEmptyExportFileSystemState,1,1696262684424.5d1d6d2f2061534012429095b2044752. 2023-10-02 16:04:45,276 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testEmptyExportFileSystemState,1,1696262684424.5d1d6d2f2061534012429095b2044752. 2023-10-02 16:04:45,276 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=92 updating hbase:meta row=5d1d6d2f2061534012429095b2044752, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,42303,1696262558956 2023-10-02 16:04:45,276 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testEmptyExportFileSystemState,1,1696262684424.5d1d6d2f2061534012429095b2044752.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1696262685276"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1696262685276"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1696262685276"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1696262685276"}]},"ts":"1696262685276"} 2023-10-02 16:04:45,277 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=94, resume processing ppid=91 2023-10-02 16:04:45,277 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=94, ppid=91, state=SUCCESS; OpenRegionProcedure 2a3bec5fb5c7687d4cec38edb5f671c2, server=jenkins-hbase4.apache.org,37455,1696262558909 in 182 msec 2023-10-02 16:04:45,278 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=91, ppid=90, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=2a3bec5fb5c7687d4cec38edb5f671c2, ASSIGN in 345 msec 2023-10-02 16:04:45,281 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=93, resume processing ppid=92 2023-10-02 16:04:45,281 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=93, ppid=92, state=SUCCESS; OpenRegionProcedure 5d1d6d2f2061534012429095b2044752, server=jenkins-hbase4.apache.org,42303,1696262558956 in 187 msec 2023-10-02 16:04:45,283 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=92, resume processing ppid=90 2023-10-02 16:04:45,283 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=92, ppid=90, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=5d1d6d2f2061534012429095b2044752, ASSIGN in 349 msec 2023-10-02 16:04:45,284 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-10-02 16:04:45,284 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696262685284"}]},"ts":"1696262685284"} 2023-10-02 16:04:45,285 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=ENABLED in hbase:meta 2023-10-02 16:04:45,287 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_POST_OPERATION 2023-10-02 16:04:45,288 DEBUG [PEWorker-4] access.PermissionStorage(175): Writing permission with rowKey testtb-testEmptyExportFileSystemState jenkins: RWXCA 2023-10-02 16:04:45,289 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=42303] access.PermissionStorage(611): Read acl: entry[testtb-testEmptyExportFileSystemState], kv [jenkins: RWXCA] 2023-10-02 16:04:45,293 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): regionserver:43801-0x10107dfc1490001, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-02 16:04:45,293 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): regionserver:42303-0x10107dfc1490003, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-02 16:04:45,293 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): master:44227-0x10107dfc1490000, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-02 16:04:45,293 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): regionserver:37455-0x10107dfc1490002, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-02 16:04:45,295 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-10-02 16:04:45,295 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-10-02 16:04:45,295 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-10-02 16:04:45,295 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-10-02 16:04:45,296 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=90, state=SUCCESS; CreateTableProcedure table=testtb-testEmptyExportFileSystemState in 870 msec 2023-10-02 16:04:45,536 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44227] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-10-02 16:04:45,536 INFO [Listener at jenkins-hbase4.apache.org/32975] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testEmptyExportFileSystemState, procId: 90 completed 2023-10-02 16:04:45,539 DEBUG [Listener at jenkins-hbase4.apache.org/32975] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testEmptyExportFileSystemState 2023-10-02 16:04:45,539 DEBUG [Listener at jenkins-hbase4.apache.org/32975] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testEmptyExportFileSystemState,,1696262684424.2a3bec5fb5c7687d4cec38edb5f671c2. 2023-10-02 16:04:45,541 INFO [Listener at jenkins-hbase4.apache.org/32975] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-10-02 16:04:45,555 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44227] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-10-02 16:04:45,555 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44227] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1696262685555 (current time:1696262685555). 2023-10-02 16:04:45,555 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44227] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-10-02 16:04:45,556 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44227] zookeeper.ReadOnlyZKClient(139): Connect 0x207ea921 to 127.0.0.1:50210 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-02 16:04:45,570 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44227] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3cc90bca, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-02 16:04:45,575 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44227] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-02 16:04:45,578 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:37834, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-02 16:04:45,580 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44227] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x207ea921 to 127.0.0.1:50210 2023-10-02 16:04:45,580 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44227] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-02 16:04:45,581 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44227] zookeeper.ReadOnlyZKClient(139): Connect 0x3bb3a3f5 to 127.0.0.1:50210 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-02 16:04:45,594 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44227] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6e513203, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-02 16:04:45,596 DEBUG [hconnection-0x1ab2e358-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-02 16:04:45,598 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:37840, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-02 16:04:45,604 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44227] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x3bb3a3f5 to 127.0.0.1:50210 2023-10-02 16:04:45,604 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44227] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-02 16:04:45,604 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44227] access.PermissionStorage(611): Read acl: entry[testtb-testEmptyExportFileSystemState], kv [jenkins: RWXCA] 2023-10-02 16:04:45,605 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44227] snapshot.SnapshotManager(637): No existing snapshot, attempting snapshot... 2023-10-02 16:04:45,605 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44227] snapshot.SnapshotManager(684): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-10-02 16:04:45,612 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44227] snapshot.SnapshotManager(519): Unable to retrieve ACL status for path: hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/.hbase-snapshot, current working dir path: hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState org.apache.hadoop.hdfs.protocol.AclException: The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.ipc.RemoteException.instantiateException(RemoteException.java:121) at org.apache.hadoop.ipc.RemoteException.unwrapRemoteException(RemoteException.java:88) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2736) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2294) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2291) at org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81) at org.apache.hadoop.hdfs.DistributedFileSystem.getAclStatus(DistributedFileSystem.java:2291) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.updateWorkingDirAclsIfRequired(SnapshotManager.java:517) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.prepareToTakeSnapshot(SnapshotManager.java:490) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.snapshotEnabledTable(SnapshotManager.java:559) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshotInternal(SnapshotManager.java:687) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshot(SnapshotManager.java:623) at org.apache.hadoop.hbase.master.MasterRpcServices.snapshot(MasterRpcServices.java:1588) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) Caused by: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.hdfs.protocol.AclException): The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at org.apache.hadoop.ipc.Client.getRpcResponse(Client.java:1540) at org.apache.hadoop.ipc.Client.call(Client.java:1486) at org.apache.hadoop.ipc.Client.call(Client.java:1385) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:232) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:118) at com.sun.proxy.$Proxy32.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.getAclStatus(ClientNamenodeProtocolTranslatorPB.java:1385) at sun.reflect.GeneratedMethodAccessor63.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:422) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeMethod(RetryInvocationHandler.java:165) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invoke(RetryInvocationHandler.java:157) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeOnce(RetryInvocationHandler.java:95) at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:359) at com.sun.proxy.$Proxy35.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor63.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor63.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor63.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor63.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor63.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2734) ... 15 more 2023-10-02 16:04:45,618 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44227] procedure2.ProcedureExecutor(1028): Stored pid=95, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-10-02 16:04:45,619 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=95, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-10-02 16:04:45,620 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=95, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1696263285620 2023-10-02 16:04:45,620 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44227] snapshot.SnapshotManager(689): Started snapshot: { ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-10-02 16:04:45,620 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState 2023-10-02 16:04:45,622 DEBUG [Listener at jenkins-hbase4.apache.org/32975] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-10-02 16:04:45,622 DEBUG [Listener at jenkins-hbase4.apache.org/32975] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-10-02 16:04:45,623 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=95, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-10-02 16:04:45,623 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=96, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-10-02 16:04:45,624 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=95, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE in 7 msec 2023-10-02 16:04:45,629 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=96, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-10-02 16:04:45,629 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=96, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED; timeout=600000, timestamp=1696263285629 2023-10-02 16:04:45,642 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testEmptyExportFileSystemState 2023-10-02 16:04:45,642 INFO [(jenkins-hbase4.apache.org,44227,1696262556745)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testEmptyExportFileSystemState' 2023-10-02 16:04:45,642 DEBUG [(jenkins-hbase4.apache.org,44227,1696262556745)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-02 16:04:45,647 DEBUG [(jenkins-hbase4.apache.org,44227,1696262556745)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' 2023-10-02 16:04:45,647 DEBUG [(jenkins-hbase4.apache.org,44227,1696262556745)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testEmptyExportFileSystemState', kicking off acquire phase on members. 2023-10-02 16:04:45,647 DEBUG [(jenkins-hbase4.apache.org,44227,1696262556745)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44227-0x10107dfc1490000, quorum=127.0.0.1:50210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-10-02 16:04:45,647 DEBUG [(jenkins-hbase4.apache.org,44227,1696262556745)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-10-02 16:04:45,660 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): regionserver:42303-0x10107dfc1490003, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-02 16:04:45,660 DEBUG [(jenkins-hbase4.apache.org,44227,1696262556745)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,42303,1696262558956 2023-10-02 16:04:45,660 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-02 16:04:45,660 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-02 16:04:45,660 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): regionserver:43801-0x10107dfc1490001, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-02 16:04:45,660 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-02 16:04:45,660 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-02 16:04:45,660 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): regionserver:37455-0x10107dfc1490002, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-02 16:04:45,660 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-02 16:04:45,660 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-02 16:04:45,660 DEBUG [(jenkins-hbase4.apache.org,44227,1696262556745)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44227-0x10107dfc1490000, quorum=127.0.0.1:50210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,42303,1696262558956 2023-10-02 16:04:45,660 DEBUG [(jenkins-hbase4.apache.org,44227,1696262556745)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37455,1696262558909 2023-10-02 16:04:45,660 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-10-02 16:04:45,661 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-10-02 16:04:45,661 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-10-02 16:04:45,661 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42303-0x10107dfc1490003, quorum=127.0.0.1:50210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-10-02 16:04:45,661 DEBUG [(jenkins-hbase4.apache.org,44227,1696262556745)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44227-0x10107dfc1490000, quorum=127.0.0.1:50210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37455,1696262558909 2023-10-02 16:04:45,661 DEBUG [(jenkins-hbase4.apache.org,44227,1696262556745)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-02 16:04:45,661 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37455-0x10107dfc1490002, quorum=127.0.0.1:50210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-10-02 16:04:45,661 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 189 2023-10-02 16:04:45,661 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-10-02 16:04:45,662 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-10-02 16:04:45,662 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testEmptyExportFileSystemState 2023-10-02 16:04:45,662 DEBUG [member: 'jenkins-hbase4.apache.org,42303,1696262558956' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-10-02 16:04:45,662 DEBUG [member: 'jenkins-hbase4.apache.org,42303,1696262558956' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-02 16:04:45,664 DEBUG [member: 'jenkins-hbase4.apache.org,42303,1696262558956' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-10-02 16:04:45,664 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 189 2023-10-02 16:04:45,664 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-10-02 16:04:45,664 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-10-02 16:04:45,664 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testEmptyExportFileSystemState 2023-10-02 16:04:45,664 DEBUG [member: 'jenkins-hbase4.apache.org,37455,1696262558909' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-10-02 16:04:45,664 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43801-0x10107dfc1490001, quorum=127.0.0.1:50210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-10-02 16:04:45,664 DEBUG [member: 'jenkins-hbase4.apache.org,42303,1696262558956' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally acquired 2023-10-02 16:04:45,665 DEBUG [member: 'jenkins-hbase4.apache.org,42303,1696262558956' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42303,1696262558956' joining acquired barrier for procedure (emptySnaptb0-testEmptyExportFileSystemState) in zk 2023-10-02 16:04:45,664 DEBUG [member: 'jenkins-hbase4.apache.org,37455,1696262558909' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-02 16:04:45,666 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 189 2023-10-02 16:04:45,666 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-10-02 16:04:45,666 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-10-02 16:04:45,666 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testEmptyExportFileSystemState 2023-10-02 16:04:45,667 DEBUG [member: 'jenkins-hbase4.apache.org,43801,1696262558835' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-10-02 16:04:45,667 DEBUG [member: 'jenkins-hbase4.apache.org,43801,1696262558835' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-02 16:04:45,668 DEBUG [member: 'jenkins-hbase4.apache.org,37455,1696262558909' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-10-02 16:04:45,669 DEBUG [member: 'jenkins-hbase4.apache.org,37455,1696262558909' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally acquired 2023-10-02 16:04:45,669 DEBUG [member: 'jenkins-hbase4.apache.org,37455,1696262558909' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37455,1696262558909' joining acquired barrier for procedure (emptySnaptb0-testEmptyExportFileSystemState) in zk 2023-10-02 16:04:45,669 DEBUG [member: 'jenkins-hbase4.apache.org,43801,1696262558835' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-10-02 16:04:45,669 DEBUG [member: 'jenkins-hbase4.apache.org,43801,1696262558835' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally acquired 2023-10-02 16:04:45,669 DEBUG [member: 'jenkins-hbase4.apache.org,43801,1696262558835' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43801,1696262558835' joining acquired barrier for procedure (emptySnaptb0-testEmptyExportFileSystemState) in zk 2023-10-02 16:04:45,669 DEBUG [member: 'jenkins-hbase4.apache.org,42303,1696262558956' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-10-02 16:04:45,670 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): master:44227-0x10107dfc1490000, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,42303,1696262558956 2023-10-02 16:04:45,670 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,42303,1696262558956 2023-10-02 16:04:45,670 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-02 16:04:45,670 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-02 16:04:45,670 DEBUG [member: 'jenkins-hbase4.apache.org,42303,1696262558956' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42303-0x10107dfc1490003, quorum=127.0.0.1:50210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-10-02 16:04:45,670 DEBUG [member: 'jenkins-hbase4.apache.org,42303,1696262558956' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-02 16:04:45,670 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-02 16:04:45,673 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): master:44227-0x10107dfc1490000, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37455,1696262558909 2023-10-02 16:04:45,673 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-02 16:04:45,674 DEBUG [member: 'jenkins-hbase4.apache.org,43801,1696262558835' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-10-02 16:04:45,674 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-10-02 16:04:45,675 DEBUG [member: 'jenkins-hbase4.apache.org,43801,1696262558835' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43801-0x10107dfc1490001, quorum=127.0.0.1:50210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-10-02 16:04:45,675 DEBUG [member: 'jenkins-hbase4.apache.org,43801,1696262558835' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-02 16:04:45,675 DEBUG [member: 'jenkins-hbase4.apache.org,37455,1696262558909' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-10-02 16:04:45,675 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37455,1696262558909 2023-10-02 16:04:45,675 DEBUG [member: 'jenkins-hbase4.apache.org,37455,1696262558909' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37455-0x10107dfc1490002, quorum=127.0.0.1:50210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-10-02 16:04:45,675 DEBUG [member: 'jenkins-hbase4.apache.org,37455,1696262558909' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-02 16:04:45,676 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42303,1696262558956 2023-10-02 16:04:45,676 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43801,1696262558835 2023-10-02 16:04:45,676 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-02 16:04:45,676 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,42303,1696262558956' joining acquired barrier for procedure 'emptySnaptb0-testEmptyExportFileSystemState' on coordinator 2023-10-02 16:04:45,677 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6b405480[Count = 1] remaining members to acquire global barrier 2023-10-02 16:04:45,677 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37455,1696262558909 2023-10-02 16:04:45,677 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-02 16:04:45,677 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-02 16:04:45,677 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-02 16:04:45,677 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-02 16:04:45,678 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-10-02 16:04:45,678 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37455,1696262558909 2023-10-02 16:04:45,678 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42303,1696262558956 2023-10-02 16:04:45,679 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43801,1696262558835 2023-10-02 16:04:45,679 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-02 16:04:45,679 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,37455,1696262558909' joining acquired barrier for procedure 'emptySnaptb0-testEmptyExportFileSystemState' on coordinator 2023-10-02 16:04:45,679 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6b405480[Count = 0] remaining members to acquire global barrier 2023-10-02 16:04:45,679 DEBUG [(jenkins-hbase4.apache.org,44227,1696262556745)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'in-barrier' execution. 2023-10-02 16:04:45,679 DEBUG [(jenkins-hbase4.apache.org,44227,1696262556745)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-10-02 16:04:45,683 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): regionserver:37455-0x10107dfc1490002, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-10-02 16:04:45,683 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): regionserver:42303-0x10107dfc1490003, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-10-02 16:04:45,684 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-10-02 16:04:45,684 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-10-02 16:04:45,684 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): regionserver:43801-0x10107dfc1490001, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-10-02 16:04:45,684 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-10-02 16:04:45,684 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-10-02 16:04:45,684 DEBUG [member: 'jenkins-hbase4.apache.org,42303,1696262558956' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-10-02 16:04:45,684 DEBUG [member: 'jenkins-hbase4.apache.org,37455,1696262558909' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-10-02 16:04:45,684 DEBUG [(jenkins-hbase4.apache.org,44227,1696262556745)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44227-0x10107dfc1490000, quorum=127.0.0.1:50210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,42303,1696262558956 2023-10-02 16:04:45,684 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-10-02 16:04:45,684 DEBUG [member: 'jenkins-hbase4.apache.org,37455,1696262558909' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-02 16:04:45,684 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-10-02 16:04:45,684 DEBUG [member: 'jenkins-hbase4.apache.org,37455,1696262558909' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-02 16:04:45,684 DEBUG [member: 'jenkins-hbase4.apache.org,43801,1696262558835' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-10-02 16:04:45,684 DEBUG [member: 'jenkins-hbase4.apache.org,43801,1696262558835' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally completed 2023-10-02 16:04:45,684 DEBUG [rs(jenkins-hbase4.apache.org,42303,1696262558956)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,1,1696262684424.5d1d6d2f2061534012429095b2044752. 2023-10-02 16:04:45,684 DEBUG [member: 'jenkins-hbase4.apache.org,42303,1696262558956' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-02 16:04:45,684 DEBUG [member: 'jenkins-hbase4.apache.org,42303,1696262558956' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-02 16:04:45,684 DEBUG [rs(jenkins-hbase4.apache.org,42303,1696262558956)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1696262684424.5d1d6d2f2061534012429095b2044752. started... 2023-10-02 16:04:45,684 DEBUG [member: 'jenkins-hbase4.apache.org,43801,1696262558835' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,43801,1696262558835' in zk 2023-10-02 16:04:45,684 DEBUG [rs(jenkins-hbase4.apache.org,37455,1696262558909)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,,1696262684424.2a3bec5fb5c7687d4cec38edb5f671c2. 2023-10-02 16:04:45,686 DEBUG [rs(jenkins-hbase4.apache.org,37455,1696262558909)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1696262684424.2a3bec5fb5c7687d4cec38edb5f671c2. started... 2023-10-02 16:04:45,686 DEBUG [rs(jenkins-hbase4.apache.org,42303,1696262558956)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 5d1d6d2f2061534012429095b2044752: 2023-10-02 16:04:45,686 DEBUG [(jenkins-hbase4.apache.org,44227,1696262556745)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44227-0x10107dfc1490000, quorum=127.0.0.1:50210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37455,1696262558909 2023-10-02 16:04:45,686 DEBUG [(jenkins-hbase4.apache.org,44227,1696262556745)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-02 16:04:45,686 DEBUG [rs(jenkins-hbase4.apache.org,37455,1696262558909)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 2a3bec5fb5c7687d4cec38edb5f671c2: 2023-10-02 16:04:45,686 DEBUG [rs(jenkins-hbase4.apache.org,42303,1696262558956)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,1,1696262684424.5d1d6d2f2061534012429095b2044752.' region-info for snapshot=emptySnaptb0-testEmptyExportFileSystemState 2023-10-02 16:04:45,687 DEBUG [rs(jenkins-hbase4.apache.org,42303,1696262558956)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-02 16:04:45,687 DEBUG [rs(jenkins-hbase4.apache.org,37455,1696262558909)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,,1696262684424.2a3bec5fb5c7687d4cec38edb5f671c2.' region-info for snapshot=emptySnaptb0-testEmptyExportFileSystemState 2023-10-02 16:04:45,687 DEBUG [rs(jenkins-hbase4.apache.org,42303,1696262558956)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-10-02 16:04:45,687 DEBUG [rs(jenkins-hbase4.apache.org,37455,1696262558909)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-02 16:04:45,687 DEBUG [rs(jenkins-hbase4.apache.org,37455,1696262558909)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-10-02 16:04:45,689 DEBUG [member: 'jenkins-hbase4.apache.org,43801,1696262558835' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-10-02 16:04:45,689 DEBUG [member: 'jenkins-hbase4.apache.org,43801,1696262558835' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-02 16:04:45,689 DEBUG [member: 'jenkins-hbase4.apache.org,43801,1696262558835' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' completed. 2023-10-02 16:04:45,709 DEBUG [rs(jenkins-hbase4.apache.org,37455,1696262558909)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1696262684424.2a3bec5fb5c7687d4cec38edb5f671c2. completed. 2023-10-02 16:04:45,710 DEBUG [rs(jenkins-hbase4.apache.org,37455,1696262558909)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,,1696262684424.2a3bec5fb5c7687d4cec38edb5f671c2. 2023-10-02 16:04:45,710 DEBUG [member: 'jenkins-hbase4.apache.org,37455,1696262558909' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-02 16:04:45,710 DEBUG [member: 'jenkins-hbase4.apache.org,37455,1696262558909' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-02 16:04:45,710 DEBUG [member: 'jenkins-hbase4.apache.org,37455,1696262558909' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,37455,1696262558909 2023-10-02 16:04:45,710 DEBUG [member: 'jenkins-hbase4.apache.org,37455,1696262558909' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally completed 2023-10-02 16:04:45,710 DEBUG [member: 'jenkins-hbase4.apache.org,37455,1696262558909' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,37455,1696262558909' in zk 2023-10-02 16:04:45,711 DEBUG [rs(jenkins-hbase4.apache.org,42303,1696262558956)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1696262684424.5d1d6d2f2061534012429095b2044752. completed. 2023-10-02 16:04:45,711 DEBUG [rs(jenkins-hbase4.apache.org,42303,1696262558956)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,1,1696262684424.5d1d6d2f2061534012429095b2044752. 2023-10-02 16:04:45,711 DEBUG [member: 'jenkins-hbase4.apache.org,42303,1696262558956' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-02 16:04:45,711 DEBUG [member: 'jenkins-hbase4.apache.org,42303,1696262558956' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-02 16:04:45,711 DEBUG [member: 'jenkins-hbase4.apache.org,42303,1696262558956' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,42303,1696262558956 2023-10-02 16:04:45,712 DEBUG [member: 'jenkins-hbase4.apache.org,42303,1696262558956' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally completed 2023-10-02 16:04:45,712 DEBUG [member: 'jenkins-hbase4.apache.org,42303,1696262558956' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,42303,1696262558956' in zk 2023-10-02 16:04:45,712 DEBUG [member: 'jenkins-hbase4.apache.org,37455,1696262558909' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-10-02 16:04:45,712 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): master:44227-0x10107dfc1490000, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37455,1696262558909 2023-10-02 16:04:45,712 DEBUG [member: 'jenkins-hbase4.apache.org,37455,1696262558909' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-02 16:04:45,712 DEBUG [member: 'jenkins-hbase4.apache.org,37455,1696262558909' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' completed. 2023-10-02 16:04:45,712 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37455,1696262558909 2023-10-02 16:04:45,714 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-02 16:04:45,714 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-02 16:04:45,715 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): master:44227-0x10107dfc1490000, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,42303,1696262558956 2023-10-02 16:04:45,715 DEBUG [member: 'jenkins-hbase4.apache.org,42303,1696262558956' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-10-02 16:04:45,715 DEBUG [member: 'jenkins-hbase4.apache.org,42303,1696262558956' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-02 16:04:45,715 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-02 16:04:45,715 DEBUG [member: 'jenkins-hbase4.apache.org,42303,1696262558956' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' completed. 2023-10-02 16:04:45,716 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-02 16:04:45,716 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-10-02 16:04:45,717 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37455,1696262558909 2023-10-02 16:04:45,717 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42303,1696262558956 2023-10-02 16:04:45,717 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43801,1696262558835 2023-10-02 16:04:45,718 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-02 16:04:45,718 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-10-02 16:04:45,718 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37455,1696262558909 2023-10-02 16:04:45,719 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42303,1696262558956 2023-10-02 16:04:45,719 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43801,1696262558835 2023-10-02 16:04:45,719 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,37455,1696262558909': 2023-10-02 16:04:45,719 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,37455,1696262558909' released barrier for procedure'emptySnaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 1 more 2023-10-02 16:04:45,719 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,42303,1696262558956 2023-10-02 16:04:45,719 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-02 16:04:45,720 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-02 16:04:45,720 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-02 16:04:45,720 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-02 16:04:45,721 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-10-02 16:04:45,721 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37455,1696262558909 2023-10-02 16:04:45,721 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42303,1696262558956 2023-10-02 16:04:45,722 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43801,1696262558835 2023-10-02 16:04:45,722 DEBUG [Listener at jenkins-hbase4.apache.org/32975] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-02 16:04:45,722 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-02 16:04:45,723 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-10-02 16:04:45,723 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37455,1696262558909 2023-10-02 16:04:45,723 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44227] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-10-02 16:04:45,723 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44227] snapshot.SnapshotManager(406): Snapshoting '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-10-02 16:04:45,723 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42303,1696262558956 2023-10-02 16:04:45,723 DEBUG [Listener at jenkins-hbase4.apache.org/32975] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-10-02 16:04:45,723 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43801,1696262558835 2023-10-02 16:04:45,725 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,42303,1696262558956': 2023-10-02 16:04:45,725 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,42303,1696262558956' released barrier for procedure'emptySnaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 0 more 2023-10-02 16:04:45,725 INFO [(jenkins-hbase4.apache.org,44227,1696262556745)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testEmptyExportFileSystemState' execution completed 2023-10-02 16:04:45,725 DEBUG [(jenkins-hbase4.apache.org,44227,1696262556745)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-02 16:04:45,725 DEBUG [(jenkins-hbase4.apache.org,44227,1696262556745)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-02 16:04:45,725 DEBUG [(jenkins-hbase4.apache.org,44227,1696262556745)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testEmptyExportFileSystemState 2023-10-02 16:04:45,725 INFO [(jenkins-hbase4.apache.org,44227,1696262556745)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testEmptyExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-10-02 16:04:45,728 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): master:44227-0x10107dfc1490000, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-10-02 16:04:45,728 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): regionserver:43801-0x10107dfc1490001, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-10-02 16:04:45,728 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-10-02 16:04:45,728 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-02 16:04:45,728 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-02 16:04:45,728 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): regionserver:37455-0x10107dfc1490002, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-10-02 16:04:45,728 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-10-02 16:04:45,728 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): regionserver:43801-0x10107dfc1490001, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-02 16:04:45,728 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): regionserver:42303-0x10107dfc1490003, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-10-02 16:04:45,728 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-10-02 16:04:45,728 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-10-02 16:04:45,728 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): regionserver:37455-0x10107dfc1490002, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-02 16:04:45,728 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-02 16:04:45,728 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-10-02 16:04:45,728 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-10-02 16:04:45,728 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): regionserver:42303-0x10107dfc1490003, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-02 16:04:45,729 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-02 16:04:45,729 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-10-02 16:04:45,729 DEBUG [(jenkins-hbase4.apache.org,44227,1696262556745)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44227-0x10107dfc1490000, quorum=127.0.0.1:50210, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37455,1696262558909 2023-10-02 16:04:45,729 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-02 16:04:45,729 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-02 16:04:45,729 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-02 16:04:45,729 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-10-02 16:04:45,729 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-02 16:04:45,729 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-02 16:04:45,729 DEBUG [(jenkins-hbase4.apache.org,44227,1696262556745)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44227-0x10107dfc1490000, quorum=127.0.0.1:50210, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,42303,1696262558956 2023-10-02 16:04:45,729 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-10-02 16:04:45,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-10-02 16:04:45,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-02 16:04:45,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-10-02 16:04:45,731 DEBUG [(jenkins-hbase4.apache.org,44227,1696262556745)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44227-0x10107dfc1490000, quorum=127.0.0.1:50210, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43801,1696262558835 2023-10-02 16:04:45,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-10-02 16:04:45,732 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37455,1696262558909 2023-10-02 16:04:45,732 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42303,1696262558956 2023-10-02 16:04:45,732 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43801,1696262558835 2023-10-02 16:04:45,733 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-02 16:04:45,733 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-10-02 16:04:45,733 DEBUG [(jenkins-hbase4.apache.org,44227,1696262556745)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44227-0x10107dfc1490000, quorum=127.0.0.1:50210, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37455,1696262558909 2023-10-02 16:04:45,733 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37455,1696262558909 2023-10-02 16:04:45,734 DEBUG [(jenkins-hbase4.apache.org,44227,1696262556745)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44227-0x10107dfc1490000, quorum=127.0.0.1:50210, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,42303,1696262558956 2023-10-02 16:04:45,734 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42303,1696262558956 2023-10-02 16:04:45,734 DEBUG [(jenkins-hbase4.apache.org,44227,1696262556745)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44227-0x10107dfc1490000, quorum=127.0.0.1:50210, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43801,1696262558835 2023-10-02 16:04:45,734 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43801,1696262558835 2023-10-02 16:04:45,737 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): master:44227-0x10107dfc1490000, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43801,1696262558835 2023-10-02 16:04:45,737 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): regionserver:43801-0x10107dfc1490001, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-02 16:04:45,737 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): regionserver:42303-0x10107dfc1490003, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-02 16:04:45,737 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): regionserver:42303-0x10107dfc1490003, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-02 16:04:45,737 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-02 16:04:45,737 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): regionserver:37455-0x10107dfc1490002, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-02 16:04:45,737 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-02 16:04:45,737 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-02 16:04:45,737 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): regionserver:43801-0x10107dfc1490001, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-02 16:04:45,737 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): master:44227-0x10107dfc1490000, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-10-02 16:04:45,737 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-02 16:04:45,737 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testEmptyExportFileSystemState 2023-10-02 16:04:45,738 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testEmptyExportFileSystemState 2023-10-02 16:04:45,738 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 37e3865d2ff7e5e2da33a03e3f723df0, NAME => 'testtb-testEmptyExportFileSystemState,.mob,0.37e3865d2ff7e5e2da33a03e3f723df0.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testEmptyExportFileSystemState 2023-10-02 16:04:45,738 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-10-02 16:04:45,737 DEBUG [(jenkins-hbase4.apache.org,44227,1696262556745)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-02 16:04:45,737 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-02 16:04:45,737 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): regionserver:37455-0x10107dfc1490002, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-02 16:04:45,738 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-02 16:04:45,738 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-02 16:04:45,738 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-02 16:04:45,738 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-02 16:04:45,737 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): master:44227-0x10107dfc1490000, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,42303,1696262558956 2023-10-02 16:04:45,739 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-02 16:04:45,739 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-10-02 16:04:45,739 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): master:44227-0x10107dfc1490000, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37455,1696262558909 2023-10-02 16:04:45,740 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): master:44227-0x10107dfc1490000, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-10-02 16:04:45,740 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): master:44227-0x10107dfc1490000, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43801,1696262558835 2023-10-02 16:04:45,740 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): master:44227-0x10107dfc1490000, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-10-02 16:04:45,741 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): master:44227-0x10107dfc1490000, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,42303,1696262558956 2023-10-02 16:04:45,741 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): master:44227-0x10107dfc1490000, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37455,1696262558909 2023-10-02 16:04:45,741 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): master:44227-0x10107dfc1490000, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-10-02 16:04:45,741 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): master:44227-0x10107dfc1490000, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-10-02 16:04:45,741 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-02 16:04:45,741 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-02 16:04:45,748 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testEmptyExportFileSystemState 2023-10-02 16:04:45,749 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-10-02 16:04:45,771 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState to hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState 2023-10-02 16:04:45,772 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed 2023-10-02 16:04:45,772 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-10-02 16:04:45,773 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-10-02 16:04:45,773 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState at 1696262685620Completed referencing HFiles for the mob region of table: testtb-testEmptyExportFileSystemState at 1696262685748 (+128 ms)Consolidate snapshot: emptySnaptb0-testEmptyExportFileSystemState at 1696262685748Loading Region manifests for emptySnaptb0-testEmptyExportFileSystemState at 1696262685749 (+1 ms)Writing data manifest for emptySnaptb0-testEmptyExportFileSystemState at 1696262685754 (+5 ms)Verifying snapshot: emptySnaptb0-testEmptyExportFileSystemState at 1696262685765 (+11 ms)Snapshot emptySnaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed at 1696262685772 (+7 ms) 2023-10-02 16:04:45,779 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=96, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-10-02 16:04:45,782 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=96, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED in 158 msec 2023-10-02 16:04:45,924 DEBUG [Listener at jenkins-hbase4.apache.org/32975] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-02 16:04:45,925 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44227] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-10-02 16:04:45,925 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44227] snapshot.SnapshotManager(403): Snapshot '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-10-02 16:04:45,927 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37455] regionserver.HRegion(8805): writing data to region testtb-testEmptyExportFileSystemState,,1696262684424.2a3bec5fb5c7687d4cec38edb5f671c2. with WAL disabled. Data may be lost in the event of a crash. 2023-10-02 16:04:45,929 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42303] regionserver.HRegion(8805): writing data to region testtb-testEmptyExportFileSystemState,1,1696262684424.5d1d6d2f2061534012429095b2044752. with WAL disabled. Data may be lost in the event of a crash. 2023-10-02 16:04:45,932 DEBUG [Listener at jenkins-hbase4.apache.org/32975] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testEmptyExportFileSystemState 2023-10-02 16:04:45,932 DEBUG [Listener at jenkins-hbase4.apache.org/32975] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testEmptyExportFileSystemState,,1696262684424.2a3bec5fb5c7687d4cec38edb5f671c2. 2023-10-02 16:04:45,933 INFO [Listener at jenkins-hbase4.apache.org/32975] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-10-02 16:04:45,946 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44227] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-10-02 16:04:45,946 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44227] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1696262685946 (current time:1696262685946). 2023-10-02 16:04:45,946 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44227] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-10-02 16:04:45,947 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44227] zookeeper.ReadOnlyZKClient(139): Connect 0x4cb92ed9 to 127.0.0.1:50210 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-02 16:04:45,957 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44227] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4b9bebce, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-02 16:04:45,959 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44227] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-02 16:04:45,963 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:37846, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-02 16:04:45,964 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44227] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4cb92ed9 to 127.0.0.1:50210 2023-10-02 16:04:45,964 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44227] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-02 16:04:45,964 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44227] zookeeper.ReadOnlyZKClient(139): Connect 0x6af17722 to 127.0.0.1:50210 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-02 16:04:45,973 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44227] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6f3b5343, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-02 16:04:45,977 DEBUG [hconnection-0x7b6a00f1-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-02 16:04:45,982 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:37856, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-02 16:04:45,988 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44227] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6af17722 to 127.0.0.1:50210 2023-10-02 16:04:45,988 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44227] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-02 16:04:45,988 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44227] access.PermissionStorage(611): Read acl: entry[testtb-testEmptyExportFileSystemState], kv [jenkins: RWXCA] 2023-10-02 16:04:45,989 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44227] snapshot.SnapshotManager(637): No existing snapshot, attempting snapshot... 2023-10-02 16:04:45,989 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44227] snapshot.SnapshotManager(684): Table enabled, starting distributed snapshots for { ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-10-02 16:04:45,992 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44227] snapshot.SnapshotManager(519): Unable to retrieve ACL status for path: hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/.hbase-snapshot, current working dir path: hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState org.apache.hadoop.hdfs.protocol.AclException: The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.ipc.RemoteException.instantiateException(RemoteException.java:121) at org.apache.hadoop.ipc.RemoteException.unwrapRemoteException(RemoteException.java:88) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2736) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2294) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2291) at org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81) at org.apache.hadoop.hdfs.DistributedFileSystem.getAclStatus(DistributedFileSystem.java:2291) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.updateWorkingDirAclsIfRequired(SnapshotManager.java:517) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.prepareToTakeSnapshot(SnapshotManager.java:490) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.snapshotEnabledTable(SnapshotManager.java:559) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshotInternal(SnapshotManager.java:687) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshot(SnapshotManager.java:623) at org.apache.hadoop.hbase.master.MasterRpcServices.snapshot(MasterRpcServices.java:1588) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) Caused by: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.hdfs.protocol.AclException): The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at org.apache.hadoop.ipc.Client.getRpcResponse(Client.java:1540) at org.apache.hadoop.ipc.Client.call(Client.java:1486) at org.apache.hadoop.ipc.Client.call(Client.java:1385) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:232) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:118) at com.sun.proxy.$Proxy32.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.getAclStatus(ClientNamenodeProtocolTranslatorPB.java:1385) at sun.reflect.GeneratedMethodAccessor63.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:422) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeMethod(RetryInvocationHandler.java:165) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invoke(RetryInvocationHandler.java:157) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeOnce(RetryInvocationHandler.java:95) at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:359) at com.sun.proxy.$Proxy35.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor63.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor63.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor63.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor63.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor63.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2734) ... 15 more 2023-10-02 16:04:45,994 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44227] procedure2.ProcedureExecutor(1028): Stored pid=97, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-10-02 16:04:45,995 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=97, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-10-02 16:04:45,996 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=97, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1696263285996 2023-10-02 16:04:45,996 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState 2023-10-02 16:04:45,996 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44227] snapshot.SnapshotManager(689): Started snapshot: { ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-10-02 16:04:45,997 DEBUG [Listener at jenkins-hbase4.apache.org/32975] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-10-02 16:04:45,997 DEBUG [Listener at jenkins-hbase4.apache.org/32975] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-10-02 16:04:45,999 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=97, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-10-02 16:04:45,999 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=98, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-10-02 16:04:46,000 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=97, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE in 6 msec 2023-10-02 16:04:46,001 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=98, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-10-02 16:04:46,003 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=98, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED; timeout=600000, timestamp=1696263286003 2023-10-02 16:04:46,016 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testEmptyExportFileSystemState 2023-10-02 16:04:46,016 INFO [(jenkins-hbase4.apache.org,44227,1696262556745)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testEmptyExportFileSystemState' 2023-10-02 16:04:46,016 DEBUG [(jenkins-hbase4.apache.org,44227,1696262556745)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-02 16:04:46,017 DEBUG [(jenkins-hbase4.apache.org,44227,1696262556745)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' 2023-10-02 16:04:46,018 DEBUG [(jenkins-hbase4.apache.org,44227,1696262556745)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testEmptyExportFileSystemState', kicking off acquire phase on members. 2023-10-02 16:04:46,018 DEBUG [(jenkins-hbase4.apache.org,44227,1696262556745)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44227-0x10107dfc1490000, quorum=127.0.0.1:50210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-10-02 16:04:46,018 DEBUG [(jenkins-hbase4.apache.org,44227,1696262556745)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-10-02 16:04:46,019 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): regionserver:37455-0x10107dfc1490002, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-02 16:04:46,019 DEBUG [(jenkins-hbase4.apache.org,44227,1696262556745)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,42303,1696262558956 2023-10-02 16:04:46,019 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-02 16:04:46,020 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-02 16:04:46,020 DEBUG [(jenkins-hbase4.apache.org,44227,1696262556745)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44227-0x10107dfc1490000, quorum=127.0.0.1:50210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,42303,1696262558956 2023-10-02 16:04:46,020 DEBUG [(jenkins-hbase4.apache.org,44227,1696262556745)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37455,1696262558909 2023-10-02 16:04:46,020 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-10-02 16:04:46,021 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): regionserver:42303-0x10107dfc1490003, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-02 16:04:46,021 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-02 16:04:46,021 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-02 16:04:46,021 DEBUG [(jenkins-hbase4.apache.org,44227,1696262556745)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44227-0x10107dfc1490000, quorum=127.0.0.1:50210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37455,1696262558909 2023-10-02 16:04:46,021 DEBUG [(jenkins-hbase4.apache.org,44227,1696262556745)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-02 16:04:46,021 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37455-0x10107dfc1490002, quorum=127.0.0.1:50210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-10-02 16:04:46,021 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-10-02 16:04:46,021 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): regionserver:43801-0x10107dfc1490001, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-02 16:04:46,021 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-02 16:04:46,021 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-02 16:04:46,022 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 184 2023-10-02 16:04:46,022 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-10-02 16:04:46,022 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42303-0x10107dfc1490003, quorum=127.0.0.1:50210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-10-02 16:04:46,022 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-10-02 16:04:46,022 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-10-02 16:04:46,022 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 184 2023-10-02 16:04:46,022 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-10-02 16:04:46,022 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-10-02 16:04:46,022 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43801-0x10107dfc1490001, quorum=127.0.0.1:50210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-10-02 16:04:46,023 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 184 2023-10-02 16:04:46,023 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-10-02 16:04:46,023 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-10-02 16:04:46,025 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testEmptyExportFileSystemState 2023-10-02 16:04:46,025 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testEmptyExportFileSystemState 2023-10-02 16:04:46,025 DEBUG [member: 'jenkins-hbase4.apache.org,37455,1696262558909' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-10-02 16:04:46,025 DEBUG [member: 'jenkins-hbase4.apache.org,43801,1696262558835' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-10-02 16:04:46,025 DEBUG [member: 'jenkins-hbase4.apache.org,43801,1696262558835' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-02 16:04:46,025 DEBUG [member: 'jenkins-hbase4.apache.org,37455,1696262558909' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-02 16:04:46,030 DEBUG [member: 'jenkins-hbase4.apache.org,43801,1696262558835' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-10-02 16:04:46,030 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testEmptyExportFileSystemState 2023-10-02 16:04:46,030 DEBUG [member: 'jenkins-hbase4.apache.org,43801,1696262558835' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally acquired 2023-10-02 16:04:46,030 DEBUG [member: 'jenkins-hbase4.apache.org,37455,1696262558909' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-10-02 16:04:46,031 DEBUG [member: 'jenkins-hbase4.apache.org,37455,1696262558909' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally acquired 2023-10-02 16:04:46,031 DEBUG [member: 'jenkins-hbase4.apache.org,42303,1696262558956' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-10-02 16:04:46,031 DEBUG [member: 'jenkins-hbase4.apache.org,43801,1696262558835' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43801,1696262558835' joining acquired barrier for procedure (snaptb0-testEmptyExportFileSystemState) in zk 2023-10-02 16:04:46,031 DEBUG [member: 'jenkins-hbase4.apache.org,42303,1696262558956' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-02 16:04:46,031 DEBUG [member: 'jenkins-hbase4.apache.org,37455,1696262558909' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37455,1696262558909' joining acquired barrier for procedure (snaptb0-testEmptyExportFileSystemState) in zk 2023-10-02 16:04:46,035 DEBUG [member: 'jenkins-hbase4.apache.org,42303,1696262558956' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-10-02 16:04:46,035 DEBUG [member: 'jenkins-hbase4.apache.org,42303,1696262558956' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally acquired 2023-10-02 16:04:46,035 DEBUG [member: 'jenkins-hbase4.apache.org,42303,1696262558956' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42303,1696262558956' joining acquired barrier for procedure (snaptb0-testEmptyExportFileSystemState) in zk 2023-10-02 16:04:46,037 DEBUG [member: 'jenkins-hbase4.apache.org,43801,1696262558835' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-10-02 16:04:46,038 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): master:44227-0x10107dfc1490000, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,42303,1696262558956 2023-10-02 16:04:46,038 DEBUG [member: 'jenkins-hbase4.apache.org,43801,1696262558835' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43801-0x10107dfc1490001, quorum=127.0.0.1:50210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-10-02 16:04:46,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,42303,1696262558956 2023-10-02 16:04:46,038 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): master:44227-0x10107dfc1490000, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37455,1696262558909 2023-10-02 16:04:46,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-02 16:04:46,038 DEBUG [member: 'jenkins-hbase4.apache.org,43801,1696262558835' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-02 16:04:46,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-02 16:04:46,038 DEBUG [member: 'jenkins-hbase4.apache.org,42303,1696262558956' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-10-02 16:04:46,038 DEBUG [member: 'jenkins-hbase4.apache.org,37455,1696262558909' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-10-02 16:04:46,041 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-02 16:04:46,041 DEBUG [member: 'jenkins-hbase4.apache.org,42303,1696262558956' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42303-0x10107dfc1490003, quorum=127.0.0.1:50210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-10-02 16:04:46,041 DEBUG [member: 'jenkins-hbase4.apache.org,37455,1696262558909' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37455-0x10107dfc1490002, quorum=127.0.0.1:50210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-10-02 16:04:46,041 DEBUG [member: 'jenkins-hbase4.apache.org,37455,1696262558909' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-02 16:04:46,041 DEBUG [member: 'jenkins-hbase4.apache.org,42303,1696262558956' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-02 16:04:46,041 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-02 16:04:46,042 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-10-02 16:04:46,042 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37455,1696262558909 2023-10-02 16:04:46,042 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42303,1696262558956 2023-10-02 16:04:46,043 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43801,1696262558835 2023-10-02 16:04:46,043 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-02 16:04:46,043 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,42303,1696262558956' joining acquired barrier for procedure 'snaptb0-testEmptyExportFileSystemState' on coordinator 2023-10-02 16:04:46,043 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@27743b30[Count = 1] remaining members to acquire global barrier 2023-10-02 16:04:46,044 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37455,1696262558909 2023-10-02 16:04:46,044 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-02 16:04:46,044 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-02 16:04:46,044 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-02 16:04:46,044 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-02 16:04:46,044 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-10-02 16:04:46,045 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37455,1696262558909 2023-10-02 16:04:46,048 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42303,1696262558956 2023-10-02 16:04:46,048 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43801,1696262558835 2023-10-02 16:04:46,049 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-02 16:04:46,049 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,37455,1696262558909' joining acquired barrier for procedure 'snaptb0-testEmptyExportFileSystemState' on coordinator 2023-10-02 16:04:46,049 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@27743b30[Count = 0] remaining members to acquire global barrier 2023-10-02 16:04:46,053 DEBUG [(jenkins-hbase4.apache.org,44227,1696262556745)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testEmptyExportFileSystemState' starting 'in-barrier' execution. 2023-10-02 16:04:46,053 DEBUG [(jenkins-hbase4.apache.org,44227,1696262556745)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-10-02 16:04:46,058 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): regionserver:43801-0x10107dfc1490001, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-10-02 16:04:46,058 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): regionserver:42303-0x10107dfc1490003, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-10-02 16:04:46,058 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-10-02 16:04:46,058 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): regionserver:37455-0x10107dfc1490002, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-10-02 16:04:46,058 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-10-02 16:04:46,058 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-10-02 16:04:46,058 DEBUG [member: 'jenkins-hbase4.apache.org,43801,1696262558835' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-10-02 16:04:46,058 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-10-02 16:04:46,058 DEBUG [member: 'jenkins-hbase4.apache.org,43801,1696262558835' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally completed 2023-10-02 16:04:46,058 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-10-02 16:04:46,058 DEBUG [member: 'jenkins-hbase4.apache.org,43801,1696262558835' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,43801,1696262558835' in zk 2023-10-02 16:04:46,058 DEBUG [member: 'jenkins-hbase4.apache.org,42303,1696262558956' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-10-02 16:04:46,058 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-10-02 16:04:46,059 DEBUG [member: 'jenkins-hbase4.apache.org,37455,1696262558909' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-10-02 16:04:46,059 DEBUG [member: 'jenkins-hbase4.apache.org,42303,1696262558956' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-02 16:04:46,059 DEBUG [member: 'jenkins-hbase4.apache.org,42303,1696262558956' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-02 16:04:46,059 DEBUG [(jenkins-hbase4.apache.org,44227,1696262556745)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44227-0x10107dfc1490000, quorum=127.0.0.1:50210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,42303,1696262558956 2023-10-02 16:04:46,059 DEBUG [rs(jenkins-hbase4.apache.org,37455,1696262558909)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,,1696262684424.2a3bec5fb5c7687d4cec38edb5f671c2. 2023-10-02 16:04:46,059 DEBUG [rs(jenkins-hbase4.apache.org,42303,1696262558956)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,1,1696262684424.5d1d6d2f2061534012429095b2044752. 2023-10-02 16:04:46,059 DEBUG [member: 'jenkins-hbase4.apache.org,37455,1696262558909' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-02 16:04:46,059 DEBUG [rs(jenkins-hbase4.apache.org,42303,1696262558956)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1696262684424.5d1d6d2f2061534012429095b2044752. started... 2023-10-02 16:04:46,059 DEBUG [rs(jenkins-hbase4.apache.org,37455,1696262558909)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1696262684424.2a3bec5fb5c7687d4cec38edb5f671c2. started... 2023-10-02 16:04:46,059 DEBUG [member: 'jenkins-hbase4.apache.org,37455,1696262558909' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-02 16:04:46,059 INFO [rs(jenkins-hbase4.apache.org,37455,1696262558909)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 2a3bec5fb5c7687d4cec38edb5f671c2 1/1 column families, dataSize=199 B heapSize=688 B 2023-10-02 16:04:46,059 INFO [rs(jenkins-hbase4.apache.org,42303,1696262558956)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 5d1d6d2f2061534012429095b2044752 1/1 column families, dataSize=3.06 KB heapSize=6.86 KB 2023-10-02 16:04:46,062 DEBUG [(jenkins-hbase4.apache.org,44227,1696262556745)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44227-0x10107dfc1490000, quorum=127.0.0.1:50210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37455,1696262558909 2023-10-02 16:04:46,062 DEBUG [(jenkins-hbase4.apache.org,44227,1696262556745)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-02 16:04:46,062 DEBUG [member: 'jenkins-hbase4.apache.org,43801,1696262558835' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-10-02 16:04:46,062 DEBUG [member: 'jenkins-hbase4.apache.org,43801,1696262558835' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-02 16:04:46,062 DEBUG [member: 'jenkins-hbase4.apache.org,43801,1696262558835' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testEmptyExportFileSystemState' completed. 2023-10-02 16:04:46,101 DEBUG [Listener at jenkins-hbase4.apache.org/32975] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-02 16:04:46,102 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44227] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-10-02 16:04:46,102 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44227] snapshot.SnapshotManager(406): Snapshoting '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-10-02 16:04:46,102 DEBUG [Listener at jenkins-hbase4.apache.org/32975] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-10-02 16:04:46,129 INFO [rs(jenkins-hbase4.apache.org,37455,1696262558909)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023100298b59e5c002c480b9b3c209c4efa7dd1 to hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e2023100298b59e5c002c480b9b3c209c4efa7dd1 2023-10-02 16:04:46,141 INFO [rs(jenkins-hbase4.apache.org,37455,1696262558909)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=199, hasBloomFilter=true, into tmp file hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/data/default/testtb-testEmptyExportFileSystemState/2a3bec5fb5c7687d4cec38edb5f671c2/.tmp/cf/c7ddd6847c804fe09dcc5aceb065507e 2023-10-02 16:04:46,147 DEBUG [rs(jenkins-hbase4.apache.org,37455,1696262558909)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/data/default/testtb-testEmptyExportFileSystemState/2a3bec5fb5c7687d4cec38edb5f671c2/.tmp/cf/c7ddd6847c804fe09dcc5aceb065507e as hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/data/default/testtb-testEmptyExportFileSystemState/2a3bec5fb5c7687d4cec38edb5f671c2/cf/c7ddd6847c804fe09dcc5aceb065507e 2023-10-02 16:04:46,151 INFO [rs(jenkins-hbase4.apache.org,37455,1696262558909)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/data/default/testtb-testEmptyExportFileSystemState/2a3bec5fb5c7687d4cec38edb5f671c2/cf/c7ddd6847c804fe09dcc5aceb065507e, entries=3, sequenceid=6, filesize=5.4 K 2023-10-02 16:04:46,152 INFO [rs(jenkins-hbase4.apache.org,37455,1696262558909)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~199 B/199, heapSize ~672 B/672, currentSize=0 B/0 for 2a3bec5fb5c7687d4cec38edb5f671c2 in 93ms, sequenceid=6, compaction requested=false 2023-10-02 16:04:46,152 DEBUG [rs(jenkins-hbase4.apache.org,37455,1696262558909)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testEmptyExportFileSystemState' 2023-10-02 16:04:46,153 DEBUG [rs(jenkins-hbase4.apache.org,37455,1696262558909)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 2a3bec5fb5c7687d4cec38edb5f671c2: 2023-10-02 16:04:46,153 DEBUG [rs(jenkins-hbase4.apache.org,37455,1696262558909)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,,1696262684424.2a3bec5fb5c7687d4cec38edb5f671c2.' region-info for snapshot=snaptb0-testEmptyExportFileSystemState 2023-10-02 16:04:46,153 DEBUG [rs(jenkins-hbase4.apache.org,37455,1696262558909)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-02 16:04:46,153 DEBUG [rs(jenkins-hbase4.apache.org,37455,1696262558909)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/data/default/testtb-testEmptyExportFileSystemState/2a3bec5fb5c7687d4cec38edb5f671c2/cf/c7ddd6847c804fe09dcc5aceb065507e] hfiles 2023-10-02 16:04:46,153 DEBUG [rs(jenkins-hbase4.apache.org,37455,1696262558909)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/data/default/testtb-testEmptyExportFileSystemState/2a3bec5fb5c7687d4cec38edb5f671c2/cf/c7ddd6847c804fe09dcc5aceb065507e for snapshot=snaptb0-testEmptyExportFileSystemState 2023-10-02 16:04:46,163 DEBUG [rs(jenkins-hbase4.apache.org,37455,1696262558909)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1696262684424.2a3bec5fb5c7687d4cec38edb5f671c2. completed. 2023-10-02 16:04:46,163 DEBUG [rs(jenkins-hbase4.apache.org,37455,1696262558909)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,,1696262684424.2a3bec5fb5c7687d4cec38edb5f671c2. 2023-10-02 16:04:46,163 DEBUG [member: 'jenkins-hbase4.apache.org,37455,1696262558909' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-02 16:04:46,163 DEBUG [member: 'jenkins-hbase4.apache.org,37455,1696262558909' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-02 16:04:46,163 DEBUG [member: 'jenkins-hbase4.apache.org,37455,1696262558909' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,37455,1696262558909 2023-10-02 16:04:46,163 DEBUG [member: 'jenkins-hbase4.apache.org,37455,1696262558909' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally completed 2023-10-02 16:04:46,164 DEBUG [member: 'jenkins-hbase4.apache.org,37455,1696262558909' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,37455,1696262558909' in zk 2023-10-02 16:04:46,165 DEBUG [member: 'jenkins-hbase4.apache.org,37455,1696262558909' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-10-02 16:04:46,165 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): master:44227-0x10107dfc1490000, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37455,1696262558909 2023-10-02 16:04:46,165 DEBUG [member: 'jenkins-hbase4.apache.org,37455,1696262558909' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-02 16:04:46,165 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37455,1696262558909 2023-10-02 16:04:46,165 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-02 16:04:46,167 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-02 16:04:46,165 DEBUG [member: 'jenkins-hbase4.apache.org,37455,1696262558909' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testEmptyExportFileSystemState' completed. 2023-10-02 16:04:46,167 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-02 16:04:46,169 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-02 16:04:46,169 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-10-02 16:04:46,170 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37455,1696262558909 2023-10-02 16:04:46,170 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42303,1696262558956 2023-10-02 16:04:46,170 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43801,1696262558835 2023-10-02 16:04:46,170 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-02 16:04:46,170 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-10-02 16:04:46,171 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37455,1696262558909 2023-10-02 16:04:46,171 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43801,1696262558835 2023-10-02 16:04:46,172 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,37455,1696262558909': 2023-10-02 16:04:46,172 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,37455,1696262558909' released barrier for procedure'snaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 1 more 2023-10-02 16:04:46,302 DEBUG [Listener at jenkins-hbase4.apache.org/32975] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-02 16:04:46,304 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44227] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-10-02 16:04:46,304 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44227] snapshot.SnapshotManager(406): Snapshoting '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-10-02 16:04:46,304 DEBUG [Listener at jenkins-hbase4.apache.org/32975] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-10-02 16:04:46,505 INFO [rs(jenkins-hbase4.apache.org,42303,1696262558956)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20231002f391b5ff8c8645f38abd52e50c118e89 to hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b20231002f391b5ff8c8645f38abd52e50c118e89 2023-10-02 16:04:46,518 INFO [rs(jenkins-hbase4.apache.org,42303,1696262558956)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=3.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/data/default/testtb-testEmptyExportFileSystemState/5d1d6d2f2061534012429095b2044752/.tmp/cf/2c710620abc74391b1a4c89eb619f9eb 2023-10-02 16:04:46,541 DEBUG [rs(jenkins-hbase4.apache.org,42303,1696262558956)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/data/default/testtb-testEmptyExportFileSystemState/5d1d6d2f2061534012429095b2044752/.tmp/cf/2c710620abc74391b1a4c89eb619f9eb as hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/data/default/testtb-testEmptyExportFileSystemState/5d1d6d2f2061534012429095b2044752/cf/2c710620abc74391b1a4c89eb619f9eb 2023-10-02 16:04:46,556 INFO [rs(jenkins-hbase4.apache.org,42303,1696262558956)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/data/default/testtb-testEmptyExportFileSystemState/5d1d6d2f2061534012429095b2044752/cf/2c710620abc74391b1a4c89eb619f9eb, entries=47, sequenceid=6, filesize=13.1 K 2023-10-02 16:04:46,557 INFO [rs(jenkins-hbase4.apache.org,42303,1696262558956)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.06 KB/3137, heapSize ~6.84 KB/7008, currentSize=0 B/0 for 5d1d6d2f2061534012429095b2044752 in 498ms, sequenceid=6, compaction requested=false 2023-10-02 16:04:46,559 DEBUG [rs(jenkins-hbase4.apache.org,42303,1696262558956)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 5d1d6d2f2061534012429095b2044752: 2023-10-02 16:04:46,559 DEBUG [rs(jenkins-hbase4.apache.org,42303,1696262558956)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,1,1696262684424.5d1d6d2f2061534012429095b2044752.' region-info for snapshot=snaptb0-testEmptyExportFileSystemState 2023-10-02 16:04:46,561 DEBUG [rs(jenkins-hbase4.apache.org,42303,1696262558956)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-02 16:04:46,561 DEBUG [rs(jenkins-hbase4.apache.org,42303,1696262558956)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/data/default/testtb-testEmptyExportFileSystemState/5d1d6d2f2061534012429095b2044752/cf/2c710620abc74391b1a4c89eb619f9eb] hfiles 2023-10-02 16:04:46,561 DEBUG [rs(jenkins-hbase4.apache.org,42303,1696262558956)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/data/default/testtb-testEmptyExportFileSystemState/5d1d6d2f2061534012429095b2044752/cf/2c710620abc74391b1a4c89eb619f9eb for snapshot=snaptb0-testEmptyExportFileSystemState 2023-10-02 16:04:46,604 DEBUG [Listener at jenkins-hbase4.apache.org/32975] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-02 16:04:46,606 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44227] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-10-02 16:04:46,606 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44227] snapshot.SnapshotManager(406): Snapshoting '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-10-02 16:04:46,606 DEBUG [Listener at jenkins-hbase4.apache.org/32975] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-10-02 16:04:46,980 DEBUG [rs(jenkins-hbase4.apache.org,42303,1696262558956)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1696262684424.5d1d6d2f2061534012429095b2044752. completed. 2023-10-02 16:04:46,980 DEBUG [rs(jenkins-hbase4.apache.org,42303,1696262558956)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,1,1696262684424.5d1d6d2f2061534012429095b2044752. 2023-10-02 16:04:46,981 DEBUG [member: 'jenkins-hbase4.apache.org,42303,1696262558956' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-02 16:04:46,981 DEBUG [member: 'jenkins-hbase4.apache.org,42303,1696262558956' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-02 16:04:46,981 DEBUG [member: 'jenkins-hbase4.apache.org,42303,1696262558956' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,42303,1696262558956 2023-10-02 16:04:46,981 DEBUG [member: 'jenkins-hbase4.apache.org,42303,1696262558956' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally completed 2023-10-02 16:04:46,981 DEBUG [member: 'jenkins-hbase4.apache.org,42303,1696262558956' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,42303,1696262558956' in zk 2023-10-02 16:04:46,982 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): master:44227-0x10107dfc1490000, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,42303,1696262558956 2023-10-02 16:04:46,982 DEBUG [member: 'jenkins-hbase4.apache.org,42303,1696262558956' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-10-02 16:04:46,982 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,42303,1696262558956 2023-10-02 16:04:46,982 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-02 16:04:46,983 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-02 16:04:46,982 DEBUG [member: 'jenkins-hbase4.apache.org,42303,1696262558956' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-02 16:04:46,983 DEBUG [member: 'jenkins-hbase4.apache.org,42303,1696262558956' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testEmptyExportFileSystemState' completed. 2023-10-02 16:04:46,987 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-02 16:04:46,987 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-02 16:04:46,988 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-10-02 16:04:46,988 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37455,1696262558909 2023-10-02 16:04:46,988 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42303,1696262558956 2023-10-02 16:04:46,988 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43801,1696262558835 2023-10-02 16:04:46,989 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-02 16:04:46,989 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-10-02 16:04:46,989 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37455,1696262558909 2023-10-02 16:04:46,989 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42303,1696262558956 2023-10-02 16:04:46,990 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43801,1696262558835 2023-10-02 16:04:46,990 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,42303,1696262558956': 2023-10-02 16:04:46,990 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,42303,1696262558956' released barrier for procedure'snaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 0 more 2023-10-02 16:04:46,990 INFO [(jenkins-hbase4.apache.org,44227,1696262556745)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testEmptyExportFileSystemState' execution completed 2023-10-02 16:04:46,990 DEBUG [(jenkins-hbase4.apache.org,44227,1696262556745)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-02 16:04:46,990 DEBUG [(jenkins-hbase4.apache.org,44227,1696262556745)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-02 16:04:46,990 DEBUG [(jenkins-hbase4.apache.org,44227,1696262556745)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testEmptyExportFileSystemState 2023-10-02 16:04:46,990 INFO [(jenkins-hbase4.apache.org,44227,1696262556745)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testEmptyExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-10-02 16:04:46,992 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): regionserver:37455-0x10107dfc1490002, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-10-02 16:04:46,992 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): regionserver:43801-0x10107dfc1490001, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-10-02 16:04:46,992 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-10-02 16:04:46,992 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-10-02 16:04:46,992 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): regionserver:43801-0x10107dfc1490001, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-02 16:04:46,992 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-10-02 16:04:46,992 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): regionserver:37455-0x10107dfc1490002, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-02 16:04:46,992 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): regionserver:42303-0x10107dfc1490003, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-10-02 16:04:46,992 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): regionserver:42303-0x10107dfc1490003, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-02 16:04:46,992 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-10-02 16:04:46,992 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-10-02 16:04:46,992 DEBUG [(jenkins-hbase4.apache.org,44227,1696262556745)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44227-0x10107dfc1490000, quorum=127.0.0.1:50210, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37455,1696262558909 2023-10-02 16:04:46,992 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): master:44227-0x10107dfc1490000, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-10-02 16:04:46,992 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-02 16:04:46,992 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-10-02 16:04:46,992 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-02 16:04:46,992 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-02 16:04:46,992 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-10-02 16:04:46,992 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-02 16:04:46,993 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-02 16:04:46,993 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-02 16:04:46,993 DEBUG [(jenkins-hbase4.apache.org,44227,1696262556745)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44227-0x10107dfc1490000, quorum=127.0.0.1:50210, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,42303,1696262558956 2023-10-02 16:04:46,993 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-10-02 16:04:46,993 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-02 16:04:46,993 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-02 16:04:46,993 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-02 16:04:46,993 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-10-02 16:04:46,993 DEBUG [(jenkins-hbase4.apache.org,44227,1696262556745)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44227-0x10107dfc1490000, quorum=127.0.0.1:50210, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43801,1696262558835 2023-10-02 16:04:46,993 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-10-02 16:04:46,993 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-10-02 16:04:46,994 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-02 16:04:46,994 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-10-02 16:04:46,994 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37455,1696262558909 2023-10-02 16:04:46,995 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42303,1696262558956 2023-10-02 16:04:46,995 DEBUG [(jenkins-hbase4.apache.org,44227,1696262556745)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44227-0x10107dfc1490000, quorum=127.0.0.1:50210, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37455,1696262558909 2023-10-02 16:04:46,995 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43801,1696262558835 2023-10-02 16:04:46,995 DEBUG [(jenkins-hbase4.apache.org,44227,1696262556745)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44227-0x10107dfc1490000, quorum=127.0.0.1:50210, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,42303,1696262558956 2023-10-02 16:04:46,995 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-02 16:04:46,996 DEBUG [(jenkins-hbase4.apache.org,44227,1696262556745)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44227-0x10107dfc1490000, quorum=127.0.0.1:50210, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43801,1696262558835 2023-10-02 16:04:46,996 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-10-02 16:04:46,996 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37455,1696262558909 2023-10-02 16:04:46,996 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42303,1696262558956 2023-10-02 16:04:46,997 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43801,1696262558835 2023-10-02 16:04:46,999 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): master:44227-0x10107dfc1490000, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43801,1696262558835 2023-10-02 16:04:46,999 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): master:44227-0x10107dfc1490000, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-10-02 16:04:47,000 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): regionserver:42303-0x10107dfc1490003, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-02 16:04:47,000 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): regionserver:37455-0x10107dfc1490002, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-02 16:04:47,000 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): master:44227-0x10107dfc1490000, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,42303,1696262558956 2023-10-02 16:04:47,000 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): regionserver:43801-0x10107dfc1490001, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-02 16:04:47,000 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): master:44227-0x10107dfc1490000, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37455,1696262558909 2023-10-02 16:04:47,000 DEBUG [(jenkins-hbase4.apache.org,44227,1696262556745)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-02 16:04:47,000 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): regionserver:37455-0x10107dfc1490002, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-02 16:04:47,000 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-02 16:04:47,000 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-02 16:04:47,000 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-02 16:04:47,000 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-02 16:04:47,000 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): regionserver:42303-0x10107dfc1490003, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-02 16:04:47,000 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): master:44227-0x10107dfc1490000, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-10-02 16:04:47,000 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testEmptyExportFileSystemState 2023-10-02 16:04:47,000 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-02 16:04:47,000 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-02 16:04:47,000 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-02 16:04:47,000 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): regionserver:43801-0x10107dfc1490001, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-02 16:04:47,000 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-02 16:04:47,000 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-02 16:04:47,000 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testEmptyExportFileSystemState 2023-10-02 16:04:47,000 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): master:44227-0x10107dfc1490000, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43801,1696262558835 2023-10-02 16:04:47,001 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-02 16:04:47,001 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-02 16:04:47,001 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 37e3865d2ff7e5e2da33a03e3f723df0, NAME => 'testtb-testEmptyExportFileSystemState,.mob,0.37e3865d2ff7e5e2da33a03e3f723df0.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testEmptyExportFileSystemState 2023-10-02 16:04:47,001 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): master:44227-0x10107dfc1490000, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-10-02 16:04:47,000 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-02 16:04:47,001 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): master:44227-0x10107dfc1490000, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,42303,1696262558956 2023-10-02 16:04:47,001 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-10-02 16:04:47,001 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): master:44227-0x10107dfc1490000, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37455,1696262558909 2023-10-02 16:04:47,001 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): master:44227-0x10107dfc1490000, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-10-02 16:04:47,001 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): master:44227-0x10107dfc1490000, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-10-02 16:04:47,002 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b20231002f391b5ff8c8645f38abd52e50c118e89, hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e2023100298b59e5c002c480b9b3c209c4efa7dd1] mob files 2023-10-02 16:04:47,002 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b20231002f391b5ff8c8645f38abd52e50c118e89 2023-10-02 16:04:47,002 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e2023100298b59e5c002c480b9b3c209c4efa7dd1 2023-10-02 16:04:47,009 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testEmptyExportFileSystemState 2023-10-02 16:04:47,010 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState 2023-10-02 16:04:47,027 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState to hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/.hbase-snapshot/snaptb0-testEmptyExportFileSystemState 2023-10-02 16:04:47,028 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed 2023-10-02 16:04:47,028 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState 2023-10-02 16:04:47,029 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState 2023-10-02 16:04:47,029 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState at 1696262685996Completed referencing HFiles for the mob region of table: testtb-testEmptyExportFileSystemState at 1696262687009 (+1013 ms)Consolidate snapshot: snaptb0-testEmptyExportFileSystemState at 1696262687009Loading Region manifests for snaptb0-testEmptyExportFileSystemState at 1696262687009Writing data manifest for snaptb0-testEmptyExportFileSystemState at 1696262687013 (+4 ms)Verifying snapshot: snaptb0-testEmptyExportFileSystemState at 1696262687020 (+7 ms)Snapshot snaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed at 1696262687028 (+8 ms) 2023-10-02 16:04:47,035 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=98, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-10-02 16:04:47,037 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=98, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED in 1.0380 sec 2023-10-02 16:04:47,106 DEBUG [Listener at jenkins-hbase4.apache.org/32975] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-02 16:04:47,107 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44227] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-10-02 16:04:47,107 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44227] snapshot.SnapshotManager(403): Snapshot '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-10-02 16:04:47,108 INFO [Listener at jenkins-hbase4.apache.org/32975] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/export-test/export-1696262687108 2023-10-02 16:04:47,108 INFO [Listener at jenkins-hbase4.apache.org/32975] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:42119, tgtDir=hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/export-test/export-1696262687108, rawTgtDir=hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/export-test/export-1696262687108, srcFsUri=hdfs://localhost:42119, srcDir=hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af 2023-10-02 16:04:47,130 DEBUG [Listener at jenkins-hbase4.apache.org/32975] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:42119, inputRoot=hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af 2023-10-02 16:04:47,130 DEBUG [Listener at jenkins-hbase4.apache.org/32975] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1537928970_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/export-test/export-1696262687108, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/export-test/export-1696262687108/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-10-02 16:04:47,131 INFO [Listener at jenkins-hbase4.apache.org/32975] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:42119, inputRoot=hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af, snapshotDir=hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState. 2023-10-02 16:04:47,138 INFO [Listener at jenkins-hbase4.apache.org/32975] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState to hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/export-test/export-1696262687108/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-10-02 16:04:47,159 DEBUG [Listener at jenkins-hbase4.apache.org/32975] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-10-02 16:04:47,159 DEBUG [Listener at jenkins-hbase4.apache.org/32975] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-10-02 16:04:47,160 DEBUG [Listener at jenkins-hbase4.apache.org/32975] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-10-02 16:04:47,160 DEBUG [Listener at jenkins-hbase4.apache.org/32975] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-10-02 16:04:48,054 DEBUG [Listener at jenkins-hbase4.apache.org/32975] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ec4ab044-456e-ce77-098f-f91b72a3e0ab/hadoop-3983051852311259391.jar 2023-10-02 16:04:48,055 DEBUG [Listener at jenkins-hbase4.apache.org/32975] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-10-02 16:04:48,055 DEBUG [Listener at jenkins-hbase4.apache.org/32975] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-10-02 16:04:48,122 DEBUG [Listener at jenkins-hbase4.apache.org/32975] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ec4ab044-456e-ce77-098f-f91b72a3e0ab/hadoop-5555579186957167303.jar 2023-10-02 16:04:48,123 DEBUG [Listener at jenkins-hbase4.apache.org/32975] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-10-02 16:04:48,123 DEBUG [Listener at jenkins-hbase4.apache.org/32975] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-10-02 16:04:48,124 DEBUG [Listener at jenkins-hbase4.apache.org/32975] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-10-02 16:04:48,124 DEBUG [Listener at jenkins-hbase4.apache.org/32975] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-10-02 16:04:48,124 DEBUG [Listener at jenkins-hbase4.apache.org/32975] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-10-02 16:04:48,125 DEBUG [Listener at jenkins-hbase4.apache.org/32975] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-10-02 16:04:48,125 DEBUG [Listener at jenkins-hbase4.apache.org/32975] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-10-02 16:04:48,126 DEBUG [Listener at jenkins-hbase4.apache.org/32975] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-10-02 16:04:48,126 DEBUG [Listener at jenkins-hbase4.apache.org/32975] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-10-02 16:04:48,126 DEBUG [Listener at jenkins-hbase4.apache.org/32975] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-10-02 16:04:48,127 DEBUG [Listener at jenkins-hbase4.apache.org/32975] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-10-02 16:04:48,127 DEBUG [Listener at jenkins-hbase4.apache.org/32975] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-10-02 16:04:48,128 DEBUG [Listener at jenkins-hbase4.apache.org/32975] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-10-02 16:04:48,128 DEBUG [Listener at jenkins-hbase4.apache.org/32975] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-10-02 16:04:48,128 DEBUG [Listener at jenkins-hbase4.apache.org/32975] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-10-02 16:04:48,129 DEBUG [Listener at jenkins-hbase4.apache.org/32975] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-10-02 16:04:48,129 DEBUG [Listener at jenkins-hbase4.apache.org/32975] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-02 16:04:48,130 DEBUG [Listener at jenkins-hbase4.apache.org/32975] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-02 16:04:48,130 DEBUG [Listener at jenkins-hbase4.apache.org/32975] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-10-02 16:04:48,130 DEBUG [Listener at jenkins-hbase4.apache.org/32975] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-02 16:04:48,131 DEBUG [Listener at jenkins-hbase4.apache.org/32975] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-02 16:04:48,131 DEBUG [Listener at jenkins-hbase4.apache.org/32975] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-10-02 16:04:48,132 DEBUG [Listener at jenkins-hbase4.apache.org/32975] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-10-02 16:04:48,243 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696262569087_0005_000001 (auth:SIMPLE) 2023-10-02 16:04:48,605 WARN [Listener at jenkins-hbase4.apache.org/32975] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-10-02 16:04:48,610 INFO [Listener at jenkins-hbase4.apache.org/32975] snapshot.ExportSnapshot(578): Loading Snapshot 'emptySnaptb0-testEmptyExportFileSystemState' hfile list 2023-10-02 16:04:49,102 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-10-02 16:04:49,102 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-10-02 16:04:49,246 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696262569087_0006_000001 (auth:SIMPLE) 2023-10-02 16:04:49,276 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-10-02 16:04:53,803 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696262569087_0006_000001 (auth:SIMPLE) 2023-10-02 16:04:56,400 INFO [Listener at jenkins-hbase4.apache.org/32975] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-10-02 16:04:56,401 INFO [Listener at jenkins-hbase4.apache.org/32975] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-10-02 16:04:56,406 INFO [Listener at jenkins-hbase4.apache.org/32975] snapshot.ExportSnapshot(1127): Export Completed: emptySnaptb0-testEmptyExportFileSystemState 2023-10-02 16:04:56,407 INFO [Listener at jenkins-hbase4.apache.org/32975] snapshot.TestExportSnapshot(279): Exported snapshot 2023-10-02 16:04:56,409 INFO [Listener at jenkins-hbase4.apache.org/32975] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-10-02 16:04:56,409 DEBUG [Listener at jenkins-hbase4.apache.org/32975] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_95248091_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState at hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState 2023-10-02 16:04:56,410 DEBUG [Listener at jenkins-hbase4.apache.org/32975] snapshot.TestExportSnapshot(367): hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/.snapshotinfo 2023-10-02 16:04:56,410 DEBUG [Listener at jenkins-hbase4.apache.org/32975] snapshot.TestExportSnapshot(367): hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/data.manifest 2023-10-02 16:04:56,410 DEBUG [Listener at jenkins-hbase4.apache.org/32975] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_95248091_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/export-test/export-1696262687108/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState at hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/export-test/export-1696262687108/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState 2023-10-02 16:04:56,410 DEBUG [Listener at jenkins-hbase4.apache.org/32975] snapshot.TestExportSnapshot(367): hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/export-test/export-1696262687108/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/.snapshotinfo 2023-10-02 16:04:56,410 DEBUG [Listener at jenkins-hbase4.apache.org/32975] snapshot.TestExportSnapshot(367): hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/export-test/export-1696262687108/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/data.manifest 2023-10-02 16:04:56,417 INFO [Listener at jenkins-hbase4.apache.org/32975] client.HBaseAdmin$15(890): Started disable of testtb-testEmptyExportFileSystemState 2023-10-02 16:04:56,417 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44227] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testEmptyExportFileSystemState 2023-10-02 16:04:56,418 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44227] procedure2.ProcedureExecutor(1028): Stored pid=99, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testEmptyExportFileSystemState 2023-10-02 16:04:56,421 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44227] master.MasterRpcServices(1230): Checking to see if procedure is done pid=99 2023-10-02 16:04:56,421 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696262696421"}]},"ts":"1696262696421"} 2023-10-02 16:04:56,425 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=DISABLING in hbase:meta 2023-10-02 16:04:56,427 INFO [PEWorker-3] procedure.DisableTableProcedure(293): Set testtb-testEmptyExportFileSystemState to state=DISABLING 2023-10-02 16:04:56,428 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=100, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=2a3bec5fb5c7687d4cec38edb5f671c2, UNASSIGN}, {pid=101, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=5d1d6d2f2061534012429095b2044752, UNASSIGN}] 2023-10-02 16:04:56,431 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=100, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=2a3bec5fb5c7687d4cec38edb5f671c2, UNASSIGN 2023-10-02 16:04:56,431 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=101, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=5d1d6d2f2061534012429095b2044752, UNASSIGN 2023-10-02 16:04:56,433 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=100 updating hbase:meta row=2a3bec5fb5c7687d4cec38edb5f671c2, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,37455,1696262558909 2023-10-02 16:04:56,433 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=101 updating hbase:meta row=5d1d6d2f2061534012429095b2044752, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,42303,1696262558956 2023-10-02 16:04:56,433 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,,1696262684424.2a3bec5fb5c7687d4cec38edb5f671c2.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1696262696433"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696262696433"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696262696433"}]},"ts":"1696262696433"} 2023-10-02 16:04:56,433 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,1,1696262684424.5d1d6d2f2061534012429095b2044752.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1696262696433"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696262696433"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696262696433"}]},"ts":"1696262696433"} 2023-10-02 16:04:56,435 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=102, ppid=100, state=RUNNABLE; CloseRegionProcedure 2a3bec5fb5c7687d4cec38edb5f671c2, server=jenkins-hbase4.apache.org,37455,1696262558909}] 2023-10-02 16:04:56,435 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=103, ppid=101, state=RUNNABLE; CloseRegionProcedure 5d1d6d2f2061534012429095b2044752, server=jenkins-hbase4.apache.org,42303,1696262558956}] 2023-10-02 16:04:56,522 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44227] master.MasterRpcServices(1230): Checking to see if procedure is done pid=99 2023-10-02 16:04:56,587 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 2a3bec5fb5c7687d4cec38edb5f671c2 2023-10-02 16:04:56,587 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 2a3bec5fb5c7687d4cec38edb5f671c2, disabling compactions & flushes 2023-10-02 16:04:56,587 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,,1696262684424.2a3bec5fb5c7687d4cec38edb5f671c2. 2023-10-02 16:04:56,587 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,,1696262684424.2a3bec5fb5c7687d4cec38edb5f671c2. 2023-10-02 16:04:56,587 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,,1696262684424.2a3bec5fb5c7687d4cec38edb5f671c2. after waiting 0 ms 2023-10-02 16:04:56,587 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,,1696262684424.2a3bec5fb5c7687d4cec38edb5f671c2. 2023-10-02 16:04:56,589 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 5d1d6d2f2061534012429095b2044752 2023-10-02 16:04:56,591 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 5d1d6d2f2061534012429095b2044752, disabling compactions & flushes 2023-10-02 16:04:56,591 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,1,1696262684424.5d1d6d2f2061534012429095b2044752. 2023-10-02 16:04:56,591 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,1,1696262684424.5d1d6d2f2061534012429095b2044752. 2023-10-02 16:04:56,591 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,1,1696262684424.5d1d6d2f2061534012429095b2044752. after waiting 0 ms 2023-10-02 16:04:56,592 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,1,1696262684424.5d1d6d2f2061534012429095b2044752. 2023-10-02 16:04:56,599 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/data/default/testtb-testEmptyExportFileSystemState/5d1d6d2f2061534012429095b2044752/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-10-02 16:04:56,600 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-10-02 16:04:56,601 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,1,1696262684424.5d1d6d2f2061534012429095b2044752. 2023-10-02 16:04:56,601 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 5d1d6d2f2061534012429095b2044752: 2023-10-02 16:04:56,603 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 5d1d6d2f2061534012429095b2044752 2023-10-02 16:04:56,603 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/data/default/testtb-testEmptyExportFileSystemState/2a3bec5fb5c7687d4cec38edb5f671c2/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-10-02 16:04:56,603 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=101 updating hbase:meta row=5d1d6d2f2061534012429095b2044752, regionState=CLOSED 2023-10-02 16:04:56,603 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,1,1696262684424.5d1d6d2f2061534012429095b2044752.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1696262696603"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696262696603"}]},"ts":"1696262696603"} 2023-10-02 16:04:56,603 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-10-02 16:04:56,604 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,,1696262684424.2a3bec5fb5c7687d4cec38edb5f671c2. 2023-10-02 16:04:56,604 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 2a3bec5fb5c7687d4cec38edb5f671c2: 2023-10-02 16:04:56,606 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 2a3bec5fb5c7687d4cec38edb5f671c2 2023-10-02 16:04:56,606 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=100 updating hbase:meta row=2a3bec5fb5c7687d4cec38edb5f671c2, regionState=CLOSED 2023-10-02 16:04:56,606 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,,1696262684424.2a3bec5fb5c7687d4cec38edb5f671c2.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1696262696606"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696262696606"}]},"ts":"1696262696606"} 2023-10-02 16:04:56,608 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=103, resume processing ppid=101 2023-10-02 16:04:56,608 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=103, ppid=101, state=SUCCESS; CloseRegionProcedure 5d1d6d2f2061534012429095b2044752, server=jenkins-hbase4.apache.org,42303,1696262558956 in 171 msec 2023-10-02 16:04:56,609 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=101, ppid=99, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=5d1d6d2f2061534012429095b2044752, UNASSIGN in 180 msec 2023-10-02 16:04:56,610 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=102, resume processing ppid=100 2023-10-02 16:04:56,610 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=102, ppid=100, state=SUCCESS; CloseRegionProcedure 2a3bec5fb5c7687d4cec38edb5f671c2, server=jenkins-hbase4.apache.org,37455,1696262558909 in 173 msec 2023-10-02 16:04:56,611 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=100, resume processing ppid=99 2023-10-02 16:04:56,611 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=100, ppid=99, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=2a3bec5fb5c7687d4cec38edb5f671c2, UNASSIGN in 182 msec 2023-10-02 16:04:56,612 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696262696612"}]},"ts":"1696262696612"} 2023-10-02 16:04:56,613 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=DISABLED in hbase:meta 2023-10-02 16:04:56,615 INFO [PEWorker-1] procedure.DisableTableProcedure(305): Set testtb-testEmptyExportFileSystemState to state=DISABLED 2023-10-02 16:04:56,616 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=99, state=SUCCESS; DisableTableProcedure table=testtb-testEmptyExportFileSystemState in 198 msec 2023-10-02 16:04:56,723 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44227] master.MasterRpcServices(1230): Checking to see if procedure is done pid=99 2023-10-02 16:04:56,723 INFO [Listener at jenkins-hbase4.apache.org/32975] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testEmptyExportFileSystemState, procId: 99 completed 2023-10-02 16:04:56,724 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44227] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testEmptyExportFileSystemState 2023-10-02 16:04:56,725 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44227] procedure2.ProcedureExecutor(1028): Stored pid=104, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-10-02 16:04:56,727 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=104, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-10-02 16:04:56,727 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44227] access.PermissionStorage(259): Removing permissions of removed table testtb-testEmptyExportFileSystemState 2023-10-02 16:04:56,728 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=104, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-10-02 16:04:56,729 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=42303] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testEmptyExportFileSystemState 2023-10-02 16:04:56,731 DEBUG [HFileArchiver-18] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/.tmp/data/default/testtb-testEmptyExportFileSystemState/2a3bec5fb5c7687d4cec38edb5f671c2 2023-10-02 16:04:56,731 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/.tmp/data/default/testtb-testEmptyExportFileSystemState/5d1d6d2f2061534012429095b2044752 2023-10-02 16:04:56,733 DEBUG [HFileArchiver-13] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/.tmp/data/default/testtb-testEmptyExportFileSystemState/5d1d6d2f2061534012429095b2044752/cf, FileablePath, hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/.tmp/data/default/testtb-testEmptyExportFileSystemState/5d1d6d2f2061534012429095b2044752/recovered.edits] 2023-10-02 16:04:56,733 DEBUG [HFileArchiver-18] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/.tmp/data/default/testtb-testEmptyExportFileSystemState/2a3bec5fb5c7687d4cec38edb5f671c2/cf, FileablePath, hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/.tmp/data/default/testtb-testEmptyExportFileSystemState/2a3bec5fb5c7687d4cec38edb5f671c2/recovered.edits] 2023-10-02 16:04:56,735 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): regionserver:42303-0x10107dfc1490003, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-10-02 16:04:56,735 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): regionserver:37455-0x10107dfc1490002, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-10-02 16:04:56,735 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): master:44227-0x10107dfc1490000, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-10-02 16:04:56,735 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): regionserver:43801-0x10107dfc1490001, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-10-02 16:04:56,736 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-10-02 16:04:56,736 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-10-02 16:04:56,736 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-10-02 16:04:56,737 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): regionserver:37455-0x10107dfc1490002, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-10-02 16:04:56,737 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): regionserver:43801-0x10107dfc1490001, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-02 16:04:56,737 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): master:44227-0x10107dfc1490000, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-10-02 16:04:56,737 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): regionserver:37455-0x10107dfc1490002, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-02 16:04:56,737 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): master:44227-0x10107dfc1490000, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-02 16:04:56,737 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): regionserver:42303-0x10107dfc1490003, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-10-02 16:04:56,737 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data null 2023-10-02 16:04:56,737 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-10-02 16:04:56,737 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): regionserver:42303-0x10107dfc1490003, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-02 16:04:56,738 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44227] master.MasterRpcServices(1230): Checking to see if procedure is done pid=104 2023-10-02 16:04:56,739 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/.tmp/data/default/testtb-testEmptyExportFileSystemState/5d1d6d2f2061534012429095b2044752/cf/2c710620abc74391b1a4c89eb619f9eb to hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/archive/data/default/testtb-testEmptyExportFileSystemState/5d1d6d2f2061534012429095b2044752/cf/2c710620abc74391b1a4c89eb619f9eb 2023-10-02 16:04:56,739 DEBUG [HFileArchiver-18] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/.tmp/data/default/testtb-testEmptyExportFileSystemState/2a3bec5fb5c7687d4cec38edb5f671c2/cf/c7ddd6847c804fe09dcc5aceb065507e to hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/archive/data/default/testtb-testEmptyExportFileSystemState/2a3bec5fb5c7687d4cec38edb5f671c2/cf/c7ddd6847c804fe09dcc5aceb065507e 2023-10-02 16:04:56,742 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/.tmp/data/default/testtb-testEmptyExportFileSystemState/5d1d6d2f2061534012429095b2044752/recovered.edits/9.seqid to hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/archive/data/default/testtb-testEmptyExportFileSystemState/5d1d6d2f2061534012429095b2044752/recovered.edits/9.seqid 2023-10-02 16:04:56,743 DEBUG [HFileArchiver-18] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/.tmp/data/default/testtb-testEmptyExportFileSystemState/2a3bec5fb5c7687d4cec38edb5f671c2/recovered.edits/9.seqid to hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/archive/data/default/testtb-testEmptyExportFileSystemState/2a3bec5fb5c7687d4cec38edb5f671c2/recovered.edits/9.seqid 2023-10-02 16:04:56,743 DEBUG [HFileArchiver-13] backup.HFileArchiver(596): Deleted hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/.tmp/data/default/testtb-testEmptyExportFileSystemState/5d1d6d2f2061534012429095b2044752 2023-10-02 16:04:56,743 DEBUG [HFileArchiver-18] backup.HFileArchiver(596): Deleted hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/.tmp/data/default/testtb-testEmptyExportFileSystemState/2a3bec5fb5c7687d4cec38edb5f671c2 2023-10-02 16:04:56,743 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testtb-testEmptyExportFileSystemState regions 2023-10-02 16:04:56,744 DEBUG [PEWorker-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0 2023-10-02 16:04:56,745 DEBUG [PEWorker-2] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf] 2023-10-02 16:04:56,749 DEBUG [PEWorker-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b20231002f391b5ff8c8645f38abd52e50c118e89 to hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/archive/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b20231002f391b5ff8c8645f38abd52e50c118e89 2023-10-02 16:04:56,750 DEBUG [PEWorker-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e2023100298b59e5c002c480b9b3c209c4efa7dd1 to hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/archive/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e2023100298b59e5c002c480b9b3c209c4efa7dd1 2023-10-02 16:04:56,751 DEBUG [PEWorker-2] backup.HFileArchiver(596): Deleted hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0 2023-10-02 16:04:56,753 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=104, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-10-02 16:04:56,755 WARN [PEWorker-2] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testEmptyExportFileSystemState from hbase:meta 2023-10-02 16:04:56,757 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(421): Removing 'testtb-testEmptyExportFileSystemState' descriptor. 2023-10-02 16:04:56,758 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=104, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-10-02 16:04:56,759 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(411): Removing 'testtb-testEmptyExportFileSystemState' from region states. 2023-10-02 16:04:56,759 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState,,1696262684424.2a3bec5fb5c7687d4cec38edb5f671c2.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1696262696759"}]},"ts":"9223372036854775807"} 2023-10-02 16:04:56,759 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState,1,1696262684424.5d1d6d2f2061534012429095b2044752.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1696262696759"}]},"ts":"9223372036854775807"} 2023-10-02 16:04:56,761 INFO [PEWorker-2] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-10-02 16:04:56,761 DEBUG [PEWorker-2] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 2a3bec5fb5c7687d4cec38edb5f671c2, NAME => 'testtb-testEmptyExportFileSystemState,,1696262684424.2a3bec5fb5c7687d4cec38edb5f671c2.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 5d1d6d2f2061534012429095b2044752, NAME => 'testtb-testEmptyExportFileSystemState,1,1696262684424.5d1d6d2f2061534012429095b2044752.', STARTKEY => '1', ENDKEY => ''}] 2023-10-02 16:04:56,761 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(415): Marking 'testtb-testEmptyExportFileSystemState' as deleted. 2023-10-02 16:04:56,761 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1696262696761"}]},"ts":"9223372036854775807"} 2023-10-02 16:04:56,763 INFO [PEWorker-2] hbase.MetaTableAccessor(1658): Deleted table testtb-testEmptyExportFileSystemState state from META 2023-10-02 16:04:56,765 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(130): Finished pid=104, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-10-02 16:04:56,766 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=104, state=SUCCESS; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState in 41 msec 2023-10-02 16:04:56,839 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44227] master.MasterRpcServices(1230): Checking to see if procedure is done pid=104 2023-10-02 16:04:56,840 INFO [Listener at jenkins-hbase4.apache.org/32975] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testEmptyExportFileSystemState, procId: 104 completed 2023-10-02 16:04:56,846 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44227] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testEmptyExportFileSystemState" 2023-10-02 16:04:56,848 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44227] snapshot.SnapshotManager(335): Deleting snapshot: emptySnaptb0-testEmptyExportFileSystemState 2023-10-02 16:04:56,849 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44227] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testEmptyExportFileSystemState" 2023-10-02 16:04:56,851 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44227] snapshot.SnapshotManager(335): Deleting snapshot: snaptb0-testEmptyExportFileSystemState 2023-10-02 16:04:56,875 INFO [Listener at jenkins-hbase4.apache.org/32975] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testEmptyExportFileSystemState Thread=767 (was 762) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-164087785_1 at /127.0.0.1:39424 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x646a4964-shared-pool-36 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x646a4964-shared-pool-39 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-164087785_1 at /127.0.0.1:56912 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x646a4964-shared-pool-38 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #10 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_95248091_17 at /127.0.0.1:37010 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (337744187) connection to jenkins-hbase4.apache.org/172.31.14.131:33171 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_95248091_17 at /127.0.0.1:35064 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (337744187) connection to jenkins-hbase4.apache.org/172.31.14.131:35447 from appattempt_1696262569087_0005_000001 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: hconnection-0x646a4964-shared-pool-37 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-4853 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: IPC Client (337744187) connection to jenkins-hbase4.apache.org/172.31.14.131:35447 from appattempt_1696262569087_0006_000001 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: ApplicationMasterLauncher #9 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_95248091_17 at /127.0.0.1:38030 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=937 (was 896) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=557 (was 566), ProcessCount=197 (was 197), AvailableMemoryMB=427 (was 559) 2023-10-02 16:04:56,875 WARN [Listener at jenkins-hbase4.apache.org/32975] hbase.ResourceChecker(130): Thread=767 is superior to 500 2023-10-02 16:04:56,896 INFO [Listener at jenkins-hbase4.apache.org/32975] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testExportFileSystemStateWithSkipTmp Thread=767, OpenFileDescriptor=937, MaxFileDescriptor=60000, SystemLoadAverage=557, ProcessCount=197, AvailableMemoryMB=426 2023-10-02 16:04:56,897 WARN [Listener at jenkins-hbase4.apache.org/32975] hbase.ResourceChecker(130): Thread=767 is superior to 500 2023-10-02 16:04:56,898 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44227] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemStateWithSkipTmp', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-10-02 16:04:56,899 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44227] procedure2.ProcedureExecutor(1028): Stored pid=105, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-10-02 16:04:56,902 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_PRE_OPERATION 2023-10-02 16:04:56,902 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44227] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemStateWithSkipTmp" procId is: 105 2023-10-02 16:04:56,902 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-10-02 16:04:56,903 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44227] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-10-02 16:04:56,905 DEBUG [HFileArchiver-20] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/cc87b7c74312cb3f197c536bbc8d02bd 2023-10-02 16:04:56,905 DEBUG [HFileArchiver-19] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/4e2ed20fe1c38112784a6cedd7c6ea28 2023-10-02 16:04:56,905 DEBUG [HFileArchiver-20] backup.HFileArchiver(153): Directory hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/cc87b7c74312cb3f197c536bbc8d02bd empty. 2023-10-02 16:04:56,905 DEBUG [HFileArchiver-19] backup.HFileArchiver(153): Directory hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/4e2ed20fe1c38112784a6cedd7c6ea28 empty. 2023-10-02 16:04:56,906 DEBUG [HFileArchiver-20] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/cc87b7c74312cb3f197c536bbc8d02bd 2023-10-02 16:04:56,906 DEBUG [HFileArchiver-19] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/4e2ed20fe1c38112784a6cedd7c6ea28 2023-10-02 16:04:56,906 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithSkipTmp regions 2023-10-02 16:04:56,915 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/.tabledesc/.tableinfo.0000000001 2023-10-02 16:04:56,917 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(7675): creating {ENCODED => cc87b7c74312cb3f197c536bbc8d02bd, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,,1696262696898.cc87b7c74312cb3f197c536bbc8d02bd.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportFileSystemStateWithSkipTmp', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/.tmp 2023-10-02 16:04:56,917 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(7675): creating {ENCODED => 4e2ed20fe1c38112784a6cedd7c6ea28, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,1,1696262696898.4e2ed20fe1c38112784a6cedd7c6ea28.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemStateWithSkipTmp', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/.tmp 2023-10-02 16:04:56,927 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,,1696262696898.cc87b7c74312cb3f197c536bbc8d02bd.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-02 16:04:56,927 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1604): Closing cc87b7c74312cb3f197c536bbc8d02bd, disabling compactions & flushes 2023-10-02 16:04:56,928 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,,1696262696898.cc87b7c74312cb3f197c536bbc8d02bd. 2023-10-02 16:04:56,928 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,,1696262696898.cc87b7c74312cb3f197c536bbc8d02bd. 2023-10-02 16:04:56,928 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,,1696262696898.cc87b7c74312cb3f197c536bbc8d02bd. after waiting 0 ms 2023-10-02 16:04:56,928 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,,1696262696898.cc87b7c74312cb3f197c536bbc8d02bd. 2023-10-02 16:04:56,928 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,1,1696262696898.4e2ed20fe1c38112784a6cedd7c6ea28.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-02 16:04:56,928 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,,1696262696898.cc87b7c74312cb3f197c536bbc8d02bd. 2023-10-02 16:04:56,928 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1604): Closing 4e2ed20fe1c38112784a6cedd7c6ea28, disabling compactions & flushes 2023-10-02 16:04:56,928 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1558): Region close journal for cc87b7c74312cb3f197c536bbc8d02bd: 2023-10-02 16:04:56,928 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,1,1696262696898.4e2ed20fe1c38112784a6cedd7c6ea28. 2023-10-02 16:04:56,928 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1696262696898.4e2ed20fe1c38112784a6cedd7c6ea28. 2023-10-02 16:04:56,928 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1696262696898.4e2ed20fe1c38112784a6cedd7c6ea28. after waiting 0 ms 2023-10-02 16:04:56,928 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,1,1696262696898.4e2ed20fe1c38112784a6cedd7c6ea28. 2023-10-02 16:04:56,928 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,1,1696262696898.4e2ed20fe1c38112784a6cedd7c6ea28. 2023-10-02 16:04:56,928 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1558): Region close journal for 4e2ed20fe1c38112784a6cedd7c6ea28: 2023-10-02 16:04:56,930 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_ADD_TO_META 2023-10-02 16:04:56,931 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1696262696898.cc87b7c74312cb3f197c536bbc8d02bd.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1696262696931"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696262696931"}]},"ts":"1696262696931"} 2023-10-02 16:04:56,931 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1696262696898.4e2ed20fe1c38112784a6cedd7c6ea28.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1696262696931"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696262696931"}]},"ts":"1696262696931"} 2023-10-02 16:04:56,933 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-10-02 16:04:56,934 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-10-02 16:04:56,934 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696262696934"}]},"ts":"1696262696934"} 2023-10-02 16:04:56,935 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=ENABLING in hbase:meta 2023-10-02 16:04:56,939 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-10-02 16:04:56,940 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-10-02 16:04:56,940 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-10-02 16:04:56,940 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-10-02 16:04:56,940 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-10-02 16:04:56,940 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=cc87b7c74312cb3f197c536bbc8d02bd, ASSIGN}, {pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=4e2ed20fe1c38112784a6cedd7c6ea28, ASSIGN}] 2023-10-02 16:04:56,942 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=cc87b7c74312cb3f197c536bbc8d02bd, ASSIGN 2023-10-02 16:04:56,942 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=4e2ed20fe1c38112784a6cedd7c6ea28, ASSIGN 2023-10-02 16:04:56,943 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=cc87b7c74312cb3f197c536bbc8d02bd, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,43801,1696262558835; forceNewPlan=false, retain=false 2023-10-02 16:04:56,943 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=4e2ed20fe1c38112784a6cedd7c6ea28, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,37455,1696262558909; forceNewPlan=false, retain=false 2023-10-02 16:04:57,004 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44227] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-10-02 16:04:57,093 INFO [jenkins-hbase4:44227] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-10-02 16:04:57,096 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=106 updating hbase:meta row=cc87b7c74312cb3f197c536bbc8d02bd, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,43801,1696262558835 2023-10-02 16:04:57,096 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=107 updating hbase:meta row=4e2ed20fe1c38112784a6cedd7c6ea28, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,37455,1696262558909 2023-10-02 16:04:57,096 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1696262696898.cc87b7c74312cb3f197c536bbc8d02bd.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1696262697096"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696262697096"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696262697096"}]},"ts":"1696262697096"} 2023-10-02 16:04:57,096 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1696262696898.4e2ed20fe1c38112784a6cedd7c6ea28.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1696262697096"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696262697096"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696262697096"}]},"ts":"1696262697096"} 2023-10-02 16:04:57,098 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=108, ppid=106, state=RUNNABLE; OpenRegionProcedure cc87b7c74312cb3f197c536bbc8d02bd, server=jenkins-hbase4.apache.org,43801,1696262558835}] 2023-10-02 16:04:57,099 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=109, ppid=107, state=RUNNABLE; OpenRegionProcedure 4e2ed20fe1c38112784a6cedd7c6ea28, server=jenkins-hbase4.apache.org,37455,1696262558909}] 2023-10-02 16:04:57,205 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44227] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-10-02 16:04:57,256 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithSkipTmp,1,1696262696898.4e2ed20fe1c38112784a6cedd7c6ea28. 2023-10-02 16:04:57,256 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithSkipTmp,,1696262696898.cc87b7c74312cb3f197c536bbc8d02bd. 2023-10-02 16:04:57,256 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 4e2ed20fe1c38112784a6cedd7c6ea28, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,1,1696262696898.4e2ed20fe1c38112784a6cedd7c6ea28.', STARTKEY => '1', ENDKEY => ''} 2023-10-02 16:04:57,256 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => cc87b7c74312cb3f197c536bbc8d02bd, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,,1696262696898.cc87b7c74312cb3f197c536bbc8d02bd.', STARTKEY => '', ENDKEY => '1'} 2023-10-02 16:04:57,256 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithSkipTmp,1,1696262696898.4e2ed20fe1c38112784a6cedd7c6ea28. service=AccessControlService 2023-10-02 16:04:57,256 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithSkipTmp,,1696262696898.cc87b7c74312cb3f197c536bbc8d02bd. service=AccessControlService 2023-10-02 16:04:57,256 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-10-02 16:04:57,256 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-10-02 16:04:57,257 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithSkipTmp 4e2ed20fe1c38112784a6cedd7c6ea28 2023-10-02 16:04:57,257 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithSkipTmp cc87b7c74312cb3f197c536bbc8d02bd 2023-10-02 16:04:57,257 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,1,1696262696898.4e2ed20fe1c38112784a6cedd7c6ea28.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-02 16:04:57,257 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,,1696262696898.cc87b7c74312cb3f197c536bbc8d02bd.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-02 16:04:57,257 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 4e2ed20fe1c38112784a6cedd7c6ea28 2023-10-02 16:04:57,257 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for cc87b7c74312cb3f197c536bbc8d02bd 2023-10-02 16:04:57,257 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 4e2ed20fe1c38112784a6cedd7c6ea28 2023-10-02 16:04:57,257 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for cc87b7c74312cb3f197c536bbc8d02bd 2023-10-02 16:04:57,258 INFO [StoreOpener-cc87b7c74312cb3f197c536bbc8d02bd-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region cc87b7c74312cb3f197c536bbc8d02bd 2023-10-02 16:04:57,258 INFO [StoreOpener-4e2ed20fe1c38112784a6cedd7c6ea28-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 4e2ed20fe1c38112784a6cedd7c6ea28 2023-10-02 16:04:57,259 DEBUG [StoreOpener-cc87b7c74312cb3f197c536bbc8d02bd-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/data/default/testtb-testExportFileSystemStateWithSkipTmp/cc87b7c74312cb3f197c536bbc8d02bd/cf 2023-10-02 16:04:57,259 DEBUG [StoreOpener-cc87b7c74312cb3f197c536bbc8d02bd-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/data/default/testtb-testExportFileSystemStateWithSkipTmp/cc87b7c74312cb3f197c536bbc8d02bd/cf 2023-10-02 16:04:57,259 DEBUG [StoreOpener-4e2ed20fe1c38112784a6cedd7c6ea28-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/data/default/testtb-testExportFileSystemStateWithSkipTmp/4e2ed20fe1c38112784a6cedd7c6ea28/cf 2023-10-02 16:04:57,259 DEBUG [StoreOpener-4e2ed20fe1c38112784a6cedd7c6ea28-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/data/default/testtb-testExportFileSystemStateWithSkipTmp/4e2ed20fe1c38112784a6cedd7c6ea28/cf 2023-10-02 16:04:57,260 INFO [StoreOpener-cc87b7c74312cb3f197c536bbc8d02bd-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region cc87b7c74312cb3f197c536bbc8d02bd columnFamilyName cf 2023-10-02 16:04:57,260 INFO [StoreOpener-4e2ed20fe1c38112784a6cedd7c6ea28-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 4e2ed20fe1c38112784a6cedd7c6ea28 columnFamilyName cf 2023-10-02 16:04:57,261 INFO [StoreOpener-4e2ed20fe1c38112784a6cedd7c6ea28-1] regionserver.HStore(310): Store=4e2ed20fe1c38112784a6cedd7c6ea28/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-02 16:04:57,261 INFO [StoreOpener-cc87b7c74312cb3f197c536bbc8d02bd-1] regionserver.HStore(310): Store=cc87b7c74312cb3f197c536bbc8d02bd/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-02 16:04:57,262 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/data/default/testtb-testExportFileSystemStateWithSkipTmp/4e2ed20fe1c38112784a6cedd7c6ea28 2023-10-02 16:04:57,262 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/data/default/testtb-testExportFileSystemStateWithSkipTmp/cc87b7c74312cb3f197c536bbc8d02bd 2023-10-02 16:04:57,262 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/data/default/testtb-testExportFileSystemStateWithSkipTmp/4e2ed20fe1c38112784a6cedd7c6ea28 2023-10-02 16:04:57,262 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/data/default/testtb-testExportFileSystemStateWithSkipTmp/cc87b7c74312cb3f197c536bbc8d02bd 2023-10-02 16:04:57,265 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 4e2ed20fe1c38112784a6cedd7c6ea28 2023-10-02 16:04:57,265 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for cc87b7c74312cb3f197c536bbc8d02bd 2023-10-02 16:04:57,266 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/data/default/testtb-testExportFileSystemStateWithSkipTmp/4e2ed20fe1c38112784a6cedd7c6ea28/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-02 16:04:57,267 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 4e2ed20fe1c38112784a6cedd7c6ea28; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59529766, jitterRate=-0.11293736100196838}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-10-02 16:04:57,267 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 4e2ed20fe1c38112784a6cedd7c6ea28: 2023-10-02 16:04:57,267 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithSkipTmp,1,1696262696898.4e2ed20fe1c38112784a6cedd7c6ea28., pid=109, masterSystemTime=1696262697250 2023-10-02 16:04:57,269 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithSkipTmp,1,1696262696898.4e2ed20fe1c38112784a6cedd7c6ea28. 2023-10-02 16:04:57,269 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithSkipTmp,1,1696262696898.4e2ed20fe1c38112784a6cedd7c6ea28. 2023-10-02 16:04:57,269 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=107 updating hbase:meta row=4e2ed20fe1c38112784a6cedd7c6ea28, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,37455,1696262558909 2023-10-02 16:04:57,270 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1696262696898.4e2ed20fe1c38112784a6cedd7c6ea28.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1696262697269"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1696262697269"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1696262697269"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1696262697269"}]},"ts":"1696262697269"} 2023-10-02 16:04:57,270 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/data/default/testtb-testExportFileSystemStateWithSkipTmp/cc87b7c74312cb3f197c536bbc8d02bd/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-02 16:04:57,270 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened cc87b7c74312cb3f197c536bbc8d02bd; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65280737, jitterRate=-0.027241215109825134}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-10-02 16:04:57,270 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for cc87b7c74312cb3f197c536bbc8d02bd: 2023-10-02 16:04:57,271 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithSkipTmp,,1696262696898.cc87b7c74312cb3f197c536bbc8d02bd., pid=108, masterSystemTime=1696262697250 2023-10-02 16:04:57,272 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithSkipTmp,,1696262696898.cc87b7c74312cb3f197c536bbc8d02bd. 2023-10-02 16:04:57,272 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithSkipTmp,,1696262696898.cc87b7c74312cb3f197c536bbc8d02bd. 2023-10-02 16:04:57,273 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=109, resume processing ppid=107 2023-10-02 16:04:57,273 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=109, ppid=107, state=SUCCESS; OpenRegionProcedure 4e2ed20fe1c38112784a6cedd7c6ea28, server=jenkins-hbase4.apache.org,37455,1696262558909 in 172 msec 2023-10-02 16:04:57,273 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=106 updating hbase:meta row=cc87b7c74312cb3f197c536bbc8d02bd, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,43801,1696262558835 2023-10-02 16:04:57,273 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1696262696898.cc87b7c74312cb3f197c536bbc8d02bd.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1696262697273"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1696262697273"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1696262697273"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1696262697273"}]},"ts":"1696262697273"} 2023-10-02 16:04:57,274 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=107, ppid=105, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=4e2ed20fe1c38112784a6cedd7c6ea28, ASSIGN in 333 msec 2023-10-02 16:04:57,275 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=108, resume processing ppid=106 2023-10-02 16:04:57,275 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=108, ppid=106, state=SUCCESS; OpenRegionProcedure cc87b7c74312cb3f197c536bbc8d02bd, server=jenkins-hbase4.apache.org,43801,1696262558835 in 176 msec 2023-10-02 16:04:57,277 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=106, resume processing ppid=105 2023-10-02 16:04:57,277 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=106, ppid=105, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=cc87b7c74312cb3f197c536bbc8d02bd, ASSIGN in 335 msec 2023-10-02 16:04:57,277 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-10-02 16:04:57,278 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696262697277"}]},"ts":"1696262697277"} 2023-10-02 16:04:57,279 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=ENABLED in hbase:meta 2023-10-02 16:04:57,281 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_POST_OPERATION 2023-10-02 16:04:57,281 DEBUG [PEWorker-5] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemStateWithSkipTmp jenkins: RWXCA 2023-10-02 16:04:57,282 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=42303] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithSkipTmp], kv [jenkins: RWXCA] 2023-10-02 16:04:57,286 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): regionserver:37455-0x10107dfc1490002, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-02 16:04:57,286 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): master:44227-0x10107dfc1490000, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-02 16:04:57,286 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): regionserver:43801-0x10107dfc1490001, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-02 16:04:57,286 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): regionserver:42303-0x10107dfc1490003, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-02 16:04:57,287 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-10-02 16:04:57,287 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-10-02 16:04:57,287 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-10-02 16:04:57,287 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-10-02 16:04:57,288 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=105, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp in 389 msec 2023-10-02 16:04:57,506 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44227] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-10-02 16:04:57,507 INFO [Listener at jenkins-hbase4.apache.org/32975] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemStateWithSkipTmp, procId: 105 completed 2023-10-02 16:04:57,509 DEBUG [Listener at jenkins-hbase4.apache.org/32975] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithSkipTmp 2023-10-02 16:04:57,509 DEBUG [Listener at jenkins-hbase4.apache.org/32975] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithSkipTmp,,1696262696898.cc87b7c74312cb3f197c536bbc8d02bd. 2023-10-02 16:04:57,511 INFO [Listener at jenkins-hbase4.apache.org/32975] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-10-02 16:04:57,523 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44227] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-10-02 16:04:57,523 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44227] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1696262697523 (current time:1696262697523). 2023-10-02 16:04:57,523 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44227] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-10-02 16:04:57,524 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44227] zookeeper.ReadOnlyZKClient(139): Connect 0x5fa3fc5e to 127.0.0.1:50210 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-02 16:04:57,535 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44227] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@60d57293, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-02 16:04:57,536 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44227] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-02 16:04:57,537 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:39762, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-02 16:04:57,538 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44227] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x5fa3fc5e to 127.0.0.1:50210 2023-10-02 16:04:57,538 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44227] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-02 16:04:57,539 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44227] zookeeper.ReadOnlyZKClient(139): Connect 0x459d5975 to 127.0.0.1:50210 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-02 16:04:57,545 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44227] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@59c0c94, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-02 16:04:57,547 DEBUG [hconnection-0x4e96b75e-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-02 16:04:57,549 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:39764, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-02 16:04:57,554 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44227] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x459d5975 to 127.0.0.1:50210 2023-10-02 16:04:57,554 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44227] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-02 16:04:57,554 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44227] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithSkipTmp], kv [jenkins: RWXCA] 2023-10-02 16:04:57,555 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44227] snapshot.SnapshotManager(637): No existing snapshot, attempting snapshot... 2023-10-02 16:04:57,555 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44227] snapshot.SnapshotManager(684): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-10-02 16:04:57,557 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44227] snapshot.SnapshotManager(519): Unable to retrieve ACL status for path: hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/.hbase-snapshot, current working dir path: hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp org.apache.hadoop.hdfs.protocol.AclException: The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.ipc.RemoteException.instantiateException(RemoteException.java:121) at org.apache.hadoop.ipc.RemoteException.unwrapRemoteException(RemoteException.java:88) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2736) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2294) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2291) at org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81) at org.apache.hadoop.hdfs.DistributedFileSystem.getAclStatus(DistributedFileSystem.java:2291) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.updateWorkingDirAclsIfRequired(SnapshotManager.java:517) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.prepareToTakeSnapshot(SnapshotManager.java:490) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.snapshotEnabledTable(SnapshotManager.java:559) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshotInternal(SnapshotManager.java:687) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshot(SnapshotManager.java:623) at org.apache.hadoop.hbase.master.MasterRpcServices.snapshot(MasterRpcServices.java:1588) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) Caused by: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.hdfs.protocol.AclException): The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at org.apache.hadoop.ipc.Client.getRpcResponse(Client.java:1540) at org.apache.hadoop.ipc.Client.call(Client.java:1486) at org.apache.hadoop.ipc.Client.call(Client.java:1385) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:232) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:118) at com.sun.proxy.$Proxy32.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.getAclStatus(ClientNamenodeProtocolTranslatorPB.java:1385) at sun.reflect.GeneratedMethodAccessor63.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:422) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeMethod(RetryInvocationHandler.java:165) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invoke(RetryInvocationHandler.java:157) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeOnce(RetryInvocationHandler.java:95) at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:359) at com.sun.proxy.$Proxy35.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor63.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor63.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor63.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor63.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor63.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2734) ... 15 more 2023-10-02 16:04:57,558 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44227] procedure2.ProcedureExecutor(1028): Stored pid=110, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-10-02 16:04:57,559 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=110, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-10-02 16:04:57,560 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=110, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE; timeout=600000, timestamp=1696263297560 2023-10-02 16:04:57,560 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44227] snapshot.SnapshotManager(689): Started snapshot: { ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-10-02 16:04:57,560 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp 2023-10-02 16:04:57,561 DEBUG [Listener at jenkins-hbase4.apache.org/32975] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-10-02 16:04:57,561 DEBUG [Listener at jenkins-hbase4.apache.org/32975] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-10-02 16:04:57,562 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=110, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-10-02 16:04:57,562 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=111, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-10-02 16:04:57,563 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=110, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE in 4 msec 2023-10-02 16:04:57,564 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=111, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-10-02 16:04:57,564 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=111, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED; timeout=600000, timestamp=1696263297564 2023-10-02 16:04:57,572 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 16:04:57,572 INFO [(jenkins-hbase4.apache.org,44227,1696262556745)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' 2023-10-02 16:04:57,572 DEBUG [(jenkins-hbase4.apache.org,44227,1696262556745)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-02 16:04:57,573 DEBUG [(jenkins-hbase4.apache.org,44227,1696262556745)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' 2023-10-02 16:04:57,573 DEBUG [(jenkins-hbase4.apache.org,44227,1696262556745)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp', kicking off acquire phase on members. 2023-10-02 16:04:57,574 DEBUG [(jenkins-hbase4.apache.org,44227,1696262556745)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44227-0x10107dfc1490000, quorum=127.0.0.1:50210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 16:04:57,574 DEBUG [(jenkins-hbase4.apache.org,44227,1696262556745)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 16:04:57,576 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): regionserver:37455-0x10107dfc1490002, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-02 16:04:57,576 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): regionserver:42303-0x10107dfc1490003, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-02 16:04:57,576 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-02 16:04:57,576 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-02 16:04:57,576 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-02 16:04:57,576 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-02 16:04:57,576 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): regionserver:43801-0x10107dfc1490001, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-02 16:04:57,576 DEBUG [(jenkins-hbase4.apache.org,44227,1696262556745)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,37455,1696262558909 2023-10-02 16:04:57,576 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-02 16:04:57,576 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-02 16:04:57,577 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 16:04:57,577 DEBUG [(jenkins-hbase4.apache.org,44227,1696262556745)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44227-0x10107dfc1490000, quorum=127.0.0.1:50210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,37455,1696262558909 2023-10-02 16:04:57,577 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 16:04:57,577 DEBUG [(jenkins-hbase4.apache.org,44227,1696262556745)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43801,1696262558835 2023-10-02 16:04:57,577 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 16:04:57,577 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37455-0x10107dfc1490002, quorum=127.0.0.1:50210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 16:04:57,577 DEBUG [(jenkins-hbase4.apache.org,44227,1696262556745)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44227-0x10107dfc1490000, quorum=127.0.0.1:50210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43801,1696262558835 2023-10-02 16:04:57,577 DEBUG [(jenkins-hbase4.apache.org,44227,1696262556745)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-02 16:04:57,577 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42303-0x10107dfc1490003, quorum=127.0.0.1:50210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 16:04:57,577 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43801-0x10107dfc1490001, quorum=127.0.0.1:50210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 16:04:57,577 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 207 2023-10-02 16:04:57,577 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 16:04:57,578 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 207 2023-10-02 16:04:57,578 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 207 2023-10-02 16:04:57,578 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-10-02 16:04:57,578 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 16:04:57,578 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 16:04:57,578 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-10-02 16:04:57,578 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-10-02 16:04:57,578 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 16:04:57,578 DEBUG [member: 'jenkins-hbase4.apache.org,37455,1696262558909' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-10-02 16:04:57,578 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 16:04:57,578 DEBUG [member: 'jenkins-hbase4.apache.org,37455,1696262558909' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-02 16:04:57,578 DEBUG [member: 'jenkins-hbase4.apache.org,43801,1696262558835' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-10-02 16:04:57,578 DEBUG [member: 'jenkins-hbase4.apache.org,43801,1696262558835' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-02 16:04:57,579 DEBUG [member: 'jenkins-hbase4.apache.org,37455,1696262558909' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-10-02 16:04:57,578 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 16:04:57,580 DEBUG [member: 'jenkins-hbase4.apache.org,37455,1696262558909' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-10-02 16:04:57,580 DEBUG [member: 'jenkins-hbase4.apache.org,43801,1696262558835' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-10-02 16:04:57,580 DEBUG [member: 'jenkins-hbase4.apache.org,37455,1696262558909' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37455,1696262558909' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-10-02 16:04:57,580 DEBUG [member: 'jenkins-hbase4.apache.org,43801,1696262558835' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-10-02 16:04:57,580 DEBUG [member: 'jenkins-hbase4.apache.org,42303,1696262558956' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-10-02 16:04:57,581 DEBUG [member: 'jenkins-hbase4.apache.org,42303,1696262558956' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-02 16:04:57,581 DEBUG [member: 'jenkins-hbase4.apache.org,43801,1696262558835' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43801,1696262558835' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-10-02 16:04:57,581 DEBUG [member: 'jenkins-hbase4.apache.org,42303,1696262558956' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-10-02 16:04:57,581 DEBUG [member: 'jenkins-hbase4.apache.org,42303,1696262558956' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-10-02 16:04:57,582 DEBUG [member: 'jenkins-hbase4.apache.org,42303,1696262558956' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42303,1696262558956' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-10-02 16:04:57,590 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): master:44227-0x10107dfc1490000, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,37455,1696262558909 2023-10-02 16:04:57,591 DEBUG [member: 'jenkins-hbase4.apache.org,37455,1696262558909' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 16:04:57,591 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,37455,1696262558909 2023-10-02 16:04:57,591 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-02 16:04:57,591 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-02 16:04:57,591 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): master:44227-0x10107dfc1490000, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43801,1696262558835 2023-10-02 16:04:57,591 DEBUG [member: 'jenkins-hbase4.apache.org,42303,1696262558956' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 16:04:57,591 DEBUG [member: 'jenkins-hbase4.apache.org,37455,1696262558909' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37455-0x10107dfc1490002, quorum=127.0.0.1:50210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 16:04:57,591 DEBUG [member: 'jenkins-hbase4.apache.org,37455,1696262558909' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-02 16:04:57,591 DEBUG [member: 'jenkins-hbase4.apache.org,43801,1696262558835' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 16:04:57,591 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-02 16:04:57,592 DEBUG [member: 'jenkins-hbase4.apache.org,42303,1696262558956' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42303-0x10107dfc1490003, quorum=127.0.0.1:50210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 16:04:57,592 DEBUG [member: 'jenkins-hbase4.apache.org,42303,1696262558956' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-02 16:04:57,592 DEBUG [member: 'jenkins-hbase4.apache.org,43801,1696262558835' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43801-0x10107dfc1490001, quorum=127.0.0.1:50210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 16:04:57,592 DEBUG [member: 'jenkins-hbase4.apache.org,43801,1696262558835' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-02 16:04:57,592 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-02 16:04:57,592 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 16:04:57,592 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37455,1696262558909 2023-10-02 16:04:57,593 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42303,1696262558956 2023-10-02 16:04:57,593 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43801,1696262558835 2023-10-02 16:04:57,593 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-02 16:04:57,593 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,37455,1696262558909' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-10-02 16:04:57,593 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5d5d0fd3[Count = 1] remaining members to acquire global barrier 2023-10-02 16:04:57,593 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43801,1696262558835 2023-10-02 16:04:57,593 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-02 16:04:57,593 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-02 16:04:57,594 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-02 16:04:57,594 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-02 16:04:57,594 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 16:04:57,594 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37455,1696262558909 2023-10-02 16:04:57,595 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42303,1696262558956 2023-10-02 16:04:57,595 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43801,1696262558835 2023-10-02 16:04:57,595 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-02 16:04:57,596 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43801,1696262558835' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-10-02 16:04:57,596 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5d5d0fd3[Count = 0] remaining members to acquire global barrier 2023-10-02 16:04:57,596 DEBUG [(jenkins-hbase4.apache.org,44227,1696262556745)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'in-barrier' execution. 2023-10-02 16:04:57,596 DEBUG [(jenkins-hbase4.apache.org,44227,1696262556745)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 16:04:57,597 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): regionserver:43801-0x10107dfc1490001, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 16:04:57,597 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): regionserver:37455-0x10107dfc1490002, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 16:04:57,597 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 16:04:57,597 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 16:04:57,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 16:04:57,597 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): regionserver:42303-0x10107dfc1490003, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 16:04:57,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 16:04:57,597 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 16:04:57,597 DEBUG [member: 'jenkins-hbase4.apache.org,37455,1696262558909' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-10-02 16:04:57,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 16:04:57,597 DEBUG [member: 'jenkins-hbase4.apache.org,42303,1696262558956' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-10-02 16:04:57,597 DEBUG [member: 'jenkins-hbase4.apache.org,42303,1696262558956' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-10-02 16:04:57,597 DEBUG [(jenkins-hbase4.apache.org,44227,1696262556745)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44227-0x10107dfc1490000, quorum=127.0.0.1:50210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,37455,1696262558909 2023-10-02 16:04:57,598 DEBUG [member: 'jenkins-hbase4.apache.org,37455,1696262558909' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-02 16:04:57,598 DEBUG [rs(jenkins-hbase4.apache.org,37455,1696262558909)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1696262696898.4e2ed20fe1c38112784a6cedd7c6ea28. 2023-10-02 16:04:57,598 DEBUG [rs(jenkins-hbase4.apache.org,37455,1696262558909)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1696262696898.4e2ed20fe1c38112784a6cedd7c6ea28. started... 2023-10-02 16:04:57,598 DEBUG [member: 'jenkins-hbase4.apache.org,42303,1696262558956' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,42303,1696262558956' in zk 2023-10-02 16:04:57,598 DEBUG [member: 'jenkins-hbase4.apache.org,37455,1696262558909' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-02 16:04:57,598 DEBUG [(jenkins-hbase4.apache.org,44227,1696262556745)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44227-0x10107dfc1490000, quorum=127.0.0.1:50210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43801,1696262558835 2023-10-02 16:04:57,598 DEBUG [(jenkins-hbase4.apache.org,44227,1696262556745)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-02 16:04:57,599 DEBUG [member: 'jenkins-hbase4.apache.org,42303,1696262558956' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-10-02 16:04:57,599 DEBUG [member: 'jenkins-hbase4.apache.org,42303,1696262558956' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-02 16:04:57,599 DEBUG [member: 'jenkins-hbase4.apache.org,42303,1696262558956' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-10-02 16:04:57,602 DEBUG [rs(jenkins-hbase4.apache.org,37455,1696262558909)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 4e2ed20fe1c38112784a6cedd7c6ea28: 2023-10-02 16:04:57,603 DEBUG [rs(jenkins-hbase4.apache.org,37455,1696262558909)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,1,1696262696898.4e2ed20fe1c38112784a6cedd7c6ea28.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 16:04:57,603 DEBUG [rs(jenkins-hbase4.apache.org,37455,1696262558909)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-02 16:04:57,603 DEBUG [rs(jenkins-hbase4.apache.org,37455,1696262558909)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-10-02 16:04:57,605 DEBUG [member: 'jenkins-hbase4.apache.org,43801,1696262558835' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-10-02 16:04:57,609 DEBUG [member: 'jenkins-hbase4.apache.org,43801,1696262558835' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-02 16:04:57,609 DEBUG [member: 'jenkins-hbase4.apache.org,43801,1696262558835' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-02 16:04:57,609 DEBUG [rs(jenkins-hbase4.apache.org,43801,1696262558835)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1696262696898.cc87b7c74312cb3f197c536bbc8d02bd. 2023-10-02 16:04:57,609 DEBUG [rs(jenkins-hbase4.apache.org,43801,1696262558835)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1696262696898.cc87b7c74312cb3f197c536bbc8d02bd. started... 2023-10-02 16:04:57,609 DEBUG [rs(jenkins-hbase4.apache.org,43801,1696262558835)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for cc87b7c74312cb3f197c536bbc8d02bd: 2023-10-02 16:04:57,609 DEBUG [rs(jenkins-hbase4.apache.org,43801,1696262558835)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,,1696262696898.cc87b7c74312cb3f197c536bbc8d02bd.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 16:04:57,609 DEBUG [rs(jenkins-hbase4.apache.org,43801,1696262558835)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-02 16:04:57,609 DEBUG [rs(jenkins-hbase4.apache.org,43801,1696262558835)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-10-02 16:04:57,624 DEBUG [rs(jenkins-hbase4.apache.org,37455,1696262558909)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1696262696898.4e2ed20fe1c38112784a6cedd7c6ea28. completed. 2023-10-02 16:04:57,624 DEBUG [rs(jenkins-hbase4.apache.org,37455,1696262558909)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1696262696898.4e2ed20fe1c38112784a6cedd7c6ea28. 2023-10-02 16:04:57,624 DEBUG [member: 'jenkins-hbase4.apache.org,37455,1696262558909' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-02 16:04:57,624 DEBUG [member: 'jenkins-hbase4.apache.org,37455,1696262558909' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-02 16:04:57,624 DEBUG [member: 'jenkins-hbase4.apache.org,37455,1696262558909' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,37455,1696262558909 2023-10-02 16:04:57,624 DEBUG [member: 'jenkins-hbase4.apache.org,37455,1696262558909' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-10-02 16:04:57,624 DEBUG [member: 'jenkins-hbase4.apache.org,37455,1696262558909' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,37455,1696262558909' in zk 2023-10-02 16:04:57,626 DEBUG [rs(jenkins-hbase4.apache.org,43801,1696262558835)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1696262696898.cc87b7c74312cb3f197c536bbc8d02bd. completed. 2023-10-02 16:04:57,626 DEBUG [rs(jenkins-hbase4.apache.org,43801,1696262558835)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1696262696898.cc87b7c74312cb3f197c536bbc8d02bd. 2023-10-02 16:04:57,626 DEBUG [member: 'jenkins-hbase4.apache.org,43801,1696262558835' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-02 16:04:57,626 DEBUG [member: 'jenkins-hbase4.apache.org,43801,1696262558835' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-02 16:04:57,626 DEBUG [member: 'jenkins-hbase4.apache.org,43801,1696262558835' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,43801,1696262558835 2023-10-02 16:04:57,627 DEBUG [member: 'jenkins-hbase4.apache.org,43801,1696262558835' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-10-02 16:04:57,627 DEBUG [member: 'jenkins-hbase4.apache.org,43801,1696262558835' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,43801,1696262558835' in zk 2023-10-02 16:04:57,627 DEBUG [member: 'jenkins-hbase4.apache.org,37455,1696262558909' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-10-02 16:04:57,627 DEBUG [member: 'jenkins-hbase4.apache.org,37455,1696262558909' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-02 16:04:57,627 DEBUG [member: 'jenkins-hbase4.apache.org,37455,1696262558909' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-10-02 16:04:57,627 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): master:44227-0x10107dfc1490000, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,37455,1696262558909 2023-10-02 16:04:57,627 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,37455,1696262558909 2023-10-02 16:04:57,627 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-02 16:04:57,627 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-02 16:04:57,628 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): master:44227-0x10107dfc1490000, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43801,1696262558835 2023-10-02 16:04:57,628 DEBUG [member: 'jenkins-hbase4.apache.org,43801,1696262558835' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-10-02 16:04:57,628 DEBUG [member: 'jenkins-hbase4.apache.org,43801,1696262558835' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-02 16:04:57,628 DEBUG [member: 'jenkins-hbase4.apache.org,43801,1696262558835' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-10-02 16:04:57,628 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-02 16:04:57,628 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-02 16:04:57,629 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 16:04:57,629 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37455,1696262558909 2023-10-02 16:04:57,629 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42303,1696262558956 2023-10-02 16:04:57,629 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43801,1696262558835 2023-10-02 16:04:57,630 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-02 16:04:57,630 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 16:04:57,630 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37455,1696262558909 2023-10-02 16:04:57,630 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42303,1696262558956 2023-10-02 16:04:57,631 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43801,1696262558835 2023-10-02 16:04:57,631 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,37455,1696262558909': 2023-10-02 16:04:57,631 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,37455,1696262558909' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 1 more 2023-10-02 16:04:57,631 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43801,1696262558835 2023-10-02 16:04:57,632 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-02 16:04:57,632 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-02 16:04:57,632 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-02 16:04:57,632 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-02 16:04:57,632 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 16:04:57,633 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37455,1696262558909 2023-10-02 16:04:57,633 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42303,1696262558956 2023-10-02 16:04:57,633 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43801,1696262558835 2023-10-02 16:04:57,633 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-02 16:04:57,633 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 16:04:57,634 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37455,1696262558909 2023-10-02 16:04:57,634 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42303,1696262558956 2023-10-02 16:04:57,634 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43801,1696262558835 2023-10-02 16:04:57,635 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,43801,1696262558835': 2023-10-02 16:04:57,635 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43801,1696262558835' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 0 more 2023-10-02 16:04:57,635 INFO [(jenkins-hbase4.apache.org,44227,1696262556745)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' execution completed 2023-10-02 16:04:57,635 DEBUG [(jenkins-hbase4.apache.org,44227,1696262556745)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-02 16:04:57,635 DEBUG [(jenkins-hbase4.apache.org,44227,1696262556745)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-02 16:04:57,635 DEBUG [(jenkins-hbase4.apache.org,44227,1696262556745)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 16:04:57,635 INFO [(jenkins-hbase4.apache.org,44227,1696262556745)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportFileSystemStateWithSkipTmpincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-10-02 16:04:57,636 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): regionserver:43801-0x10107dfc1490001, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 16:04:57,636 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): regionserver:37455-0x10107dfc1490002, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 16:04:57,636 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 16:04:57,636 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): master:44227-0x10107dfc1490000, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 16:04:57,636 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 16:04:57,637 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 16:04:57,637 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-02 16:04:57,637 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-02 16:04:57,636 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 16:04:57,636 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): regionserver:37455-0x10107dfc1490002, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-02 16:04:57,636 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): regionserver:43801-0x10107dfc1490001, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-02 16:04:57,636 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): regionserver:42303-0x10107dfc1490003, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 16:04:57,637 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 16:04:57,637 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 16:04:57,637 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-02 16:04:57,637 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): regionserver:42303-0x10107dfc1490003, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-02 16:04:57,637 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-02 16:04:57,637 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-02 16:04:57,637 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 16:04:57,637 DEBUG [(jenkins-hbase4.apache.org,44227,1696262556745)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44227-0x10107dfc1490000, quorum=127.0.0.1:50210, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,37455,1696262558909 2023-10-02 16:04:57,637 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-02 16:04:57,637 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-02 16:04:57,637 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 16:04:57,637 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 16:04:57,637 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-02 16:04:57,638 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-02 16:04:57,638 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 16:04:57,638 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 16:04:57,638 DEBUG [(jenkins-hbase4.apache.org,44227,1696262556745)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44227-0x10107dfc1490000, quorum=127.0.0.1:50210, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,42303,1696262558956 2023-10-02 16:04:57,638 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-02 16:04:57,638 DEBUG [(jenkins-hbase4.apache.org,44227,1696262556745)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44227-0x10107dfc1490000, quorum=127.0.0.1:50210, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43801,1696262558835 2023-10-02 16:04:57,638 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 16:04:57,639 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37455,1696262558909 2023-10-02 16:04:57,639 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42303,1696262558956 2023-10-02 16:04:57,639 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43801,1696262558835 2023-10-02 16:04:57,639 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-02 16:04:57,639 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 16:04:57,640 DEBUG [(jenkins-hbase4.apache.org,44227,1696262556745)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44227-0x10107dfc1490000, quorum=127.0.0.1:50210, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,37455,1696262558909 2023-10-02 16:04:57,640 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37455,1696262558909 2023-10-02 16:04:57,640 DEBUG [(jenkins-hbase4.apache.org,44227,1696262556745)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44227-0x10107dfc1490000, quorum=127.0.0.1:50210, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,42303,1696262558956 2023-10-02 16:04:57,640 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42303,1696262558956 2023-10-02 16:04:57,640 DEBUG [(jenkins-hbase4.apache.org,44227,1696262556745)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44227-0x10107dfc1490000, quorum=127.0.0.1:50210, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43801,1696262558835 2023-10-02 16:04:57,640 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43801,1696262558835 2023-10-02 16:04:57,644 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): master:44227-0x10107dfc1490000, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43801,1696262558835 2023-10-02 16:04:57,644 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): master:44227-0x10107dfc1490000, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 16:04:57,644 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): regionserver:42303-0x10107dfc1490003, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-02 16:04:57,644 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): master:44227-0x10107dfc1490000, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,42303,1696262558956 2023-10-02 16:04:57,645 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): regionserver:42303-0x10107dfc1490003, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-02 16:04:57,645 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): master:44227-0x10107dfc1490000, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,37455,1696262558909 2023-10-02 16:04:57,645 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-02 16:04:57,645 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): regionserver:37455-0x10107dfc1490002, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-02 16:04:57,645 DEBUG [(jenkins-hbase4.apache.org,44227,1696262556745)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-02 16:04:57,644 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): regionserver:43801-0x10107dfc1490001, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-02 16:04:57,645 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-02 16:04:57,645 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 16:04:57,645 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): regionserver:37455-0x10107dfc1490002, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-02 16:04:57,645 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemStateWithSkipTmp 2023-10-02 16:04:57,645 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-02 16:04:57,645 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): master:44227-0x10107dfc1490000, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 16:04:57,645 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => e9516f04c7d2974b21addb190acc6c0a, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,.mob,0.e9516f04c7d2974b21addb190acc6c0a.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 16:04:57,645 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-02 16:04:57,645 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): regionserver:43801-0x10107dfc1490001, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-02 16:04:57,645 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-02 16:04:57,645 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-10-02 16:04:57,645 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): master:44227-0x10107dfc1490000, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43801,1696262558835 2023-10-02 16:04:57,645 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-02 16:04:57,645 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-02 16:04:57,645 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-02 16:04:57,645 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): master:44227-0x10107dfc1490000, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 16:04:57,645 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-02 16:04:57,646 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): master:44227-0x10107dfc1490000, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,42303,1696262558956 2023-10-02 16:04:57,646 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-02 16:04:57,646 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): master:44227-0x10107dfc1490000, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,37455,1696262558909 2023-10-02 16:04:57,646 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): master:44227-0x10107dfc1490000, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 16:04:57,646 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): master:44227-0x10107dfc1490000, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 16:04:57,646 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-10-02 16:04:57,646 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-02 16:04:57,646 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-02 16:04:57,655 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 16:04:57,655 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 16:04:57,661 DEBUG [Listener at jenkins-hbase4.apache.org/32975] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-02 16:04:57,662 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44227] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-10-02 16:04:57,662 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44227] snapshot.SnapshotManager(406): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-10-02 16:04:57,663 DEBUG [Listener at jenkins-hbase4.apache.org/32975] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-10-02 16:04:57,670 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp to hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/.hbase-snapshot/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 16:04:57,671 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed 2023-10-02 16:04:57,671 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 16:04:57,671 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 16:04:57,671 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp at 1696262697560Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemStateWithSkipTmp at 1696262697655 (+95 ms)Consolidate snapshot: emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1696262697655Loading Region manifests for emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1696262697655Writing data manifest for emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1696262697658 (+3 ms)Verifying snapshot: emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1696262697665 (+7 ms)Snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed at 1696262697671 (+6 ms) 2023-10-02 16:04:57,674 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=111, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-10-02 16:04:57,675 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=111, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED in 113 msec 2023-10-02 16:04:57,863 DEBUG [Listener at jenkins-hbase4.apache.org/32975] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-02 16:04:57,864 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44227] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-10-02 16:04:57,864 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44227] snapshot.SnapshotManager(403): Snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' has completed, notifying client. 2023-10-02 16:04:57,866 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43801] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithSkipTmp,,1696262696898.cc87b7c74312cb3f197c536bbc8d02bd. with WAL disabled. Data may be lost in the event of a crash. 2023-10-02 16:04:57,867 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37455] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithSkipTmp,1,1696262696898.4e2ed20fe1c38112784a6cedd7c6ea28. with WAL disabled. Data may be lost in the event of a crash. 2023-10-02 16:04:57,869 DEBUG [Listener at jenkins-hbase4.apache.org/32975] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithSkipTmp 2023-10-02 16:04:57,869 DEBUG [Listener at jenkins-hbase4.apache.org/32975] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithSkipTmp,,1696262696898.cc87b7c74312cb3f197c536bbc8d02bd. 2023-10-02 16:04:57,870 INFO [Listener at jenkins-hbase4.apache.org/32975] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-10-02 16:04:57,879 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44227] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-10-02 16:04:57,879 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44227] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1696262697879 (current time:1696262697879). 2023-10-02 16:04:57,879 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44227] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-10-02 16:04:57,880 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44227] zookeeper.ReadOnlyZKClient(139): Connect 0x1033572d to 127.0.0.1:50210 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-02 16:04:57,889 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44227] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5bc8be49, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-02 16:04:57,891 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44227] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-02 16:04:57,894 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:39780, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-02 16:04:57,895 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44227] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1033572d to 127.0.0.1:50210 2023-10-02 16:04:57,895 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44227] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-02 16:04:57,896 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44227] zookeeper.ReadOnlyZKClient(139): Connect 0x1bc57090 to 127.0.0.1:50210 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-02 16:04:57,901 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44227] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1145d6fa, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-02 16:04:57,903 DEBUG [hconnection-0xf61086d-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-02 16:04:57,904 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:39782, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-02 16:04:57,909 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44227] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1bc57090 to 127.0.0.1:50210 2023-10-02 16:04:57,909 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44227] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-02 16:04:57,909 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44227] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithSkipTmp], kv [jenkins: RWXCA] 2023-10-02 16:04:57,910 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44227] snapshot.SnapshotManager(637): No existing snapshot, attempting snapshot... 2023-10-02 16:04:57,910 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44227] snapshot.SnapshotManager(684): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-10-02 16:04:57,912 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44227] snapshot.SnapshotManager(519): Unable to retrieve ACL status for path: hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/.hbase-snapshot, current working dir path: hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp org.apache.hadoop.hdfs.protocol.AclException: The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.ipc.RemoteException.instantiateException(RemoteException.java:121) at org.apache.hadoop.ipc.RemoteException.unwrapRemoteException(RemoteException.java:88) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2736) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2294) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2291) at org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81) at org.apache.hadoop.hdfs.DistributedFileSystem.getAclStatus(DistributedFileSystem.java:2291) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.updateWorkingDirAclsIfRequired(SnapshotManager.java:517) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.prepareToTakeSnapshot(SnapshotManager.java:490) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.snapshotEnabledTable(SnapshotManager.java:559) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshotInternal(SnapshotManager.java:687) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshot(SnapshotManager.java:623) at org.apache.hadoop.hbase.master.MasterRpcServices.snapshot(MasterRpcServices.java:1588) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) Caused by: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.hdfs.protocol.AclException): The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at org.apache.hadoop.ipc.Client.getRpcResponse(Client.java:1540) at org.apache.hadoop.ipc.Client.call(Client.java:1486) at org.apache.hadoop.ipc.Client.call(Client.java:1385) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:232) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:118) at com.sun.proxy.$Proxy32.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.getAclStatus(ClientNamenodeProtocolTranslatorPB.java:1385) at sun.reflect.GeneratedMethodAccessor63.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:422) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeMethod(RetryInvocationHandler.java:165) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invoke(RetryInvocationHandler.java:157) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeOnce(RetryInvocationHandler.java:95) at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:359) at com.sun.proxy.$Proxy35.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor63.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor63.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor63.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor63.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor63.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2734) ... 15 more 2023-10-02 16:04:57,914 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44227] procedure2.ProcedureExecutor(1028): Stored pid=112, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-10-02 16:04:57,915 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=112, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-10-02 16:04:57,915 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=112, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE; timeout=600000, timestamp=1696263297915 2023-10-02 16:04:57,915 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44227] snapshot.SnapshotManager(689): Started snapshot: { ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-10-02 16:04:57,915 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp 2023-10-02 16:04:57,916 DEBUG [Listener at jenkins-hbase4.apache.org/32975] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-10-02 16:04:57,917 DEBUG [Listener at jenkins-hbase4.apache.org/32975] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-10-02 16:04:57,918 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=112, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-10-02 16:04:57,918 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=113, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-10-02 16:04:57,924 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=112, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE in 5 msec 2023-10-02 16:04:57,925 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=113, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-10-02 16:04:57,925 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=113, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED; timeout=600000, timestamp=1696263297925 2023-10-02 16:04:57,934 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 16:04:57,934 INFO [(jenkins-hbase4.apache.org,44227,1696262556745)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' 2023-10-02 16:04:57,934 DEBUG [(jenkins-hbase4.apache.org,44227,1696262556745)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-02 16:04:57,936 DEBUG [(jenkins-hbase4.apache.org,44227,1696262556745)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' 2023-10-02 16:04:57,936 DEBUG [(jenkins-hbase4.apache.org,44227,1696262556745)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemStateWithSkipTmp', kicking off acquire phase on members. 2023-10-02 16:04:57,936 DEBUG [(jenkins-hbase4.apache.org,44227,1696262556745)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44227-0x10107dfc1490000, quorum=127.0.0.1:50210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 16:04:57,936 DEBUG [(jenkins-hbase4.apache.org,44227,1696262556745)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 16:04:57,938 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): regionserver:42303-0x10107dfc1490003, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-02 16:04:57,938 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): regionserver:37455-0x10107dfc1490002, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-02 16:04:57,938 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-02 16:04:57,938 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-02 16:04:57,938 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): regionserver:43801-0x10107dfc1490001, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-02 16:04:57,938 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-02 16:04:57,938 DEBUG [(jenkins-hbase4.apache.org,44227,1696262556745)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,37455,1696262558909 2023-10-02 16:04:57,938 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-02 16:04:57,938 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-02 16:04:57,938 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-02 16:04:57,938 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 16:04:57,939 DEBUG [(jenkins-hbase4.apache.org,44227,1696262556745)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44227-0x10107dfc1490000, quorum=127.0.0.1:50210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,37455,1696262558909 2023-10-02 16:04:57,939 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 16:04:57,939 DEBUG [(jenkins-hbase4.apache.org,44227,1696262556745)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43801,1696262558835 2023-10-02 16:04:57,939 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 16:04:57,939 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42303-0x10107dfc1490003, quorum=127.0.0.1:50210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 16:04:57,939 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37455-0x10107dfc1490002, quorum=127.0.0.1:50210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 16:04:57,939 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43801-0x10107dfc1490001, quorum=127.0.0.1:50210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 16:04:57,939 DEBUG [(jenkins-hbase4.apache.org,44227,1696262556745)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44227-0x10107dfc1490000, quorum=127.0.0.1:50210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43801,1696262558835 2023-10-02 16:04:57,939 DEBUG [(jenkins-hbase4.apache.org,44227,1696262556745)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-02 16:04:57,939 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 202 2023-10-02 16:04:57,939 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 16:04:57,939 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 202 2023-10-02 16:04:57,939 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 16:04:57,939 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-10-02 16:04:57,939 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-10-02 16:04:57,939 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 202 2023-10-02 16:04:57,940 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 16:04:57,940 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 16:04:57,940 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-10-02 16:04:57,940 DEBUG [member: 'jenkins-hbase4.apache.org,42303,1696262558956' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-10-02 16:04:57,940 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 16:04:57,940 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 16:04:57,940 DEBUG [member: 'jenkins-hbase4.apache.org,42303,1696262558956' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-02 16:04:57,940 DEBUG [member: 'jenkins-hbase4.apache.org,43801,1696262558835' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-10-02 16:04:57,940 DEBUG [member: 'jenkins-hbase4.apache.org,43801,1696262558835' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-02 16:04:57,941 DEBUG [member: 'jenkins-hbase4.apache.org,42303,1696262558956' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-10-02 16:04:57,942 DEBUG [member: 'jenkins-hbase4.apache.org,43801,1696262558835' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-10-02 16:04:57,942 DEBUG [member: 'jenkins-hbase4.apache.org,43801,1696262558835' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-10-02 16:04:57,940 DEBUG [member: 'jenkins-hbase4.apache.org,37455,1696262558909' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-10-02 16:04:57,942 DEBUG [member: 'jenkins-hbase4.apache.org,43801,1696262558835' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43801,1696262558835' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-10-02 16:04:57,942 DEBUG [member: 'jenkins-hbase4.apache.org,37455,1696262558909' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-02 16:04:57,942 DEBUG [member: 'jenkins-hbase4.apache.org,42303,1696262558956' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-10-02 16:04:57,943 DEBUG [member: 'jenkins-hbase4.apache.org,37455,1696262558909' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-10-02 16:04:57,943 DEBUG [member: 'jenkins-hbase4.apache.org,37455,1696262558909' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-10-02 16:04:57,943 DEBUG [member: 'jenkins-hbase4.apache.org,42303,1696262558956' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42303,1696262558956' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-10-02 16:04:57,943 DEBUG [member: 'jenkins-hbase4.apache.org,37455,1696262558909' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37455,1696262558909' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-10-02 16:04:57,945 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): master:44227-0x10107dfc1490000, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43801,1696262558835 2023-10-02 16:04:57,945 DEBUG [member: 'jenkins-hbase4.apache.org,43801,1696262558835' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 16:04:57,945 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43801,1696262558835 2023-10-02 16:04:57,945 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-02 16:04:57,945 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-02 16:04:57,945 DEBUG [member: 'jenkins-hbase4.apache.org,42303,1696262558956' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 16:04:57,945 DEBUG [member: 'jenkins-hbase4.apache.org,43801,1696262558835' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43801-0x10107dfc1490001, quorum=127.0.0.1:50210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 16:04:57,945 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): master:44227-0x10107dfc1490000, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,37455,1696262558909 2023-10-02 16:04:57,945 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-02 16:04:57,945 DEBUG [member: 'jenkins-hbase4.apache.org,43801,1696262558835' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-02 16:04:57,945 DEBUG [member: 'jenkins-hbase4.apache.org,37455,1696262558909' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 16:04:57,946 DEBUG [member: 'jenkins-hbase4.apache.org,42303,1696262558956' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42303-0x10107dfc1490003, quorum=127.0.0.1:50210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 16:04:57,946 DEBUG [member: 'jenkins-hbase4.apache.org,42303,1696262558956' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-02 16:04:57,946 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-02 16:04:57,946 DEBUG [member: 'jenkins-hbase4.apache.org,37455,1696262558909' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37455-0x10107dfc1490002, quorum=127.0.0.1:50210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 16:04:57,946 DEBUG [member: 'jenkins-hbase4.apache.org,37455,1696262558909' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-02 16:04:57,946 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 16:04:57,946 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37455,1696262558909 2023-10-02 16:04:57,947 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42303,1696262558956 2023-10-02 16:04:57,947 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43801,1696262558835 2023-10-02 16:04:57,947 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-02 16:04:57,947 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43801,1696262558835' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-10-02 16:04:57,947 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@56ced365[Count = 1] remaining members to acquire global barrier 2023-10-02 16:04:57,947 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,37455,1696262558909 2023-10-02 16:04:57,947 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-02 16:04:57,947 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-02 16:04:57,948 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-02 16:04:57,948 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-02 16:04:57,948 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 16:04:57,948 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37455,1696262558909 2023-10-02 16:04:57,949 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42303,1696262558956 2023-10-02 16:04:57,949 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43801,1696262558835 2023-10-02 16:04:57,949 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-02 16:04:57,949 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,37455,1696262558909' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-10-02 16:04:57,949 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@56ced365[Count = 0] remaining members to acquire global barrier 2023-10-02 16:04:57,949 DEBUG [(jenkins-hbase4.apache.org,44227,1696262556745)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'in-barrier' execution. 2023-10-02 16:04:57,950 DEBUG [(jenkins-hbase4.apache.org,44227,1696262556745)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 16:04:57,958 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): regionserver:37455-0x10107dfc1490002, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 16:04:57,958 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): regionserver:42303-0x10107dfc1490003, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 16:04:57,958 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 16:04:57,958 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): regionserver:43801-0x10107dfc1490001, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 16:04:57,958 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 16:04:57,958 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 16:04:57,958 DEBUG [member: 'jenkins-hbase4.apache.org,37455,1696262558909' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-10-02 16:04:57,958 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 16:04:57,958 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 16:04:57,958 DEBUG [member: 'jenkins-hbase4.apache.org,42303,1696262558956' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-10-02 16:04:57,958 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 16:04:57,958 DEBUG [(jenkins-hbase4.apache.org,44227,1696262556745)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44227-0x10107dfc1490000, quorum=127.0.0.1:50210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43801,1696262558835 2023-10-02 16:04:57,958 DEBUG [member: 'jenkins-hbase4.apache.org,37455,1696262558909' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-02 16:04:57,958 DEBUG [member: 'jenkins-hbase4.apache.org,37455,1696262558909' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-02 16:04:57,958 DEBUG [member: 'jenkins-hbase4.apache.org,43801,1696262558835' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-10-02 16:04:57,958 DEBUG [member: 'jenkins-hbase4.apache.org,42303,1696262558956' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-10-02 16:04:57,958 DEBUG [rs(jenkins-hbase4.apache.org,37455,1696262558909)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1696262696898.4e2ed20fe1c38112784a6cedd7c6ea28. 2023-10-02 16:04:57,958 DEBUG [member: 'jenkins-hbase4.apache.org,42303,1696262558956' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,42303,1696262558956' in zk 2023-10-02 16:04:57,959 DEBUG [rs(jenkins-hbase4.apache.org,37455,1696262558909)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1696262696898.4e2ed20fe1c38112784a6cedd7c6ea28. started... 2023-10-02 16:04:57,959 DEBUG [member: 'jenkins-hbase4.apache.org,43801,1696262558835' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-02 16:04:57,959 DEBUG [member: 'jenkins-hbase4.apache.org,43801,1696262558835' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-02 16:04:57,959 DEBUG [rs(jenkins-hbase4.apache.org,43801,1696262558835)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1696262696898.cc87b7c74312cb3f197c536bbc8d02bd. 2023-10-02 16:04:57,959 DEBUG [(jenkins-hbase4.apache.org,44227,1696262556745)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44227-0x10107dfc1490000, quorum=127.0.0.1:50210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,37455,1696262558909 2023-10-02 16:04:57,959 DEBUG [(jenkins-hbase4.apache.org,44227,1696262556745)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-02 16:04:57,959 DEBUG [rs(jenkins-hbase4.apache.org,43801,1696262558835)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1696262696898.cc87b7c74312cb3f197c536bbc8d02bd. started... 2023-10-02 16:04:57,959 INFO [rs(jenkins-hbase4.apache.org,37455,1696262558909)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 4e2ed20fe1c38112784a6cedd7c6ea28 1/1 column families, dataSize=2.93 KB heapSize=6.58 KB 2023-10-02 16:04:57,959 INFO [rs(jenkins-hbase4.apache.org,43801,1696262558835)-snapshot-pool-0] regionserver.HRegion(2745): Flushing cc87b7c74312cb3f197c536bbc8d02bd 1/1 column families, dataSize=333 B heapSize=976 B 2023-10-02 16:04:57,960 DEBUG [member: 'jenkins-hbase4.apache.org,42303,1696262558956' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-10-02 16:04:57,960 DEBUG [member: 'jenkins-hbase4.apache.org,42303,1696262558956' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-02 16:04:57,960 DEBUG [member: 'jenkins-hbase4.apache.org,42303,1696262558956' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-10-02 16:04:57,982 INFO [rs(jenkins-hbase4.apache.org,43801,1696262558835)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202310023ab4d16000bb48b4882c896ebffaf963 to hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e202310023ab4d16000bb48b4882c896ebffaf963 2023-10-02 16:04:57,982 INFO [rs(jenkins-hbase4.apache.org,37455,1696262558909)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202310022b270ce02bb74760bdc2915cc4c41752 to hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b202310022b270ce02bb74760bdc2915cc4c41752 2023-10-02 16:04:58,008 INFO [rs(jenkins-hbase4.apache.org,43801,1696262558835)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=333, hasBloomFilter=true, into tmp file hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/data/default/testtb-testExportFileSystemStateWithSkipTmp/cc87b7c74312cb3f197c536bbc8d02bd/.tmp/cf/46b51b36ab1b4a79969c66fb121621c7 2023-10-02 16:04:58,012 INFO [rs(jenkins-hbase4.apache.org,37455,1696262558909)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=2.9 K, hasBloomFilter=true, into tmp file hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/data/default/testtb-testExportFileSystemStateWithSkipTmp/4e2ed20fe1c38112784a6cedd7c6ea28/.tmp/cf/a0611f991c02467f99a07c078d5af086 2023-10-02 16:04:58,014 DEBUG [rs(jenkins-hbase4.apache.org,43801,1696262558835)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/data/default/testtb-testExportFileSystemStateWithSkipTmp/cc87b7c74312cb3f197c536bbc8d02bd/.tmp/cf/46b51b36ab1b4a79969c66fb121621c7 as hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/data/default/testtb-testExportFileSystemStateWithSkipTmp/cc87b7c74312cb3f197c536bbc8d02bd/cf/46b51b36ab1b4a79969c66fb121621c7 2023-10-02 16:04:58,017 DEBUG [Listener at jenkins-hbase4.apache.org/32975] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-02 16:04:58,017 DEBUG [rs(jenkins-hbase4.apache.org,37455,1696262558909)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/data/default/testtb-testExportFileSystemStateWithSkipTmp/4e2ed20fe1c38112784a6cedd7c6ea28/.tmp/cf/a0611f991c02467f99a07c078d5af086 as hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/data/default/testtb-testExportFileSystemStateWithSkipTmp/4e2ed20fe1c38112784a6cedd7c6ea28/cf/a0611f991c02467f99a07c078d5af086 2023-10-02 16:04:58,018 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44227] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-10-02 16:04:58,018 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44227] snapshot.SnapshotManager(406): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-10-02 16:04:58,018 DEBUG [Listener at jenkins-hbase4.apache.org/32975] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-10-02 16:04:58,020 INFO [rs(jenkins-hbase4.apache.org,43801,1696262558835)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/data/default/testtb-testExportFileSystemStateWithSkipTmp/cc87b7c74312cb3f197c536bbc8d02bd/cf/46b51b36ab1b4a79969c66fb121621c7, entries=5, sequenceid=6, filesize=5.8 K 2023-10-02 16:04:58,021 INFO [rs(jenkins-hbase4.apache.org,43801,1696262558835)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~333 B/333, heapSize ~960 B/960, currentSize=0 B/0 for cc87b7c74312cb3f197c536bbc8d02bd in 62ms, sequenceid=6, compaction requested=false 2023-10-02 16:04:58,021 DEBUG [rs(jenkins-hbase4.apache.org,43801,1696262558835)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithSkipTmp' 2023-10-02 16:04:58,022 DEBUG [rs(jenkins-hbase4.apache.org,43801,1696262558835)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for cc87b7c74312cb3f197c536bbc8d02bd: 2023-10-02 16:04:58,022 DEBUG [rs(jenkins-hbase4.apache.org,43801,1696262558835)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,,1696262696898.cc87b7c74312cb3f197c536bbc8d02bd.' region-info for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 16:04:58,022 DEBUG [rs(jenkins-hbase4.apache.org,43801,1696262558835)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-02 16:04:58,022 DEBUG [rs(jenkins-hbase4.apache.org,43801,1696262558835)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/data/default/testtb-testExportFileSystemStateWithSkipTmp/cc87b7c74312cb3f197c536bbc8d02bd/cf/46b51b36ab1b4a79969c66fb121621c7] hfiles 2023-10-02 16:04:58,022 DEBUG [rs(jenkins-hbase4.apache.org,43801,1696262558835)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/data/default/testtb-testExportFileSystemStateWithSkipTmp/cc87b7c74312cb3f197c536bbc8d02bd/cf/46b51b36ab1b4a79969c66fb121621c7 for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 16:04:58,026 INFO [rs(jenkins-hbase4.apache.org,37455,1696262558909)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/data/default/testtb-testExportFileSystemStateWithSkipTmp/4e2ed20fe1c38112784a6cedd7c6ea28/cf/a0611f991c02467f99a07c078d5af086, entries=45, sequenceid=6, filesize=13.0 K 2023-10-02 16:04:58,027 INFO [rs(jenkins-hbase4.apache.org,37455,1696262558909)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~2.93 KB/3003, heapSize ~6.56 KB/6720, currentSize=0 B/0 for 4e2ed20fe1c38112784a6cedd7c6ea28 in 68ms, sequenceid=6, compaction requested=false 2023-10-02 16:04:58,029 DEBUG [rs(jenkins-hbase4.apache.org,37455,1696262558909)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 4e2ed20fe1c38112784a6cedd7c6ea28: 2023-10-02 16:04:58,029 DEBUG [rs(jenkins-hbase4.apache.org,37455,1696262558909)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,1,1696262696898.4e2ed20fe1c38112784a6cedd7c6ea28.' region-info for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 16:04:58,029 DEBUG [rs(jenkins-hbase4.apache.org,37455,1696262558909)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-02 16:04:58,029 DEBUG [rs(jenkins-hbase4.apache.org,37455,1696262558909)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/data/default/testtb-testExportFileSystemStateWithSkipTmp/4e2ed20fe1c38112784a6cedd7c6ea28/cf/a0611f991c02467f99a07c078d5af086] hfiles 2023-10-02 16:04:58,029 DEBUG [rs(jenkins-hbase4.apache.org,37455,1696262558909)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/data/default/testtb-testExportFileSystemStateWithSkipTmp/4e2ed20fe1c38112784a6cedd7c6ea28/cf/a0611f991c02467f99a07c078d5af086 for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 16:04:58,040 DEBUG [rs(jenkins-hbase4.apache.org,43801,1696262558835)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1696262696898.cc87b7c74312cb3f197c536bbc8d02bd. completed. 2023-10-02 16:04:58,040 DEBUG [rs(jenkins-hbase4.apache.org,43801,1696262558835)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1696262696898.cc87b7c74312cb3f197c536bbc8d02bd. 2023-10-02 16:04:58,040 DEBUG [member: 'jenkins-hbase4.apache.org,43801,1696262558835' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-02 16:04:58,040 DEBUG [member: 'jenkins-hbase4.apache.org,43801,1696262558835' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-02 16:04:58,040 DEBUG [member: 'jenkins-hbase4.apache.org,43801,1696262558835' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,43801,1696262558835 2023-10-02 16:04:58,040 DEBUG [member: 'jenkins-hbase4.apache.org,43801,1696262558835' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-10-02 16:04:58,040 DEBUG [member: 'jenkins-hbase4.apache.org,43801,1696262558835' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,43801,1696262558835' in zk 2023-10-02 16:04:58,042 DEBUG [member: 'jenkins-hbase4.apache.org,43801,1696262558835' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-10-02 16:04:58,042 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): master:44227-0x10107dfc1490000, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43801,1696262558835 2023-10-02 16:04:58,042 DEBUG [member: 'jenkins-hbase4.apache.org,43801,1696262558835' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-02 16:04:58,042 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43801,1696262558835 2023-10-02 16:04:58,043 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-02 16:04:58,043 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-02 16:04:58,042 DEBUG [member: 'jenkins-hbase4.apache.org,43801,1696262558835' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-10-02 16:04:58,043 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-02 16:04:58,043 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-02 16:04:58,043 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 16:04:58,044 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37455,1696262558909 2023-10-02 16:04:58,044 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42303,1696262558956 2023-10-02 16:04:58,044 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43801,1696262558835 2023-10-02 16:04:58,044 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-02 16:04:58,045 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 16:04:58,045 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42303,1696262558956 2023-10-02 16:04:58,045 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43801,1696262558835 2023-10-02 16:04:58,046 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,43801,1696262558835': 2023-10-02 16:04:58,046 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43801,1696262558835' released barrier for procedure'snaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 1 more 2023-10-02 16:04:58,048 DEBUG [rs(jenkins-hbase4.apache.org,37455,1696262558909)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1696262696898.4e2ed20fe1c38112784a6cedd7c6ea28. completed. 2023-10-02 16:04:58,048 DEBUG [rs(jenkins-hbase4.apache.org,37455,1696262558909)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1696262696898.4e2ed20fe1c38112784a6cedd7c6ea28. 2023-10-02 16:04:58,048 DEBUG [member: 'jenkins-hbase4.apache.org,37455,1696262558909' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-02 16:04:58,048 DEBUG [member: 'jenkins-hbase4.apache.org,37455,1696262558909' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-02 16:04:58,048 DEBUG [member: 'jenkins-hbase4.apache.org,37455,1696262558909' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,37455,1696262558909 2023-10-02 16:04:58,048 DEBUG [member: 'jenkins-hbase4.apache.org,37455,1696262558909' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-10-02 16:04:58,048 DEBUG [member: 'jenkins-hbase4.apache.org,37455,1696262558909' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,37455,1696262558909' in zk 2023-10-02 16:04:58,050 DEBUG [member: 'jenkins-hbase4.apache.org,37455,1696262558909' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-10-02 16:04:58,050 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): master:44227-0x10107dfc1490000, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,37455,1696262558909 2023-10-02 16:04:58,050 DEBUG [member: 'jenkins-hbase4.apache.org,37455,1696262558909' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-02 16:04:58,050 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,37455,1696262558909 2023-10-02 16:04:58,050 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-02 16:04:58,050 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-02 16:04:58,050 DEBUG [member: 'jenkins-hbase4.apache.org,37455,1696262558909' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-10-02 16:04:58,051 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-02 16:04:58,051 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-02 16:04:58,051 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 16:04:58,051 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37455,1696262558909 2023-10-02 16:04:58,052 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42303,1696262558956 2023-10-02 16:04:58,052 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43801,1696262558835 2023-10-02 16:04:58,052 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-02 16:04:58,053 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 16:04:58,053 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37455,1696262558909 2023-10-02 16:04:58,053 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42303,1696262558956 2023-10-02 16:04:58,053 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43801,1696262558835 2023-10-02 16:04:58,054 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,37455,1696262558909': 2023-10-02 16:04:58,054 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,37455,1696262558909' released barrier for procedure'snaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 0 more 2023-10-02 16:04:58,054 INFO [(jenkins-hbase4.apache.org,44227,1696262556745)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' execution completed 2023-10-02 16:04:58,054 DEBUG [(jenkins-hbase4.apache.org,44227,1696262556745)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-02 16:04:58,054 DEBUG [(jenkins-hbase4.apache.org,44227,1696262556745)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-02 16:04:58,054 DEBUG [(jenkins-hbase4.apache.org,44227,1696262556745)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 16:04:58,054 INFO [(jenkins-hbase4.apache.org,44227,1696262556745)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateWithSkipTmpincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-10-02 16:04:58,056 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): master:44227-0x10107dfc1490000, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 16:04:58,057 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): regionserver:43801-0x10107dfc1490001, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 16:04:58,057 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 16:04:58,057 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 16:04:58,057 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-02 16:04:58,057 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-02 16:04:58,057 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): regionserver:43801-0x10107dfc1490001, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-02 16:04:58,057 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): regionserver:37455-0x10107dfc1490002, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 16:04:58,057 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): regionserver:42303-0x10107dfc1490003, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 16:04:58,057 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 16:04:58,057 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 16:04:58,057 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 16:04:58,057 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): regionserver:42303-0x10107dfc1490003, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-02 16:04:58,057 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): regionserver:37455-0x10107dfc1490002, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-02 16:04:58,057 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 16:04:58,057 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-02 16:04:58,057 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 16:04:58,057 DEBUG [(jenkins-hbase4.apache.org,44227,1696262556745)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44227-0x10107dfc1490000, quorum=127.0.0.1:50210, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,37455,1696262558909 2023-10-02 16:04:58,057 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-02 16:04:58,058 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-02 16:04:58,058 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-02 16:04:58,058 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-02 16:04:58,058 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-02 16:04:58,058 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-02 16:04:58,058 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 16:04:58,058 DEBUG [(jenkins-hbase4.apache.org,44227,1696262556745)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44227-0x10107dfc1490000, quorum=127.0.0.1:50210, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,42303,1696262558956 2023-10-02 16:04:58,058 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 16:04:58,058 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 16:04:58,058 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-02 16:04:58,058 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 16:04:58,058 DEBUG [(jenkins-hbase4.apache.org,44227,1696262556745)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44227-0x10107dfc1490000, quorum=127.0.0.1:50210, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43801,1696262558835 2023-10-02 16:04:58,059 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 16:04:58,059 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37455,1696262558909 2023-10-02 16:04:58,059 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42303,1696262558956 2023-10-02 16:04:58,060 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43801,1696262558835 2023-10-02 16:04:58,060 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-02 16:04:58,060 DEBUG [(jenkins-hbase4.apache.org,44227,1696262556745)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44227-0x10107dfc1490000, quorum=127.0.0.1:50210, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,37455,1696262558909 2023-10-02 16:04:58,060 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 16:04:58,060 DEBUG [(jenkins-hbase4.apache.org,44227,1696262556745)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44227-0x10107dfc1490000, quorum=127.0.0.1:50210, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,42303,1696262558956 2023-10-02 16:04:58,061 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37455,1696262558909 2023-10-02 16:04:58,061 DEBUG [(jenkins-hbase4.apache.org,44227,1696262556745)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44227-0x10107dfc1490000, quorum=127.0.0.1:50210, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43801,1696262558835 2023-10-02 16:04:58,061 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42303,1696262558956 2023-10-02 16:04:58,061 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43801,1696262558835 2023-10-02 16:04:58,063 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): master:44227-0x10107dfc1490000, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43801,1696262558835 2023-10-02 16:04:58,063 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): master:44227-0x10107dfc1490000, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 16:04:58,064 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): master:44227-0x10107dfc1490000, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,42303,1696262558956 2023-10-02 16:04:58,064 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): regionserver:43801-0x10107dfc1490001, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-02 16:04:58,064 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): regionserver:37455-0x10107dfc1490002, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-02 16:04:58,064 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): master:44227-0x10107dfc1490000, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,37455,1696262558909 2023-10-02 16:04:58,064 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-02 16:04:58,064 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-02 16:04:58,064 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): regionserver:37455-0x10107dfc1490002, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-02 16:04:58,064 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): regionserver:42303-0x10107dfc1490003, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-02 16:04:58,064 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): regionserver:43801-0x10107dfc1490001, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-02 16:04:58,064 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): master:44227-0x10107dfc1490000, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 16:04:58,064 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-02 16:04:58,064 DEBUG [(jenkins-hbase4.apache.org,44227,1696262556745)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-02 16:04:58,064 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): master:44227-0x10107dfc1490000, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43801,1696262558835 2023-10-02 16:04:58,064 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-02 16:04:58,064 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): regionserver:42303-0x10107dfc1490003, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-02 16:04:58,064 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-02 16:04:58,064 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): master:44227-0x10107dfc1490000, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 16:04:58,064 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 16:04:58,064 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-02 16:04:58,064 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-02 16:04:58,064 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-02 16:04:58,064 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemStateWithSkipTmp 2023-10-02 16:04:58,064 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): master:44227-0x10107dfc1490000, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,42303,1696262558956 2023-10-02 16:04:58,065 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): master:44227-0x10107dfc1490000, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,37455,1696262558909 2023-10-02 16:04:58,065 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): master:44227-0x10107dfc1490000, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 16:04:58,065 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): master:44227-0x10107dfc1490000, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 16:04:58,065 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => e9516f04c7d2974b21addb190acc6c0a, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,.mob,0.e9516f04c7d2974b21addb190acc6c0a.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 16:04:58,065 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-10-02 16:04:58,065 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-02 16:04:58,065 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-02 16:04:58,065 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-02 16:04:58,065 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-02 16:04:58,066 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b202310022b270ce02bb74760bdc2915cc4c41752, hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e202310023ab4d16000bb48b4882c896ebffaf963] mob files 2023-10-02 16:04:58,066 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b202310022b270ce02bb74760bdc2915cc4c41752 2023-10-02 16:04:58,066 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e202310023ab4d16000bb48b4882c896ebffaf963 2023-10-02 16:04:58,078 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 16:04:58,078 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 16:04:58,101 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp to hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 16:04:58,102 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed 2023-10-02 16:04:58,102 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 16:04:58,103 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 16:04:58,103 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp at 1696262697915Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemStateWithSkipTmp at 1696262698078 (+163 ms)Consolidate snapshot: snaptb0-testExportFileSystemStateWithSkipTmp at 1696262698078Loading Region manifests for snaptb0-testExportFileSystemStateWithSkipTmp at 1696262698078Writing data manifest for snaptb0-testExportFileSystemStateWithSkipTmp at 1696262698081 (+3 ms)Verifying snapshot: snaptb0-testExportFileSystemStateWithSkipTmp at 1696262698093 (+12 ms)Snapshot snaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed at 1696262698102 (+9 ms) 2023-10-02 16:04:58,106 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=113, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-10-02 16:04:58,107 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=113, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED in 190 msec 2023-10-02 16:04:58,219 DEBUG [Listener at jenkins-hbase4.apache.org/32975] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-02 16:04:58,220 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44227] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-10-02 16:04:58,220 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44227] snapshot.SnapshotManager(403): Snapshot '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' has completed, notifying client. 2023-10-02 16:04:58,220 INFO [Listener at jenkins-hbase4.apache.org/32975] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/export-test/export-1696262698220 2023-10-02 16:04:58,220 INFO [Listener at jenkins-hbase4.apache.org/32975] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:42119, tgtDir=hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/export-test/export-1696262698220, rawTgtDir=hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/export-test/export-1696262698220, srcFsUri=hdfs://localhost:42119, srcDir=hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af 2023-10-02 16:04:58,251 DEBUG [Listener at jenkins-hbase4.apache.org/32975] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:42119, inputRoot=hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af 2023-10-02 16:04:58,251 DEBUG [Listener at jenkins-hbase4.apache.org/32975] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_261397227_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/export-test/export-1696262698220, skipTmp=true, initialOutputSnapshotDir=hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/export-test/export-1696262698220/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 16:04:58,251 INFO [Listener at jenkins-hbase4.apache.org/32975] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:42119, inputRoot=hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af, snapshotDir=hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp. 2023-10-02 16:04:58,263 INFO [Listener at jenkins-hbase4.apache.org/32975] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp to hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/export-test/export-1696262698220/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 16:04:58,281 DEBUG [Listener at jenkins-hbase4.apache.org/32975] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-10-02 16:04:58,282 DEBUG [Listener at jenkins-hbase4.apache.org/32975] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-10-02 16:04:58,282 DEBUG [Listener at jenkins-hbase4.apache.org/32975] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-10-02 16:04:58,282 DEBUG [Listener at jenkins-hbase4.apache.org/32975] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-10-02 16:04:59,163 DEBUG [Listener at jenkins-hbase4.apache.org/32975] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ec4ab044-456e-ce77-098f-f91b72a3e0ab/hadoop-5407864664108413043.jar 2023-10-02 16:04:59,164 DEBUG [Listener at jenkins-hbase4.apache.org/32975] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-10-02 16:04:59,164 DEBUG [Listener at jenkins-hbase4.apache.org/32975] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-10-02 16:04:59,230 DEBUG [Listener at jenkins-hbase4.apache.org/32975] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ec4ab044-456e-ce77-098f-f91b72a3e0ab/hadoop-1573197102740819799.jar 2023-10-02 16:04:59,231 DEBUG [Listener at jenkins-hbase4.apache.org/32975] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-10-02 16:04:59,231 DEBUG [Listener at jenkins-hbase4.apache.org/32975] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-10-02 16:04:59,232 DEBUG [Listener at jenkins-hbase4.apache.org/32975] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-10-02 16:04:59,232 DEBUG [Listener at jenkins-hbase4.apache.org/32975] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-10-02 16:04:59,233 DEBUG [Listener at jenkins-hbase4.apache.org/32975] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-10-02 16:04:59,233 DEBUG [Listener at jenkins-hbase4.apache.org/32975] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-10-02 16:04:59,233 DEBUG [Listener at jenkins-hbase4.apache.org/32975] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-10-02 16:04:59,233 DEBUG [Listener at jenkins-hbase4.apache.org/32975] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-10-02 16:04:59,234 DEBUG [Listener at jenkins-hbase4.apache.org/32975] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-10-02 16:04:59,234 DEBUG [Listener at jenkins-hbase4.apache.org/32975] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-10-02 16:04:59,234 DEBUG [Listener at jenkins-hbase4.apache.org/32975] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-10-02 16:04:59,235 DEBUG [Listener at jenkins-hbase4.apache.org/32975] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-10-02 16:04:59,235 DEBUG [Listener at jenkins-hbase4.apache.org/32975] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-10-02 16:04:59,235 DEBUG [Listener at jenkins-hbase4.apache.org/32975] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-10-02 16:04:59,236 DEBUG [Listener at jenkins-hbase4.apache.org/32975] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-10-02 16:04:59,236 DEBUG [Listener at jenkins-hbase4.apache.org/32975] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-10-02 16:04:59,237 DEBUG [Listener at jenkins-hbase4.apache.org/32975] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-02 16:04:59,237 DEBUG [Listener at jenkins-hbase4.apache.org/32975] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-02 16:04:59,238 DEBUG [Listener at jenkins-hbase4.apache.org/32975] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-10-02 16:04:59,238 DEBUG [Listener at jenkins-hbase4.apache.org/32975] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-02 16:04:59,238 DEBUG [Listener at jenkins-hbase4.apache.org/32975] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-02 16:04:59,239 DEBUG [Listener at jenkins-hbase4.apache.org/32975] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-10-02 16:04:59,239 DEBUG [Listener at jenkins-hbase4.apache.org/32975] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-10-02 16:04:59,649 WARN [Listener at jenkins-hbase4.apache.org/32975] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-10-02 16:04:59,655 INFO [Listener at jenkins-hbase4.apache.org/32975] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportFileSystemStateWithSkipTmp' hfile list 2023-10-02 16:04:59,657 DEBUG [Listener at jenkins-hbase4.apache.org/32975] snapshot.ExportSnapshot(671): export split=0 size=31.5 K 2023-10-02 16:05:01,155 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-10-02 16:05:01,155 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-10-02 16:05:01,157 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696262569087_0006_000001 (auth:SIMPLE) 2023-10-02 16:05:01,851 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696262569087_0007_000001 (auth:SIMPLE) 2023-10-02 16:05:02,182 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-10-02 16:05:05,917 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696262569087_0007_000001 (auth:SIMPLE) 2023-10-02 16:05:08,139 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696262569087_0007_000001 (auth:SIMPLE) 2023-10-02 16:05:11,478 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696262569087_0007_000001 (auth:SIMPLE) 2023-10-02 16:05:12,821 INFO [Listener at jenkins-hbase4.apache.org/32975] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-10-02 16:05:12,821 INFO [Listener at jenkins-hbase4.apache.org/32975] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-10-02 16:05:12,828 INFO [Listener at jenkins-hbase4.apache.org/32975] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 16:05:12,828 INFO [Listener at jenkins-hbase4.apache.org/32975] snapshot.TestExportSnapshot(279): Exported snapshot 2023-10-02 16:05:12,829 INFO [Listener at jenkins-hbase4.apache.org/32975] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-10-02 16:05:12,829 DEBUG [Listener at jenkins-hbase4.apache.org/32975] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_95248091_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp at hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 16:05:12,829 DEBUG [Listener at jenkins-hbase4.apache.org/32975] snapshot.TestExportSnapshot(367): hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/.snapshotinfo 2023-10-02 16:05:12,829 DEBUG [Listener at jenkins-hbase4.apache.org/32975] snapshot.TestExportSnapshot(367): hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/data.manifest 2023-10-02 16:05:12,830 DEBUG [Listener at jenkins-hbase4.apache.org/32975] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_95248091_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/export-test/export-1696262698220/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp at hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/export-test/export-1696262698220/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 16:05:12,830 DEBUG [Listener at jenkins-hbase4.apache.org/32975] snapshot.TestExportSnapshot(367): hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/export-test/export-1696262698220/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/.snapshotinfo 2023-10-02 16:05:12,830 DEBUG [Listener at jenkins-hbase4.apache.org/32975] snapshot.TestExportSnapshot(367): hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/export-test/export-1696262698220/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/data.manifest 2023-10-02 16:05:12,836 INFO [Listener at jenkins-hbase4.apache.org/32975] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemStateWithSkipTmp 2023-10-02 16:05:12,836 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44227] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemStateWithSkipTmp 2023-10-02 16:05:12,837 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44227] procedure2.ProcedureExecutor(1028): Stored pid=114, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-10-02 16:05:12,840 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44227] master.MasterRpcServices(1230): Checking to see if procedure is done pid=114 2023-10-02 16:05:12,841 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696262712840"}]},"ts":"1696262712840"} 2023-10-02 16:05:12,842 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=DISABLING in hbase:meta 2023-10-02 16:05:12,866 INFO [PEWorker-4] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemStateWithSkipTmp to state=DISABLING 2023-10-02 16:05:12,867 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=115, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=cc87b7c74312cb3f197c536bbc8d02bd, UNASSIGN}, {pid=116, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=4e2ed20fe1c38112784a6cedd7c6ea28, UNASSIGN}] 2023-10-02 16:05:12,869 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=115, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=cc87b7c74312cb3f197c536bbc8d02bd, UNASSIGN 2023-10-02 16:05:12,869 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=116, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=4e2ed20fe1c38112784a6cedd7c6ea28, UNASSIGN 2023-10-02 16:05:12,870 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=116 updating hbase:meta row=4e2ed20fe1c38112784a6cedd7c6ea28, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,37455,1696262558909 2023-10-02 16:05:12,870 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=115 updating hbase:meta row=cc87b7c74312cb3f197c536bbc8d02bd, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,43801,1696262558835 2023-10-02 16:05:12,870 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1696262696898.4e2ed20fe1c38112784a6cedd7c6ea28.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1696262712870"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696262712870"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696262712870"}]},"ts":"1696262712870"} 2023-10-02 16:05:12,870 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1696262696898.cc87b7c74312cb3f197c536bbc8d02bd.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1696262712870"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696262712870"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696262712870"}]},"ts":"1696262712870"} 2023-10-02 16:05:12,872 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=117, ppid=116, state=RUNNABLE; CloseRegionProcedure 4e2ed20fe1c38112784a6cedd7c6ea28, server=jenkins-hbase4.apache.org,37455,1696262558909}] 2023-10-02 16:05:12,872 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=118, ppid=115, state=RUNNABLE; CloseRegionProcedure cc87b7c74312cb3f197c536bbc8d02bd, server=jenkins-hbase4.apache.org,43801,1696262558835}] 2023-10-02 16:05:12,941 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44227] master.MasterRpcServices(1230): Checking to see if procedure is done pid=114 2023-10-02 16:05:13,024 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close cc87b7c74312cb3f197c536bbc8d02bd 2023-10-02 16:05:13,024 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 4e2ed20fe1c38112784a6cedd7c6ea28 2023-10-02 16:05:13,024 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing cc87b7c74312cb3f197c536bbc8d02bd, disabling compactions & flushes 2023-10-02 16:05:13,024 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 4e2ed20fe1c38112784a6cedd7c6ea28, disabling compactions & flushes 2023-10-02 16:05:13,024 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,,1696262696898.cc87b7c74312cb3f197c536bbc8d02bd. 2023-10-02 16:05:13,024 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,1,1696262696898.4e2ed20fe1c38112784a6cedd7c6ea28. 2023-10-02 16:05:13,024 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,,1696262696898.cc87b7c74312cb3f197c536bbc8d02bd. 2023-10-02 16:05:13,024 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1696262696898.4e2ed20fe1c38112784a6cedd7c6ea28. 2023-10-02 16:05:13,024 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,,1696262696898.cc87b7c74312cb3f197c536bbc8d02bd. after waiting 0 ms 2023-10-02 16:05:13,024 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,,1696262696898.cc87b7c74312cb3f197c536bbc8d02bd. 2023-10-02 16:05:13,024 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1696262696898.4e2ed20fe1c38112784a6cedd7c6ea28. after waiting 0 ms 2023-10-02 16:05:13,024 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,1,1696262696898.4e2ed20fe1c38112784a6cedd7c6ea28. 2023-10-02 16:05:13,035 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/data/default/testtb-testExportFileSystemStateWithSkipTmp/4e2ed20fe1c38112784a6cedd7c6ea28/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-10-02 16:05:13,035 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/data/default/testtb-testExportFileSystemStateWithSkipTmp/cc87b7c74312cb3f197c536bbc8d02bd/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-10-02 16:05:13,036 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-10-02 16:05:13,037 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-10-02 16:05:13,037 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,1,1696262696898.4e2ed20fe1c38112784a6cedd7c6ea28. 2023-10-02 16:05:13,037 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 4e2ed20fe1c38112784a6cedd7c6ea28: 2023-10-02 16:05:13,037 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,,1696262696898.cc87b7c74312cb3f197c536bbc8d02bd. 2023-10-02 16:05:13,037 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for cc87b7c74312cb3f197c536bbc8d02bd: 2023-10-02 16:05:13,039 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed cc87b7c74312cb3f197c536bbc8d02bd 2023-10-02 16:05:13,041 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=115 updating hbase:meta row=cc87b7c74312cb3f197c536bbc8d02bd, regionState=CLOSED 2023-10-02 16:05:13,041 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1696262696898.cc87b7c74312cb3f197c536bbc8d02bd.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1696262713041"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696262713041"}]},"ts":"1696262713041"} 2023-10-02 16:05:13,041 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 4e2ed20fe1c38112784a6cedd7c6ea28 2023-10-02 16:05:13,042 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=116 updating hbase:meta row=4e2ed20fe1c38112784a6cedd7c6ea28, regionState=CLOSED 2023-10-02 16:05:13,042 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1696262696898.4e2ed20fe1c38112784a6cedd7c6ea28.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1696262713042"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696262713042"}]},"ts":"1696262713042"} 2023-10-02 16:05:13,044 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=118, resume processing ppid=115 2023-10-02 16:05:13,044 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=118, ppid=115, state=SUCCESS; CloseRegionProcedure cc87b7c74312cb3f197c536bbc8d02bd, server=jenkins-hbase4.apache.org,43801,1696262558835 in 171 msec 2023-10-02 16:05:13,045 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=117, resume processing ppid=116 2023-10-02 16:05:13,045 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=117, ppid=116, state=SUCCESS; CloseRegionProcedure 4e2ed20fe1c38112784a6cedd7c6ea28, server=jenkins-hbase4.apache.org,37455,1696262558909 in 172 msec 2023-10-02 16:05:13,045 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=115, ppid=114, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=cc87b7c74312cb3f197c536bbc8d02bd, UNASSIGN in 177 msec 2023-10-02 16:05:13,047 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=116, resume processing ppid=114 2023-10-02 16:05:13,047 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=116, ppid=114, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=4e2ed20fe1c38112784a6cedd7c6ea28, UNASSIGN in 178 msec 2023-10-02 16:05:13,047 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696262713047"}]},"ts":"1696262713047"} 2023-10-02 16:05:13,048 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=DISABLED in hbase:meta 2023-10-02 16:05:13,081 INFO [PEWorker-2] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemStateWithSkipTmp to state=DISABLED 2023-10-02 16:05:13,083 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=114, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp in 245 msec 2023-10-02 16:05:13,143 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44227] master.MasterRpcServices(1230): Checking to see if procedure is done pid=114 2023-10-02 16:05:13,143 INFO [Listener at jenkins-hbase4.apache.org/32975] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemStateWithSkipTmp, procId: 114 completed 2023-10-02 16:05:13,144 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44227] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemStateWithSkipTmp 2023-10-02 16:05:13,145 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44227] procedure2.ProcedureExecutor(1028): Stored pid=119, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-10-02 16:05:13,147 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=119, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-10-02 16:05:13,147 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44227] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemStateWithSkipTmp 2023-10-02 16:05:13,148 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=119, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-10-02 16:05:13,149 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=42303] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemStateWithSkipTmp 2023-10-02 16:05:13,152 DEBUG [HFileArchiver-15] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/cc87b7c74312cb3f197c536bbc8d02bd 2023-10-02 16:05:13,152 DEBUG [HFileArchiver-14] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/4e2ed20fe1c38112784a6cedd7c6ea28 2023-10-02 16:05:13,154 DEBUG [HFileArchiver-15] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/cc87b7c74312cb3f197c536bbc8d02bd/cf, FileablePath, hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/cc87b7c74312cb3f197c536bbc8d02bd/recovered.edits] 2023-10-02 16:05:13,154 DEBUG [HFileArchiver-14] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/4e2ed20fe1c38112784a6cedd7c6ea28/cf, FileablePath, hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/4e2ed20fe1c38112784a6cedd7c6ea28/recovered.edits] 2023-10-02 16:05:13,158 DEBUG [HFileArchiver-15] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/cc87b7c74312cb3f197c536bbc8d02bd/cf/46b51b36ab1b4a79969c66fb121621c7 to hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/cc87b7c74312cb3f197c536bbc8d02bd/cf/46b51b36ab1b4a79969c66fb121621c7 2023-10-02 16:05:13,159 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/4e2ed20fe1c38112784a6cedd7c6ea28/cf/a0611f991c02467f99a07c078d5af086 to hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/4e2ed20fe1c38112784a6cedd7c6ea28/cf/a0611f991c02467f99a07c078d5af086 2023-10-02 16:05:13,162 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/4e2ed20fe1c38112784a6cedd7c6ea28/recovered.edits/9.seqid to hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/4e2ed20fe1c38112784a6cedd7c6ea28/recovered.edits/9.seqid 2023-10-02 16:05:13,162 DEBUG [HFileArchiver-15] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/cc87b7c74312cb3f197c536bbc8d02bd/recovered.edits/9.seqid to hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/cc87b7c74312cb3f197c536bbc8d02bd/recovered.edits/9.seqid 2023-10-02 16:05:13,163 DEBUG [HFileArchiver-14] backup.HFileArchiver(596): Deleted hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/4e2ed20fe1c38112784a6cedd7c6ea28 2023-10-02 16:05:13,163 DEBUG [HFileArchiver-15] backup.HFileArchiver(596): Deleted hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/cc87b7c74312cb3f197c536bbc8d02bd 2023-10-02 16:05:13,163 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithSkipTmp regions 2023-10-02 16:05:13,164 DEBUG [PEWorker-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a 2023-10-02 16:05:13,165 DEBUG [PEWorker-1] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf] 2023-10-02 16:05:13,169 DEBUG [PEWorker-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b202310022b270ce02bb74760bdc2915cc4c41752 to hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b202310022b270ce02bb74760bdc2915cc4c41752 2023-10-02 16:05:13,170 DEBUG [PEWorker-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e202310023ab4d16000bb48b4882c896ebffaf963 to hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e202310023ab4d16000bb48b4882c896ebffaf963 2023-10-02 16:05:13,171 DEBUG [PEWorker-1] backup.HFileArchiver(596): Deleted hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a 2023-10-02 16:05:13,173 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=119, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-10-02 16:05:13,176 WARN [PEWorker-1] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportFileSystemStateWithSkipTmp from hbase:meta 2023-10-02 16:05:13,212 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): regionserver:43801-0x10107dfc1490001, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-10-02 16:05:13,212 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): regionserver:37455-0x10107dfc1490002, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-10-02 16:05:13,212 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): regionserver:42303-0x10107dfc1490003, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-10-02 16:05:13,212 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): master:44227-0x10107dfc1490000, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-10-02 16:05:13,213 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-10-02 16:05:13,213 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-10-02 16:05:13,213 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-10-02 16:05:13,213 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-10-02 16:05:13,214 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemStateWithSkipTmp' descriptor. 2023-10-02 16:05:13,215 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=119, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-10-02 16:05:13,215 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemStateWithSkipTmp' from region states. 2023-10-02 16:05:13,216 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1696262696898.cc87b7c74312cb3f197c536bbc8d02bd.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1696262713215"}]},"ts":"9223372036854775807"} 2023-10-02 16:05:13,216 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1696262696898.4e2ed20fe1c38112784a6cedd7c6ea28.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1696262713215"}]},"ts":"9223372036854775807"} 2023-10-02 16:05:13,218 INFO [PEWorker-1] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-10-02 16:05:13,218 DEBUG [PEWorker-1] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => cc87b7c74312cb3f197c536bbc8d02bd, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,,1696262696898.cc87b7c74312cb3f197c536bbc8d02bd.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 4e2ed20fe1c38112784a6cedd7c6ea28, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,1,1696262696898.4e2ed20fe1c38112784a6cedd7c6ea28.', STARTKEY => '1', ENDKEY => ''}] 2023-10-02 16:05:13,218 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemStateWithSkipTmp' as deleted. 2023-10-02 16:05:13,218 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1696262713218"}]},"ts":"9223372036854775807"} 2023-10-02 16:05:13,220 INFO [PEWorker-1] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemStateWithSkipTmp state from META 2023-10-02 16:05:13,259 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): master:44227-0x10107dfc1490000, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-10-02 16:05:13,259 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): regionserver:37455-0x10107dfc1490002, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-10-02 16:05:13,259 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): regionserver:43801-0x10107dfc1490001, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-10-02 16:05:13,259 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): regionserver:42303-0x10107dfc1490003, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-10-02 16:05:13,259 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): regionserver:43801-0x10107dfc1490001, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-02 16:05:13,259 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): regionserver:42303-0x10107dfc1490003, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-02 16:05:13,259 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): regionserver:37455-0x10107dfc1490002, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-02 16:05:13,259 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): master:44227-0x10107dfc1490000, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-02 16:05:13,260 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44227] master.MasterRpcServices(1230): Checking to see if procedure is done pid=119 2023-10-02 16:05:13,297 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(130): Finished pid=119, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-10-02 16:05:13,299 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=119, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp in 153 msec 2023-10-02 16:05:13,361 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44227] master.MasterRpcServices(1230): Checking to see if procedure is done pid=119 2023-10-02 16:05:13,361 INFO [Listener at jenkins-hbase4.apache.org/32975] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemStateWithSkipTmp, procId: 119 completed 2023-10-02 16:05:13,368 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44227] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportFileSystemStateWithSkipTmp" 2023-10-02 16:05:13,370 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44227] snapshot.SnapshotManager(335): Deleting snapshot: emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 16:05:13,371 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44227] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemStateWithSkipTmp" 2023-10-02 16:05:13,373 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44227] snapshot.SnapshotManager(335): Deleting snapshot: snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-02 16:05:13,399 INFO [Listener at jenkins-hbase4.apache.org/32975] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testExportFileSystemStateWithSkipTmp Thread=768 (was 767) Potentially hanging thread: hconnection-0x646a4964-shared-pool-43 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_704838996_1 at /127.0.0.1:59410 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #12 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-5461 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_95248091_17 at /127.0.0.1:42678 [Waiting for operation #6] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (337744187) connection to jenkins-hbase4.apache.org/172.31.14.131:43357 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: ApplicationMasterLauncher #11 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_95248091_17 at /127.0.0.1:59424 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x646a4964-shared-pool-42 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x646a4964-shared-pool-44 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_95248091_17 at /127.0.0.1:53292 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x646a4964-shared-pool-45 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=916 (was 937), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=508 (was 557), ProcessCount=197 (was 197), AvailableMemoryMB=869 (was 426) - AvailableMemoryMB LEAK? - 2023-10-02 16:05:13,399 WARN [Listener at jenkins-hbase4.apache.org/32975] hbase.ResourceChecker(130): Thread=768 is superior to 500 2023-10-02 16:05:13,399 INFO [Listener at jenkins-hbase4.apache.org/32975] hbase.HBaseTestingUtility(2762): Stopping mini mapreduce cluster... 2023-10-02 16:05:13,411 INFO [Listener at jenkins-hbase4.apache.org/32975] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-10-02 16:05:17,659 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696262569087_0007_000001 (auth:SIMPLE) 2023-10-02 16:05:18,610 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-10-02 16:05:27,540 INFO [Listener at jenkins-hbase4.apache.org/32975] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-10-02 16:05:41,660 ERROR [Thread[Thread-410,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager$ExpiredTokenRemover(696): ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted 2023-10-02 16:05:41,661 INFO [Listener at jenkins-hbase4.apache.org/32975] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-10-02 16:05:41,771 WARN [ApplicationMaster Launcher] amlauncher.ApplicationMasterLauncher$LauncherThread(122): org.apache.hadoop.yarn.server.resourcemanager.amlauncher.ApplicationMasterLauncher$LauncherThread interrupted. Returning. 2023-10-02 16:05:41,780 ERROR [SchedulerEventDispatcher:Event Processor] event.EventDispatcher$EventProcessor(61): Returning, interrupted : java.lang.InterruptedException 2023-10-02 16:05:41,782 ERROR [Thread[Thread-420,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager$ExpiredTokenRemover(696): ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted 2023-10-02 16:05:41,799 INFO [Listener at jenkins-hbase4.apache.org/32975] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-10-02 16:05:41,904 ERROR [Thread[Thread-384,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager$ExpiredTokenRemover(696): ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted 2023-10-02 16:05:41,904 INFO [Listener at jenkins-hbase4.apache.org/32975] hbase.HBaseTestingUtility(2765): Mini mapreduce cluster stopped 2023-10-02 16:05:41,904 INFO [Listener at jenkins-hbase4.apache.org/32975] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-10-02 16:05:41,904 INFO [Listener at jenkins-hbase4.apache.org/32975] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-10-02 16:05:41,904 DEBUG [Listener at jenkins-hbase4.apache.org/32975] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x627146cd to 127.0.0.1:50210 2023-10-02 16:05:41,905 DEBUG [Listener at jenkins-hbase4.apache.org/32975] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-02 16:05:41,906 DEBUG [Listener at jenkins-hbase4.apache.org/32975] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-10-02 16:05:41,906 DEBUG [Listener at jenkins-hbase4.apache.org/32975] util.JVMClusterUtil(257): Found active master hash=2068765342, stopped=false 2023-10-02 16:05:41,906 DEBUG [Listener at jenkins-hbase4.apache.org/32975] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-10-02 16:05:41,906 DEBUG [Listener at jenkins-hbase4.apache.org/32975] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver 2023-10-02 16:05:41,906 INFO [Listener at jenkins-hbase4.apache.org/32975] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase4.apache.org,44227,1696262556745 2023-10-02 16:05:41,908 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): regionserver:42303-0x10107dfc1490003, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-10-02 16:05:41,908 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): master:44227-0x10107dfc1490000, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-10-02 16:05:41,908 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): master:44227-0x10107dfc1490000, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-10-02 16:05:41,909 INFO [Listener at jenkins-hbase4.apache.org/32975] procedure2.ProcedureExecutor(628): Stopping 2023-10-02 16:05:41,909 DEBUG [Listener at jenkins-hbase4.apache.org/32975] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x45a45377 to 127.0.0.1:50210 2023-10-02 16:05:41,910 DEBUG [Listener at jenkins-hbase4.apache.org/32975] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-02 16:05:41,910 INFO [Listener at jenkins-hbase4.apache.org/32975] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,43801,1696262558835' ***** 2023-10-02 16:05:41,910 DEBUG [Listener at jenkins-hbase4.apache.org/32975] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-10-02 16:05:41,910 INFO [Listener at jenkins-hbase4.apache.org/32975] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-10-02 16:05:41,910 INFO [RS:0;jenkins-hbase4:43801] regionserver.HeapMemoryManager(220): Stopping 2023-10-02 16:05:41,910 INFO [RS:0;jenkins-hbase4:43801] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-10-02 16:05:41,911 INFO [RS:0;jenkins-hbase4:43801] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-10-02 16:05:41,911 INFO [RS:0;jenkins-hbase4:43801] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,43801,1696262558835 2023-10-02 16:05:41,911 DEBUG [RS:0;jenkins-hbase4:43801] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x309db57c to 127.0.0.1:50210 2023-10-02 16:05:41,911 DEBUG [RS:0;jenkins-hbase4:43801] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-02 16:05:41,911 INFO [Listener at jenkins-hbase4.apache.org/32975] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,37455,1696262558909' ***** 2023-10-02 16:05:41,911 DEBUG [Listener at jenkins-hbase4.apache.org/32975] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-10-02 16:05:41,911 INFO [Listener at jenkins-hbase4.apache.org/32975] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-10-02 16:05:41,911 INFO [Listener at jenkins-hbase4.apache.org/32975] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,42303,1696262558956' ***** 2023-10-02 16:05:41,911 DEBUG [Listener at jenkins-hbase4.apache.org/32975] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-10-02 16:05:41,911 INFO [Listener at jenkins-hbase4.apache.org/32975] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-10-02 16:05:41,911 INFO [RS:1;jenkins-hbase4:37455] regionserver.HeapMemoryManager(220): Stopping 2023-10-02 16:05:41,912 INFO [RS:2;jenkins-hbase4:42303] regionserver.HeapMemoryManager(220): Stopping 2023-10-02 16:05:41,912 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): regionserver:43801-0x10107dfc1490001, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-10-02 16:05:41,912 INFO [RS:2;jenkins-hbase4:42303] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-10-02 16:05:41,912 INFO [RS:2;jenkins-hbase4:42303] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-10-02 16:05:41,912 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42303-0x10107dfc1490003, quorum=127.0.0.1:50210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-10-02 16:05:41,912 INFO [RS:2;jenkins-hbase4:42303] regionserver.HRegionServer(3305): Received CLOSE for ec420c8fac16838c0245735817757993 2023-10-02 16:05:41,912 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:44227-0x10107dfc1490000, quorum=127.0.0.1:50210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-10-02 16:05:41,912 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): regionserver:37455-0x10107dfc1490002, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-10-02 16:05:41,914 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-10-02 16:05:41,912 INFO [RS:1;jenkins-hbase4:37455] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-10-02 16:05:41,914 INFO [RS:1;jenkins-hbase4:37455] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-10-02 16:05:41,914 INFO [RS:1;jenkins-hbase4:37455] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,37455,1696262558909 2023-10-02 16:05:41,914 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43801-0x10107dfc1490001, quorum=127.0.0.1:50210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-10-02 16:05:41,914 INFO [RS:2;jenkins-hbase4:42303] regionserver.HRegionServer(3305): Received CLOSE for 629418abee8c789ea807f30d3267c0ae 2023-10-02 16:05:41,915 INFO [RS:2;jenkins-hbase4:42303] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,42303,1696262558956 2023-10-02 16:05:41,915 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37455-0x10107dfc1490002, quorum=127.0.0.1:50210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-10-02 16:05:41,914 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-10-02 16:05:41,914 INFO [RS:0;jenkins-hbase4:43801] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,43801,1696262558835; all regions closed. 2023-10-02 16:05:41,912 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-10-02 16:05:41,915 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing ec420c8fac16838c0245735817757993, disabling compactions & flushes 2023-10-02 16:05:41,916 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:acl,,1696262562713.ec420c8fac16838c0245735817757993. 2023-10-02 16:05:41,916 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:acl,,1696262562713.ec420c8fac16838c0245735817757993. 2023-10-02 16:05:41,916 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:acl,,1696262562713.ec420c8fac16838c0245735817757993. after waiting 0 ms 2023-10-02 16:05:41,916 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:acl,,1696262562713.ec420c8fac16838c0245735817757993. 2023-10-02 16:05:41,915 DEBUG [RS:2;jenkins-hbase4:42303] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1c306437 to 127.0.0.1:50210 2023-10-02 16:05:41,916 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing ec420c8fac16838c0245735817757993 1/1 column families, dataSize=914 B heapSize=2.17 KB 2023-10-02 16:05:41,914 DEBUG [RS:1;jenkins-hbase4:37455] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x29c90dff to 127.0.0.1:50210 2023-10-02 16:05:41,916 DEBUG [RS:1;jenkins-hbase4:37455] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-02 16:05:41,916 DEBUG [RS:2;jenkins-hbase4:42303] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-02 16:05:41,920 INFO [RS:1;jenkins-hbase4:37455] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,37455,1696262558909; all regions closed. 2023-10-02 16:05:41,920 INFO [RS:2;jenkins-hbase4:42303] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-10-02 16:05:41,920 INFO [RS:2;jenkins-hbase4:42303] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-10-02 16:05:41,921 INFO [RS:2;jenkins-hbase4:42303] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-10-02 16:05:41,921 INFO [RS:2;jenkins-hbase4:42303] regionserver.HRegionServer(3305): Received CLOSE for 1588230740 2023-10-02 16:05:41,921 INFO [RS:2;jenkins-hbase4:42303] regionserver.HRegionServer(1474): Waiting on 3 regions to close 2023-10-02 16:05:41,921 DEBUG [RS:2;jenkins-hbase4:42303] regionserver.HRegionServer(1478): Online Regions={ec420c8fac16838c0245735817757993=hbase:acl,,1696262562713.ec420c8fac16838c0245735817757993., 1588230740=hbase:meta,,1.1588230740, 629418abee8c789ea807f30d3267c0ae=hbase:namespace,,1696262561661.629418abee8c789ea807f30d3267c0ae.} 2023-10-02 16:05:41,922 DEBUG [RS:2;jenkins-hbase4:42303] regionserver.HRegionServer(1504): Waiting on 1588230740, 629418abee8c789ea807f30d3267c0ae, ec420c8fac16838c0245735817757993 2023-10-02 16:05:41,923 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-10-02 16:05:41,923 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-10-02 16:05:41,923 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-10-02 16:05:41,923 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-10-02 16:05:41,923 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-10-02 16:05:41,924 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 1588230740 3/3 column families, dataSize=45.93 KB heapSize=71.92 KB 2023-10-02 16:05:41,930 INFO [regionserver/jenkins-hbase4:0.Chore.1] hbase.ScheduledChore(146): Chore: CompactionChecker was stopped 2023-10-02 16:05:41,930 INFO [regionserver/jenkins-hbase4:0.Chore.1] hbase.ScheduledChore(146): Chore: MemstoreFlusherChore was stopped 2023-10-02 16:05:41,940 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-10-02 16:05:41,944 INFO [regionserver/jenkins-hbase4:0.Chore.1] hbase.ScheduledChore(146): Chore: CompactionChecker was stopped 2023-10-02 16:05:41,944 INFO [regionserver/jenkins-hbase4:0.Chore.1] hbase.ScheduledChore(146): Chore: MemstoreFlusherChore was stopped 2023-10-02 16:05:41,948 DEBUG [RS:1;jenkins-hbase4:37455] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/oldWALs 2023-10-02 16:05:41,948 INFO [RS:1;jenkins-hbase4:37455] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C37455%2C1696262558909:(num 1696262561087) 2023-10-02 16:05:41,948 DEBUG [RS:1;jenkins-hbase4:37455] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-02 16:05:41,948 INFO [RS:1;jenkins-hbase4:37455] regionserver.LeaseManager(133): Closed leases 2023-10-02 16:05:41,949 INFO [RS:1;jenkins-hbase4:37455] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-10-02 16:05:41,949 INFO [RS:1;jenkins-hbase4:37455] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-10-02 16:05:41,949 INFO [RS:1;jenkins-hbase4:37455] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-10-02 16:05:41,949 INFO [RS:1;jenkins-hbase4:37455] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-10-02 16:05:41,949 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-10-02 16:05:41,950 INFO [RS:1;jenkins-hbase4:37455] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:37455 2023-10-02 16:05:41,951 DEBUG [RS:0;jenkins-hbase4:43801] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/oldWALs 2023-10-02 16:05:41,951 INFO [RS:0;jenkins-hbase4:43801] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C43801%2C1696262558835:(num 1696262561087) 2023-10-02 16:05:41,951 DEBUG [RS:0;jenkins-hbase4:43801] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-02 16:05:41,951 INFO [RS:0;jenkins-hbase4:43801] regionserver.LeaseManager(133): Closed leases 2023-10-02 16:05:41,957 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): regionserver:43801-0x10107dfc1490001, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,37455,1696262558909 2023-10-02 16:05:41,957 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): master:44227-0x10107dfc1490000, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-10-02 16:05:41,957 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): regionserver:43801-0x10107dfc1490001, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-10-02 16:05:41,957 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): regionserver:42303-0x10107dfc1490003, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,37455,1696262558909 2023-10-02 16:05:41,957 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): regionserver:42303-0x10107dfc1490003, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-10-02 16:05:41,957 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): regionserver:37455-0x10107dfc1490002, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,37455,1696262558909 2023-10-02 16:05:41,957 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): regionserver:37455-0x10107dfc1490002, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-10-02 16:05:41,959 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,37455,1696262558909] 2023-10-02 16:05:41,960 INFO [RS:0;jenkins-hbase4:43801] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-10-02 16:05:41,960 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,37455,1696262558909; numProcessing=1 2023-10-02 16:05:41,960 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-10-02 16:05:41,960 INFO [RS:0;jenkins-hbase4:43801] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-10-02 16:05:41,961 INFO [RS:0;jenkins-hbase4:43801] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-10-02 16:05:41,961 INFO [RS:0;jenkins-hbase4:43801] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-10-02 16:05:41,963 INFO [RS:0;jenkins-hbase4:43801] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:43801 2023-10-02 16:05:41,968 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): regionserver:42303-0x10107dfc1490003, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,43801,1696262558835 2023-10-02 16:05:41,968 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,37455,1696262558909 already deleted, retry=false 2023-10-02 16:05:41,968 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,37455,1696262558909 expired; onlineServers=2 2023-10-02 16:05:41,968 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): master:44227-0x10107dfc1490000, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-10-02 16:05:41,968 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,43801,1696262558835] 2023-10-02 16:05:41,969 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,43801,1696262558835; numProcessing=2 2023-10-02 16:05:41,970 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): regionserver:43801-0x10107dfc1490001, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,43801,1696262558835 2023-10-02 16:05:41,970 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,43801,1696262558835 already deleted, retry=false 2023-10-02 16:05:41,970 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,43801,1696262558835 expired; onlineServers=1 2023-10-02 16:05:41,974 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=914 B at sequenceid=18 (bloomFilter=false), to=hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/data/hbase/acl/ec420c8fac16838c0245735817757993/.tmp/l/22e2540e498b4a35ae575033130a31a4 2023-10-02 16:05:41,989 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 22e2540e498b4a35ae575033130a31a4 2023-10-02 16:05:41,991 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/data/hbase/acl/ec420c8fac16838c0245735817757993/.tmp/l/22e2540e498b4a35ae575033130a31a4 as hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/data/hbase/acl/ec420c8fac16838c0245735817757993/l/22e2540e498b4a35ae575033130a31a4 2023-10-02 16:05:41,992 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=40.45 KB at sequenceid=131 (bloomFilter=false), to=hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/data/hbase/meta/1588230740/.tmp/info/9bec5c1d1a464f7c83ba0df17f705655 2023-10-02 16:05:41,995 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-10-02 16:05:41,998 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 9bec5c1d1a464f7c83ba0df17f705655 2023-10-02 16:05:42,001 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-10-02 16:05:42,011 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 22e2540e498b4a35ae575033130a31a4 2023-10-02 16:05:42,012 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/data/hbase/acl/ec420c8fac16838c0245735817757993/l/22e2540e498b4a35ae575033130a31a4, entries=7, sequenceid=18, filesize=5.2 K 2023-10-02 16:05:42,013 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~914 B/914, heapSize ~2.16 KB/2208, currentSize=0 B/0 for ec420c8fac16838c0245735817757993 in 97ms, sequenceid=18, compaction requested=false 2023-10-02 16:05:42,043 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=1.50 KB at sequenceid=131 (bloomFilter=false), to=hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/data/hbase/meta/1588230740/.tmp/rep_barrier/81597ae4a0f64f9387e404fe2f27540b 2023-10-02 16:05:42,045 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/data/hbase/acl/ec420c8fac16838c0245735817757993/recovered.edits/21.seqid, newMaxSeqId=21, maxSeqId=1 2023-10-02 16:05:42,046 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-10-02 16:05:42,047 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:acl,,1696262562713.ec420c8fac16838c0245735817757993. 2023-10-02 16:05:42,047 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for ec420c8fac16838c0245735817757993: 2023-10-02 16:05:42,048 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:acl,,1696262562713.ec420c8fac16838c0245735817757993. 2023-10-02 16:05:42,048 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 629418abee8c789ea807f30d3267c0ae, disabling compactions & flushes 2023-10-02 16:05:42,048 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1696262561661.629418abee8c789ea807f30d3267c0ae. 2023-10-02 16:05:42,048 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1696262561661.629418abee8c789ea807f30d3267c0ae. 2023-10-02 16:05:42,048 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1696262561661.629418abee8c789ea807f30d3267c0ae. after waiting 0 ms 2023-10-02 16:05:42,048 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1696262561661.629418abee8c789ea807f30d3267c0ae. 2023-10-02 16:05:42,048 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 629418abee8c789ea807f30d3267c0ae 1/1 column families, dataSize=78 B heapSize=488 B 2023-10-02 16:05:42,050 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 81597ae4a0f64f9387e404fe2f27540b 2023-10-02 16:05:42,067 INFO [RS:1;jenkins-hbase4:37455] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,37455,1696262558909; zookeeper connection closed. 2023-10-02 16:05:42,067 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): regionserver:37455-0x10107dfc1490002, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-10-02 16:05:42,067 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): regionserver:37455-0x10107dfc1490002, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-10-02 16:05:42,069 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@1c2e3d94] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@1c2e3d94 2023-10-02 16:05:42,078 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): regionserver:43801-0x10107dfc1490001, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-10-02 16:05:42,079 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): regionserver:43801-0x10107dfc1490001, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-10-02 16:05:42,079 INFO [RS:0;jenkins-hbase4:43801] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,43801,1696262558835; zookeeper connection closed. 2023-10-02 16:05:42,079 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@75c76a7f] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@75c76a7f 2023-10-02 16:05:42,086 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.98 KB at sequenceid=131 (bloomFilter=false), to=hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/data/hbase/meta/1588230740/.tmp/table/ea793002a2734724ba34b24764055c43 2023-10-02 16:05:42,095 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=78 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/data/hbase/namespace/629418abee8c789ea807f30d3267c0ae/.tmp/info/cd4f8b97fdab4da7b419dff7ddec3332 2023-10-02 16:05:42,099 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for ea793002a2734724ba34b24764055c43 2023-10-02 16:05:42,101 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/data/hbase/meta/1588230740/.tmp/info/9bec5c1d1a464f7c83ba0df17f705655 as hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/data/hbase/meta/1588230740/info/9bec5c1d1a464f7c83ba0df17f705655 2023-10-02 16:05:42,121 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/data/hbase/namespace/629418abee8c789ea807f30d3267c0ae/.tmp/info/cd4f8b97fdab4da7b419dff7ddec3332 as hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/data/hbase/namespace/629418abee8c789ea807f30d3267c0ae/info/cd4f8b97fdab4da7b419dff7ddec3332 2023-10-02 16:05:42,122 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 9bec5c1d1a464f7c83ba0df17f705655 2023-10-02 16:05:42,123 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/data/hbase/meta/1588230740/info/9bec5c1d1a464f7c83ba0df17f705655, entries=48, sequenceid=131, filesize=10.3 K 2023-10-02 16:05:42,125 DEBUG [RS:2;jenkins-hbase4:42303] regionserver.HRegionServer(1504): Waiting on 1588230740, 629418abee8c789ea807f30d3267c0ae 2023-10-02 16:05:42,128 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/data/hbase/meta/1588230740/.tmp/rep_barrier/81597ae4a0f64f9387e404fe2f27540b as hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/data/hbase/meta/1588230740/rep_barrier/81597ae4a0f64f9387e404fe2f27540b 2023-10-02 16:05:42,136 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/data/hbase/namespace/629418abee8c789ea807f30d3267c0ae/info/cd4f8b97fdab4da7b419dff7ddec3332, entries=2, sequenceid=6, filesize=4.8 K 2023-10-02 16:05:42,141 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for 629418abee8c789ea807f30d3267c0ae in 93ms, sequenceid=6, compaction requested=false 2023-10-02 16:05:42,150 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 81597ae4a0f64f9387e404fe2f27540b 2023-10-02 16:05:42,150 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/data/hbase/meta/1588230740/rep_barrier/81597ae4a0f64f9387e404fe2f27540b, entries=13, sequenceid=131, filesize=6.4 K 2023-10-02 16:05:42,156 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/data/hbase/meta/1588230740/.tmp/table/ea793002a2734724ba34b24764055c43 as hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/data/hbase/meta/1588230740/table/ea793002a2734724ba34b24764055c43 2023-10-02 16:05:42,158 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/data/hbase/namespace/629418abee8c789ea807f30d3267c0ae/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-10-02 16:05:42,159 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-10-02 16:05:42,161 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:namespace,,1696262561661.629418abee8c789ea807f30d3267c0ae. 2023-10-02 16:05:42,161 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 629418abee8c789ea807f30d3267c0ae: 2023-10-02 16:05:42,161 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1696262561661.629418abee8c789ea807f30d3267c0ae. 2023-10-02 16:05:42,167 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for ea793002a2734724ba34b24764055c43 2023-10-02 16:05:42,167 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/data/hbase/meta/1588230740/table/ea793002a2734724ba34b24764055c43, entries=24, sequenceid=131, filesize=6.9 K 2023-10-02 16:05:42,173 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~45.93 KB/47028, heapSize ~71.88 KB/73600, currentSize=0 B/0 for 1588230740 in 250ms, sequenceid=131, compaction requested=false 2023-10-02 16:05:42,185 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/data/hbase/meta/1588230740/recovered.edits/134.seqid, newMaxSeqId=134, maxSeqId=1 2023-10-02 16:05:42,186 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-10-02 16:05:42,186 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-10-02 16:05:42,187 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-10-02 16:05:42,187 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-10-02 16:05:42,187 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-10-02 16:05:42,325 INFO [RS:2;jenkins-hbase4:42303] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,42303,1696262558956; all regions closed. 2023-10-02 16:05:42,335 DEBUG [RS:2;jenkins-hbase4:42303] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/oldWALs 2023-10-02 16:05:42,335 INFO [RS:2;jenkins-hbase4:42303] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C42303%2C1696262558956.meta:.meta(num 1696262561282) 2023-10-02 16:05:42,345 DEBUG [RS:2;jenkins-hbase4:42303] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/oldWALs 2023-10-02 16:05:42,345 INFO [RS:2;jenkins-hbase4:42303] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C42303%2C1696262558956:(num 1696262561088) 2023-10-02 16:05:42,345 DEBUG [RS:2;jenkins-hbase4:42303] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-02 16:05:42,345 INFO [RS:2;jenkins-hbase4:42303] regionserver.LeaseManager(133): Closed leases 2023-10-02 16:05:42,345 INFO [RS:2;jenkins-hbase4:42303] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-10-02 16:05:42,346 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-10-02 16:05:42,347 INFO [RS:2;jenkins-hbase4:42303] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:42303 2023-10-02 16:05:42,349 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): master:44227-0x10107dfc1490000, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-10-02 16:05:42,349 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): regionserver:42303-0x10107dfc1490003, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,42303,1696262558956 2023-10-02 16:05:42,349 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,42303,1696262558956] 2023-10-02 16:05:42,349 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,42303,1696262558956; numProcessing=3 2023-10-02 16:05:42,352 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,42303,1696262558956 already deleted, retry=false 2023-10-02 16:05:42,353 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,42303,1696262558956 expired; onlineServers=0 2023-10-02 16:05:42,353 INFO [RegionServerTracker-0] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,44227,1696262556745' ***** 2023-10-02 16:05:42,353 INFO [RegionServerTracker-0] regionserver.HRegionServer(2311): STOPPED: Cluster shutdown set; onlineServer=0 2023-10-02 16:05:42,353 DEBUG [M:0;jenkins-hbase4:44227] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3a73d0a5, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-10-02 16:05:42,353 INFO [M:0;jenkins-hbase4:44227] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,44227,1696262556745 2023-10-02 16:05:42,353 INFO [M:0;jenkins-hbase4:44227] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,44227,1696262556745; all regions closed. 2023-10-02 16:05:42,353 DEBUG [M:0;jenkins-hbase4:44227] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-02 16:05:42,353 DEBUG [M:0;jenkins-hbase4:44227] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-10-02 16:05:42,353 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-10-02 16:05:42,354 DEBUG [M:0;jenkins-hbase4:44227] cleaner.HFileCleaner(317): Stopping file delete threads 2023-10-02 16:05:42,354 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1696262560629] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1696262560629,5,FailOnTimeoutGroup] 2023-10-02 16:05:42,354 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1696262560633] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1696262560633,5,FailOnTimeoutGroup] 2023-10-02 16:05:42,354 INFO [M:0;jenkins-hbase4:44227] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-10-02 16:05:42,354 INFO [M:0;jenkins-hbase4:44227] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-10-02 16:05:42,354 INFO [M:0;jenkins-hbase4:44227] hbase.ChoreService(369): Chore service for: master/jenkins-hbase4:0 had [] on shutdown 2023-10-02 16:05:42,354 DEBUG [M:0;jenkins-hbase4:44227] master.HMaster(1512): Stopping service threads 2023-10-02 16:05:42,354 INFO [M:0;jenkins-hbase4:44227] procedure2.RemoteProcedureDispatcher(119): Stopping procedure remote dispatcher 2023-10-02 16:05:42,354 ERROR [M:0;jenkins-hbase4:44227] procedure2.ProcedureExecutor(652): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] Thread[HFileArchiver-14,5,PEWorkerGroup] Thread[HFileArchiver-15,5,PEWorkerGroup] 2023-10-02 16:05:42,355 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): master:44227-0x10107dfc1490000, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-10-02 16:05:42,355 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): master:44227-0x10107dfc1490000, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-10-02 16:05:42,355 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:44227-0x10107dfc1490000, quorum=127.0.0.1:50210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-10-02 16:05:42,355 INFO [M:0;jenkins-hbase4:44227] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-10-02 16:05:42,356 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-10-02 16:05:42,356 DEBUG [M:0;jenkins-hbase4:44227] zookeeper.ZKUtil(398): master:44227-0x10107dfc1490000, quorum=127.0.0.1:50210, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-10-02 16:05:42,356 WARN [M:0;jenkins-hbase4:44227] master.ActiveMasterManager(326): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-10-02 16:05:42,356 INFO [M:0;jenkins-hbase4:44227] assignment.AssignmentManager(315): Stopping assignment manager 2023-10-02 16:05:42,356 INFO [M:0;jenkins-hbase4:44227] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-10-02 16:05:42,357 DEBUG [M:0;jenkins-hbase4:44227] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-10-02 16:05:42,358 INFO [M:0;jenkins-hbase4:44227] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-10-02 16:05:42,358 DEBUG [M:0;jenkins-hbase4:44227] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-10-02 16:05:42,358 DEBUG [M:0;jenkins-hbase4:44227] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-10-02 16:05:42,358 DEBUG [M:0;jenkins-hbase4:44227] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-10-02 16:05:42,358 INFO [M:0;jenkins-hbase4:44227] regionserver.HRegion(2745): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=375.68 KB heapSize=451.95 KB 2023-10-02 16:05:42,380 INFO [M:0;jenkins-hbase4:44227] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=375.68 KB at sequenceid=899 (bloomFilter=true), to=hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/31cb9ece66e64604b144363af00a7a54 2023-10-02 16:05:42,386 INFO [M:0;jenkins-hbase4:44227] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 31cb9ece66e64604b144363af00a7a54 2023-10-02 16:05:42,387 DEBUG [M:0;jenkins-hbase4:44227] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/31cb9ece66e64604b144363af00a7a54 as hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/31cb9ece66e64604b144363af00a7a54 2023-10-02 16:05:42,392 INFO [M:0;jenkins-hbase4:44227] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 31cb9ece66e64604b144363af00a7a54 2023-10-02 16:05:42,392 INFO [M:0;jenkins-hbase4:44227] regionserver.HStore(1080): Added hdfs://localhost:42119/user/jenkins/test-data/bfde0ba6-ca8a-3f61-6b99-fe2a2b6d98af/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/31cb9ece66e64604b144363af00a7a54, entries=119, sequenceid=899, filesize=28.6 K 2023-10-02 16:05:42,394 INFO [M:0;jenkins-hbase4:44227] regionserver.HRegion(2948): Finished flush of dataSize ~375.68 KB/384693, heapSize ~451.93 KB/462776, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 36ms, sequenceid=899, compaction requested=false 2023-10-02 16:05:42,396 INFO [M:0;jenkins-hbase4:44227] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-10-02 16:05:42,396 DEBUG [M:0;jenkins-hbase4:44227] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-10-02 16:05:42,405 INFO [M:0;jenkins-hbase4:44227] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-10-02 16:05:42,405 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-10-02 16:05:42,406 INFO [M:0;jenkins-hbase4:44227] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:44227 2023-10-02 16:05:42,408 DEBUG [M:0;jenkins-hbase4:44227] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase4.apache.org,44227,1696262556745 already deleted, retry=false 2023-10-02 16:05:42,452 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): regionserver:42303-0x10107dfc1490003, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-10-02 16:05:42,452 INFO [RS:2;jenkins-hbase4:42303] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,42303,1696262558956; zookeeper connection closed. 2023-10-02 16:05:42,452 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): regionserver:42303-0x10107dfc1490003, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-10-02 16:05:42,453 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@31d4ae5b] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@31d4ae5b 2023-10-02 16:05:42,453 INFO [Listener at jenkins-hbase4.apache.org/32975] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 3 regionserver(s) complete 2023-10-02 16:05:42,553 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): master:44227-0x10107dfc1490000, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-10-02 16:05:42,553 INFO [M:0;jenkins-hbase4:44227] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,44227,1696262556745; zookeeper connection closed. 2023-10-02 16:05:42,553 DEBUG [Listener at localhost/38719-EventThread] zookeeper.ZKWatcher(600): master:44227-0x10107dfc1490000, quorum=127.0.0.1:50210, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-10-02 16:05:42,555 WARN [Listener at jenkins-hbase4.apache.org/32975] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-10-02 16:05:42,563 INFO [Listener at jenkins-hbase4.apache.org/32975] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-10-02 16:05:42,669 WARN [BP-337378547-172.31.14.131-1696262552717 heartbeating to localhost/127.0.0.1:42119] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-10-02 16:05:42,669 WARN [BP-337378547-172.31.14.131-1696262552717 heartbeating to localhost/127.0.0.1:42119] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-337378547-172.31.14.131-1696262552717 (Datanode Uuid fee509bd-121f-4d50-85f9-5ac3450d857f) service to localhost/127.0.0.1:42119 2023-10-02 16:05:42,672 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ec4ab044-456e-ce77-098f-f91b72a3e0ab/cluster_a1e9014f-f81d-2e22-2bb2-f7ceda69c14c/dfs/data/data5/current/BP-337378547-172.31.14.131-1696262552717] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-10-02 16:05:42,672 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ec4ab044-456e-ce77-098f-f91b72a3e0ab/cluster_a1e9014f-f81d-2e22-2bb2-f7ceda69c14c/dfs/data/data6/current/BP-337378547-172.31.14.131-1696262552717] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-10-02 16:05:42,674 WARN [Listener at jenkins-hbase4.apache.org/32975] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-10-02 16:05:42,683 INFO [Listener at jenkins-hbase4.apache.org/32975] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-10-02 16:05:42,789 WARN [BP-337378547-172.31.14.131-1696262552717 heartbeating to localhost/127.0.0.1:42119] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-10-02 16:05:42,789 WARN [BP-337378547-172.31.14.131-1696262552717 heartbeating to localhost/127.0.0.1:42119] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-337378547-172.31.14.131-1696262552717 (Datanode Uuid dbbc5bf0-6ae7-42c7-9c36-7792d22cfac1) service to localhost/127.0.0.1:42119 2023-10-02 16:05:42,790 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ec4ab044-456e-ce77-098f-f91b72a3e0ab/cluster_a1e9014f-f81d-2e22-2bb2-f7ceda69c14c/dfs/data/data3/current/BP-337378547-172.31.14.131-1696262552717] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-10-02 16:05:42,790 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ec4ab044-456e-ce77-098f-f91b72a3e0ab/cluster_a1e9014f-f81d-2e22-2bb2-f7ceda69c14c/dfs/data/data4/current/BP-337378547-172.31.14.131-1696262552717] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-10-02 16:05:42,792 WARN [Listener at jenkins-hbase4.apache.org/32975] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-10-02 16:05:42,799 INFO [Listener at jenkins-hbase4.apache.org/32975] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-10-02 16:05:42,904 WARN [BP-337378547-172.31.14.131-1696262552717 heartbeating to localhost/127.0.0.1:42119] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-10-02 16:05:42,904 WARN [BP-337378547-172.31.14.131-1696262552717 heartbeating to localhost/127.0.0.1:42119] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-337378547-172.31.14.131-1696262552717 (Datanode Uuid a82a1096-ff63-42b1-93e5-7b20244449f9) service to localhost/127.0.0.1:42119 2023-10-02 16:05:42,905 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ec4ab044-456e-ce77-098f-f91b72a3e0ab/cluster_a1e9014f-f81d-2e22-2bb2-f7ceda69c14c/dfs/data/data1/current/BP-337378547-172.31.14.131-1696262552717] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-10-02 16:05:42,906 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ec4ab044-456e-ce77-098f-f91b72a3e0ab/cluster_a1e9014f-f81d-2e22-2bb2-f7ceda69c14c/dfs/data/data2/current/BP-337378547-172.31.14.131-1696262552717] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-10-02 16:05:42,937 INFO [Listener at jenkins-hbase4.apache.org/32975] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-10-02 16:05:43,079 INFO [Listener at jenkins-hbase4.apache.org/32975] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-10-02 16:05:43,199 INFO [Listener at jenkins-hbase4.apache.org/32975] hbase.HBaseTestingUtility(1293): Minicluster is down