2023-10-04 01:59:59,012 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.snapshot.TestExportSnapshot timeout: 13 mins 2023-10-04 01:59:59,235 DEBUG [main] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/757a468a-9656-cc80-ec19-d6f68f36be5a 2023-10-04 01:59:59,235 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.snapshot.TestMobExportSnapshot timeout: 13 mins 2023-10-04 01:59:59,235 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.snapshot.TestMobSecureExportSnapshot timeout: 13 mins 2023-10-04 01:59:59,273 WARN [Time-limited test] util.NativeCodeLoader(62): Unable to load native-hadoop library for your platform... using builtin-java classes where applicable 2023-10-04 01:59:59,511 INFO [Time-limited test] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=3, rsPorts=, rsClass=null, numDataNodes=3, dataNodeHosts=null, numZkServers=1, createRootDir=false, createWALDir=false} 2023-10-04 01:59:59,511 INFO [Time-limited test] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/757a468a-9656-cc80-ec19-d6f68f36be5a/cluster_99689198-45bf-8fbc-bd30-def9ae3ef530, deleteOnExit=true 2023-10-04 01:59:59,512 INFO [Time-limited test] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-10-04 01:59:59,512 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/757a468a-9656-cc80-ec19-d6f68f36be5a/test.cache.data in system properties and HBase conf 2023-10-04 01:59:59,513 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/757a468a-9656-cc80-ec19-d6f68f36be5a/hadoop.tmp.dir in system properties and HBase conf 2023-10-04 01:59:59,513 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/757a468a-9656-cc80-ec19-d6f68f36be5a/hadoop.log.dir in system properties and HBase conf 2023-10-04 01:59:59,514 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/757a468a-9656-cc80-ec19-d6f68f36be5a/mapreduce.cluster.local.dir in system properties and HBase conf 2023-10-04 01:59:59,514 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/757a468a-9656-cc80-ec19-d6f68f36be5a/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-10-04 01:59:59,515 INFO [Time-limited test] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-10-04 01:59:59,803 DEBUG [Time-limited test] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-10-04 01:59:59,807 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/757a468a-9656-cc80-ec19-d6f68f36be5a/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-10-04 01:59:59,807 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/757a468a-9656-cc80-ec19-d6f68f36be5a/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-10-04 01:59:59,808 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/757a468a-9656-cc80-ec19-d6f68f36be5a/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-10-04 01:59:59,808 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/757a468a-9656-cc80-ec19-d6f68f36be5a/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-10-04 01:59:59,808 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/757a468a-9656-cc80-ec19-d6f68f36be5a/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-10-04 01:59:59,809 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/757a468a-9656-cc80-ec19-d6f68f36be5a/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-10-04 01:59:59,809 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/757a468a-9656-cc80-ec19-d6f68f36be5a/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-10-04 01:59:59,809 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/757a468a-9656-cc80-ec19-d6f68f36be5a/dfs.journalnode.edits.dir in system properties and HBase conf 2023-10-04 01:59:59,809 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/757a468a-9656-cc80-ec19-d6f68f36be5a/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-10-04 01:59:59,810 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/757a468a-9656-cc80-ec19-d6f68f36be5a/nfs.dump.dir in system properties and HBase conf 2023-10-04 01:59:59,810 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/757a468a-9656-cc80-ec19-d6f68f36be5a/java.io.tmpdir in system properties and HBase conf 2023-10-04 01:59:59,810 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/757a468a-9656-cc80-ec19-d6f68f36be5a/dfs.journalnode.edits.dir in system properties and HBase conf 2023-10-04 01:59:59,810 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/757a468a-9656-cc80-ec19-d6f68f36be5a/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-10-04 01:59:59,811 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/757a468a-9656-cc80-ec19-d6f68f36be5a/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-10-04 02:00:00,292 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-10-04 02:00:00,296 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-10-04 02:00:00,583 WARN [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-namenode.properties,hadoop-metrics2.properties 2023-10-04 02:00:00,732 INFO [Time-limited test] log.Slf4jLog(67): Logging to org.slf4j.impl.Reload4jLoggerAdapter(org.mortbay.log) via org.mortbay.log.Slf4jLog 2023-10-04 02:00:00,744 WARN [Time-limited test] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-10-04 02:00:00,778 INFO [Time-limited test] log.Slf4jLog(67): jetty-6.1.26 2023-10-04 02:00:00,809 INFO [Time-limited test] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/757a468a-9656-cc80-ec19-d6f68f36be5a/java.io.tmpdir/Jetty_localhost_46697_hdfs____.4aaeys/webapp 2023-10-04 02:00:00,956 INFO [Time-limited test] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:46697 2023-10-04 02:00:01,005 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-10-04 02:00:01,005 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-10-04 02:00:01,456 WARN [Listener at localhost/38449] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-10-04 02:00:01,542 WARN [Listener at localhost/38449] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-10-04 02:00:01,561 WARN [Listener at localhost/38449] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-10-04 02:00:01,567 INFO [Listener at localhost/38449] log.Slf4jLog(67): jetty-6.1.26 2023-10-04 02:00:01,572 INFO [Listener at localhost/38449] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/757a468a-9656-cc80-ec19-d6f68f36be5a/java.io.tmpdir/Jetty_localhost_46607_datanode____72pobm/webapp 2023-10-04 02:00:01,677 INFO [Listener at localhost/38449] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:46607 2023-10-04 02:00:02,116 WARN [Listener at localhost/33085] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-10-04 02:00:02,137 WARN [Listener at localhost/33085] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-10-04 02:00:02,144 WARN [Listener at localhost/33085] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-10-04 02:00:02,147 INFO [Listener at localhost/33085] log.Slf4jLog(67): jetty-6.1.26 2023-10-04 02:00:02,162 INFO [Listener at localhost/33085] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/757a468a-9656-cc80-ec19-d6f68f36be5a/java.io.tmpdir/Jetty_localhost_33811_datanode____9lz6jj/webapp 2023-10-04 02:00:02,299 INFO [Listener at localhost/33085] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:33811 2023-10-04 02:00:02,325 WARN [Listener at localhost/45859] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-10-04 02:00:02,354 WARN [Listener at localhost/45859] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-10-04 02:00:02,362 WARN [Listener at localhost/45859] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-10-04 02:00:02,365 INFO [Listener at localhost/45859] log.Slf4jLog(67): jetty-6.1.26 2023-10-04 02:00:02,372 INFO [Listener at localhost/45859] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/757a468a-9656-cc80-ec19-d6f68f36be5a/java.io.tmpdir/Jetty_localhost_43623_datanode____z3c267/webapp 2023-10-04 02:00:02,513 INFO [Listener at localhost/45859] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:43623 2023-10-04 02:00:02,546 WARN [Listener at localhost/41661] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-10-04 02:00:02,729 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xb1922c395a801e94: Processing first storage report for DS-5937343d-efb4-4c2a-b54d-a8b1679065a9 from datanode edb287ae-283f-4776-9175-a8f1c8f78f9e 2023-10-04 02:00:02,730 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xb1922c395a801e94: from storage DS-5937343d-efb4-4c2a-b54d-a8b1679065a9 node DatanodeRegistration(127.0.0.1:40239, datanodeUuid=edb287ae-283f-4776-9175-a8f1c8f78f9e, infoPort=41303, infoSecurePort=0, ipcPort=33085, storageInfo=lv=-57;cid=testClusterID;nsid=630599398;c=1696384800366), blocks: 0, hasStaleStorage: true, processing time: 1 msecs, invalidatedBlocks: 0 2023-10-04 02:00:02,730 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xa27b1d4d995edd00: Processing first storage report for DS-4bb6d0c7-cfe4-40cc-a28a-9e8744863e6e from datanode 34efd62f-e667-4310-8896-4088ac0f23f5 2023-10-04 02:00:02,731 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xa27b1d4d995edd00: from storage DS-4bb6d0c7-cfe4-40cc-a28a-9e8744863e6e node DatanodeRegistration(127.0.0.1:36939, datanodeUuid=34efd62f-e667-4310-8896-4088ac0f23f5, infoPort=46107, infoSecurePort=0, ipcPort=41661, storageInfo=lv=-57;cid=testClusterID;nsid=630599398;c=1696384800366), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-10-04 02:00:02,731 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xb1922c395a801e94: Processing first storage report for DS-bde39302-d6fc-45a9-96cc-55290cc96dc3 from datanode edb287ae-283f-4776-9175-a8f1c8f78f9e 2023-10-04 02:00:02,731 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xb1922c395a801e94: from storage DS-bde39302-d6fc-45a9-96cc-55290cc96dc3 node DatanodeRegistration(127.0.0.1:40239, datanodeUuid=edb287ae-283f-4776-9175-a8f1c8f78f9e, infoPort=41303, infoSecurePort=0, ipcPort=33085, storageInfo=lv=-57;cid=testClusterID;nsid=630599398;c=1696384800366), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-10-04 02:00:02,731 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xa27b1d4d995edd00: Processing first storage report for DS-50561690-2e17-4f87-88a4-ad667bd855bd from datanode 34efd62f-e667-4310-8896-4088ac0f23f5 2023-10-04 02:00:02,731 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xa27b1d4d995edd00: from storage DS-50561690-2e17-4f87-88a4-ad667bd855bd node DatanodeRegistration(127.0.0.1:36939, datanodeUuid=34efd62f-e667-4310-8896-4088ac0f23f5, infoPort=46107, infoSecurePort=0, ipcPort=41661, storageInfo=lv=-57;cid=testClusterID;nsid=630599398;c=1696384800366), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-10-04 02:00:02,731 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xccc7beec454634fb: Processing first storage report for DS-a965123a-1314-4e4c-a8bf-c83a581e21ea from datanode 3d7b3d74-f4e4-4baa-b482-70929f3fcd65 2023-10-04 02:00:02,732 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xccc7beec454634fb: from storage DS-a965123a-1314-4e4c-a8bf-c83a581e21ea node DatanodeRegistration(127.0.0.1:35507, datanodeUuid=3d7b3d74-f4e4-4baa-b482-70929f3fcd65, infoPort=36097, infoSecurePort=0, ipcPort=45859, storageInfo=lv=-57;cid=testClusterID;nsid=630599398;c=1696384800366), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-10-04 02:00:02,732 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xccc7beec454634fb: Processing first storage report for DS-e24025d8-e692-4d18-9d76-f5bae4dae904 from datanode 3d7b3d74-f4e4-4baa-b482-70929f3fcd65 2023-10-04 02:00:02,732 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xccc7beec454634fb: from storage DS-e24025d8-e692-4d18-9d76-f5bae4dae904 node DatanodeRegistration(127.0.0.1:35507, datanodeUuid=3d7b3d74-f4e4-4baa-b482-70929f3fcd65, infoPort=36097, infoSecurePort=0, ipcPort=45859, storageInfo=lv=-57;cid=testClusterID;nsid=630599398;c=1696384800366), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-10-04 02:00:02,968 DEBUG [Listener at localhost/41661] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/757a468a-9656-cc80-ec19-d6f68f36be5a 2023-10-04 02:00:03,054 INFO [Listener at localhost/41661] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/757a468a-9656-cc80-ec19-d6f68f36be5a/cluster_99689198-45bf-8fbc-bd30-def9ae3ef530/zookeeper_0, clientPort=60027, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/757a468a-9656-cc80-ec19-d6f68f36be5a/cluster_99689198-45bf-8fbc-bd30-def9ae3ef530/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/757a468a-9656-cc80-ec19-d6f68f36be5a/cluster_99689198-45bf-8fbc-bd30-def9ae3ef530/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-10-04 02:00:03,072 INFO [Listener at localhost/41661] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=60027 2023-10-04 02:00:03,080 INFO [Listener at localhost/41661] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-10-04 02:00:03,083 INFO [Listener at localhost/41661] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-10-04 02:00:03,768 INFO [Listener at localhost/41661] util.FSUtils(471): Created version file at hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51 with version=8 2023-10-04 02:00:03,768 INFO [Listener at localhost/41661] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/hbase-staging 2023-10-04 02:00:04,206 INFO [Listener at localhost/41661] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl 2023-10-04 02:00:04,741 INFO [Listener at localhost/41661] client.ConnectionUtils(127): master/jenkins-hbase9:0 server-side Connection retries=45 2023-10-04 02:00:04,775 INFO [Listener at localhost/41661] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-10-04 02:00:04,775 INFO [Listener at localhost/41661] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-10-04 02:00:04,775 INFO [Listener at localhost/41661] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-10-04 02:00:04,776 INFO [Listener at localhost/41661] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-10-04 02:00:04,776 INFO [Listener at localhost/41661] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-10-04 02:00:04,921 INFO [Listener at localhost/41661] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-10-04 02:00:04,995 DEBUG [Listener at localhost/41661] util.ClassSize(228): Using Unsafe to estimate memory layout 2023-10-04 02:00:05,092 INFO [Listener at localhost/41661] ipc.NettyRpcServer(120): Bind to /172.31.2.10:39651 2023-10-04 02:00:05,106 INFO [Listener at localhost/41661] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-10-04 02:00:05,108 INFO [Listener at localhost/41661] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-10-04 02:00:05,131 INFO [Listener at localhost/41661] zookeeper.RecoverableZooKeeper(93): Process identifier=master:39651 connecting to ZooKeeper ensemble=127.0.0.1:60027 2023-10-04 02:00:05,182 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): master:396510x0, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-10-04 02:00:05,185 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): master:39651-0x1010f1b55330000 connected 2023-10-04 02:00:05,213 DEBUG [Listener at localhost/41661] zookeeper.ZKUtil(164): master:39651-0x1010f1b55330000, quorum=127.0.0.1:60027, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-10-04 02:00:05,214 DEBUG [Listener at localhost/41661] zookeeper.ZKUtil(164): master:39651-0x1010f1b55330000, quorum=127.0.0.1:60027, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-10-04 02:00:05,232 DEBUG [Listener at localhost/41661] zookeeper.ZKUtil(164): master:39651-0x1010f1b55330000, quorum=127.0.0.1:60027, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-10-04 02:00:05,240 DEBUG [Listener at localhost/41661] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=39651 2023-10-04 02:00:05,240 DEBUG [Listener at localhost/41661] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=39651 2023-10-04 02:00:05,241 DEBUG [Listener at localhost/41661] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=39651 2023-10-04 02:00:05,241 DEBUG [Listener at localhost/41661] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=39651 2023-10-04 02:00:05,242 DEBUG [Listener at localhost/41661] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=39651 2023-10-04 02:00:05,250 INFO [Listener at localhost/41661] master.HMaster(444): hbase.rootdir=hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51, hbase.cluster.distributed=false 2023-10-04 02:00:05,320 INFO [Listener at localhost/41661] client.ConnectionUtils(127): regionserver/jenkins-hbase9:0 server-side Connection retries=45 2023-10-04 02:00:05,320 INFO [Listener at localhost/41661] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-10-04 02:00:05,320 INFO [Listener at localhost/41661] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-10-04 02:00:05,320 INFO [Listener at localhost/41661] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-10-04 02:00:05,321 INFO [Listener at localhost/41661] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-10-04 02:00:05,321 INFO [Listener at localhost/41661] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-10-04 02:00:05,325 INFO [Listener at localhost/41661] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-10-04 02:00:05,329 INFO [Listener at localhost/41661] ipc.NettyRpcServer(120): Bind to /172.31.2.10:44303 2023-10-04 02:00:05,331 INFO [Listener at localhost/41661] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-10-04 02:00:05,339 INFO [Listener at localhost/41661] mob.MobFileCache(125): MobFileCache disabled 2023-10-04 02:00:05,341 INFO [Listener at localhost/41661] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-10-04 02:00:05,343 INFO [Listener at localhost/41661] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-10-04 02:00:05,347 INFO [Listener at localhost/41661] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:44303 connecting to ZooKeeper ensemble=127.0.0.1:60027 2023-10-04 02:00:05,352 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): regionserver:443030x0, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-10-04 02:00:05,353 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:44303-0x1010f1b55330001 connected 2023-10-04 02:00:05,353 DEBUG [Listener at localhost/41661] zookeeper.ZKUtil(164): regionserver:44303-0x1010f1b55330001, quorum=127.0.0.1:60027, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-10-04 02:00:05,355 DEBUG [Listener at localhost/41661] zookeeper.ZKUtil(164): regionserver:44303-0x1010f1b55330001, quorum=127.0.0.1:60027, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-10-04 02:00:05,356 DEBUG [Listener at localhost/41661] zookeeper.ZKUtil(164): regionserver:44303-0x1010f1b55330001, quorum=127.0.0.1:60027, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-10-04 02:00:05,360 DEBUG [Listener at localhost/41661] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=44303 2023-10-04 02:00:05,363 DEBUG [Listener at localhost/41661] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=44303 2023-10-04 02:00:05,364 DEBUG [Listener at localhost/41661] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=44303 2023-10-04 02:00:05,373 DEBUG [Listener at localhost/41661] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=44303 2023-10-04 02:00:05,373 DEBUG [Listener at localhost/41661] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=44303 2023-10-04 02:00:05,393 INFO [Listener at localhost/41661] client.ConnectionUtils(127): regionserver/jenkins-hbase9:0 server-side Connection retries=45 2023-10-04 02:00:05,394 INFO [Listener at localhost/41661] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-10-04 02:00:05,394 INFO [Listener at localhost/41661] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-10-04 02:00:05,394 INFO [Listener at localhost/41661] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-10-04 02:00:05,395 INFO [Listener at localhost/41661] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-10-04 02:00:05,395 INFO [Listener at localhost/41661] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-10-04 02:00:05,395 INFO [Listener at localhost/41661] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-10-04 02:00:05,397 INFO [Listener at localhost/41661] ipc.NettyRpcServer(120): Bind to /172.31.2.10:39045 2023-10-04 02:00:05,398 INFO [Listener at localhost/41661] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-10-04 02:00:05,399 INFO [Listener at localhost/41661] mob.MobFileCache(125): MobFileCache disabled 2023-10-04 02:00:05,399 INFO [Listener at localhost/41661] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-10-04 02:00:05,402 INFO [Listener at localhost/41661] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-10-04 02:00:05,406 INFO [Listener at localhost/41661] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:39045 connecting to ZooKeeper ensemble=127.0.0.1:60027 2023-10-04 02:00:05,412 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): regionserver:390450x0, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-10-04 02:00:05,413 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:39045-0x1010f1b55330002 connected 2023-10-04 02:00:05,414 DEBUG [Listener at localhost/41661] zookeeper.ZKUtil(164): regionserver:39045-0x1010f1b55330002, quorum=127.0.0.1:60027, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-10-04 02:00:05,414 DEBUG [Listener at localhost/41661] zookeeper.ZKUtil(164): regionserver:39045-0x1010f1b55330002, quorum=127.0.0.1:60027, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-10-04 02:00:05,415 DEBUG [Listener at localhost/41661] zookeeper.ZKUtil(164): regionserver:39045-0x1010f1b55330002, quorum=127.0.0.1:60027, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-10-04 02:00:05,420 DEBUG [Listener at localhost/41661] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=39045 2023-10-04 02:00:05,420 DEBUG [Listener at localhost/41661] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=39045 2023-10-04 02:00:05,422 DEBUG [Listener at localhost/41661] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=39045 2023-10-04 02:00:05,422 DEBUG [Listener at localhost/41661] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=39045 2023-10-04 02:00:05,423 DEBUG [Listener at localhost/41661] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=39045 2023-10-04 02:00:05,436 INFO [Listener at localhost/41661] client.ConnectionUtils(127): regionserver/jenkins-hbase9:0 server-side Connection retries=45 2023-10-04 02:00:05,436 INFO [Listener at localhost/41661] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-10-04 02:00:05,437 INFO [Listener at localhost/41661] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-10-04 02:00:05,437 INFO [Listener at localhost/41661] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-10-04 02:00:05,437 INFO [Listener at localhost/41661] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-10-04 02:00:05,437 INFO [Listener at localhost/41661] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-10-04 02:00:05,437 INFO [Listener at localhost/41661] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-10-04 02:00:05,441 INFO [Listener at localhost/41661] ipc.NettyRpcServer(120): Bind to /172.31.2.10:35175 2023-10-04 02:00:05,441 INFO [Listener at localhost/41661] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-10-04 02:00:05,442 INFO [Listener at localhost/41661] mob.MobFileCache(125): MobFileCache disabled 2023-10-04 02:00:05,443 INFO [Listener at localhost/41661] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-10-04 02:00:05,445 INFO [Listener at localhost/41661] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-10-04 02:00:05,446 INFO [Listener at localhost/41661] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:35175 connecting to ZooKeeper ensemble=127.0.0.1:60027 2023-10-04 02:00:05,452 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): regionserver:351750x0, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-10-04 02:00:05,453 DEBUG [Listener at localhost/41661] zookeeper.ZKUtil(164): regionserver:351750x0, quorum=127.0.0.1:60027, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-10-04 02:00:05,454 DEBUG [Listener at localhost/41661] zookeeper.ZKUtil(164): regionserver:351750x0, quorum=127.0.0.1:60027, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-10-04 02:00:05,455 DEBUG [Listener at localhost/41661] zookeeper.ZKUtil(164): regionserver:351750x0, quorum=127.0.0.1:60027, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-10-04 02:00:05,456 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:35175-0x1010f1b55330003 connected 2023-10-04 02:00:05,457 DEBUG [Listener at localhost/41661] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=35175 2023-10-04 02:00:05,457 DEBUG [Listener at localhost/41661] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=35175 2023-10-04 02:00:05,460 DEBUG [Listener at localhost/41661] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=35175 2023-10-04 02:00:05,461 DEBUG [Listener at localhost/41661] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=35175 2023-10-04 02:00:05,461 DEBUG [Listener at localhost/41661] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=35175 2023-10-04 02:00:05,464 INFO [master/jenkins-hbase9:0:becomeActiveMaster] master.HMaster(2168): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase9.apache.org,39651,1696384803959 2023-10-04 02:00:05,474 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): master:39651-0x1010f1b55330000, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-10-04 02:00:05,476 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:39651-0x1010f1b55330000, quorum=127.0.0.1:60027, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase9.apache.org,39651,1696384803959 2023-10-04 02:00:05,495 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): master:39651-0x1010f1b55330000, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-10-04 02:00:05,495 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): regionserver:39045-0x1010f1b55330002, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-10-04 02:00:05,495 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): regionserver:35175-0x1010f1b55330003, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-10-04 02:00:05,495 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): regionserver:44303-0x1010f1b55330001, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-10-04 02:00:05,496 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): master:39651-0x1010f1b55330000, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-10-04 02:00:05,497 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:39651-0x1010f1b55330000, quorum=127.0.0.1:60027, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-10-04 02:00:05,502 INFO [master/jenkins-hbase9:0:becomeActiveMaster] master.ActiveMasterManager(227): Deleting ZNode for /hbase/backup-masters/jenkins-hbase9.apache.org,39651,1696384803959 from backup master directory 2023-10-04 02:00:05,502 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:39651-0x1010f1b55330000, quorum=127.0.0.1:60027, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-10-04 02:00:05,507 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): master:39651-0x1010f1b55330000, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase9.apache.org,39651,1696384803959 2023-10-04 02:00:05,507 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): master:39651-0x1010f1b55330000, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-10-04 02:00:05,508 WARN [master/jenkins-hbase9:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-10-04 02:00:05,508 INFO [master/jenkins-hbase9:0:becomeActiveMaster] master.ActiveMasterManager(237): Registered as active master=jenkins-hbase9.apache.org,39651,1696384803959 2023-10-04 02:00:05,511 INFO [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating data MemStoreChunkPool with chunk size 2 MB, max count 352, initial count 0 2023-10-04 02:00:05,513 INFO [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating index MemStoreChunkPool with chunk size 204.80 KB, max count 391, initial count 0 2023-10-04 02:00:05,617 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] util.FSUtils(620): Created cluster ID file at hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/hbase.id with ID: 1a716637-b34c-441d-9db3-c001df7c94ed 2023-10-04 02:00:05,669 INFO [master/jenkins-hbase9:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-10-04 02:00:05,687 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): master:39651-0x1010f1b55330000, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-10-04 02:00:05,742 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x0acbf86e to 127.0.0.1:60027 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-04 02:00:05,777 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@53e87780, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-04 02:00:05,803 INFO [master/jenkins-hbase9:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-10-04 02:00:05,805 INFO [master/jenkins-hbase9:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-10-04 02:00:05,824 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(264): ClientProtocol::create wrong number of arguments, should be hadoop 3.2 or below 2023-10-04 02:00:05,824 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(270): ClientProtocol::create wrong number of arguments, should be hadoop 2.x 2023-10-04 02:00:05,826 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(279): can not find SHOULD_REPLICATE flag, should be hadoop 2.x java.lang.IllegalArgumentException: No enum constant org.apache.hadoop.fs.CreateFlag.SHOULD_REPLICATE at java.lang.Enum.valueOf(Enum.java:238) at org.apache.hadoop.fs.CreateFlag.valueOf(CreateFlag.java:63) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.loadShouldReplicateFlag(FanOutOneBlockAsyncDFSOutputHelper.java:277) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.(FanOutOneBlockAsyncDFSOutputHelper.java:304) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:139) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:855) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2193) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:528) at java.lang.Thread.run(Thread.java:750) 2023-10-04 02:00:05,831 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(243): No decryptEncryptedDataEncryptionKey method in DFSClient, should be hadoop version with HDFS-12396 java.lang.NoSuchMethodException: org.apache.hadoop.hdfs.DFSClient.decryptEncryptedDataEncryptionKey(org.apache.hadoop.fs.FileEncryptionInfo) at java.lang.Class.getDeclaredMethod(Class.java:2130) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelperWithoutHDFS12396(FanOutOneBlockAsyncDFSOutputSaslHelper.java:182) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelper(FanOutOneBlockAsyncDFSOutputSaslHelper.java:241) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.(FanOutOneBlockAsyncDFSOutputSaslHelper.java:252) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:140) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:855) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2193) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:528) at java.lang.Thread.run(Thread.java:750) 2023-10-04 02:00:05,833 INFO [master/jenkins-hbase9:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-10-04 02:00:05,871 INFO [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(7693): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/MasterData/data/master/store-tmp 2023-10-04 02:00:05,930 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-04 02:00:05,930 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-10-04 02:00:05,930 INFO [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-10-04 02:00:05,930 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-10-04 02:00:05,930 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-10-04 02:00:05,930 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-10-04 02:00:05,930 INFO [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-10-04 02:00:05,930 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-10-04 02:00:05,933 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/MasterData/WALs/jenkins-hbase9.apache.org,39651,1696384803959 2023-10-04 02:00:05,957 INFO [master/jenkins-hbase9:0:becomeActiveMaster] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase9.apache.org%2C39651%2C1696384803959, suffix=, logDir=hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/MasterData/WALs/jenkins-hbase9.apache.org,39651,1696384803959, archiveDir=hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/MasterData/oldWALs, maxLogs=10 2023-10-04 02:00:06,022 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:36939,DS-4bb6d0c7-cfe4-40cc-a28a-9e8744863e6e,DISK] 2023-10-04 02:00:06,022 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:40239,DS-5937343d-efb4-4c2a-b54d-a8b1679065a9,DISK] 2023-10-04 02:00:06,022 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:35507,DS-a965123a-1314-4e4c-a8bf-c83a581e21ea,DISK] 2023-10-04 02:00:06,031 DEBUG [RS-EventLoopGroup-5-3] asyncfs.ProtobufDecoder(123): Hadoop 3.2 and below use unshaded protobuf. java.lang.ClassNotFoundException: org.apache.hadoop.thirdparty.protobuf.MessageLite at java.net.URLClassLoader.findClass(URLClassLoader.java:387) at java.lang.ClassLoader.loadClass(ClassLoader.java:418) at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:352) at java.lang.ClassLoader.loadClass(ClassLoader.java:351) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.io.asyncfs.ProtobufDecoder.(ProtobufDecoder.java:118) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.processWriteBlockResponse(FanOutOneBlockAsyncDFSOutputHelper.java:340) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$100(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$4.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:424) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:557) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.addListener(DefaultPromise.java:185) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.initialize(FanOutOneBlockAsyncDFSOutputHelper.java:418) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$300(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:476) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:471) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:583) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:559) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:636) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setSuccess0(DefaultPromise.java:625) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.trySuccess(DefaultPromise.java:105) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPromise.trySuccess(DefaultChannelPromise.java:84) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.fulfillConnectPromise(AbstractEpollChannel.java:653) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:691) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-10-04 02:00:06,115 INFO [master/jenkins-hbase9:0:becomeActiveMaster] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/MasterData/WALs/jenkins-hbase9.apache.org,39651,1696384803959/jenkins-hbase9.apache.org%2C39651%2C1696384803959.1696384805967 2023-10-04 02:00:06,116 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:40239,DS-5937343d-efb4-4c2a-b54d-a8b1679065a9,DISK], DatanodeInfoWithStorage[127.0.0.1:35507,DS-a965123a-1314-4e4c-a8bf-c83a581e21ea,DISK], DatanodeInfoWithStorage[127.0.0.1:36939,DS-4bb6d0c7-cfe4-40cc-a28a-9e8744863e6e,DISK]] 2023-10-04 02:00:06,117 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(7854): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-10-04 02:00:06,117 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-04 02:00:06,122 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(7894): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-10-04 02:00:06,123 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(7897): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-10-04 02:00:06,199 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-10-04 02:00:06,207 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-10-04 02:00:06,244 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-10-04 02:00:06,257 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-04 02:00:06,263 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-10-04 02:00:06,265 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-10-04 02:00:06,283 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(1055): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-10-04 02:00:06,288 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-04 02:00:06,289 INFO [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(1072): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66812665, jitterRate=-0.004413709044456482}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-10-04 02:00:06,290 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(965): Region open journal for 1595e783b53d99cd5eef43b6debb2682: 2023-10-04 02:00:06,291 INFO [master/jenkins-hbase9:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-10-04 02:00:06,323 INFO [master/jenkins-hbase9:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-10-04 02:00:06,324 INFO [master/jenkins-hbase9:0:becomeActiveMaster] procedure2.ProcedureExecutor(561): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-10-04 02:00:06,327 INFO [master/jenkins-hbase9:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-10-04 02:00:06,329 INFO [master/jenkins-hbase9:0:becomeActiveMaster] procedure2.ProcedureExecutor(581): Recovered RegionProcedureStore lease in 1 msec 2023-10-04 02:00:06,366 INFO [master/jenkins-hbase9:0:becomeActiveMaster] procedure2.ProcedureExecutor(595): Loaded RegionProcedureStore in 36 msec 2023-10-04 02:00:06,367 INFO [master/jenkins-hbase9:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(96): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-10-04 02:00:06,400 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-10-04 02:00:06,406 INFO [master/jenkins-hbase9:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-10-04 02:00:06,443 INFO [master/jenkins-hbase9:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-10-04 02:00:06,450 INFO [master/jenkins-hbase9:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-10-04 02:00:06,452 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:39651-0x1010f1b55330000, quorum=127.0.0.1:60027, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-10-04 02:00:06,460 INFO [master/jenkins-hbase9:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-10-04 02:00:06,466 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:39651-0x1010f1b55330000, quorum=127.0.0.1:60027, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-10-04 02:00:06,469 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): master:39651-0x1010f1b55330000, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-10-04 02:00:06,471 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:39651-0x1010f1b55330000, quorum=127.0.0.1:60027, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-10-04 02:00:06,472 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:39651-0x1010f1b55330000, quorum=127.0.0.1:60027, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-10-04 02:00:06,490 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:39651-0x1010f1b55330000, quorum=127.0.0.1:60027, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-10-04 02:00:06,496 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): master:39651-0x1010f1b55330000, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-10-04 02:00:06,496 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): regionserver:35175-0x1010f1b55330003, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-10-04 02:00:06,496 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): regionserver:39045-0x1010f1b55330002, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-10-04 02:00:06,496 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): regionserver:44303-0x1010f1b55330001, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-10-04 02:00:06,496 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): master:39651-0x1010f1b55330000, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-10-04 02:00:06,497 INFO [master/jenkins-hbase9:0:becomeActiveMaster] master.HMaster(744): Active/primary master=jenkins-hbase9.apache.org,39651,1696384803959, sessionid=0x1010f1b55330000, setting cluster-up flag (Was=false) 2023-10-04 02:00:06,519 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): master:39651-0x1010f1b55330000, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-10-04 02:00:06,526 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-10-04 02:00:06,527 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase9.apache.org,39651,1696384803959 2023-10-04 02:00:06,533 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): master:39651-0x1010f1b55330000, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-10-04 02:00:06,540 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-10-04 02:00:06,541 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase9.apache.org,39651,1696384803959 2023-10-04 02:00:06,545 WARN [master/jenkins-hbase9:0:becomeActiveMaster] snapshot.SnapshotManager(304): Couldn't delete working snapshot directory: hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/.hbase-snapshot/.tmp 2023-10-04 02:00:06,568 INFO [RS:0;jenkins-hbase9:44303] regionserver.HRegionServer(951): ClusterId : 1a716637-b34c-441d-9db3-c001df7c94ed 2023-10-04 02:00:06,569 INFO [RS:1;jenkins-hbase9:39045] regionserver.HRegionServer(951): ClusterId : 1a716637-b34c-441d-9db3-c001df7c94ed 2023-10-04 02:00:06,569 INFO [RS:2;jenkins-hbase9:35175] regionserver.HRegionServer(951): ClusterId : 1a716637-b34c-441d-9db3-c001df7c94ed 2023-10-04 02:00:06,577 DEBUG [RS:1;jenkins-hbase9:39045] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-10-04 02:00:06,577 DEBUG [RS:0;jenkins-hbase9:44303] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-10-04 02:00:06,577 DEBUG [RS:2;jenkins-hbase9:35175] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-10-04 02:00:06,585 DEBUG [RS:1;jenkins-hbase9:39045] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-10-04 02:00:06,585 DEBUG [RS:2;jenkins-hbase9:35175] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-10-04 02:00:06,585 DEBUG [RS:0;jenkins-hbase9:44303] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-10-04 02:00:06,585 DEBUG [RS:2;jenkins-hbase9:35175] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-10-04 02:00:06,585 DEBUG [RS:1;jenkins-hbase9:39045] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-10-04 02:00:06,586 DEBUG [RS:0;jenkins-hbase9:44303] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-10-04 02:00:06,591 DEBUG [RS:2;jenkins-hbase9:35175] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-10-04 02:00:06,592 DEBUG [RS:1;jenkins-hbase9:39045] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-10-04 02:00:06,592 DEBUG [RS:0;jenkins-hbase9:44303] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-10-04 02:00:06,595 DEBUG [RS:2;jenkins-hbase9:35175] zookeeper.ReadOnlyZKClient(139): Connect 0x0e54d3ac to 127.0.0.1:60027 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-04 02:00:06,596 DEBUG [RS:0;jenkins-hbase9:44303] zookeeper.ReadOnlyZKClient(139): Connect 0x2ab078bf to 127.0.0.1:60027 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-04 02:00:06,596 DEBUG [RS:1;jenkins-hbase9:39045] zookeeper.ReadOnlyZKClient(139): Connect 0x2c8779a5 to 127.0.0.1:60027 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-04 02:00:06,608 DEBUG [RS:0;jenkins-hbase9:44303] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4626b132, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-04 02:00:06,608 DEBUG [RS:0;jenkins-hbase9:44303] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2347c34b, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase9.apache.org/172.31.2.10:0 2023-10-04 02:00:06,628 DEBUG [RS:2;jenkins-hbase9:35175] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@579e6ac2, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-04 02:00:06,628 DEBUG [RS:2;jenkins-hbase9:35175] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@76922e74, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase9.apache.org/172.31.2.10:0 2023-10-04 02:00:06,632 DEBUG [RS:1;jenkins-hbase9:39045] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@47b6b675, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-04 02:00:06,632 DEBUG [RS:1;jenkins-hbase9:39045] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@33828ee5, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase9.apache.org/172.31.2.10:0 2023-10-04 02:00:06,648 DEBUG [RS:0;jenkins-hbase9:44303] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase9:44303 2023-10-04 02:00:06,648 DEBUG [RS:2;jenkins-hbase9:35175] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:2;jenkins-hbase9:35175 2023-10-04 02:00:06,649 DEBUG [RS:1;jenkins-hbase9:39045] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:1;jenkins-hbase9:39045 2023-10-04 02:00:06,653 INFO [RS:2;jenkins-hbase9:35175] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-10-04 02:00:06,654 INFO [RS:2;jenkins-hbase9:35175] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-10-04 02:00:06,653 INFO [RS:1;jenkins-hbase9:39045] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-10-04 02:00:06,654 INFO [RS:1;jenkins-hbase9:39045] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-10-04 02:00:06,653 INFO [RS:0;jenkins-hbase9:44303] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-10-04 02:00:06,655 INFO [RS:0;jenkins-hbase9:44303] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-10-04 02:00:06,658 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] master.HMaster(2930): Registered master coprocessor service: service=AccessControlService 2023-10-04 02:00:06,659 DEBUG [RS:0;jenkins-hbase9:44303] regionserver.HRegionServer(839): Registered regionserver coprocessor executorService: executorService=AccessControlService 2023-10-04 02:00:06,659 DEBUG [RS:2;jenkins-hbase9:35175] regionserver.HRegionServer(839): Registered regionserver coprocessor executorService: executorService=AccessControlService 2023-10-04 02:00:06,659 DEBUG [RS:1;jenkins-hbase9:39045] regionserver.HRegionServer(839): Registered regionserver coprocessor executorService: executorService=AccessControlService 2023-10-04 02:00:06,661 INFO [master/jenkins-hbase9:0:becomeActiveMaster] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-10-04 02:00:06,661 INFO [RS:0;jenkins-hbase9:44303] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-10-04 02:00:06,661 INFO [RS:2;jenkins-hbase9:35175] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-10-04 02:00:06,662 DEBUG [RS:2;jenkins-hbase9:35175] regionserver.HRegionServer(1022): About to register with Master. 2023-10-04 02:00:06,662 INFO [master/jenkins-hbase9:0:becomeActiveMaster] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver loaded, priority=536870912. 2023-10-04 02:00:06,661 INFO [RS:1;jenkins-hbase9:39045] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-10-04 02:00:06,662 DEBUG [RS:1;jenkins-hbase9:39045] regionserver.HRegionServer(1022): About to register with Master. 2023-10-04 02:00:06,662 DEBUG [RS:0;jenkins-hbase9:44303] regionserver.HRegionServer(1022): About to register with Master. 2023-10-04 02:00:06,666 INFO [RS:1;jenkins-hbase9:39045] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase9.apache.org,39651,1696384803959 with isa=jenkins-hbase9.apache.org/172.31.2.10:39045, startcode=1696384805392 2023-10-04 02:00:06,666 INFO [RS:0;jenkins-hbase9:44303] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase9.apache.org,39651,1696384803959 with isa=jenkins-hbase9.apache.org/172.31.2.10:44303, startcode=1696384805319 2023-10-04 02:00:06,666 INFO [RS:2;jenkins-hbase9:35175] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase9.apache.org,39651,1696384803959 with isa=jenkins-hbase9.apache.org/172.31.2.10:35175, startcode=1696384805436 2023-10-04 02:00:06,685 DEBUG [RS:2;jenkins-hbase9:35175] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-10-04 02:00:06,685 DEBUG [RS:1;jenkins-hbase9:39045] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-10-04 02:00:06,685 DEBUG [RS:0;jenkins-hbase9:44303] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-10-04 02:00:06,756 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:48223, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.2 (auth:SIMPLE), service=RegionServerStatusService 2023-10-04 02:00:06,756 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:44103, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.1 (auth:SIMPLE), service=RegionServerStatusService 2023-10-04 02:00:06,756 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:37087, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.0 (auth:SIMPLE), service=RegionServerStatusService 2023-10-04 02:00:06,764 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] procedure2.ProcedureExecutor(1028): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-10-04 02:00:06,766 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=39651] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server is not running yet at org.apache.hadoop.hbase.master.HMaster.checkServiceStarted(HMaster.java:2832) at org.apache.hadoop.hbase.master.MasterRpcServices.regionServerStartup(MasterRpcServices.java:579) at org.apache.hadoop.hbase.shaded.protobuf.generated.RegionServerStatusProtos$RegionServerStatusService$2.callBlockingMethod(RegionServerStatusProtos.java:15952) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-10-04 02:00:06,776 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=39651] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server is not running yet at org.apache.hadoop.hbase.master.HMaster.checkServiceStarted(HMaster.java:2832) at org.apache.hadoop.hbase.master.MasterRpcServices.regionServerStartup(MasterRpcServices.java:579) at org.apache.hadoop.hbase.shaded.protobuf.generated.RegionServerStatusProtos$RegionServerStatusService$2.callBlockingMethod(RegionServerStatusProtos.java:15952) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-10-04 02:00:06,778 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=39651] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server is not running yet at org.apache.hadoop.hbase.master.HMaster.checkServiceStarted(HMaster.java:2832) at org.apache.hadoop.hbase.master.MasterRpcServices.regionServerStartup(MasterRpcServices.java:579) at org.apache.hadoop.hbase.shaded.protobuf.generated.RegionServerStatusProtos$RegionServerStatusService$2.callBlockingMethod(RegionServerStatusProtos.java:15952) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-10-04 02:00:06,780 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase9:0, corePoolSize=5, maxPoolSize=5 2023-10-04 02:00:06,781 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase9:0, corePoolSize=5, maxPoolSize=5 2023-10-04 02:00:06,781 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase9:0, corePoolSize=5, maxPoolSize=5 2023-10-04 02:00:06,781 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase9:0, corePoolSize=5, maxPoolSize=5 2023-10-04 02:00:06,781 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase9:0, corePoolSize=10, maxPoolSize=10 2023-10-04 02:00:06,781 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-10-04 02:00:06,781 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase9:0, corePoolSize=2, maxPoolSize=2 2023-10-04 02:00:06,781 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-10-04 02:00:06,786 INFO [master/jenkins-hbase9:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1696384836786 2023-10-04 02:00:06,790 INFO [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-10-04 02:00:06,803 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-10-04 02:00:06,803 DEBUG [RS:0;jenkins-hbase9:44303] regionserver.HRegionServer(2830): Master is not running yet 2023-10-04 02:00:06,804 DEBUG [RS:2;jenkins-hbase9:35175] regionserver.HRegionServer(2830): Master is not running yet 2023-10-04 02:00:06,804 WARN [RS:0;jenkins-hbase9:44303] regionserver.HRegionServer(1030): reportForDuty failed; sleeping 100 ms and then retrying. 2023-10-04 02:00:06,804 DEBUG [RS:1;jenkins-hbase9:39045] regionserver.HRegionServer(2830): Master is not running yet 2023-10-04 02:00:06,804 WARN [RS:2;jenkins-hbase9:35175] regionserver.HRegionServer(1030): reportForDuty failed; sleeping 100 ms and then retrying. 2023-10-04 02:00:06,804 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-10-04 02:00:06,804 WARN [RS:1;jenkins-hbase9:39045] regionserver.HRegionServer(1030): reportForDuty failed; sleeping 100 ms and then retrying. 2023-10-04 02:00:06,804 INFO [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-10-04 02:00:06,813 INFO [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-10-04 02:00:06,814 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-10-04 02:00:06,814 INFO [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-10-04 02:00:06,815 INFO [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-10-04 02:00:06,815 INFO [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-10-04 02:00:06,816 INFO [master/jenkins-hbase9:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-10-04 02:00:06,821 INFO [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-10-04 02:00:06,824 INFO [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-10-04 02:00:06,824 INFO [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-10-04 02:00:06,828 INFO [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-10-04 02:00:06,829 INFO [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-10-04 02:00:06,832 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase9:0:becomeActiveMaster-HFileCleaner.large.0-1696384806831,5,FailOnTimeoutGroup] 2023-10-04 02:00:06,833 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase9:0:becomeActiveMaster-HFileCleaner.small.0-1696384806832,5,FailOnTimeoutGroup] 2023-10-04 02:00:06,833 INFO [master/jenkins-hbase9:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-10-04 02:00:06,833 INFO [master/jenkins-hbase9:0:becomeActiveMaster] master.HMaster(1461): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-10-04 02:00:06,835 INFO [master/jenkins-hbase9:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-10-04 02:00:06,835 INFO [master/jenkins-hbase9:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-10-04 02:00:06,875 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-10-04 02:00:06,877 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-10-04 02:00:06,877 INFO [PEWorker-1] regionserver.HRegion(7675): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51 2023-10-04 02:00:06,900 DEBUG [PEWorker-1] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-04 02:00:06,902 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-10-04 02:00:06,905 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/data/hbase/meta/1588230740/info 2023-10-04 02:00:06,905 INFO [RS:0;jenkins-hbase9:44303] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase9.apache.org,39651,1696384803959 with isa=jenkins-hbase9.apache.org/172.31.2.10:44303, startcode=1696384805319 2023-10-04 02:00:06,905 INFO [RS:2;jenkins-hbase9:35175] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase9.apache.org,39651,1696384803959 with isa=jenkins-hbase9.apache.org/172.31.2.10:35175, startcode=1696384805436 2023-10-04 02:00:06,905 INFO [RS:1;jenkins-hbase9:39045] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase9.apache.org,39651,1696384803959 with isa=jenkins-hbase9.apache.org/172.31.2.10:39045, startcode=1696384805392 2023-10-04 02:00:06,906 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-10-04 02:00:06,907 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-04 02:00:06,907 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-10-04 02:00:06,910 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/data/hbase/meta/1588230740/rep_barrier 2023-10-04 02:00:06,911 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-10-04 02:00:06,912 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=39651] master.ServerManager(394): Registering regionserver=jenkins-hbase9.apache.org,35175,1696384805436 2023-10-04 02:00:06,913 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-04 02:00:06,913 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-10-04 02:00:06,915 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/data/hbase/meta/1588230740/table 2023-10-04 02:00:06,916 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-10-04 02:00:06,917 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-04 02:00:06,919 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=39651] master.ServerManager(394): Registering regionserver=jenkins-hbase9.apache.org,39045,1696384805392 2023-10-04 02:00:06,920 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/data/hbase/meta/1588230740 2023-10-04 02:00:06,920 DEBUG [RS:2;jenkins-hbase9:35175] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51 2023-10-04 02:00:06,920 DEBUG [RS:2;jenkins-hbase9:35175] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:38449 2023-10-04 02:00:06,920 DEBUG [RS:2;jenkins-hbase9:35175] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-10-04 02:00:06,921 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=39651] master.ServerManager(394): Registering regionserver=jenkins-hbase9.apache.org,44303,1696384805319 2023-10-04 02:00:06,921 DEBUG [RS:1;jenkins-hbase9:39045] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51 2023-10-04 02:00:06,922 DEBUG [RS:1;jenkins-hbase9:39045] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:38449 2023-10-04 02:00:06,922 DEBUG [RS:1;jenkins-hbase9:39045] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-10-04 02:00:06,922 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/data/hbase/meta/1588230740 2023-10-04 02:00:06,922 DEBUG [RS:0;jenkins-hbase9:44303] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51 2023-10-04 02:00:06,922 DEBUG [RS:0;jenkins-hbase9:44303] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:38449 2023-10-04 02:00:06,922 DEBUG [RS:0;jenkins-hbase9:44303] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-10-04 02:00:06,926 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-10-04 02:00:06,930 DEBUG [PEWorker-1] regionserver.HRegion(1055): writing seq id for 1588230740 2023-10-04 02:00:06,930 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): master:39651-0x1010f1b55330000, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-10-04 02:00:06,935 DEBUG [RS:0;jenkins-hbase9:44303] zookeeper.ZKUtil(162): regionserver:44303-0x1010f1b55330001, quorum=127.0.0.1:60027, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase9.apache.org,44303,1696384805319 2023-10-04 02:00:06,935 WARN [RS:0;jenkins-hbase9:44303] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-10-04 02:00:06,935 INFO [RS:0;jenkins-hbase9:44303] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-10-04 02:00:06,935 DEBUG [RS:0;jenkins-hbase9:44303] regionserver.HRegionServer(1948): logDir=hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/WALs/jenkins-hbase9.apache.org,44303,1696384805319 2023-10-04 02:00:06,936 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-04 02:00:06,936 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): master:39651-0x1010f1b55330000, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-10-04 02:00:06,936 DEBUG [RS:1;jenkins-hbase9:39045] zookeeper.ZKUtil(162): regionserver:39045-0x1010f1b55330002, quorum=127.0.0.1:60027, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase9.apache.org,39045,1696384805392 2023-10-04 02:00:06,937 INFO [PEWorker-1] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74069908, jitterRate=0.10372763872146606}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-10-04 02:00:06,937 DEBUG [PEWorker-1] regionserver.HRegion(965): Region open journal for 1588230740: 2023-10-04 02:00:06,937 DEBUG [PEWorker-1] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-10-04 02:00:06,937 INFO [PEWorker-1] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-10-04 02:00:06,938 DEBUG [PEWorker-1] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-10-04 02:00:06,938 DEBUG [PEWorker-1] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-10-04 02:00:06,938 DEBUG [PEWorker-1] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-10-04 02:00:06,938 DEBUG [RS:2;jenkins-hbase9:35175] zookeeper.ZKUtil(162): regionserver:35175-0x1010f1b55330003, quorum=127.0.0.1:60027, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase9.apache.org,35175,1696384805436 2023-10-04 02:00:06,936 WARN [RS:1;jenkins-hbase9:39045] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-10-04 02:00:06,939 WARN [RS:2;jenkins-hbase9:35175] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-10-04 02:00:06,941 INFO [RS:1;jenkins-hbase9:39045] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-10-04 02:00:06,941 INFO [RS:2;jenkins-hbase9:35175] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-10-04 02:00:06,942 DEBUG [RS:1;jenkins-hbase9:39045] regionserver.HRegionServer(1948): logDir=hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/WALs/jenkins-hbase9.apache.org,39045,1696384805392 2023-10-04 02:00:06,942 INFO [PEWorker-1] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-10-04 02:00:06,942 DEBUG [RS:2;jenkins-hbase9:35175] regionserver.HRegionServer(1948): logDir=hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/WALs/jenkins-hbase9.apache.org,35175,1696384805436 2023-10-04 02:00:06,942 DEBUG [PEWorker-1] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-10-04 02:00:06,947 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase9.apache.org,44303,1696384805319] 2023-10-04 02:00:06,952 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase9.apache.org,35175,1696384805436] 2023-10-04 02:00:06,953 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase9.apache.org,39045,1696384805392] 2023-10-04 02:00:06,957 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-10-04 02:00:06,957 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-10-04 02:00:06,966 DEBUG [RS:2;jenkins-hbase9:35175] zookeeper.ZKUtil(162): regionserver:35175-0x1010f1b55330003, quorum=127.0.0.1:60027, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase9.apache.org,39045,1696384805392 2023-10-04 02:00:06,966 DEBUG [RS:0;jenkins-hbase9:44303] zookeeper.ZKUtil(162): regionserver:44303-0x1010f1b55330001, quorum=127.0.0.1:60027, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase9.apache.org,39045,1696384805392 2023-10-04 02:00:06,966 DEBUG [RS:1;jenkins-hbase9:39045] zookeeper.ZKUtil(162): regionserver:39045-0x1010f1b55330002, quorum=127.0.0.1:60027, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase9.apache.org,39045,1696384805392 2023-10-04 02:00:06,966 DEBUG [RS:2;jenkins-hbase9:35175] zookeeper.ZKUtil(162): regionserver:35175-0x1010f1b55330003, quorum=127.0.0.1:60027, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase9.apache.org,35175,1696384805436 2023-10-04 02:00:06,967 DEBUG [RS:1;jenkins-hbase9:39045] zookeeper.ZKUtil(162): regionserver:39045-0x1010f1b55330002, quorum=127.0.0.1:60027, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase9.apache.org,35175,1696384805436 2023-10-04 02:00:06,967 DEBUG [RS:2;jenkins-hbase9:35175] zookeeper.ZKUtil(162): regionserver:35175-0x1010f1b55330003, quorum=127.0.0.1:60027, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase9.apache.org,44303,1696384805319 2023-10-04 02:00:06,968 DEBUG [RS:0;jenkins-hbase9:44303] zookeeper.ZKUtil(162): regionserver:44303-0x1010f1b55330001, quorum=127.0.0.1:60027, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase9.apache.org,35175,1696384805436 2023-10-04 02:00:06,968 DEBUG [RS:1;jenkins-hbase9:39045] zookeeper.ZKUtil(162): regionserver:39045-0x1010f1b55330002, quorum=127.0.0.1:60027, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase9.apache.org,44303,1696384805319 2023-10-04 02:00:06,969 DEBUG [RS:0;jenkins-hbase9:44303] zookeeper.ZKUtil(162): regionserver:44303-0x1010f1b55330001, quorum=127.0.0.1:60027, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase9.apache.org,44303,1696384805319 2023-10-04 02:00:06,972 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-10-04 02:00:06,985 DEBUG [RS:0;jenkins-hbase9:44303] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-10-04 02:00:06,985 DEBUG [RS:1;jenkins-hbase9:39045] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-10-04 02:00:06,985 DEBUG [RS:2;jenkins-hbase9:35175] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-10-04 02:00:06,987 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-10-04 02:00:06,992 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-10-04 02:00:06,999 INFO [RS:1;jenkins-hbase9:39045] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-10-04 02:00:06,999 INFO [RS:2;jenkins-hbase9:35175] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-10-04 02:00:06,999 INFO [RS:0;jenkins-hbase9:44303] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-10-04 02:00:07,027 INFO [RS:1;jenkins-hbase9:39045] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-10-04 02:00:07,027 INFO [RS:2;jenkins-hbase9:35175] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-10-04 02:00:07,027 INFO [RS:0;jenkins-hbase9:44303] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-10-04 02:00:07,032 INFO [RS:2;jenkins-hbase9:35175] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-10-04 02:00:07,032 INFO [RS:0;jenkins-hbase9:44303] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-10-04 02:00:07,032 INFO [RS:2;jenkins-hbase9:35175] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-10-04 02:00:07,033 INFO [RS:1;jenkins-hbase9:39045] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-10-04 02:00:07,033 INFO [RS:0;jenkins-hbase9:44303] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-10-04 02:00:07,033 INFO [RS:1;jenkins-hbase9:39045] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-10-04 02:00:07,033 INFO [RS:2;jenkins-hbase9:35175] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-10-04 02:00:07,034 INFO [RS:0;jenkins-hbase9:44303] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-10-04 02:00:07,035 INFO [RS:1;jenkins-hbase9:39045] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-10-04 02:00:07,043 INFO [RS:2;jenkins-hbase9:35175] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-10-04 02:00:07,043 INFO [RS:1;jenkins-hbase9:39045] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-10-04 02:00:07,043 INFO [RS:0;jenkins-hbase9:44303] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-10-04 02:00:07,044 DEBUG [RS:2;jenkins-hbase9:35175] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-10-04 02:00:07,044 DEBUG [RS:1;jenkins-hbase9:39045] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-10-04 02:00:07,044 DEBUG [RS:2;jenkins-hbase9:35175] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-10-04 02:00:07,044 DEBUG [RS:0;jenkins-hbase9:44303] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-10-04 02:00:07,045 DEBUG [RS:2;jenkins-hbase9:35175] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-10-04 02:00:07,045 DEBUG [RS:0;jenkins-hbase9:44303] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-10-04 02:00:07,045 DEBUG [RS:2;jenkins-hbase9:35175] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-10-04 02:00:07,045 DEBUG [RS:0;jenkins-hbase9:44303] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-10-04 02:00:07,045 DEBUG [RS:2;jenkins-hbase9:35175] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-10-04 02:00:07,045 DEBUG [RS:0;jenkins-hbase9:44303] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-10-04 02:00:07,045 DEBUG [RS:2;jenkins-hbase9:35175] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase9:0, corePoolSize=2, maxPoolSize=2 2023-10-04 02:00:07,045 DEBUG [RS:0;jenkins-hbase9:44303] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-10-04 02:00:07,045 DEBUG [RS:2;jenkins-hbase9:35175] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-10-04 02:00:07,045 DEBUG [RS:0;jenkins-hbase9:44303] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase9:0, corePoolSize=2, maxPoolSize=2 2023-10-04 02:00:07,045 DEBUG [RS:2;jenkins-hbase9:35175] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-10-04 02:00:07,045 DEBUG [RS:0;jenkins-hbase9:44303] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-10-04 02:00:07,045 DEBUG [RS:2;jenkins-hbase9:35175] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-10-04 02:00:07,045 DEBUG [RS:0;jenkins-hbase9:44303] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-10-04 02:00:07,045 DEBUG [RS:2;jenkins-hbase9:35175] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-10-04 02:00:07,045 DEBUG [RS:0;jenkins-hbase9:44303] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-10-04 02:00:07,044 DEBUG [RS:1;jenkins-hbase9:39045] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-10-04 02:00:07,045 DEBUG [RS:0;jenkins-hbase9:44303] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-10-04 02:00:07,046 DEBUG [RS:1;jenkins-hbase9:39045] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-10-04 02:00:07,046 DEBUG [RS:1;jenkins-hbase9:39045] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-10-04 02:00:07,047 DEBUG [RS:1;jenkins-hbase9:39045] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-10-04 02:00:07,047 DEBUG [RS:1;jenkins-hbase9:39045] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase9:0, corePoolSize=2, maxPoolSize=2 2023-10-04 02:00:07,047 DEBUG [RS:1;jenkins-hbase9:39045] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-10-04 02:00:07,047 DEBUG [RS:1;jenkins-hbase9:39045] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-10-04 02:00:07,047 DEBUG [RS:1;jenkins-hbase9:39045] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-10-04 02:00:07,047 DEBUG [RS:1;jenkins-hbase9:39045] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-10-04 02:00:07,052 INFO [RS:2;jenkins-hbase9:35175] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-10-04 02:00:07,052 INFO [RS:2;jenkins-hbase9:35175] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-10-04 02:00:07,053 INFO [RS:2;jenkins-hbase9:35175] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-10-04 02:00:07,053 INFO [RS:0;jenkins-hbase9:44303] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-10-04 02:00:07,053 INFO [RS:0;jenkins-hbase9:44303] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-10-04 02:00:07,053 INFO [RS:0;jenkins-hbase9:44303] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-10-04 02:00:07,053 INFO [RS:1;jenkins-hbase9:39045] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-10-04 02:00:07,053 INFO [RS:1;jenkins-hbase9:39045] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-10-04 02:00:07,054 INFO [RS:1;jenkins-hbase9:39045] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-10-04 02:00:07,076 INFO [RS:2;jenkins-hbase9:35175] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-10-04 02:00:07,076 INFO [RS:0;jenkins-hbase9:44303] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-10-04 02:00:07,076 INFO [RS:1;jenkins-hbase9:39045] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-10-04 02:00:07,080 INFO [RS:1;jenkins-hbase9:39045] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase9.apache.org,39045,1696384805392-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-10-04 02:00:07,080 INFO [RS:0;jenkins-hbase9:44303] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase9.apache.org,44303,1696384805319-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-10-04 02:00:07,080 INFO [RS:2;jenkins-hbase9:35175] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase9.apache.org,35175,1696384805436-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-10-04 02:00:07,103 INFO [RS:2;jenkins-hbase9:35175] regionserver.Replication(203): jenkins-hbase9.apache.org,35175,1696384805436 started 2023-10-04 02:00:07,103 INFO [RS:2;jenkins-hbase9:35175] regionserver.HRegionServer(1637): Serving as jenkins-hbase9.apache.org,35175,1696384805436, RpcServer on jenkins-hbase9.apache.org/172.31.2.10:35175, sessionid=0x1010f1b55330003 2023-10-04 02:00:07,104 INFO [RS:0;jenkins-hbase9:44303] regionserver.Replication(203): jenkins-hbase9.apache.org,44303,1696384805319 started 2023-10-04 02:00:07,104 INFO [RS:1;jenkins-hbase9:39045] regionserver.Replication(203): jenkins-hbase9.apache.org,39045,1696384805392 started 2023-10-04 02:00:07,104 DEBUG [RS:2;jenkins-hbase9:35175] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-10-04 02:00:07,104 INFO [RS:0;jenkins-hbase9:44303] regionserver.HRegionServer(1637): Serving as jenkins-hbase9.apache.org,44303,1696384805319, RpcServer on jenkins-hbase9.apache.org/172.31.2.10:44303, sessionid=0x1010f1b55330001 2023-10-04 02:00:07,104 DEBUG [RS:2;jenkins-hbase9:35175] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase9.apache.org,35175,1696384805436 2023-10-04 02:00:07,104 DEBUG [RS:0;jenkins-hbase9:44303] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-10-04 02:00:07,104 INFO [RS:1;jenkins-hbase9:39045] regionserver.HRegionServer(1637): Serving as jenkins-hbase9.apache.org,39045,1696384805392, RpcServer on jenkins-hbase9.apache.org/172.31.2.10:39045, sessionid=0x1010f1b55330002 2023-10-04 02:00:07,104 DEBUG [RS:0;jenkins-hbase9:44303] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase9.apache.org,44303,1696384805319 2023-10-04 02:00:07,105 DEBUG [RS:1;jenkins-hbase9:39045] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-10-04 02:00:07,106 DEBUG [RS:1;jenkins-hbase9:39045] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase9.apache.org,39045,1696384805392 2023-10-04 02:00:07,106 DEBUG [RS:1;jenkins-hbase9:39045] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase9.apache.org,39045,1696384805392' 2023-10-04 02:00:07,104 DEBUG [RS:2;jenkins-hbase9:35175] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase9.apache.org,35175,1696384805436' 2023-10-04 02:00:07,107 DEBUG [RS:1;jenkins-hbase9:39045] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-04 02:00:07,105 DEBUG [RS:0;jenkins-hbase9:44303] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase9.apache.org,44303,1696384805319' 2023-10-04 02:00:07,107 DEBUG [RS:0;jenkins-hbase9:44303] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-04 02:00:07,107 DEBUG [RS:2;jenkins-hbase9:35175] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-04 02:00:07,108 DEBUG [RS:2;jenkins-hbase9:35175] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-04 02:00:07,108 DEBUG [RS:1;jenkins-hbase9:39045] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-04 02:00:07,108 DEBUG [RS:0;jenkins-hbase9:44303] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-04 02:00:07,109 DEBUG [RS:2;jenkins-hbase9:35175] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-10-04 02:00:07,109 DEBUG [RS:1;jenkins-hbase9:39045] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-10-04 02:00:07,109 DEBUG [RS:2;jenkins-hbase9:35175] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-10-04 02:00:07,109 DEBUG [RS:1;jenkins-hbase9:39045] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-10-04 02:00:07,109 DEBUG [RS:2;jenkins-hbase9:35175] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase9.apache.org,35175,1696384805436 2023-10-04 02:00:07,109 DEBUG [RS:1;jenkins-hbase9:39045] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase9.apache.org,39045,1696384805392 2023-10-04 02:00:07,109 DEBUG [RS:1;jenkins-hbase9:39045] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase9.apache.org,39045,1696384805392' 2023-10-04 02:00:07,110 DEBUG [RS:1;jenkins-hbase9:39045] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-04 02:00:07,109 DEBUG [RS:2;jenkins-hbase9:35175] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase9.apache.org,35175,1696384805436' 2023-10-04 02:00:07,110 DEBUG [RS:2;jenkins-hbase9:35175] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-04 02:00:07,111 DEBUG [RS:0;jenkins-hbase9:44303] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-10-04 02:00:07,111 DEBUG [RS:0;jenkins-hbase9:44303] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-10-04 02:00:07,111 DEBUG [RS:0;jenkins-hbase9:44303] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase9.apache.org,44303,1696384805319 2023-10-04 02:00:07,111 DEBUG [RS:0;jenkins-hbase9:44303] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase9.apache.org,44303,1696384805319' 2023-10-04 02:00:07,111 DEBUG [RS:2;jenkins-hbase9:35175] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-04 02:00:07,112 DEBUG [RS:1;jenkins-hbase9:39045] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-04 02:00:07,111 DEBUG [RS:0;jenkins-hbase9:44303] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-04 02:00:07,112 DEBUG [RS:2;jenkins-hbase9:35175] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-10-04 02:00:07,113 DEBUG [RS:0;jenkins-hbase9:44303] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-04 02:00:07,113 INFO [RS:2;jenkins-hbase9:35175] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-10-04 02:00:07,113 INFO [RS:2;jenkins-hbase9:35175] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-10-04 02:00:07,113 DEBUG [RS:0;jenkins-hbase9:44303] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-10-04 02:00:07,113 INFO [RS:0;jenkins-hbase9:44303] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-10-04 02:00:07,113 INFO [RS:0;jenkins-hbase9:44303] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-10-04 02:00:07,115 DEBUG [RS:1;jenkins-hbase9:39045] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-10-04 02:00:07,115 INFO [RS:1;jenkins-hbase9:39045] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-10-04 02:00:07,115 INFO [RS:1;jenkins-hbase9:39045] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-10-04 02:00:07,144 DEBUG [jenkins-hbase9:39651] assignment.AssignmentManager(2176): Processing assignQueue; systemServersCount=3, allServersCount=3 2023-10-04 02:00:07,149 DEBUG [jenkins-hbase9:39651] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase9.apache.org=0} racks are {/default-rack=0} 2023-10-04 02:00:07,154 DEBUG [jenkins-hbase9:39651] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-10-04 02:00:07,154 DEBUG [jenkins-hbase9:39651] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-10-04 02:00:07,154 DEBUG [jenkins-hbase9:39651] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-10-04 02:00:07,154 DEBUG [jenkins-hbase9:39651] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-10-04 02:00:07,157 INFO [PEWorker-3] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase9.apache.org,44303,1696384805319, state=OPENING 2023-10-04 02:00:07,166 DEBUG [PEWorker-3] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-10-04 02:00:07,167 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): master:39651-0x1010f1b55330000, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-10-04 02:00:07,168 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-10-04 02:00:07,171 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase9.apache.org,44303,1696384805319}] 2023-10-04 02:00:07,225 INFO [RS:0;jenkins-hbase9:44303] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase9.apache.org%2C44303%2C1696384805319, suffix=, logDir=hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/WALs/jenkins-hbase9.apache.org,44303,1696384805319, archiveDir=hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/oldWALs, maxLogs=32 2023-10-04 02:00:07,225 INFO [RS:1;jenkins-hbase9:39045] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase9.apache.org%2C39045%2C1696384805392, suffix=, logDir=hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/WALs/jenkins-hbase9.apache.org,39045,1696384805392, archiveDir=hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/oldWALs, maxLogs=32 2023-10-04 02:00:07,226 INFO [RS:2;jenkins-hbase9:35175] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase9.apache.org%2C35175%2C1696384805436, suffix=, logDir=hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/WALs/jenkins-hbase9.apache.org,35175,1696384805436, archiveDir=hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/oldWALs, maxLogs=32 2023-10-04 02:00:07,258 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:35507,DS-a965123a-1314-4e4c-a8bf-c83a581e21ea,DISK] 2023-10-04 02:00:07,258 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:40239,DS-5937343d-efb4-4c2a-b54d-a8b1679065a9,DISK] 2023-10-04 02:00:07,265 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:36939,DS-4bb6d0c7-cfe4-40cc-a28a-9e8744863e6e,DISK] 2023-10-04 02:00:07,266 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:40239,DS-5937343d-efb4-4c2a-b54d-a8b1679065a9,DISK] 2023-10-04 02:00:07,266 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:40239,DS-5937343d-efb4-4c2a-b54d-a8b1679065a9,DISK] 2023-10-04 02:00:07,267 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:36939,DS-4bb6d0c7-cfe4-40cc-a28a-9e8744863e6e,DISK] 2023-10-04 02:00:07,267 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:35507,DS-a965123a-1314-4e4c-a8bf-c83a581e21ea,DISK] 2023-10-04 02:00:07,268 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:35507,DS-a965123a-1314-4e4c-a8bf-c83a581e21ea,DISK] 2023-10-04 02:00:07,268 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:36939,DS-4bb6d0c7-cfe4-40cc-a28a-9e8744863e6e,DISK] 2023-10-04 02:00:07,292 INFO [RS:2;jenkins-hbase9:35175] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/WALs/jenkins-hbase9.apache.org,35175,1696384805436/jenkins-hbase9.apache.org%2C35175%2C1696384805436.1696384807229 2023-10-04 02:00:07,292 DEBUG [RS:2;jenkins-hbase9:35175] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:40239,DS-5937343d-efb4-4c2a-b54d-a8b1679065a9,DISK], DatanodeInfoWithStorage[127.0.0.1:35507,DS-a965123a-1314-4e4c-a8bf-c83a581e21ea,DISK], DatanodeInfoWithStorage[127.0.0.1:36939,DS-4bb6d0c7-cfe4-40cc-a28a-9e8744863e6e,DISK]] 2023-10-04 02:00:07,296 INFO [RS:0;jenkins-hbase9:44303] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/WALs/jenkins-hbase9.apache.org,44303,1696384805319/jenkins-hbase9.apache.org%2C44303%2C1696384805319.1696384807229 2023-10-04 02:00:07,296 INFO [RS:1;jenkins-hbase9:39045] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/WALs/jenkins-hbase9.apache.org,39045,1696384805392/jenkins-hbase9.apache.org%2C39045%2C1696384805392.1696384807229 2023-10-04 02:00:07,296 DEBUG [RS:0;jenkins-hbase9:44303] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:36939,DS-4bb6d0c7-cfe4-40cc-a28a-9e8744863e6e,DISK], DatanodeInfoWithStorage[127.0.0.1:40239,DS-5937343d-efb4-4c2a-b54d-a8b1679065a9,DISK], DatanodeInfoWithStorage[127.0.0.1:35507,DS-a965123a-1314-4e4c-a8bf-c83a581e21ea,DISK]] 2023-10-04 02:00:07,296 DEBUG [RS:1;jenkins-hbase9:39045] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:40239,DS-5937343d-efb4-4c2a-b54d-a8b1679065a9,DISK], DatanodeInfoWithStorage[127.0.0.1:35507,DS-a965123a-1314-4e4c-a8bf-c83a581e21ea,DISK], DatanodeInfoWithStorage[127.0.0.1:36939,DS-4bb6d0c7-cfe4-40cc-a28a-9e8744863e6e,DISK]] 2023-10-04 02:00:07,358 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase9.apache.org,44303,1696384805319 2023-10-04 02:00:07,360 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-10-04 02:00:07,363 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:57026, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-10-04 02:00:07,378 INFO [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(130): Open hbase:meta,,1.1588230740 2023-10-04 02:00:07,379 INFO [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-10-04 02:00:07,383 INFO [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase9.apache.org%2C44303%2C1696384805319.meta, suffix=.meta, logDir=hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/WALs/jenkins-hbase9.apache.org,44303,1696384805319, archiveDir=hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/oldWALs, maxLogs=32 2023-10-04 02:00:07,404 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:36939,DS-4bb6d0c7-cfe4-40cc-a28a-9e8744863e6e,DISK] 2023-10-04 02:00:07,405 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:40239,DS-5937343d-efb4-4c2a-b54d-a8b1679065a9,DISK] 2023-10-04 02:00:07,406 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:35507,DS-a965123a-1314-4e4c-a8bf-c83a581e21ea,DISK] 2023-10-04 02:00:07,416 INFO [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/WALs/jenkins-hbase9.apache.org,44303,1696384805319/jenkins-hbase9.apache.org%2C44303%2C1696384805319.meta.1696384807384.meta 2023-10-04 02:00:07,417 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:36939,DS-4bb6d0c7-cfe4-40cc-a28a-9e8744863e6e,DISK], DatanodeInfoWithStorage[127.0.0.1:40239,DS-5937343d-efb4-4c2a-b54d-a8b1679065a9,DISK], DatanodeInfoWithStorage[127.0.0.1:35507,DS-a965123a-1314-4e4c-a8bf-c83a581e21ea,DISK]] 2023-10-04 02:00:07,417 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-10-04 02:00:07,418 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:meta,,1 service=AccessControlService 2023-10-04 02:00:07,420 INFO [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-10-04 02:00:07,423 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-10-04 02:00:07,425 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-10-04 02:00:07,427 INFO [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-10-04 02:00:07,440 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-10-04 02:00:07,440 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-04 02:00:07,440 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7894): checking encryption for 1588230740 2023-10-04 02:00:07,440 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7897): checking classloading for 1588230740 2023-10-04 02:00:07,443 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-10-04 02:00:07,445 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/data/hbase/meta/1588230740/info 2023-10-04 02:00:07,445 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/data/hbase/meta/1588230740/info 2023-10-04 02:00:07,446 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-10-04 02:00:07,447 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-04 02:00:07,447 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-10-04 02:00:07,449 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/data/hbase/meta/1588230740/rep_barrier 2023-10-04 02:00:07,449 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/data/hbase/meta/1588230740/rep_barrier 2023-10-04 02:00:07,449 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-10-04 02:00:07,450 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-04 02:00:07,450 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-10-04 02:00:07,452 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/data/hbase/meta/1588230740/table 2023-10-04 02:00:07,452 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/data/hbase/meta/1588230740/table 2023-10-04 02:00:07,453 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-10-04 02:00:07,454 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-04 02:00:07,456 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/data/hbase/meta/1588230740 2023-10-04 02:00:07,459 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/data/hbase/meta/1588230740 2023-10-04 02:00:07,463 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-10-04 02:00:07,466 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1055): writing seq id for 1588230740 2023-10-04 02:00:07,470 INFO [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73184320, jitterRate=0.0905313491821289}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-10-04 02:00:07,473 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(965): Region open journal for 1588230740: 2023-10-04 02:00:07,483 INFO [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1696384807350 2023-10-04 02:00:07,505 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:meta,,1.1588230740 2023-10-04 02:00:07,506 INFO [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(158): Opened hbase:meta,,1.1588230740 2023-10-04 02:00:07,506 INFO [PEWorker-5] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase9.apache.org,44303,1696384805319, state=OPEN 2023-10-04 02:00:07,509 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): master:39651-0x1010f1b55330000, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-10-04 02:00:07,509 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-10-04 02:00:07,516 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=3, resume processing ppid=2 2023-10-04 02:00:07,516 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase9.apache.org,44303,1696384805319 in 338 msec 2023-10-04 02:00:07,523 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=2, resume processing ppid=1 2023-10-04 02:00:07,524 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 546 msec 2023-10-04 02:00:07,543 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 858 msec 2023-10-04 02:00:07,543 INFO [master/jenkins-hbase9:0:becomeActiveMaster] master.HMaster(953): Wait for region servers to report in: status=null, state=RUNNING, startTime=1696384807543, completionTime=-1 2023-10-04 02:00:07,544 INFO [master/jenkins-hbase9:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=3; waited=0ms, expected min=3 server(s), max=3 server(s), master is running 2023-10-04 02:00:07,544 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] assignment.AssignmentManager(1517): Joining cluster... 2023-10-04 02:00:07,613 DEBUG [hconnection-0x20d1013d-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-04 02:00:07,616 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:57038, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-04 02:00:07,638 INFO [master/jenkins-hbase9:0:becomeActiveMaster] assignment.AssignmentManager(1529): Number of RegionServers=3 2023-10-04 02:00:07,638 INFO [master/jenkins-hbase9:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1696384867638 2023-10-04 02:00:07,638 INFO [master/jenkins-hbase9:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1696384927638 2023-10-04 02:00:07,638 INFO [master/jenkins-hbase9:0:becomeActiveMaster] assignment.AssignmentManager(1536): Joined the cluster in 93 msec 2023-10-04 02:00:07,674 INFO [master/jenkins-hbase9:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase9.apache.org,39651,1696384803959-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-10-04 02:00:07,674 INFO [master/jenkins-hbase9:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase9.apache.org,39651,1696384803959-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-10-04 02:00:07,674 INFO [master/jenkins-hbase9:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase9.apache.org,39651,1696384803959-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-10-04 02:00:07,677 INFO [master/jenkins-hbase9:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase9:39651, period=300000, unit=MILLISECONDS is enabled. 2023-10-04 02:00:07,678 INFO [master/jenkins-hbase9:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-10-04 02:00:07,685 DEBUG [master/jenkins-hbase9:0.Chore.1] janitor.CatalogJanitor(175): 2023-10-04 02:00:07,698 INFO [master/jenkins-hbase9:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-10-04 02:00:07,699 INFO [master/jenkins-hbase9:0:becomeActiveMaster] master.HMaster(2148): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-10-04 02:00:07,710 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] procedure2.ProcedureExecutor(1028): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-10-04 02:00:07,713 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-10-04 02:00:07,717 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-10-04 02:00:07,741 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/.tmp/data/hbase/namespace/2ec2ed12b72bd33dd2c8b72e8e42d407 2023-10-04 02:00:07,744 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/.tmp/data/hbase/namespace/2ec2ed12b72bd33dd2c8b72e8e42d407 empty. 2023-10-04 02:00:07,745 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/.tmp/data/hbase/namespace/2ec2ed12b72bd33dd2c8b72e8e42d407 2023-10-04 02:00:07,745 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-10-04 02:00:07,789 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-10-04 02:00:07,792 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7675): creating {ENCODED => 2ec2ed12b72bd33dd2c8b72e8e42d407, NAME => 'hbase:namespace,,1696384807699.2ec2ed12b72bd33dd2c8b72e8e42d407.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/.tmp 2023-10-04 02:00:07,817 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1696384807699.2ec2ed12b72bd33dd2c8b72e8e42d407.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-04 02:00:07,817 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1604): Closing 2ec2ed12b72bd33dd2c8b72e8e42d407, disabling compactions & flushes 2023-10-04 02:00:07,817 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1696384807699.2ec2ed12b72bd33dd2c8b72e8e42d407. 2023-10-04 02:00:07,817 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1696384807699.2ec2ed12b72bd33dd2c8b72e8e42d407. 2023-10-04 02:00:07,817 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1696384807699.2ec2ed12b72bd33dd2c8b72e8e42d407. after waiting 0 ms 2023-10-04 02:00:07,818 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1696384807699.2ec2ed12b72bd33dd2c8b72e8e42d407. 2023-10-04 02:00:07,818 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1838): Closed hbase:namespace,,1696384807699.2ec2ed12b72bd33dd2c8b72e8e42d407. 2023-10-04 02:00:07,818 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1558): Region close journal for 2ec2ed12b72bd33dd2c8b72e8e42d407: 2023-10-04 02:00:07,823 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-10-04 02:00:07,839 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1696384807699.2ec2ed12b72bd33dd2c8b72e8e42d407.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1696384807826"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696384807826"}]},"ts":"1696384807826"} 2023-10-04 02:00:07,875 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-10-04 02:00:07,877 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-10-04 02:00:07,884 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696384807877"}]},"ts":"1696384807877"} 2023-10-04 02:00:07,891 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-10-04 02:00:07,895 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase9.apache.org=0} racks are {/default-rack=0} 2023-10-04 02:00:07,897 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-10-04 02:00:07,897 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-10-04 02:00:07,897 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-10-04 02:00:07,897 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-10-04 02:00:07,899 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=2ec2ed12b72bd33dd2c8b72e8e42d407, ASSIGN}] 2023-10-04 02:00:07,906 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=2ec2ed12b72bd33dd2c8b72e8e42d407, ASSIGN 2023-10-04 02:00:07,909 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=2ec2ed12b72bd33dd2c8b72e8e42d407, ASSIGN; state=OFFLINE, location=jenkins-hbase9.apache.org,35175,1696384805436; forceNewPlan=false, retain=false 2023-10-04 02:00:08,062 INFO [jenkins-hbase9:39651] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-10-04 02:00:08,063 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=2ec2ed12b72bd33dd2c8b72e8e42d407, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,35175,1696384805436 2023-10-04 02:00:08,063 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1696384807699.2ec2ed12b72bd33dd2c8b72e8e42d407.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1696384808062"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696384808062"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696384808062"}]},"ts":"1696384808062"} 2023-10-04 02:00:08,069 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure 2ec2ed12b72bd33dd2c8b72e8e42d407, server=jenkins-hbase9.apache.org,35175,1696384805436}] 2023-10-04 02:00:08,224 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(712): New admin connection to jenkins-hbase9.apache.org,35175,1696384805436 2023-10-04 02:00:08,224 DEBUG [RSProcedureDispatcher-pool-1] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-10-04 02:00:08,228 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:58866, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-10-04 02:00:08,235 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(130): Open hbase:namespace,,1696384807699.2ec2ed12b72bd33dd2c8b72e8e42d407. 2023-10-04 02:00:08,235 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 2ec2ed12b72bd33dd2c8b72e8e42d407, NAME => 'hbase:namespace,,1696384807699.2ec2ed12b72bd33dd2c8b72e8e42d407.', STARTKEY => '', ENDKEY => ''} 2023-10-04 02:00:08,235 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:namespace,,1696384807699.2ec2ed12b72bd33dd2c8b72e8e42d407. service=AccessControlService 2023-10-04 02:00:08,236 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-10-04 02:00:08,237 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace 2ec2ed12b72bd33dd2c8b72e8e42d407 2023-10-04 02:00:08,237 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1696384807699.2ec2ed12b72bd33dd2c8b72e8e42d407.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-04 02:00:08,237 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7894): checking encryption for 2ec2ed12b72bd33dd2c8b72e8e42d407 2023-10-04 02:00:08,237 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7897): checking classloading for 2ec2ed12b72bd33dd2c8b72e8e42d407 2023-10-04 02:00:08,240 INFO [StoreOpener-2ec2ed12b72bd33dd2c8b72e8e42d407-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 2ec2ed12b72bd33dd2c8b72e8e42d407 2023-10-04 02:00:08,243 DEBUG [StoreOpener-2ec2ed12b72bd33dd2c8b72e8e42d407-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/data/hbase/namespace/2ec2ed12b72bd33dd2c8b72e8e42d407/info 2023-10-04 02:00:08,243 DEBUG [StoreOpener-2ec2ed12b72bd33dd2c8b72e8e42d407-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/data/hbase/namespace/2ec2ed12b72bd33dd2c8b72e8e42d407/info 2023-10-04 02:00:08,243 INFO [StoreOpener-2ec2ed12b72bd33dd2c8b72e8e42d407-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 2ec2ed12b72bd33dd2c8b72e8e42d407 columnFamilyName info 2023-10-04 02:00:08,244 INFO [StoreOpener-2ec2ed12b72bd33dd2c8b72e8e42d407-1] regionserver.HStore(310): Store=2ec2ed12b72bd33dd2c8b72e8e42d407/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-04 02:00:08,246 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/data/hbase/namespace/2ec2ed12b72bd33dd2c8b72e8e42d407 2023-10-04 02:00:08,248 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/data/hbase/namespace/2ec2ed12b72bd33dd2c8b72e8e42d407 2023-10-04 02:00:08,252 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1055): writing seq id for 2ec2ed12b72bd33dd2c8b72e8e42d407 2023-10-04 02:00:08,256 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/data/hbase/namespace/2ec2ed12b72bd33dd2c8b72e8e42d407/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-04 02:00:08,257 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1072): Opened 2ec2ed12b72bd33dd2c8b72e8e42d407; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60090954, jitterRate=-0.1045750081539154}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-10-04 02:00:08,257 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(965): Region open journal for 2ec2ed12b72bd33dd2c8b72e8e42d407: 2023-10-04 02:00:08,259 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:namespace,,1696384807699.2ec2ed12b72bd33dd2c8b72e8e42d407., pid=6, masterSystemTime=1696384808224 2023-10-04 02:00:08,265 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:namespace,,1696384807699.2ec2ed12b72bd33dd2c8b72e8e42d407. 2023-10-04 02:00:08,265 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(158): Opened hbase:namespace,,1696384807699.2ec2ed12b72bd33dd2c8b72e8e42d407. 2023-10-04 02:00:08,268 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=2ec2ed12b72bd33dd2c8b72e8e42d407, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase9.apache.org,35175,1696384805436 2023-10-04 02:00:08,269 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1696384807699.2ec2ed12b72bd33dd2c8b72e8e42d407.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1696384808267"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1696384808267"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1696384808267"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1696384808267"}]},"ts":"1696384808267"} 2023-10-04 02:00:08,276 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=6, resume processing ppid=5 2023-10-04 02:00:08,276 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure 2ec2ed12b72bd33dd2c8b72e8e42d407, server=jenkins-hbase9.apache.org,35175,1696384805436 in 203 msec 2023-10-04 02:00:08,280 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=5, resume processing ppid=4 2023-10-04 02:00:08,281 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=2ec2ed12b72bd33dd2c8b72e8e42d407, ASSIGN in 377 msec 2023-10-04 02:00:08,282 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-10-04 02:00:08,283 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696384808283"}]},"ts":"1696384808283"} 2023-10-04 02:00:08,285 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-10-04 02:00:08,289 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-10-04 02:00:08,292 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 589 msec 2023-10-04 02:00:08,314 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:39651-0x1010f1b55330000, quorum=127.0.0.1:60027, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-10-04 02:00:08,316 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): master:39651-0x1010f1b55330000, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-10-04 02:00:08,316 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): master:39651-0x1010f1b55330000, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-10-04 02:00:08,344 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-04 02:00:08,346 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:58876, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-04 02:00:08,364 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] procedure2.ProcedureExecutor(1028): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-10-04 02:00:08,384 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): master:39651-0x1010f1b55330000, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-10-04 02:00:08,391 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 37 msec 2023-10-04 02:00:08,398 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] procedure2.ProcedureExecutor(1028): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-10-04 02:00:08,410 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): master:39651-0x1010f1b55330000, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-10-04 02:00:08,417 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 18 msec 2023-10-04 02:00:08,424 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): master:39651-0x1010f1b55330000, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-10-04 02:00:08,428 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): master:39651-0x1010f1b55330000, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-10-04 02:00:08,428 INFO [master/jenkins-hbase9:0:becomeActiveMaster] master.HMaster(1083): Master has completed initialization 2.920sec 2023-10-04 02:00:08,431 INFO [master/jenkins-hbase9:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-10-04 02:00:08,433 INFO [master/jenkins-hbase9:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-10-04 02:00:08,433 INFO [master/jenkins-hbase9:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-10-04 02:00:08,435 INFO [master/jenkins-hbase9:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase9.apache.org,39651,1696384803959-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-10-04 02:00:08,435 INFO [master/jenkins-hbase9:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase9.apache.org,39651,1696384803959-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-10-04 02:00:08,457 INFO [master/jenkins-hbase9:0:becomeActiveMaster] master.HMaster$4(2112): Client=null/null create 'hbase:acl', {NAME => 'l', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-10-04 02:00:08,459 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] procedure2.ProcedureExecutor(1028): Stored pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:acl 2023-10-04 02:00:08,461 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_PRE_OPERATION 2023-10-04 02:00:08,462 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-10-04 02:00:08,466 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/.tmp/data/hbase/acl/efd2d5b3ef87d5ee769a207fc17e879a 2023-10-04 02:00:08,466 INFO [master/jenkins-hbase9:0:becomeActiveMaster] master.MasterRpcServices(700): Client=null/null procedure request for creating table: namespace: "hbase" qualifier: "acl" procId is: 9 2023-10-04 02:00:08,467 DEBUG [HFileArchiver-2] backup.HFileArchiver(153): Directory hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/.tmp/data/hbase/acl/efd2d5b3ef87d5ee769a207fc17e879a empty. 2023-10-04 02:00:08,469 DEBUG [HFileArchiver-2] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/.tmp/data/hbase/acl/efd2d5b3ef87d5ee769a207fc17e879a 2023-10-04 02:00:08,469 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived hbase:acl regions 2023-10-04 02:00:08,475 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-10-04 02:00:08,478 DEBUG [Listener at localhost/41661] zookeeper.ReadOnlyZKClient(139): Connect 0x322007f2 to 127.0.0.1:60027 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-04 02:00:08,485 DEBUG [Listener at localhost/41661] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2f56dc7, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-04 02:00:08,507 DEBUG [hconnection-0x4d455589-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-04 02:00:08,507 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/.tmp/data/hbase/acl/.tabledesc/.tableinfo.0000000001 2023-10-04 02:00:08,509 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(7675): creating {ENCODED => efd2d5b3ef87d5ee769a207fc17e879a, NAME => 'hbase:acl,,1696384808452.efd2d5b3ef87d5ee769a207fc17e879a.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:acl', {NAME => 'l', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/.tmp 2023-10-04 02:00:08,523 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:57046, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-04 02:00:08,526 INFO [Listener at localhost/41661] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase9.apache.org,39651,1696384803959 2023-10-04 02:00:08,533 INFO [Listener at localhost/41661] hbase.HBaseTestingUtility(2699): Starting mini mapreduce cluster... 2023-10-04 02:00:08,533 INFO [Listener at localhost/41661] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/757a468a-9656-cc80-ec19-d6f68f36be5a/test.cache.data in system properties and HBase conf 2023-10-04 02:00:08,535 INFO [Listener at localhost/41661] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/757a468a-9656-cc80-ec19-d6f68f36be5a/hadoop.tmp.dir in system properties and HBase conf 2023-10-04 02:00:08,535 INFO [Listener at localhost/41661] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/757a468a-9656-cc80-ec19-d6f68f36be5a/hadoop.log.dir in system properties and HBase conf 2023-10-04 02:00:08,535 INFO [Listener at localhost/41661] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/757a468a-9656-cc80-ec19-d6f68f36be5a/mapreduce.cluster.local.dir in system properties and HBase conf 2023-10-04 02:00:08,536 INFO [Listener at localhost/41661] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/757a468a-9656-cc80-ec19-d6f68f36be5a/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-10-04 02:00:08,536 INFO [Listener at localhost/41661] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-10-04 02:00:08,536 INFO [Listener at localhost/41661] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/757a468a-9656-cc80-ec19-d6f68f36be5a/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-10-04 02:00:08,536 INFO [Listener at localhost/41661] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/757a468a-9656-cc80-ec19-d6f68f36be5a/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-10-04 02:00:08,536 INFO [Listener at localhost/41661] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/757a468a-9656-cc80-ec19-d6f68f36be5a/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-10-04 02:00:08,536 INFO [Listener at localhost/41661] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/757a468a-9656-cc80-ec19-d6f68f36be5a/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-10-04 02:00:08,536 INFO [Listener at localhost/41661] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/757a468a-9656-cc80-ec19-d6f68f36be5a/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-10-04 02:00:08,536 INFO [Listener at localhost/41661] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/757a468a-9656-cc80-ec19-d6f68f36be5a/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-10-04 02:00:08,536 INFO [Listener at localhost/41661] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/757a468a-9656-cc80-ec19-d6f68f36be5a/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-10-04 02:00:08,537 INFO [Listener at localhost/41661] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/757a468a-9656-cc80-ec19-d6f68f36be5a/dfs.journalnode.edits.dir in system properties and HBase conf 2023-10-04 02:00:08,537 INFO [Listener at localhost/41661] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/757a468a-9656-cc80-ec19-d6f68f36be5a/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-10-04 02:00:08,537 INFO [Listener at localhost/41661] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/757a468a-9656-cc80-ec19-d6f68f36be5a/nfs.dump.dir in system properties and HBase conf 2023-10-04 02:00:08,537 INFO [Listener at localhost/41661] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/757a468a-9656-cc80-ec19-d6f68f36be5a/java.io.tmpdir in system properties and HBase conf 2023-10-04 02:00:08,537 INFO [Listener at localhost/41661] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/757a468a-9656-cc80-ec19-d6f68f36be5a/dfs.journalnode.edits.dir in system properties and HBase conf 2023-10-04 02:00:08,537 INFO [Listener at localhost/41661] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/757a468a-9656-cc80-ec19-d6f68f36be5a/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-10-04 02:00:08,537 INFO [Listener at localhost/41661] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/757a468a-9656-cc80-ec19-d6f68f36be5a/fs.s3a.committer.staging.tmp.path in system properties and HBase conf 2023-10-04 02:00:08,543 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(866): Instantiated hbase:acl,,1696384808452.efd2d5b3ef87d5ee769a207fc17e879a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-04 02:00:08,543 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1604): Closing efd2d5b3ef87d5ee769a207fc17e879a, disabling compactions & flushes 2023-10-04 02:00:08,543 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1626): Closing region hbase:acl,,1696384808452.efd2d5b3ef87d5ee769a207fc17e879a. 2023-10-04 02:00:08,543 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:acl,,1696384808452.efd2d5b3ef87d5ee769a207fc17e879a. 2023-10-04 02:00:08,543 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1714): Acquired close lock on hbase:acl,,1696384808452.efd2d5b3ef87d5ee769a207fc17e879a. after waiting 0 ms 2023-10-04 02:00:08,543 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1724): Updates disabled for region hbase:acl,,1696384808452.efd2d5b3ef87d5ee769a207fc17e879a. 2023-10-04 02:00:08,543 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1838): Closed hbase:acl,,1696384808452.efd2d5b3ef87d5ee769a207fc17e879a. 2023-10-04 02:00:08,544 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1558): Region close journal for efd2d5b3ef87d5ee769a207fc17e879a: 2023-10-04 02:00:08,549 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_ADD_TO_META 2023-10-04 02:00:08,550 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:acl,,1696384808452.efd2d5b3ef87d5ee769a207fc17e879a.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1696384808550"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696384808550"}]},"ts":"1696384808550"} 2023-10-04 02:00:08,554 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-10-04 02:00:08,555 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-10-04 02:00:08,556 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:acl","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696384808555"}]},"ts":"1696384808555"} 2023-10-04 02:00:08,558 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=hbase:acl, state=ENABLING in hbase:meta 2023-10-04 02:00:08,564 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase9.apache.org=0} racks are {/default-rack=0} 2023-10-04 02:00:08,565 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-10-04 02:00:08,565 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-10-04 02:00:08,565 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-10-04 02:00:08,565 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-10-04 02:00:08,566 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:acl, region=efd2d5b3ef87d5ee769a207fc17e879a, ASSIGN}] 2023-10-04 02:00:08,569 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:acl, region=efd2d5b3ef87d5ee769a207fc17e879a, ASSIGN 2023-10-04 02:00:08,571 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:acl, region=efd2d5b3ef87d5ee769a207fc17e879a, ASSIGN; state=OFFLINE, location=jenkins-hbase9.apache.org,44303,1696384805319; forceNewPlan=false, retain=false 2023-10-04 02:00:08,581 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-10-04 02:00:08,721 INFO [jenkins-hbase9:39651] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-10-04 02:00:08,722 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=efd2d5b3ef87d5ee769a207fc17e879a, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,44303,1696384805319 2023-10-04 02:00:08,723 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:acl,,1696384808452.efd2d5b3ef87d5ee769a207fc17e879a.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1696384808722"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696384808722"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696384808722"}]},"ts":"1696384808722"} 2023-10-04 02:00:08,726 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE; OpenRegionProcedure efd2d5b3ef87d5ee769a207fc17e879a, server=jenkins-hbase9.apache.org,44303,1696384805319}] 2023-10-04 02:00:08,782 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-10-04 02:00:08,889 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(130): Open hbase:acl,,1696384808452.efd2d5b3ef87d5ee769a207fc17e879a. 2023-10-04 02:00:08,890 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => efd2d5b3ef87d5ee769a207fc17e879a, NAME => 'hbase:acl,,1696384808452.efd2d5b3ef87d5ee769a207fc17e879a.', STARTKEY => '', ENDKEY => ''} 2023-10-04 02:00:08,890 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:acl,,1696384808452.efd2d5b3ef87d5ee769a207fc17e879a. service=AccessControlService 2023-10-04 02:00:08,891 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-10-04 02:00:08,891 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table acl efd2d5b3ef87d5ee769a207fc17e879a 2023-10-04 02:00:08,891 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(866): Instantiated hbase:acl,,1696384808452.efd2d5b3ef87d5ee769a207fc17e879a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-04 02:00:08,891 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7894): checking encryption for efd2d5b3ef87d5ee769a207fc17e879a 2023-10-04 02:00:08,891 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7897): checking classloading for efd2d5b3ef87d5ee769a207fc17e879a 2023-10-04 02:00:08,894 INFO [StoreOpener-efd2d5b3ef87d5ee769a207fc17e879a-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family l of region efd2d5b3ef87d5ee769a207fc17e879a 2023-10-04 02:00:08,896 DEBUG [StoreOpener-efd2d5b3ef87d5ee769a207fc17e879a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/data/hbase/acl/efd2d5b3ef87d5ee769a207fc17e879a/l 2023-10-04 02:00:08,897 DEBUG [StoreOpener-efd2d5b3ef87d5ee769a207fc17e879a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/data/hbase/acl/efd2d5b3ef87d5ee769a207fc17e879a/l 2023-10-04 02:00:08,897 INFO [StoreOpener-efd2d5b3ef87d5ee769a207fc17e879a-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region efd2d5b3ef87d5ee769a207fc17e879a columnFamilyName l 2023-10-04 02:00:08,898 INFO [StoreOpener-efd2d5b3ef87d5ee769a207fc17e879a-1] regionserver.HStore(310): Store=efd2d5b3ef87d5ee769a207fc17e879a/l, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-04 02:00:08,901 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/data/hbase/acl/efd2d5b3ef87d5ee769a207fc17e879a 2023-10-04 02:00:08,902 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/data/hbase/acl/efd2d5b3ef87d5ee769a207fc17e879a 2023-10-04 02:00:08,908 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1055): writing seq id for efd2d5b3ef87d5ee769a207fc17e879a 2023-10-04 02:00:08,913 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/data/hbase/acl/efd2d5b3ef87d5ee769a207fc17e879a/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-04 02:00:08,914 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1072): Opened efd2d5b3ef87d5ee769a207fc17e879a; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65196976, jitterRate=-0.028489351272583008}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-10-04 02:00:08,914 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(965): Region open journal for efd2d5b3ef87d5ee769a207fc17e879a: 2023-10-04 02:00:08,916 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:acl,,1696384808452.efd2d5b3ef87d5ee769a207fc17e879a., pid=11, masterSystemTime=1696384808880 2023-10-04 02:00:08,920 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:acl,,1696384808452.efd2d5b3ef87d5ee769a207fc17e879a. 2023-10-04 02:00:08,920 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(158): Opened hbase:acl,,1696384808452.efd2d5b3ef87d5ee769a207fc17e879a. 2023-10-04 02:00:08,921 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=efd2d5b3ef87d5ee769a207fc17e879a, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase9.apache.org,44303,1696384805319 2023-10-04 02:00:08,921 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:acl,,1696384808452.efd2d5b3ef87d5ee769a207fc17e879a.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1696384808920"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1696384808920"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1696384808920"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1696384808920"}]},"ts":"1696384808920"} 2023-10-04 02:00:08,930 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=11, resume processing ppid=10 2023-10-04 02:00:08,930 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=11, ppid=10, state=SUCCESS; OpenRegionProcedure efd2d5b3ef87d5ee769a207fc17e879a, server=jenkins-hbase9.apache.org,44303,1696384805319 in 199 msec 2023-10-04 02:00:08,934 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=10, resume processing ppid=9 2023-10-04 02:00:08,934 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=10, ppid=9, state=SUCCESS; TransitRegionStateProcedure table=hbase:acl, region=efd2d5b3ef87d5ee769a207fc17e879a, ASSIGN in 364 msec 2023-10-04 02:00:08,936 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-10-04 02:00:08,936 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:acl","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696384808936"}]},"ts":"1696384808936"} 2023-10-04 02:00:08,939 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=hbase:acl, state=ENABLED in hbase:meta 2023-10-04 02:00:08,943 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_POST_OPERATION 2023-10-04 02:00:08,948 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=9, state=SUCCESS; CreateTableProcedure table=hbase:acl in 487 msec 2023-10-04 02:00:09,082 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-10-04 02:00:09,082 INFO [master/jenkins-hbase9:0:becomeActiveMaster] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: hbase:acl, procId: 9 completed 2023-10-04 02:00:09,092 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] master.HMaster(1175): Balancer post startup initialization complete, took 0 seconds 2023-10-04 02:00:09,785 WARN [Thread-384] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-10-04 02:00:10,074 INFO [Thread-384] log.Slf4jLog(67): jetty-6.1.26 2023-10-04 02:00:10,082 INFO [Thread-384] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/jobhistory to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/757a468a-9656-cc80-ec19-d6f68f36be5a/java.io.tmpdir/Jetty_jenkins.hbase9_apache_org_33797_jobhistory____.z62687/webapp 2023-10-04 02:00:10,233 INFO [Thread-384] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.mapreduce.v2.hs.webapp.HsWebServices as a root resource class 2023-10-04 02:00:10,234 INFO [Thread-384] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.mapreduce.v2.hs.webapp.JAXBContextResolver as a provider class 2023-10-04 02:00:10,234 INFO [Thread-384] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-10-04 02:00:10,236 INFO [Thread-384] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-10-04 02:00:10,300 INFO [Thread-384] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.mapreduce.v2.hs.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-10-04 02:00:10,554 INFO [Thread-384] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-10-04 02:00:10,785 INFO [Thread-384] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.mapreduce.v2.hs.webapp.HsWebServices to GuiceManagedComponentProvider with the scope "PerRequest" 2023-10-04 02:00:10,807 INFO [Thread-384] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase9.apache.org:33797 2023-10-04 02:00:11,277 WARN [Listener at jenkins-hbase9.apache.org/45277] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-10-04 02:00:11,539 WARN [Listener at jenkins-hbase9.apache.org/45277] servlet.GuiceFilter(87): Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected. 2023-10-04 02:00:11,540 INFO [Listener at jenkins-hbase9.apache.org/45277] log.Slf4jLog(67): jetty-6.1.26 2023-10-04 02:00:11,545 INFO [Listener at jenkins-hbase9.apache.org/45277] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/cluster to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/757a468a-9656-cc80-ec19-d6f68f36be5a/java.io.tmpdir/Jetty_jenkins.hbase9_apache_org_38795_cluster____.1j1iud/webapp 2023-10-04 02:00:11,613 INFO [Listener at jenkins-hbase9.apache.org/45277] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.server.resourcemanager.webapp.JAXBContextResolver as a provider class 2023-10-04 02:00:11,613 INFO [Listener at jenkins-hbase9.apache.org/45277] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.yarn.server.resourcemanager.webapp.RMWebServices as a root resource class 2023-10-04 02:00:11,613 INFO [Listener at jenkins-hbase9.apache.org/45277] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-10-04 02:00:11,614 INFO [Listener at jenkins-hbase9.apache.org/45277] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-10-04 02:00:11,621 INFO [Listener at jenkins-hbase9.apache.org/45277] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.resourcemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-10-04 02:00:11,810 INFO [Listener at jenkins-hbase9.apache.org/45277] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-10-04 02:00:11,933 INFO [Listener at jenkins-hbase9.apache.org/45277] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.resourcemanager.webapp.RMWebServices to GuiceManagedComponentProvider with the scope "Singleton" 2023-10-04 02:00:11,942 INFO [Listener at jenkins-hbase9.apache.org/45277] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase9.apache.org:38795 2023-10-04 02:00:12,414 WARN [Listener at jenkins-hbase9.apache.org/44823] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-10-04 02:00:12,437 WARN [Listener at jenkins-hbase9.apache.org/44823] servlet.GuiceFilter(87): Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected. 2023-10-04 02:00:12,438 INFO [Listener at jenkins-hbase9.apache.org/44823] log.Slf4jLog(67): jetty-6.1.26 2023-10-04 02:00:12,444 INFO [Listener at jenkins-hbase9.apache.org/44823] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/node to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/757a468a-9656-cc80-ec19-d6f68f36be5a/java.io.tmpdir/Jetty_jenkins.hbase9_apache_org_44385_node____6ffq2x/webapp 2023-10-04 02:00:12,529 INFO [Listener at jenkins-hbase9.apache.org/44823] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices as a root resource class 2023-10-04 02:00:12,529 INFO [Listener at jenkins-hbase9.apache.org/44823] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-10-04 02:00:12,529 INFO [Listener at jenkins-hbase9.apache.org/44823] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver as a provider class 2023-10-04 02:00:12,529 INFO [Listener at jenkins-hbase9.apache.org/44823] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-10-04 02:00:12,536 INFO [Listener at jenkins-hbase9.apache.org/44823] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-10-04 02:00:12,554 INFO [Listener at jenkins-hbase9.apache.org/44823] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-10-04 02:00:12,616 INFO [Listener at jenkins-hbase9.apache.org/44823] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices to GuiceManagedComponentProvider with the scope "Singleton" 2023-10-04 02:00:12,624 INFO [Listener at jenkins-hbase9.apache.org/44823] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase9.apache.org:44385 2023-10-04 02:00:12,768 WARN [Listener at jenkins-hbase9.apache.org/33899] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-10-04 02:00:12,773 WARN [Listener at jenkins-hbase9.apache.org/33899] servlet.GuiceFilter(87): Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected. 2023-10-04 02:00:12,774 INFO [Listener at jenkins-hbase9.apache.org/33899] log.Slf4jLog(67): jetty-6.1.26 2023-10-04 02:00:12,779 INFO [Listener at jenkins-hbase9.apache.org/33899] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/node to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/757a468a-9656-cc80-ec19-d6f68f36be5a/java.io.tmpdir/Jetty_jenkins.hbase9_apache_org_37543_node____v16jjd/webapp 2023-10-04 02:00:12,833 INFO [Listener at jenkins-hbase9.apache.org/33899] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices as a root resource class 2023-10-04 02:00:12,833 INFO [Listener at jenkins-hbase9.apache.org/33899] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-10-04 02:00:12,833 INFO [Listener at jenkins-hbase9.apache.org/33899] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver as a provider class 2023-10-04 02:00:12,833 INFO [Listener at jenkins-hbase9.apache.org/33899] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-10-04 02:00:12,840 INFO [Listener at jenkins-hbase9.apache.org/33899] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-10-04 02:00:12,851 INFO [Listener at jenkins-hbase9.apache.org/33899] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-10-04 02:00:12,906 INFO [Listener at jenkins-hbase9.apache.org/33899] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices to GuiceManagedComponentProvider with the scope "Singleton" 2023-10-04 02:00:12,910 INFO [Listener at jenkins-hbase9.apache.org/33899] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase9.apache.org:37543 2023-10-04 02:00:12,932 INFO [Listener at jenkins-hbase9.apache.org/33899] hbase.HBaseTestingUtility(2726): Mini mapreduce cluster started 2023-10-04 02:00:12,934 INFO [Listener at jenkins-hbase9.apache.org/33899] hbase.Waiter(180): Waiting up to [30,000] milli-secs(wait.for.ratio=[1]) 2023-10-04 02:00:12,994 INFO [Listener at jenkins-hbase9.apache.org/33899] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testExportWithTargetName Thread=702, OpenFileDescriptor=902, MaxFileDescriptor=60000, SystemLoadAverage=222, ProcessCount=165, AvailableMemoryMB=11900 2023-10-04 02:00:12,994 WARN [Listener at jenkins-hbase9.apache.org/33899] hbase.ResourceChecker(130): Thread=702 is superior to 500 2023-10-04 02:00:12,996 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-10-04 02:00:13,024 DEBUG [Listener at jenkins-hbase9.apache.org/33899] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-10-04 02:00:13,030 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:59460, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-10-04 02:00:13,038 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39651] master.HMaster$4(2112): Client=jenkins//172.31.2.10 create 'testtb-testExportWithTargetName', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-10-04 02:00:13,041 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39651] procedure2.ProcedureExecutor(1028): Stored pid=12, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportWithTargetName 2023-10-04 02:00:13,044 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_PRE_OPERATION 2023-10-04 02:00:13,045 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39651] master.MasterRpcServices(700): Client=jenkins//172.31.2.10 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportWithTargetName" procId is: 12 2023-10-04 02:00:13,049 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-10-04 02:00:13,053 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39651] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-10-04 02:00:13,061 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/.tmp/data/default/testtb-testExportWithTargetName/5de56d0448b25922e7a6d562d9fb2f8c 2023-10-04 02:00:13,061 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/.tmp/data/default/testtb-testExportWithTargetName/66724f2ee238f5ca8201ddf6308997b3 2023-10-04 02:00:13,063 DEBUG [HFileArchiver-3] backup.HFileArchiver(153): Directory hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/.tmp/data/default/testtb-testExportWithTargetName/5de56d0448b25922e7a6d562d9fb2f8c empty. 2023-10-04 02:00:13,063 DEBUG [HFileArchiver-4] backup.HFileArchiver(153): Directory hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/.tmp/data/default/testtb-testExportWithTargetName/66724f2ee238f5ca8201ddf6308997b3 empty. 2023-10-04 02:00:13,065 DEBUG [HFileArchiver-3] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/.tmp/data/default/testtb-testExportWithTargetName/5de56d0448b25922e7a6d562d9fb2f8c 2023-10-04 02:00:13,065 DEBUG [HFileArchiver-4] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/.tmp/data/default/testtb-testExportWithTargetName/66724f2ee238f5ca8201ddf6308997b3 2023-10-04 02:00:13,065 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testExportWithTargetName regions 2023-10-04 02:00:13,128 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/.tmp/data/default/testtb-testExportWithTargetName/.tabledesc/.tableinfo.0000000001 2023-10-04 02:00:13,134 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(7675): creating {ENCODED => 66724f2ee238f5ca8201ddf6308997b3, NAME => 'testtb-testExportWithTargetName,1,1696384813038.66724f2ee238f5ca8201ddf6308997b3.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportWithTargetName', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/.tmp 2023-10-04 02:00:13,134 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(7675): creating {ENCODED => 5de56d0448b25922e7a6d562d9fb2f8c, NAME => 'testtb-testExportWithTargetName,,1696384813038.5de56d0448b25922e7a6d562d9fb2f8c.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportWithTargetName', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/.tmp 2023-10-04 02:00:13,159 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39651] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-10-04 02:00:13,191 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,,1696384813038.5de56d0448b25922e7a6d562d9fb2f8c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-04 02:00:13,191 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,1,1696384813038.66724f2ee238f5ca8201ddf6308997b3.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-04 02:00:13,193 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1604): Closing 5de56d0448b25922e7a6d562d9fb2f8c, disabling compactions & flushes 2023-10-04 02:00:13,193 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1604): Closing 66724f2ee238f5ca8201ddf6308997b3, disabling compactions & flushes 2023-10-04 02:00:13,193 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,,1696384813038.5de56d0448b25922e7a6d562d9fb2f8c. 2023-10-04 02:00:13,193 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,1,1696384813038.66724f2ee238f5ca8201ddf6308997b3. 2023-10-04 02:00:13,193 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,,1696384813038.5de56d0448b25922e7a6d562d9fb2f8c. 2023-10-04 02:00:13,193 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,1,1696384813038.66724f2ee238f5ca8201ddf6308997b3. 2023-10-04 02:00:13,194 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,,1696384813038.5de56d0448b25922e7a6d562d9fb2f8c. after waiting 0 ms 2023-10-04 02:00:13,194 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,1,1696384813038.66724f2ee238f5ca8201ddf6308997b3. after waiting 0 ms 2023-10-04 02:00:13,194 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,,1696384813038.5de56d0448b25922e7a6d562d9fb2f8c. 2023-10-04 02:00:13,194 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,1,1696384813038.66724f2ee238f5ca8201ddf6308997b3. 2023-10-04 02:00:13,194 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,,1696384813038.5de56d0448b25922e7a6d562d9fb2f8c. 2023-10-04 02:00:13,194 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,1,1696384813038.66724f2ee238f5ca8201ddf6308997b3. 2023-10-04 02:00:13,194 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1558): Region close journal for 5de56d0448b25922e7a6d562d9fb2f8c: 2023-10-04 02:00:13,194 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1558): Region close journal for 66724f2ee238f5ca8201ddf6308997b3: 2023-10-04 02:00:13,204 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_ADD_TO_META 2023-10-04 02:00:13,209 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,,1696384813038.5de56d0448b25922e7a6d562d9fb2f8c.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1696384813205"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696384813205"}]},"ts":"1696384813205"} 2023-10-04 02:00:13,210 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,1,1696384813038.66724f2ee238f5ca8201ddf6308997b3.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1696384813205"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696384813205"}]},"ts":"1696384813205"} 2023-10-04 02:00:13,228 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:meta' 2023-10-04 02:00:13,230 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:acl' 2023-10-04 02:00:13,231 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:namespace' 2023-10-04 02:00:13,268 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-10-04 02:00:13,270 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-10-04 02:00:13,270 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696384813270"}]},"ts":"1696384813270"} 2023-10-04 02:00:13,272 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=ENABLING in hbase:meta 2023-10-04 02:00:13,277 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase9.apache.org=0} racks are {/default-rack=0} 2023-10-04 02:00:13,279 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-10-04 02:00:13,279 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-10-04 02:00:13,279 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-10-04 02:00:13,279 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-10-04 02:00:13,280 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=5de56d0448b25922e7a6d562d9fb2f8c, ASSIGN}, {pid=14, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=66724f2ee238f5ca8201ddf6308997b3, ASSIGN}] 2023-10-04 02:00:13,283 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=14, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=66724f2ee238f5ca8201ddf6308997b3, ASSIGN 2023-10-04 02:00:13,283 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=5de56d0448b25922e7a6d562d9fb2f8c, ASSIGN 2023-10-04 02:00:13,284 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=14, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=66724f2ee238f5ca8201ddf6308997b3, ASSIGN; state=OFFLINE, location=jenkins-hbase9.apache.org,35175,1696384805436; forceNewPlan=false, retain=false 2023-10-04 02:00:13,284 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=5de56d0448b25922e7a6d562d9fb2f8c, ASSIGN; state=OFFLINE, location=jenkins-hbase9.apache.org,44303,1696384805319; forceNewPlan=false, retain=false 2023-10-04 02:00:13,362 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39651] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-10-04 02:00:13,434 INFO [jenkins-hbase9:39651] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-10-04 02:00:13,437 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=66724f2ee238f5ca8201ddf6308997b3, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,35175,1696384805436 2023-10-04 02:00:13,437 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=5de56d0448b25922e7a6d562d9fb2f8c, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,44303,1696384805319 2023-10-04 02:00:13,437 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,1,1696384813038.66724f2ee238f5ca8201ddf6308997b3.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1696384813437"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696384813437"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696384813437"}]},"ts":"1696384813437"} 2023-10-04 02:00:13,437 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,,1696384813038.5de56d0448b25922e7a6d562d9fb2f8c.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1696384813437"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696384813437"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696384813437"}]},"ts":"1696384813437"} 2023-10-04 02:00:13,440 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=15, ppid=14, state=RUNNABLE; OpenRegionProcedure 66724f2ee238f5ca8201ddf6308997b3, server=jenkins-hbase9.apache.org,35175,1696384805436}] 2023-10-04 02:00:13,441 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=16, ppid=13, state=RUNNABLE; OpenRegionProcedure 5de56d0448b25922e7a6d562d9fb2f8c, server=jenkins-hbase9.apache.org,44303,1696384805319}] 2023-10-04 02:00:13,599 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(130): Open testtb-testExportWithTargetName,,1696384813038.5de56d0448b25922e7a6d562d9fb2f8c. 2023-10-04 02:00:13,599 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(130): Open testtb-testExportWithTargetName,1,1696384813038.66724f2ee238f5ca8201ddf6308997b3. 2023-10-04 02:00:13,600 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 5de56d0448b25922e7a6d562d9fb2f8c, NAME => 'testtb-testExportWithTargetName,,1696384813038.5de56d0448b25922e7a6d562d9fb2f8c.', STARTKEY => '', ENDKEY => '1'} 2023-10-04 02:00:13,600 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 66724f2ee238f5ca8201ddf6308997b3, NAME => 'testtb-testExportWithTargetName,1,1696384813038.66724f2ee238f5ca8201ddf6308997b3.', STARTKEY => '1', ENDKEY => ''} 2023-10-04 02:00:13,600 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportWithTargetName,1,1696384813038.66724f2ee238f5ca8201ddf6308997b3. service=AccessControlService 2023-10-04 02:00:13,600 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportWithTargetName,,1696384813038.5de56d0448b25922e7a6d562d9fb2f8c. service=AccessControlService 2023-10-04 02:00:13,600 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-10-04 02:00:13,600 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-10-04 02:00:13,600 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportWithTargetName 66724f2ee238f5ca8201ddf6308997b3 2023-10-04 02:00:13,601 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportWithTargetName 5de56d0448b25922e7a6d562d9fb2f8c 2023-10-04 02:00:13,601 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,1,1696384813038.66724f2ee238f5ca8201ddf6308997b3.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-04 02:00:13,601 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,,1696384813038.5de56d0448b25922e7a6d562d9fb2f8c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-04 02:00:13,601 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7894): checking encryption for 66724f2ee238f5ca8201ddf6308997b3 2023-10-04 02:00:13,601 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7894): checking encryption for 5de56d0448b25922e7a6d562d9fb2f8c 2023-10-04 02:00:13,601 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7897): checking classloading for 66724f2ee238f5ca8201ddf6308997b3 2023-10-04 02:00:13,601 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7897): checking classloading for 5de56d0448b25922e7a6d562d9fb2f8c 2023-10-04 02:00:13,605 INFO [StoreOpener-5de56d0448b25922e7a6d562d9fb2f8c-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 5de56d0448b25922e7a6d562d9fb2f8c 2023-10-04 02:00:13,605 INFO [StoreOpener-66724f2ee238f5ca8201ddf6308997b3-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 66724f2ee238f5ca8201ddf6308997b3 2023-10-04 02:00:13,608 DEBUG [StoreOpener-66724f2ee238f5ca8201ddf6308997b3-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/data/default/testtb-testExportWithTargetName/66724f2ee238f5ca8201ddf6308997b3/cf 2023-10-04 02:00:13,608 DEBUG [StoreOpener-66724f2ee238f5ca8201ddf6308997b3-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/data/default/testtb-testExportWithTargetName/66724f2ee238f5ca8201ddf6308997b3/cf 2023-10-04 02:00:13,608 DEBUG [StoreOpener-5de56d0448b25922e7a6d562d9fb2f8c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/data/default/testtb-testExportWithTargetName/5de56d0448b25922e7a6d562d9fb2f8c/cf 2023-10-04 02:00:13,608 DEBUG [StoreOpener-5de56d0448b25922e7a6d562d9fb2f8c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/data/default/testtb-testExportWithTargetName/5de56d0448b25922e7a6d562d9fb2f8c/cf 2023-10-04 02:00:13,612 INFO [StoreOpener-66724f2ee238f5ca8201ddf6308997b3-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 66724f2ee238f5ca8201ddf6308997b3 columnFamilyName cf 2023-10-04 02:00:13,612 INFO [StoreOpener-5de56d0448b25922e7a6d562d9fb2f8c-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 5de56d0448b25922e7a6d562d9fb2f8c columnFamilyName cf 2023-10-04 02:00:13,616 INFO [StoreOpener-66724f2ee238f5ca8201ddf6308997b3-1] regionserver.HStore(310): Store=66724f2ee238f5ca8201ddf6308997b3/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-04 02:00:13,617 INFO [StoreOpener-5de56d0448b25922e7a6d562d9fb2f8c-1] regionserver.HStore(310): Store=5de56d0448b25922e7a6d562d9fb2f8c/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-04 02:00:13,622 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/data/default/testtb-testExportWithTargetName/5de56d0448b25922e7a6d562d9fb2f8c 2023-10-04 02:00:13,623 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/data/default/testtb-testExportWithTargetName/66724f2ee238f5ca8201ddf6308997b3 2023-10-04 02:00:13,624 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/data/default/testtb-testExportWithTargetName/66724f2ee238f5ca8201ddf6308997b3 2023-10-04 02:00:13,624 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/data/default/testtb-testExportWithTargetName/5de56d0448b25922e7a6d562d9fb2f8c 2023-10-04 02:00:13,629 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1055): writing seq id for 5de56d0448b25922e7a6d562d9fb2f8c 2023-10-04 02:00:13,637 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/data/default/testtb-testExportWithTargetName/5de56d0448b25922e7a6d562d9fb2f8c/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-04 02:00:13,638 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1055): writing seq id for 66724f2ee238f5ca8201ddf6308997b3 2023-10-04 02:00:13,638 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1072): Opened 5de56d0448b25922e7a6d562d9fb2f8c; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72082992, jitterRate=0.07412028312683105}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-10-04 02:00:13,638 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(965): Region open journal for 5de56d0448b25922e7a6d562d9fb2f8c: 2023-10-04 02:00:13,641 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportWithTargetName,,1696384813038.5de56d0448b25922e7a6d562d9fb2f8c., pid=16, masterSystemTime=1696384813594 2023-10-04 02:00:13,643 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/data/default/testtb-testExportWithTargetName/66724f2ee238f5ca8201ddf6308997b3/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-04 02:00:13,644 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportWithTargetName,,1696384813038.5de56d0448b25922e7a6d562d9fb2f8c. 2023-10-04 02:00:13,644 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1072): Opened 66724f2ee238f5ca8201ddf6308997b3; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=75329540, jitterRate=0.12249761819839478}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-10-04 02:00:13,644 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportWithTargetName,,1696384813038.5de56d0448b25922e7a6d562d9fb2f8c. 2023-10-04 02:00:13,644 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(965): Region open journal for 66724f2ee238f5ca8201ddf6308997b3: 2023-10-04 02:00:13,645 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportWithTargetName,1,1696384813038.66724f2ee238f5ca8201ddf6308997b3., pid=15, masterSystemTime=1696384813593 2023-10-04 02:00:13,646 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=5de56d0448b25922e7a6d562d9fb2f8c, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase9.apache.org,44303,1696384805319 2023-10-04 02:00:13,646 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportWithTargetName,,1696384813038.5de56d0448b25922e7a6d562d9fb2f8c.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1696384813646"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1696384813646"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1696384813646"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1696384813646"}]},"ts":"1696384813646"} 2023-10-04 02:00:13,649 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportWithTargetName,1,1696384813038.66724f2ee238f5ca8201ddf6308997b3. 2023-10-04 02:00:13,649 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportWithTargetName,1,1696384813038.66724f2ee238f5ca8201ddf6308997b3. 2023-10-04 02:00:13,650 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=66724f2ee238f5ca8201ddf6308997b3, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase9.apache.org,35175,1696384805436 2023-10-04 02:00:13,651 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportWithTargetName,1,1696384813038.66724f2ee238f5ca8201ddf6308997b3.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1696384813650"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1696384813650"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1696384813650"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1696384813650"}]},"ts":"1696384813650"} 2023-10-04 02:00:13,653 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=16, resume processing ppid=13 2023-10-04 02:00:13,653 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=16, ppid=13, state=SUCCESS; OpenRegionProcedure 5de56d0448b25922e7a6d562d9fb2f8c, server=jenkins-hbase9.apache.org,44303,1696384805319 in 208 msec 2023-10-04 02:00:13,655 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=13, ppid=12, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=5de56d0448b25922e7a6d562d9fb2f8c, ASSIGN in 373 msec 2023-10-04 02:00:13,658 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=15, resume processing ppid=14 2023-10-04 02:00:13,658 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=15, ppid=14, state=SUCCESS; OpenRegionProcedure 66724f2ee238f5ca8201ddf6308997b3, server=jenkins-hbase9.apache.org,35175,1696384805436 in 214 msec 2023-10-04 02:00:13,661 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=14, resume processing ppid=12 2023-10-04 02:00:13,661 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=14, ppid=12, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=66724f2ee238f5ca8201ddf6308997b3, ASSIGN in 378 msec 2023-10-04 02:00:13,662 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-10-04 02:00:13,662 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696384813662"}]},"ts":"1696384813662"} 2023-10-04 02:00:13,663 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39651] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-10-04 02:00:13,664 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=ENABLED in hbase:meta 2023-10-04 02:00:13,667 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_POST_OPERATION 2023-10-04 02:00:13,672 DEBUG [PEWorker-5] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportWithTargetName jenkins: RWXCA 2023-10-04 02:00:13,690 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=44303] access.PermissionStorage(611): Read acl: entry[testtb-testExportWithTargetName], kv [jenkins: RWXCA] 2023-10-04 02:00:13,723 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): regionserver:39045-0x1010f1b55330002, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-10-04 02:00:13,723 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): regionserver:35175-0x1010f1b55330003, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-10-04 02:00:13,723 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): master:39651-0x1010f1b55330000, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-10-04 02:00:13,723 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): master:39651-0x1010f1b55330000, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-10-04 02:00:13,723 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): regionserver:44303-0x1010f1b55330001, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-10-04 02:00:13,732 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-10-04 02:00:13,732 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-10-04 02:00:13,732 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-10-04 02:00:13,732 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-10-04 02:00:13,735 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=12, state=SUCCESS; CreateTableProcedure table=testtb-testExportWithTargetName in 694 msec 2023-10-04 02:00:14,165 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39651] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-10-04 02:00:14,166 INFO [Listener at jenkins-hbase9.apache.org/33899] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportWithTargetName, procId: 12 completed 2023-10-04 02:00:14,170 DEBUG [Listener at jenkins-hbase9.apache.org/33899] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportWithTargetName 2023-10-04 02:00:14,172 DEBUG [Listener at jenkins-hbase9.apache.org/33899] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportWithTargetName,,1696384813038.5de56d0448b25922e7a6d562d9fb2f8c. 2023-10-04 02:00:14,174 INFO [Listener at jenkins-hbase9.apache.org/33899] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-10-04 02:00:14,185 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.RegionServer.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-10-04 02:00:14,186 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.RegionServer.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase RegionServerObservers 2023-10-04 02:00:14,186 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-10-04 02:00:14,186 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase MasterObservers 2023-10-04 02:00:14,187 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver 2023-10-04 02:00:14,187 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver Metrics about HBase MasterObservers 2023-10-04 02:00:14,187 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-10-04 02:00:14,187 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase RegionObservers 2023-10-04 02:00:14,187 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-10-04 02:00:14,187 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint Metrics about HBase RegionObservers 2023-10-04 02:00:14,202 DEBUG [hconnection-0x4d455589-shared-pool-5] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-04 02:00:14,206 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:58892, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-04 02:00:14,225 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39651] master.MasterRpcServices(1583): Client=jenkins//172.31.2.10 snapshot request for:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-10-04 02:00:14,225 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39651] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1696384814225 (current time:1696384814225). 2023-10-04 02:00:14,226 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39651] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-10-04 02:00:14,227 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39651] zookeeper.ReadOnlyZKClient(139): Connect 0x7873024c to 127.0.0.1:60027 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-04 02:00:14,234 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39651] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3ddf4d92, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-04 02:00:14,236 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39651] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-04 02:00:14,239 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:57054, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-04 02:00:14,240 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39651] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7873024c to 127.0.0.1:60027 2023-10-04 02:00:14,240 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39651] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-04 02:00:14,243 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39651] zookeeper.ReadOnlyZKClient(139): Connect 0x28fd229b to 127.0.0.1:60027 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-04 02:00:14,251 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39651] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@550012e4, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-04 02:00:14,254 DEBUG [hconnection-0x4c327dad-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-04 02:00:14,257 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:57056, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-04 02:00:14,263 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39651] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x28fd229b to 127.0.0.1:60027 2023-10-04 02:00:14,263 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39651] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-04 02:00:14,263 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39651] access.PermissionStorage(611): Read acl: entry[testtb-testExportWithTargetName], kv [jenkins: RWXCA] 2023-10-04 02:00:14,286 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39651] snapshot.SnapshotManager(637): No existing snapshot, attempting snapshot... 2023-10-04 02:00:14,286 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39651] snapshot.SnapshotManager(684): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-10-04 02:00:14,298 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39651] snapshot.SnapshotManager(519): Unable to retrieve ACL status for path: hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/.hbase-snapshot, current working dir path: hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName org.apache.hadoop.hdfs.protocol.AclException: The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.ipc.RemoteException.instantiateException(RemoteException.java:121) at org.apache.hadoop.ipc.RemoteException.unwrapRemoteException(RemoteException.java:88) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2736) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2294) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2291) at org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81) at org.apache.hadoop.hdfs.DistributedFileSystem.getAclStatus(DistributedFileSystem.java:2291) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.updateWorkingDirAclsIfRequired(SnapshotManager.java:517) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.prepareToTakeSnapshot(SnapshotManager.java:490) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.snapshotEnabledTable(SnapshotManager.java:559) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshotInternal(SnapshotManager.java:687) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshot(SnapshotManager.java:623) at org.apache.hadoop.hbase.master.MasterRpcServices.snapshot(MasterRpcServices.java:1588) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) Caused by: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.hdfs.protocol.AclException): The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at org.apache.hadoop.ipc.Client.getRpcResponse(Client.java:1540) at org.apache.hadoop.ipc.Client.call(Client.java:1486) at org.apache.hadoop.ipc.Client.call(Client.java:1385) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:232) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:118) at com.sun.proxy.$Proxy32.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.getAclStatus(ClientNamenodeProtocolTranslatorPB.java:1385) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:422) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeMethod(RetryInvocationHandler.java:165) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invoke(RetryInvocationHandler.java:157) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeOnce(RetryInvocationHandler.java:95) at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:359) at com.sun.proxy.$Proxy35.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2734) ... 15 more 2023-10-04 02:00:14,318 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39651] procedure2.ProcedureExecutor(1028): Stored pid=17, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-10-04 02:00:14,320 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=17, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-10-04 02:00:14,321 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=17, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE; timeout=600000, timestamp=1696385414321 2023-10-04 02:00:14,321 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39651] snapshot.SnapshotManager(689): Started snapshot: { ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-10-04 02:00:14,321 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName 2023-10-04 02:00:14,325 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=17, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-10-04 02:00:14,326 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] procedure2.ProcedureExecutor(1028): Stored pid=18, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-10-04 02:00:14,327 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=17, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE in 14 msec 2023-10-04 02:00:14,328 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=18, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-10-04 02:00:14,329 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=18, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED; timeout=600000, timestamp=1696385414329 2023-10-04 02:00:14,330 DEBUG [Listener at jenkins-hbase9.apache.org/33899] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-10-04 02:00:14,330 DEBUG [Listener at jenkins-hbase9.apache.org/33899] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-10-04 02:00:14,357 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportWithTargetName 2023-10-04 02:00:14,358 INFO [(jenkins-hbase9.apache.org,39651,1696384803959)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportWithTargetName' 2023-10-04 02:00:14,358 DEBUG [(jenkins-hbase9.apache.org,39651,1696384803959)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-04 02:00:14,359 DEBUG [(jenkins-hbase9.apache.org,39651,1696384803959)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' 2023-10-04 02:00:14,359 DEBUG [(jenkins-hbase9.apache.org,39651,1696384803959)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportWithTargetName', kicking off acquire phase on members. 2023-10-04 02:00:14,359 DEBUG [(jenkins-hbase9.apache.org,39651,1696384803959)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39651-0x1010f1b55330000, quorum=127.0.0.1:60027, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-10-04 02:00:14,360 DEBUG [(jenkins-hbase9.apache.org,39651,1696384803959)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-10-04 02:00:14,368 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): regionserver:39045-0x1010f1b55330002, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-04 02:00:14,368 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): regionserver:44303-0x1010f1b55330001, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-04 02:00:14,368 DEBUG [(jenkins-hbase9.apache.org,39651,1696384803959)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,35175,1696384805436 2023-10-04 02:00:14,368 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): regionserver:35175-0x1010f1b55330003, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-04 02:00:14,368 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-04 02:00:14,368 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-04 02:00:14,368 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-04 02:00:14,368 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-04 02:00:14,368 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-04 02:00:14,369 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-04 02:00:14,369 DEBUG [(jenkins-hbase9.apache.org,39651,1696384803959)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39651-0x1010f1b55330000, quorum=127.0.0.1:60027, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,35175,1696384805436 2023-10-04 02:00:14,369 DEBUG [(jenkins-hbase9.apache.org,39651,1696384803959)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,44303,1696384805319 2023-10-04 02:00:14,369 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-10-04 02:00:14,369 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-10-04 02:00:14,369 DEBUG [(jenkins-hbase9.apache.org,39651,1696384803959)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39651-0x1010f1b55330000, quorum=127.0.0.1:60027, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,44303,1696384805319 2023-10-04 02:00:14,370 DEBUG [(jenkins-hbase9.apache.org,39651,1696384803959)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-04 02:00:14,369 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-10-04 02:00:14,370 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35175-0x1010f1b55330003, quorum=127.0.0.1:60027, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-10-04 02:00:14,370 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44303-0x1010f1b55330001, quorum=127.0.0.1:60027, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-10-04 02:00:14,372 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39045-0x1010f1b55330002, quorum=127.0.0.1:60027, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-10-04 02:00:14,372 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 171 2023-10-04 02:00:14,372 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 171 2023-10-04 02:00:14,373 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-10-04 02:00:14,372 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-10-04 02:00:14,373 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 171 2023-10-04 02:00:14,373 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-10-04 02:00:14,374 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-10-04 02:00:14,374 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-10-04 02:00:14,374 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-10-04 02:00:14,377 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportWithTargetName 2023-10-04 02:00:14,377 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportWithTargetName 2023-10-04 02:00:14,377 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportWithTargetName 2023-10-04 02:00:14,377 DEBUG [member: 'jenkins-hbase9.apache.org,44303,1696384805319' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportWithTargetName' with timeout 300000ms 2023-10-04 02:00:14,377 DEBUG [member: 'jenkins-hbase9.apache.org,44303,1696384805319' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-04 02:00:14,377 DEBUG [member: 'jenkins-hbase9.apache.org,39045,1696384805392' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportWithTargetName' with timeout 300000ms 2023-10-04 02:00:14,378 DEBUG [member: 'jenkins-hbase9.apache.org,44303,1696384805319' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' stage 2023-10-04 02:00:14,378 DEBUG [member: 'jenkins-hbase9.apache.org,39045,1696384805392' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-04 02:00:14,378 DEBUG [member: 'jenkins-hbase9.apache.org,44303,1696384805319' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally acquired 2023-10-04 02:00:14,377 DEBUG [member: 'jenkins-hbase9.apache.org,35175,1696384805436' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportWithTargetName' with timeout 300000ms 2023-10-04 02:00:14,379 DEBUG [member: 'jenkins-hbase9.apache.org,44303,1696384805319' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,44303,1696384805319' joining acquired barrier for procedure (emptySnaptb0-testExportWithTargetName) in zk 2023-10-04 02:00:14,379 DEBUG [member: 'jenkins-hbase9.apache.org,39045,1696384805392' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' stage 2023-10-04 02:00:14,379 DEBUG [member: 'jenkins-hbase9.apache.org,39045,1696384805392' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally acquired 2023-10-04 02:00:14,379 DEBUG [member: 'jenkins-hbase9.apache.org,35175,1696384805436' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-04 02:00:14,379 DEBUG [member: 'jenkins-hbase9.apache.org,39045,1696384805392' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,39045,1696384805392' joining acquired barrier for procedure (emptySnaptb0-testExportWithTargetName) in zk 2023-10-04 02:00:14,380 DEBUG [member: 'jenkins-hbase9.apache.org,35175,1696384805436' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' stage 2023-10-04 02:00:14,380 DEBUG [member: 'jenkins-hbase9.apache.org,35175,1696384805436' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally acquired 2023-10-04 02:00:14,380 DEBUG [member: 'jenkins-hbase9.apache.org,35175,1696384805436' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,35175,1696384805436' joining acquired barrier for procedure (emptySnaptb0-testExportWithTargetName) in zk 2023-10-04 02:00:14,382 DEBUG [member: 'jenkins-hbase9.apache.org,44303,1696384805319' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-10-04 02:00:14,382 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): master:39651-0x1010f1b55330000, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,44303,1696384805319 2023-10-04 02:00:14,382 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,44303,1696384805319 2023-10-04 02:00:14,382 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-04 02:00:14,382 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-04 02:00:14,383 DEBUG [member: 'jenkins-hbase9.apache.org,39045,1696384805392' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-10-04 02:00:14,383 DEBUG [member: 'jenkins-hbase9.apache.org,35175,1696384805436' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-10-04 02:00:14,383 DEBUG [member: 'jenkins-hbase9.apache.org,44303,1696384805319' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44303-0x1010f1b55330001, quorum=127.0.0.1:60027, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-10-04 02:00:14,383 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-04 02:00:14,383 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): master:39651-0x1010f1b55330000, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,35175,1696384805436 2023-10-04 02:00:14,383 DEBUG [member: 'jenkins-hbase9.apache.org,44303,1696384805319' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-04 02:00:14,383 DEBUG [member: 'jenkins-hbase9.apache.org,35175,1696384805436' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35175-0x1010f1b55330003, quorum=127.0.0.1:60027, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-10-04 02:00:14,384 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-04 02:00:14,384 DEBUG [member: 'jenkins-hbase9.apache.org,39045,1696384805392' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39045-0x1010f1b55330002, quorum=127.0.0.1:60027, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-10-04 02:00:14,384 DEBUG [member: 'jenkins-hbase9.apache.org,39045,1696384805392' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-04 02:00:14,384 DEBUG [member: 'jenkins-hbase9.apache.org,35175,1696384805436' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-04 02:00:14,384 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-10-04 02:00:14,385 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,39045,1696384805392 2023-10-04 02:00:14,385 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,35175,1696384805436 2023-10-04 02:00:14,385 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44303,1696384805319 2023-10-04 02:00:14,386 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-04 02:00:14,386 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,44303,1696384805319' joining acquired barrier for procedure 'emptySnaptb0-testExportWithTargetName' on coordinator 2023-10-04 02:00:14,386 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@26c6d7d2[Count = 1] remaining members to acquire global barrier 2023-10-04 02:00:14,386 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,35175,1696384805436 2023-10-04 02:00:14,386 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-04 02:00:14,386 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-04 02:00:14,387 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-04 02:00:14,387 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-04 02:00:14,387 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-10-04 02:00:14,388 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,39045,1696384805392 2023-10-04 02:00:14,388 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,35175,1696384805436 2023-10-04 02:00:14,388 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44303,1696384805319 2023-10-04 02:00:14,389 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-04 02:00:14,389 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,35175,1696384805436' joining acquired barrier for procedure 'emptySnaptb0-testExportWithTargetName' on coordinator 2023-10-04 02:00:14,389 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@26c6d7d2[Count = 0] remaining members to acquire global barrier 2023-10-04 02:00:14,389 DEBUG [(jenkins-hbase9.apache.org,39651,1696384803959)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportWithTargetName' starting 'in-barrier' execution. 2023-10-04 02:00:14,389 DEBUG [(jenkins-hbase9.apache.org,39651,1696384803959)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-10-04 02:00:14,393 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): regionserver:35175-0x1010f1b55330003, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-10-04 02:00:14,393 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): regionserver:39045-0x1010f1b55330002, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-10-04 02:00:14,393 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-10-04 02:00:14,393 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-10-04 02:00:14,393 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-10-04 02:00:14,393 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): regionserver:44303-0x1010f1b55330001, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-10-04 02:00:14,393 DEBUG [member: 'jenkins-hbase9.apache.org,39045,1696384805392' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-10-04 02:00:14,393 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-10-04 02:00:14,393 DEBUG [member: 'jenkins-hbase9.apache.org,39045,1696384805392' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally completed 2023-10-04 02:00:14,393 DEBUG [(jenkins-hbase9.apache.org,39651,1696384803959)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39651-0x1010f1b55330000, quorum=127.0.0.1:60027, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,44303,1696384805319 2023-10-04 02:00:14,393 DEBUG [member: 'jenkins-hbase9.apache.org,39045,1696384805392' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportWithTargetName' completed for member 'jenkins-hbase9.apache.org,39045,1696384805392' in zk 2023-10-04 02:00:14,393 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-10-04 02:00:14,393 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-10-04 02:00:14,394 DEBUG [member: 'jenkins-hbase9.apache.org,44303,1696384805319' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-10-04 02:00:14,394 DEBUG [member: 'jenkins-hbase9.apache.org,35175,1696384805436' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-10-04 02:00:14,394 DEBUG [(jenkins-hbase9.apache.org,39651,1696384803959)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39651-0x1010f1b55330000, quorum=127.0.0.1:60027, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,35175,1696384805436 2023-10-04 02:00:14,394 DEBUG [(jenkins-hbase9.apache.org,39651,1696384803959)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-04 02:00:14,401 DEBUG [member: 'jenkins-hbase9.apache.org,35175,1696384805436' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-04 02:00:14,401 DEBUG [rs(jenkins-hbase9.apache.org,35175,1696384805436)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,1,1696384813038.66724f2ee238f5ca8201ddf6308997b3. 2023-10-04 02:00:14,401 DEBUG [rs(jenkins-hbase9.apache.org,44303,1696384805319)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,,1696384813038.5de56d0448b25922e7a6d562d9fb2f8c. 2023-10-04 02:00:14,401 DEBUG [member: 'jenkins-hbase9.apache.org,44303,1696384805319' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-04 02:00:14,402 DEBUG [member: 'jenkins-hbase9.apache.org,44303,1696384805319' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-04 02:00:14,401 DEBUG [member: 'jenkins-hbase9.apache.org,39045,1696384805392' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportWithTargetName' has notified controller of completion 2023-10-04 02:00:14,401 DEBUG [member: 'jenkins-hbase9.apache.org,35175,1696384805436' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-04 02:00:14,402 DEBUG [member: 'jenkins-hbase9.apache.org,39045,1696384805392' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-04 02:00:14,402 DEBUG [member: 'jenkins-hbase9.apache.org,39045,1696384805392' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportWithTargetName' completed. 2023-10-04 02:00:14,402 DEBUG [rs(jenkins-hbase9.apache.org,35175,1696384805436)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,1,1696384813038.66724f2ee238f5ca8201ddf6308997b3. started... 2023-10-04 02:00:14,402 DEBUG [rs(jenkins-hbase9.apache.org,44303,1696384805319)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,,1696384813038.5de56d0448b25922e7a6d562d9fb2f8c. started... 2023-10-04 02:00:14,406 DEBUG [rs(jenkins-hbase9.apache.org,44303,1696384805319)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 5de56d0448b25922e7a6d562d9fb2f8c: 2023-10-04 02:00:14,406 DEBUG [rs(jenkins-hbase9.apache.org,35175,1696384805436)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 66724f2ee238f5ca8201ddf6308997b3: 2023-10-04 02:00:14,407 DEBUG [rs(jenkins-hbase9.apache.org,44303,1696384805319)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,,1696384813038.5de56d0448b25922e7a6d562d9fb2f8c.' region-info for snapshot=emptySnaptb0-testExportWithTargetName 2023-10-04 02:00:14,407 DEBUG [rs(jenkins-hbase9.apache.org,35175,1696384805436)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,1,1696384813038.66724f2ee238f5ca8201ddf6308997b3.' region-info for snapshot=emptySnaptb0-testExportWithTargetName 2023-10-04 02:00:14,412 DEBUG [rs(jenkins-hbase9.apache.org,44303,1696384805319)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-04 02:00:14,412 DEBUG [rs(jenkins-hbase9.apache.org,35175,1696384805436)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-04 02:00:14,416 DEBUG [rs(jenkins-hbase9.apache.org,35175,1696384805436)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-10-04 02:00:14,416 DEBUG [rs(jenkins-hbase9.apache.org,44303,1696384805319)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-10-04 02:00:14,431 DEBUG [Listener at jenkins-hbase9.apache.org/33899] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-04 02:00:14,447 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39651] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-10-04 02:00:14,449 DEBUG [rs(jenkins-hbase9.apache.org,35175,1696384805436)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,1,1696384813038.66724f2ee238f5ca8201ddf6308997b3. completed. 2023-10-04 02:00:14,449 DEBUG [rs(jenkins-hbase9.apache.org,35175,1696384805436)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,1,1696384813038.66724f2ee238f5ca8201ddf6308997b3. 2023-10-04 02:00:14,449 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39651] snapshot.SnapshotManager(406): Snapshoting '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-10-04 02:00:14,449 DEBUG [member: 'jenkins-hbase9.apache.org,35175,1696384805436' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-04 02:00:14,450 DEBUG [member: 'jenkins-hbase9.apache.org,35175,1696384805436' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-04 02:00:14,450 DEBUG [member: 'jenkins-hbase9.apache.org,35175,1696384805436' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase9.apache.org,35175,1696384805436 2023-10-04 02:00:14,450 DEBUG [member: 'jenkins-hbase9.apache.org,35175,1696384805436' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally completed 2023-10-04 02:00:14,450 DEBUG [member: 'jenkins-hbase9.apache.org,35175,1696384805436' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportWithTargetName' completed for member 'jenkins-hbase9.apache.org,35175,1696384805436' in zk 2023-10-04 02:00:14,450 DEBUG [Listener at jenkins-hbase9.apache.org/33899] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-10-04 02:00:14,451 DEBUG [rs(jenkins-hbase9.apache.org,44303,1696384805319)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,,1696384813038.5de56d0448b25922e7a6d562d9fb2f8c. completed. 2023-10-04 02:00:14,451 DEBUG [rs(jenkins-hbase9.apache.org,44303,1696384805319)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,,1696384813038.5de56d0448b25922e7a6d562d9fb2f8c. 2023-10-04 02:00:14,451 DEBUG [member: 'jenkins-hbase9.apache.org,44303,1696384805319' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-04 02:00:14,451 DEBUG [member: 'jenkins-hbase9.apache.org,44303,1696384805319' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-04 02:00:14,451 DEBUG [member: 'jenkins-hbase9.apache.org,44303,1696384805319' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase9.apache.org,44303,1696384805319 2023-10-04 02:00:14,451 DEBUG [member: 'jenkins-hbase9.apache.org,44303,1696384805319' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally completed 2023-10-04 02:00:14,451 DEBUG [member: 'jenkins-hbase9.apache.org,44303,1696384805319' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportWithTargetName' completed for member 'jenkins-hbase9.apache.org,44303,1696384805319' in zk 2023-10-04 02:00:14,452 DEBUG [member: 'jenkins-hbase9.apache.org,35175,1696384805436' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportWithTargetName' has notified controller of completion 2023-10-04 02:00:14,452 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): master:39651-0x1010f1b55330000, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,35175,1696384805436 2023-10-04 02:00:14,452 DEBUG [member: 'jenkins-hbase9.apache.org,35175,1696384805436' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-04 02:00:14,452 DEBUG [member: 'jenkins-hbase9.apache.org,35175,1696384805436' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportWithTargetName' completed. 2023-10-04 02:00:14,452 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,35175,1696384805436 2023-10-04 02:00:14,454 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-04 02:00:14,454 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-04 02:00:14,454 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): master:39651-0x1010f1b55330000, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,44303,1696384805319 2023-10-04 02:00:14,454 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-04 02:00:14,454 DEBUG [member: 'jenkins-hbase9.apache.org,44303,1696384805319' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportWithTargetName' has notified controller of completion 2023-10-04 02:00:14,454 DEBUG [member: 'jenkins-hbase9.apache.org,44303,1696384805319' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-04 02:00:14,454 DEBUG [member: 'jenkins-hbase9.apache.org,44303,1696384805319' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportWithTargetName' completed. 2023-10-04 02:00:14,456 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-04 02:00:14,456 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-10-04 02:00:14,456 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,39045,1696384805392 2023-10-04 02:00:14,457 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,35175,1696384805436 2023-10-04 02:00:14,457 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44303,1696384805319 2023-10-04 02:00:14,458 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-04 02:00:14,458 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-10-04 02:00:14,458 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,39045,1696384805392 2023-10-04 02:00:14,459 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,35175,1696384805436 2023-10-04 02:00:14,459 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44303,1696384805319 2023-10-04 02:00:14,460 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportWithTargetName' member 'jenkins-hbase9.apache.org,35175,1696384805436': 2023-10-04 02:00:14,460 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,35175,1696384805436' released barrier for procedure'emptySnaptb0-testExportWithTargetName', counting down latch. Waiting for 1 more 2023-10-04 02:00:14,460 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,44303,1696384805319 2023-10-04 02:00:14,460 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-04 02:00:14,460 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-04 02:00:14,460 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-04 02:00:14,461 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-04 02:00:14,461 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-10-04 02:00:14,461 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,39045,1696384805392 2023-10-04 02:00:14,461 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,35175,1696384805436 2023-10-04 02:00:14,462 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44303,1696384805319 2023-10-04 02:00:14,462 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-04 02:00:14,463 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-10-04 02:00:14,463 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,39045,1696384805392 2023-10-04 02:00:14,463 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,35175,1696384805436 2023-10-04 02:00:14,464 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44303,1696384805319 2023-10-04 02:00:14,464 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportWithTargetName' member 'jenkins-hbase9.apache.org,44303,1696384805319': 2023-10-04 02:00:14,464 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,44303,1696384805319' released barrier for procedure'emptySnaptb0-testExportWithTargetName', counting down latch. Waiting for 0 more 2023-10-04 02:00:14,464 INFO [(jenkins-hbase9.apache.org,39651,1696384803959)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportWithTargetName' execution completed 2023-10-04 02:00:14,464 DEBUG [(jenkins-hbase9.apache.org,39651,1696384803959)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-04 02:00:14,465 DEBUG [(jenkins-hbase9.apache.org,39651,1696384803959)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-04 02:00:14,465 DEBUG [(jenkins-hbase9.apache.org,39651,1696384803959)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportWithTargetName 2023-10-04 02:00:14,465 INFO [(jenkins-hbase9.apache.org,39651,1696384803959)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportWithTargetNameincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-10-04 02:00:14,468 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): regionserver:39045-0x1010f1b55330002, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-10-04 02:00:14,468 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): regionserver:44303-0x1010f1b55330001, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-10-04 02:00:14,468 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): regionserver:35175-0x1010f1b55330003, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-10-04 02:00:14,468 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-10-04 02:00:14,468 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-10-04 02:00:14,468 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-10-04 02:00:14,468 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): regionserver:39045-0x1010f1b55330002, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-04 02:00:14,468 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): master:39651-0x1010f1b55330000, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-10-04 02:00:14,468 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-10-04 02:00:14,468 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-10-04 02:00:14,468 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): regionserver:35175-0x1010f1b55330003, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-04 02:00:14,468 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): regionserver:44303-0x1010f1b55330001, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-04 02:00:14,469 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-10-04 02:00:14,469 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-04 02:00:14,469 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-04 02:00:14,469 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-10-04 02:00:14,469 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-04 02:00:14,469 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-04 02:00:14,469 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-04 02:00:14,469 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-04 02:00:14,469 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-04 02:00:14,469 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-04 02:00:14,469 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-10-04 02:00:14,470 DEBUG [(jenkins-hbase9.apache.org,39651,1696384803959)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39651-0x1010f1b55330000, quorum=127.0.0.1:60027, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,39045,1696384805392 2023-10-04 02:00:14,470 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-04 02:00:14,470 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-10-04 02:00:14,470 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-10-04 02:00:14,470 DEBUG [(jenkins-hbase9.apache.org,39651,1696384803959)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39651-0x1010f1b55330000, quorum=127.0.0.1:60027, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,35175,1696384805436 2023-10-04 02:00:14,470 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-10-04 02:00:14,471 DEBUG [(jenkins-hbase9.apache.org,39651,1696384803959)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39651-0x1010f1b55330000, quorum=127.0.0.1:60027, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,44303,1696384805319 2023-10-04 02:00:14,471 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-04 02:00:14,471 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-10-04 02:00:14,472 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,39045,1696384805392 2023-10-04 02:00:14,472 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,35175,1696384805436 2023-10-04 02:00:14,472 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44303,1696384805319 2023-10-04 02:00:14,473 DEBUG [(jenkins-hbase9.apache.org,39651,1696384803959)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39651-0x1010f1b55330000, quorum=127.0.0.1:60027, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,39045,1696384805392 2023-10-04 02:00:14,473 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-04 02:00:14,473 DEBUG [(jenkins-hbase9.apache.org,39651,1696384803959)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39651-0x1010f1b55330000, quorum=127.0.0.1:60027, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,35175,1696384805436 2023-10-04 02:00:14,473 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-10-04 02:00:14,474 DEBUG [(jenkins-hbase9.apache.org,39651,1696384803959)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39651-0x1010f1b55330000, quorum=127.0.0.1:60027, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,44303,1696384805319 2023-10-04 02:00:14,474 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,39045,1696384805392 2023-10-04 02:00:14,474 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,35175,1696384805436 2023-10-04 02:00:14,475 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44303,1696384805319 2023-10-04 02:00:14,486 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): regionserver:39045-0x1010f1b55330002, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-04 02:00:14,486 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): regionserver:44303-0x1010f1b55330001, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-04 02:00:14,486 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-04 02:00:14,486 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-04 02:00:14,486 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): regionserver:35175-0x1010f1b55330003, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-04 02:00:14,486 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): master:39651-0x1010f1b55330000, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,44303,1696384805319 2023-10-04 02:00:14,486 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): regionserver:39045-0x1010f1b55330002, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-04 02:00:14,487 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-04 02:00:14,487 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): regionserver:44303-0x1010f1b55330001, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-04 02:00:14,486 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-04 02:00:14,487 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-04 02:00:14,487 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-04 02:00:14,487 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportWithTargetName 2023-10-04 02:00:14,487 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): master:39651-0x1010f1b55330000, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-10-04 02:00:14,487 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportWithTargetName 2023-10-04 02:00:14,486 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): regionserver:35175-0x1010f1b55330003, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-04 02:00:14,487 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): master:39651-0x1010f1b55330000, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,35175,1696384805436 2023-10-04 02:00:14,487 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 90c8eeaaf01a24f585da11044309be71, NAME => 'testtb-testExportWithTargetName,.mob,0.90c8eeaaf01a24f585da11044309be71.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testExportWithTargetName 2023-10-04 02:00:14,487 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): master:39651-0x1010f1b55330000, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,39045,1696384805392 2023-10-04 02:00:14,487 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-10-04 02:00:14,487 DEBUG [(jenkins-hbase9.apache.org,39651,1696384803959)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-04 02:00:14,487 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-04 02:00:14,488 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-04 02:00:14,488 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-04 02:00:14,488 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-04 02:00:14,487 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-04 02:00:14,487 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): master:39651-0x1010f1b55330000, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-10-04 02:00:14,488 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-04 02:00:14,488 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): master:39651-0x1010f1b55330000, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,44303,1696384805319 2023-10-04 02:00:14,489 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): master:39651-0x1010f1b55330000, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-10-04 02:00:14,489 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): master:39651-0x1010f1b55330000, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,35175,1696384805436 2023-10-04 02:00:14,489 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): master:39651-0x1010f1b55330000, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,39045,1696384805392 2023-10-04 02:00:14,489 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): master:39651-0x1010f1b55330000, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-10-04 02:00:14,489 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): master:39651-0x1010f1b55330000, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-10-04 02:00:14,489 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-10-04 02:00:14,505 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportWithTargetName 2023-10-04 02:00:14,507 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName 2023-10-04 02:00:14,566 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName to hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/.hbase-snapshot/emptySnaptb0-testExportWithTargetName 2023-10-04 02:00:14,567 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed 2023-10-04 02:00:14,568 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName 2023-10-04 02:00:14,568 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName 2023-10-04 02:00:14,569 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName at 1696384814322Completed referencing HFiles for the mob region of table: testtb-testExportWithTargetName at 1696384814505 (+183 ms)Consolidate snapshot: emptySnaptb0-testExportWithTargetName at 1696384814505Loading Region manifests for emptySnaptb0-testExportWithTargetName at 1696384814505Writing data manifest for emptySnaptb0-testExportWithTargetName at 1696384814521 (+16 ms)Verifying snapshot: emptySnaptb0-testExportWithTargetName at 1696384814553 (+32 ms)Snapshot emptySnaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed at 1696384814567 (+14 ms) 2023-10-04 02:00:14,572 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=18, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-10-04 02:00:14,574 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=18, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED in 249 msec 2023-10-04 02:00:14,650 DEBUG [Listener at jenkins-hbase9.apache.org/33899] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-04 02:00:14,653 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39651] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-10-04 02:00:14,653 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39651] snapshot.SnapshotManager(403): Snapshot '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' has completed, notifying client. 2023-10-04 02:00:14,667 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44303] regionserver.HRegion(8805): writing data to region testtb-testExportWithTargetName,,1696384813038.5de56d0448b25922e7a6d562d9fb2f8c. with WAL disabled. Data may be lost in the event of a crash. 2023-10-04 02:00:14,669 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35175] regionserver.HRegion(8805): writing data to region testtb-testExportWithTargetName,1,1696384813038.66724f2ee238f5ca8201ddf6308997b3. with WAL disabled. Data may be lost in the event of a crash. 2023-10-04 02:00:14,674 DEBUG [Listener at jenkins-hbase9.apache.org/33899] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportWithTargetName 2023-10-04 02:00:14,674 DEBUG [Listener at jenkins-hbase9.apache.org/33899] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportWithTargetName,,1696384813038.5de56d0448b25922e7a6d562d9fb2f8c. 2023-10-04 02:00:14,675 INFO [Listener at jenkins-hbase9.apache.org/33899] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-10-04 02:00:14,691 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39651] master.MasterRpcServices(1583): Client=jenkins//172.31.2.10 snapshot request for:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-10-04 02:00:14,691 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39651] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1696384814691 (current time:1696384814691). 2023-10-04 02:00:14,691 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39651] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-10-04 02:00:14,692 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39651] zookeeper.ReadOnlyZKClient(139): Connect 0x173aadcd to 127.0.0.1:60027 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-04 02:00:14,700 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39651] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5db2aeb2, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-04 02:00:14,701 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39651] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-04 02:00:14,702 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:57070, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-04 02:00:14,703 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39651] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x173aadcd to 127.0.0.1:60027 2023-10-04 02:00:14,703 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39651] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-04 02:00:14,705 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39651] zookeeper.ReadOnlyZKClient(139): Connect 0x751530ce to 127.0.0.1:60027 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-04 02:00:14,714 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39651] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3783af64, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-04 02:00:14,716 DEBUG [hconnection-0x7f8c4018-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-04 02:00:14,719 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:57086, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-04 02:00:14,725 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39651] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x751530ce to 127.0.0.1:60027 2023-10-04 02:00:14,725 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39651] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-04 02:00:14,725 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39651] access.PermissionStorage(611): Read acl: entry[testtb-testExportWithTargetName], kv [jenkins: RWXCA] 2023-10-04 02:00:14,726 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39651] snapshot.SnapshotManager(637): No existing snapshot, attempting snapshot... 2023-10-04 02:00:14,726 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39651] snapshot.SnapshotManager(684): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-10-04 02:00:14,729 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39651] snapshot.SnapshotManager(519): Unable to retrieve ACL status for path: hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/.hbase-snapshot, current working dir path: hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName org.apache.hadoop.hdfs.protocol.AclException: The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.ipc.RemoteException.instantiateException(RemoteException.java:121) at org.apache.hadoop.ipc.RemoteException.unwrapRemoteException(RemoteException.java:88) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2736) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2294) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2291) at org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81) at org.apache.hadoop.hdfs.DistributedFileSystem.getAclStatus(DistributedFileSystem.java:2291) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.updateWorkingDirAclsIfRequired(SnapshotManager.java:517) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.prepareToTakeSnapshot(SnapshotManager.java:490) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.snapshotEnabledTable(SnapshotManager.java:559) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshotInternal(SnapshotManager.java:687) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshot(SnapshotManager.java:623) at org.apache.hadoop.hbase.master.MasterRpcServices.snapshot(MasterRpcServices.java:1588) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) Caused by: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.hdfs.protocol.AclException): The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at org.apache.hadoop.ipc.Client.getRpcResponse(Client.java:1540) at org.apache.hadoop.ipc.Client.call(Client.java:1486) at org.apache.hadoop.ipc.Client.call(Client.java:1385) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:232) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:118) at com.sun.proxy.$Proxy32.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.getAclStatus(ClientNamenodeProtocolTranslatorPB.java:1385) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:422) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeMethod(RetryInvocationHandler.java:165) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invoke(RetryInvocationHandler.java:157) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeOnce(RetryInvocationHandler.java:95) at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:359) at com.sun.proxy.$Proxy35.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2734) ... 15 more 2023-10-04 02:00:14,731 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39651] procedure2.ProcedureExecutor(1028): Stored pid=19, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-10-04 02:00:14,732 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=19, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-10-04 02:00:14,733 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=19, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE; timeout=600000, timestamp=1696385414733 2023-10-04 02:00:14,733 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39651] snapshot.SnapshotManager(689): Started snapshot: { ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-10-04 02:00:14,733 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName 2023-10-04 02:00:14,735 DEBUG [Listener at jenkins-hbase9.apache.org/33899] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-10-04 02:00:14,735 DEBUG [Listener at jenkins-hbase9.apache.org/33899] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-10-04 02:00:14,736 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=19, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-10-04 02:00:14,736 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] procedure2.ProcedureExecutor(1028): Stored pid=20, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-10-04 02:00:14,738 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=19, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE in 6 msec 2023-10-04 02:00:14,738 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=20, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-10-04 02:00:14,739 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=20, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED; timeout=600000, timestamp=1696385414739 2023-10-04 02:00:14,756 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportWithTargetName 2023-10-04 02:00:14,756 INFO [(jenkins-hbase9.apache.org,39651,1696384803959)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportWithTargetName' 2023-10-04 02:00:14,756 DEBUG [(jenkins-hbase9.apache.org,39651,1696384803959)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-04 02:00:14,758 DEBUG [(jenkins-hbase9.apache.org,39651,1696384803959)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportWithTargetName' starting 'acquire' 2023-10-04 02:00:14,758 DEBUG [(jenkins-hbase9.apache.org,39651,1696384803959)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportWithTargetName', kicking off acquire phase on members. 2023-10-04 02:00:14,758 DEBUG [(jenkins-hbase9.apache.org,39651,1696384803959)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39651-0x1010f1b55330000, quorum=127.0.0.1:60027, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-10-04 02:00:14,758 DEBUG [(jenkins-hbase9.apache.org,39651,1696384803959)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-10-04 02:00:14,760 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): regionserver:39045-0x1010f1b55330002, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-04 02:00:14,760 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): regionserver:44303-0x1010f1b55330001, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-04 02:00:14,760 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-04 02:00:14,760 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-04 02:00:14,760 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-04 02:00:14,760 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): regionserver:35175-0x1010f1b55330003, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-04 02:00:14,760 DEBUG [(jenkins-hbase9.apache.org,39651,1696384803959)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,35175,1696384805436 2023-10-04 02:00:14,760 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-04 02:00:14,760 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-04 02:00:14,761 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-04 02:00:14,762 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-10-04 02:00:14,762 DEBUG [(jenkins-hbase9.apache.org,39651,1696384803959)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39651-0x1010f1b55330000, quorum=127.0.0.1:60027, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,35175,1696384805436 2023-10-04 02:00:14,762 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-10-04 02:00:14,762 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-10-04 02:00:14,762 DEBUG [(jenkins-hbase9.apache.org,39651,1696384803959)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,44303,1696384805319 2023-10-04 02:00:14,762 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39045-0x1010f1b55330002, quorum=127.0.0.1:60027, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-10-04 02:00:14,762 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35175-0x1010f1b55330003, quorum=127.0.0.1:60027, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-10-04 02:00:14,762 DEBUG [(jenkins-hbase9.apache.org,39651,1696384803959)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39651-0x1010f1b55330000, quorum=127.0.0.1:60027, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,44303,1696384805319 2023-10-04 02:00:14,762 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44303-0x1010f1b55330001, quorum=127.0.0.1:60027, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-10-04 02:00:14,762 DEBUG [(jenkins-hbase9.apache.org,39651,1696384803959)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-04 02:00:14,763 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 166 2023-10-04 02:00:14,763 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-10-04 02:00:14,763 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 166 2023-10-04 02:00:14,763 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 166 2023-10-04 02:00:14,763 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-10-04 02:00:14,763 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-10-04 02:00:14,763 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-10-04 02:00:14,763 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-10-04 02:00:14,763 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-10-04 02:00:14,763 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportWithTargetName 2023-10-04 02:00:14,763 DEBUG [member: 'jenkins-hbase9.apache.org,35175,1696384805436' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportWithTargetName' with timeout 300000ms 2023-10-04 02:00:14,763 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportWithTargetName 2023-10-04 02:00:14,763 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportWithTargetName 2023-10-04 02:00:14,764 DEBUG [member: 'jenkins-hbase9.apache.org,44303,1696384805319' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportWithTargetName' with timeout 300000ms 2023-10-04 02:00:14,763 DEBUG [member: 'jenkins-hbase9.apache.org,35175,1696384805436' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-04 02:00:14,767 DEBUG [member: 'jenkins-hbase9.apache.org,44303,1696384805319' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-04 02:00:14,768 DEBUG [member: 'jenkins-hbase9.apache.org,35175,1696384805436' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportWithTargetName' starting 'acquire' stage 2023-10-04 02:00:14,767 DEBUG [member: 'jenkins-hbase9.apache.org,39045,1696384805392' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportWithTargetName' with timeout 300000ms 2023-10-04 02:00:14,769 DEBUG [member: 'jenkins-hbase9.apache.org,35175,1696384805436' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportWithTargetName' locally acquired 2023-10-04 02:00:14,769 DEBUG [member: 'jenkins-hbase9.apache.org,44303,1696384805319' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportWithTargetName' starting 'acquire' stage 2023-10-04 02:00:14,769 DEBUG [member: 'jenkins-hbase9.apache.org,35175,1696384805436' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,35175,1696384805436' joining acquired barrier for procedure (snaptb0-testExportWithTargetName) in zk 2023-10-04 02:00:14,769 DEBUG [member: 'jenkins-hbase9.apache.org,44303,1696384805319' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportWithTargetName' locally acquired 2023-10-04 02:00:14,769 DEBUG [member: 'jenkins-hbase9.apache.org,39045,1696384805392' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-04 02:00:14,769 DEBUG [member: 'jenkins-hbase9.apache.org,44303,1696384805319' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,44303,1696384805319' joining acquired barrier for procedure (snaptb0-testExportWithTargetName) in zk 2023-10-04 02:00:14,770 DEBUG [member: 'jenkins-hbase9.apache.org,39045,1696384805392' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportWithTargetName' starting 'acquire' stage 2023-10-04 02:00:14,770 DEBUG [member: 'jenkins-hbase9.apache.org,39045,1696384805392' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportWithTargetName' locally acquired 2023-10-04 02:00:14,770 DEBUG [member: 'jenkins-hbase9.apache.org,39045,1696384805392' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,39045,1696384805392' joining acquired barrier for procedure (snaptb0-testExportWithTargetName) in zk 2023-10-04 02:00:14,772 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): master:39651-0x1010f1b55330000, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,35175,1696384805436 2023-10-04 02:00:14,772 DEBUG [member: 'jenkins-hbase9.apache.org,35175,1696384805436' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-10-04 02:00:14,772 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,35175,1696384805436 2023-10-04 02:00:14,772 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-04 02:00:14,772 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-04 02:00:14,773 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): master:39651-0x1010f1b55330000, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,44303,1696384805319 2023-10-04 02:00:14,773 DEBUG [member: 'jenkins-hbase9.apache.org,35175,1696384805436' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35175-0x1010f1b55330003, quorum=127.0.0.1:60027, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-10-04 02:00:14,773 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-04 02:00:14,773 DEBUG [member: 'jenkins-hbase9.apache.org,39045,1696384805392' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-10-04 02:00:14,773 DEBUG [member: 'jenkins-hbase9.apache.org,35175,1696384805436' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-04 02:00:14,773 DEBUG [member: 'jenkins-hbase9.apache.org,44303,1696384805319' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-10-04 02:00:14,774 DEBUG [member: 'jenkins-hbase9.apache.org,39045,1696384805392' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39045-0x1010f1b55330002, quorum=127.0.0.1:60027, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-10-04 02:00:14,774 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-04 02:00:14,774 DEBUG [member: 'jenkins-hbase9.apache.org,39045,1696384805392' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-04 02:00:14,774 DEBUG [member: 'jenkins-hbase9.apache.org,44303,1696384805319' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44303-0x1010f1b55330001, quorum=127.0.0.1:60027, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-10-04 02:00:14,774 DEBUG [member: 'jenkins-hbase9.apache.org,44303,1696384805319' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-04 02:00:14,774 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-10-04 02:00:14,775 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,39045,1696384805392 2023-10-04 02:00:14,775 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,35175,1696384805436 2023-10-04 02:00:14,775 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44303,1696384805319 2023-10-04 02:00:14,776 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-04 02:00:14,776 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,35175,1696384805436' joining acquired barrier for procedure 'snaptb0-testExportWithTargetName' on coordinator 2023-10-04 02:00:14,776 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@28e24ab0[Count = 1] remaining members to acquire global barrier 2023-10-04 02:00:14,776 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,44303,1696384805319 2023-10-04 02:00:14,776 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-04 02:00:14,776 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-04 02:00:14,777 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-04 02:00:14,777 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-04 02:00:14,777 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-10-04 02:00:14,778 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,39045,1696384805392 2023-10-04 02:00:14,778 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,35175,1696384805436 2023-10-04 02:00:14,778 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44303,1696384805319 2023-10-04 02:00:14,779 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-04 02:00:14,779 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,44303,1696384805319' joining acquired barrier for procedure 'snaptb0-testExportWithTargetName' on coordinator 2023-10-04 02:00:14,779 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@28e24ab0[Count = 0] remaining members to acquire global barrier 2023-10-04 02:00:14,779 DEBUG [(jenkins-hbase9.apache.org,39651,1696384803959)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportWithTargetName' starting 'in-barrier' execution. 2023-10-04 02:00:14,779 DEBUG [(jenkins-hbase9.apache.org,39651,1696384803959)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-10-04 02:00:14,784 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): regionserver:44303-0x1010f1b55330001, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-10-04 02:00:14,784 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): regionserver:35175-0x1010f1b55330003, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-10-04 02:00:14,784 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-10-04 02:00:14,784 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-10-04 02:00:14,784 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-10-04 02:00:14,784 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-10-04 02:00:14,784 DEBUG [member: 'jenkins-hbase9.apache.org,44303,1696384805319' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-10-04 02:00:14,784 DEBUG [(jenkins-hbase9.apache.org,39651,1696384803959)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39651-0x1010f1b55330000, quorum=127.0.0.1:60027, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,35175,1696384805436 2023-10-04 02:00:14,784 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): regionserver:39045-0x1010f1b55330002, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-10-04 02:00:14,784 DEBUG [member: 'jenkins-hbase9.apache.org,35175,1696384805436' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-10-04 02:00:14,784 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-10-04 02:00:14,784 DEBUG [rs(jenkins-hbase9.apache.org,44303,1696384805319)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,,1696384813038.5de56d0448b25922e7a6d562d9fb2f8c. 2023-10-04 02:00:14,784 DEBUG [member: 'jenkins-hbase9.apache.org,44303,1696384805319' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-04 02:00:14,784 DEBUG [member: 'jenkins-hbase9.apache.org,35175,1696384805436' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-04 02:00:14,784 DEBUG [(jenkins-hbase9.apache.org,39651,1696384803959)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39651-0x1010f1b55330000, quorum=127.0.0.1:60027, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,44303,1696384805319 2023-10-04 02:00:14,784 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-10-04 02:00:14,785 DEBUG [(jenkins-hbase9.apache.org,39651,1696384803959)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-04 02:00:14,784 DEBUG [member: 'jenkins-hbase9.apache.org,35175,1696384805436' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-04 02:00:14,784 DEBUG [rs(jenkins-hbase9.apache.org,35175,1696384805436)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,1,1696384813038.66724f2ee238f5ca8201ddf6308997b3. 2023-10-04 02:00:14,784 DEBUG [rs(jenkins-hbase9.apache.org,44303,1696384805319)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,,1696384813038.5de56d0448b25922e7a6d562d9fb2f8c. started... 2023-10-04 02:00:14,784 DEBUG [member: 'jenkins-hbase9.apache.org,44303,1696384805319' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-04 02:00:14,785 DEBUG [rs(jenkins-hbase9.apache.org,35175,1696384805436)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,1,1696384813038.66724f2ee238f5ca8201ddf6308997b3. started... 2023-10-04 02:00:14,785 DEBUG [member: 'jenkins-hbase9.apache.org,39045,1696384805392' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-10-04 02:00:14,785 DEBUG [member: 'jenkins-hbase9.apache.org,39045,1696384805392' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportWithTargetName' locally completed 2023-10-04 02:00:14,785 DEBUG [member: 'jenkins-hbase9.apache.org,39045,1696384805392' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportWithTargetName' completed for member 'jenkins-hbase9.apache.org,39045,1696384805392' in zk 2023-10-04 02:00:14,785 INFO [rs(jenkins-hbase9.apache.org,44303,1696384805319)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 5de56d0448b25922e7a6d562d9fb2f8c 1/1 column families, dataSize=266 B heapSize=832 B 2023-10-04 02:00:14,785 INFO [rs(jenkins-hbase9.apache.org,35175,1696384805436)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 66724f2ee238f5ca8201ddf6308997b3 1/1 column families, dataSize=3.00 KB heapSize=6.72 KB 2023-10-04 02:00:14,788 DEBUG [member: 'jenkins-hbase9.apache.org,39045,1696384805392' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportWithTargetName' has notified controller of completion 2023-10-04 02:00:14,788 DEBUG [member: 'jenkins-hbase9.apache.org,39045,1696384805392' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-04 02:00:14,788 DEBUG [member: 'jenkins-hbase9.apache.org,39045,1696384805392' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportWithTargetName' completed. 2023-10-04 02:00:14,835 DEBUG [Listener at jenkins-hbase9.apache.org/33899] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-04 02:00:14,837 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39651] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-10-04 02:00:14,837 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39651] snapshot.SnapshotManager(406): Snapshoting '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-10-04 02:00:14,838 DEBUG [Listener at jenkins-hbase9.apache.org/33899] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-10-04 02:00:14,925 INFO [rs(jenkins-hbase9.apache.org,44303,1696384805319)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202310045465b6a07df344bfbad822a6bf6e4ee6 to hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e202310045465b6a07df344bfbad822a6bf6e4ee6 2023-10-04 02:00:14,925 INFO [rs(jenkins-hbase9.apache.org,35175,1696384805436)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20231004dcf60096095d4cae9ae8c2d4fd484aa7 to hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b20231004dcf60096095d4cae9ae8c2d4fd484aa7 2023-10-04 02:00:14,965 INFO [rs(jenkins-hbase9.apache.org,44303,1696384805319)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=266, hasBloomFilter=true, into tmp file hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/data/default/testtb-testExportWithTargetName/5de56d0448b25922e7a6d562d9fb2f8c/.tmp/cf/bf393de1ff9449d4b607069660f9e713 2023-10-04 02:00:14,966 INFO [rs(jenkins-hbase9.apache.org,35175,1696384805436)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=3.0 K, hasBloomFilter=true, into tmp file hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/data/default/testtb-testExportWithTargetName/66724f2ee238f5ca8201ddf6308997b3/.tmp/cf/1bf79b8618d441f3a3f43f97540d6691 2023-10-04 02:00:14,977 DEBUG [rs(jenkins-hbase9.apache.org,35175,1696384805436)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/data/default/testtb-testExportWithTargetName/66724f2ee238f5ca8201ddf6308997b3/.tmp/cf/1bf79b8618d441f3a3f43f97540d6691 as hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/data/default/testtb-testExportWithTargetName/66724f2ee238f5ca8201ddf6308997b3/cf/1bf79b8618d441f3a3f43f97540d6691 2023-10-04 02:00:14,977 DEBUG [rs(jenkins-hbase9.apache.org,44303,1696384805319)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/data/default/testtb-testExportWithTargetName/5de56d0448b25922e7a6d562d9fb2f8c/.tmp/cf/bf393de1ff9449d4b607069660f9e713 as hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/data/default/testtb-testExportWithTargetName/5de56d0448b25922e7a6d562d9fb2f8c/cf/bf393de1ff9449d4b607069660f9e713 2023-10-04 02:00:14,986 INFO [rs(jenkins-hbase9.apache.org,44303,1696384805319)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/data/default/testtb-testExportWithTargetName/5de56d0448b25922e7a6d562d9fb2f8c/cf/bf393de1ff9449d4b607069660f9e713, entries=4, sequenceid=6, filesize=5.6 K 2023-10-04 02:00:14,986 INFO [rs(jenkins-hbase9.apache.org,35175,1696384805436)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/data/default/testtb-testExportWithTargetName/66724f2ee238f5ca8201ddf6308997b3/cf/1bf79b8618d441f3a3f43f97540d6691, entries=46, sequenceid=6, filesize=12.6 K 2023-10-04 02:00:14,990 INFO [rs(jenkins-hbase9.apache.org,44303,1696384805319)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~266 B/266, heapSize ~816 B/816, currentSize=0 B/0 for 5de56d0448b25922e7a6d562d9fb2f8c in 205ms, sequenceid=6, compaction requested=false 2023-10-04 02:00:14,990 INFO [rs(jenkins-hbase9.apache.org,35175,1696384805436)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.00 KB/3070, heapSize ~6.70 KB/6864, currentSize=0 B/0 for 66724f2ee238f5ca8201ddf6308997b3 in 205ms, sequenceid=6, compaction requested=false 2023-10-04 02:00:14,991 DEBUG [rs(jenkins-hbase9.apache.org,44303,1696384805319)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportWithTargetName' 2023-10-04 02:00:14,991 DEBUG [rs(jenkins-hbase9.apache.org,35175,1696384805436)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportWithTargetName' 2023-10-04 02:00:14,993 DEBUG [rs(jenkins-hbase9.apache.org,35175,1696384805436)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 66724f2ee238f5ca8201ddf6308997b3: 2023-10-04 02:00:14,993 DEBUG [rs(jenkins-hbase9.apache.org,44303,1696384805319)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 5de56d0448b25922e7a6d562d9fb2f8c: 2023-10-04 02:00:14,994 DEBUG [rs(jenkins-hbase9.apache.org,44303,1696384805319)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,,1696384813038.5de56d0448b25922e7a6d562d9fb2f8c.' region-info for snapshot=snaptb0-testExportWithTargetName 2023-10-04 02:00:14,994 DEBUG [rs(jenkins-hbase9.apache.org,35175,1696384805436)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,1,1696384813038.66724f2ee238f5ca8201ddf6308997b3.' region-info for snapshot=snaptb0-testExportWithTargetName 2023-10-04 02:00:14,994 DEBUG [rs(jenkins-hbase9.apache.org,44303,1696384805319)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-04 02:00:14,994 DEBUG [rs(jenkins-hbase9.apache.org,35175,1696384805436)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-04 02:00:14,994 DEBUG [rs(jenkins-hbase9.apache.org,44303,1696384805319)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/data/default/testtb-testExportWithTargetName/5de56d0448b25922e7a6d562d9fb2f8c/cf/bf393de1ff9449d4b607069660f9e713] hfiles 2023-10-04 02:00:14,994 DEBUG [rs(jenkins-hbase9.apache.org,35175,1696384805436)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/data/default/testtb-testExportWithTargetName/66724f2ee238f5ca8201ddf6308997b3/cf/1bf79b8618d441f3a3f43f97540d6691] hfiles 2023-10-04 02:00:14,994 DEBUG [rs(jenkins-hbase9.apache.org,44303,1696384805319)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/data/default/testtb-testExportWithTargetName/5de56d0448b25922e7a6d562d9fb2f8c/cf/bf393de1ff9449d4b607069660f9e713 for snapshot=snaptb0-testExportWithTargetName 2023-10-04 02:00:14,994 DEBUG [rs(jenkins-hbase9.apache.org,35175,1696384805436)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/data/default/testtb-testExportWithTargetName/66724f2ee238f5ca8201ddf6308997b3/cf/1bf79b8618d441f3a3f43f97540d6691 for snapshot=snaptb0-testExportWithTargetName 2023-10-04 02:00:15,021 DEBUG [rs(jenkins-hbase9.apache.org,35175,1696384805436)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,1,1696384813038.66724f2ee238f5ca8201ddf6308997b3. completed. 2023-10-04 02:00:15,021 DEBUG [rs(jenkins-hbase9.apache.org,35175,1696384805436)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,1,1696384813038.66724f2ee238f5ca8201ddf6308997b3. 2023-10-04 02:00:15,022 DEBUG [member: 'jenkins-hbase9.apache.org,35175,1696384805436' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-04 02:00:15,022 DEBUG [member: 'jenkins-hbase9.apache.org,35175,1696384805436' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-04 02:00:15,022 DEBUG [member: 'jenkins-hbase9.apache.org,35175,1696384805436' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase9.apache.org,35175,1696384805436 2023-10-04 02:00:15,022 DEBUG [member: 'jenkins-hbase9.apache.org,35175,1696384805436' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportWithTargetName' locally completed 2023-10-04 02:00:15,022 DEBUG [member: 'jenkins-hbase9.apache.org,35175,1696384805436' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportWithTargetName' completed for member 'jenkins-hbase9.apache.org,35175,1696384805436' in zk 2023-10-04 02:00:15,024 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): master:39651-0x1010f1b55330000, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,35175,1696384805436 2023-10-04 02:00:15,024 DEBUG [member: 'jenkins-hbase9.apache.org,35175,1696384805436' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportWithTargetName' has notified controller of completion 2023-10-04 02:00:15,024 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,35175,1696384805436 2023-10-04 02:00:15,024 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-04 02:00:15,024 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-04 02:00:15,024 DEBUG [member: 'jenkins-hbase9.apache.org,35175,1696384805436' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-04 02:00:15,024 DEBUG [member: 'jenkins-hbase9.apache.org,35175,1696384805436' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportWithTargetName' completed. 2023-10-04 02:00:15,026 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-04 02:00:15,027 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-04 02:00:15,027 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-10-04 02:00:15,027 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,39045,1696384805392 2023-10-04 02:00:15,028 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,35175,1696384805436 2023-10-04 02:00:15,028 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44303,1696384805319 2023-10-04 02:00:15,028 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-04 02:00:15,029 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-10-04 02:00:15,029 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,39045,1696384805392 2023-10-04 02:00:15,029 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,35175,1696384805436 2023-10-04 02:00:15,030 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportWithTargetName' member 'jenkins-hbase9.apache.org,35175,1696384805436': 2023-10-04 02:00:15,030 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,35175,1696384805436' released barrier for procedure'snaptb0-testExportWithTargetName', counting down latch. Waiting for 1 more 2023-10-04 02:00:15,038 DEBUG [Listener at jenkins-hbase9.apache.org/33899] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-04 02:00:15,039 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39651] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-10-04 02:00:15,039 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39651] snapshot.SnapshotManager(406): Snapshoting '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-10-04 02:00:15,040 DEBUG [Listener at jenkins-hbase9.apache.org/33899] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-10-04 02:00:15,340 DEBUG [Listener at jenkins-hbase9.apache.org/33899] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-04 02:00:15,341 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39651] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-10-04 02:00:15,341 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39651] snapshot.SnapshotManager(406): Snapshoting '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-10-04 02:00:15,342 DEBUG [Listener at jenkins-hbase9.apache.org/33899] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-10-04 02:00:15,421 DEBUG [rs(jenkins-hbase9.apache.org,44303,1696384805319)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,,1696384813038.5de56d0448b25922e7a6d562d9fb2f8c. completed. 2023-10-04 02:00:15,421 DEBUG [rs(jenkins-hbase9.apache.org,44303,1696384805319)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,,1696384813038.5de56d0448b25922e7a6d562d9fb2f8c. 2023-10-04 02:00:15,421 DEBUG [member: 'jenkins-hbase9.apache.org,44303,1696384805319' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-04 02:00:15,421 DEBUG [member: 'jenkins-hbase9.apache.org,44303,1696384805319' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-04 02:00:15,421 DEBUG [member: 'jenkins-hbase9.apache.org,44303,1696384805319' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase9.apache.org,44303,1696384805319 2023-10-04 02:00:15,421 DEBUG [member: 'jenkins-hbase9.apache.org,44303,1696384805319' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportWithTargetName' locally completed 2023-10-04 02:00:15,421 DEBUG [member: 'jenkins-hbase9.apache.org,44303,1696384805319' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportWithTargetName' completed for member 'jenkins-hbase9.apache.org,44303,1696384805319' in zk 2023-10-04 02:00:15,423 DEBUG [member: 'jenkins-hbase9.apache.org,44303,1696384805319' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportWithTargetName' has notified controller of completion 2023-10-04 02:00:15,423 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): master:39651-0x1010f1b55330000, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,44303,1696384805319 2023-10-04 02:00:15,423 DEBUG [member: 'jenkins-hbase9.apache.org,44303,1696384805319' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-04 02:00:15,423 DEBUG [member: 'jenkins-hbase9.apache.org,44303,1696384805319' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportWithTargetName' completed. 2023-10-04 02:00:15,423 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,44303,1696384805319 2023-10-04 02:00:15,425 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-04 02:00:15,425 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-04 02:00:15,425 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-04 02:00:15,425 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-04 02:00:15,426 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-10-04 02:00:15,426 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,39045,1696384805392 2023-10-04 02:00:15,426 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,35175,1696384805436 2023-10-04 02:00:15,427 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44303,1696384805319 2023-10-04 02:00:15,427 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-04 02:00:15,427 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-10-04 02:00:15,428 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,39045,1696384805392 2023-10-04 02:00:15,428 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,35175,1696384805436 2023-10-04 02:00:15,429 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44303,1696384805319 2023-10-04 02:00:15,429 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportWithTargetName' member 'jenkins-hbase9.apache.org,44303,1696384805319': 2023-10-04 02:00:15,429 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,44303,1696384805319' released barrier for procedure'snaptb0-testExportWithTargetName', counting down latch. Waiting for 0 more 2023-10-04 02:00:15,429 INFO [(jenkins-hbase9.apache.org,39651,1696384803959)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportWithTargetName' execution completed 2023-10-04 02:00:15,429 DEBUG [(jenkins-hbase9.apache.org,39651,1696384803959)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-04 02:00:15,429 DEBUG [(jenkins-hbase9.apache.org,39651,1696384803959)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-04 02:00:15,430 DEBUG [(jenkins-hbase9.apache.org,39651,1696384803959)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportWithTargetName 2023-10-04 02:00:15,430 INFO [(jenkins-hbase9.apache.org,39651,1696384803959)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportWithTargetNameincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-10-04 02:00:15,433 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): regionserver:35175-0x1010f1b55330003, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-10-04 02:00:15,433 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): master:39651-0x1010f1b55330000, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-10-04 02:00:15,433 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-10-04 02:00:15,433 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-10-04 02:00:15,433 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): regionserver:44303-0x1010f1b55330001, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-10-04 02:00:15,433 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-04 02:00:15,433 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-10-04 02:00:15,433 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-04 02:00:15,433 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): regionserver:44303-0x1010f1b55330001, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-04 02:00:15,433 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-10-04 02:00:15,433 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): regionserver:35175-0x1010f1b55330003, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-04 02:00:15,433 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): regionserver:39045-0x1010f1b55330002, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-10-04 02:00:15,434 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-10-04 02:00:15,434 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-10-04 02:00:15,434 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-10-04 02:00:15,434 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-04 02:00:15,434 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): regionserver:39045-0x1010f1b55330002, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-04 02:00:15,434 DEBUG [(jenkins-hbase9.apache.org,39651,1696384803959)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39651-0x1010f1b55330000, quorum=127.0.0.1:60027, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,39045,1696384805392 2023-10-04 02:00:15,434 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-04 02:00:15,434 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-04 02:00:15,434 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-04 02:00:15,434 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-04 02:00:15,435 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-04 02:00:15,435 DEBUG [(jenkins-hbase9.apache.org,39651,1696384803959)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39651-0x1010f1b55330000, quorum=127.0.0.1:60027, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,35175,1696384805436 2023-10-04 02:00:15,435 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-04 02:00:15,435 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-10-04 02:00:15,435 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-10-04 02:00:15,435 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-10-04 02:00:15,435 DEBUG [(jenkins-hbase9.apache.org,39651,1696384803959)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39651-0x1010f1b55330000, quorum=127.0.0.1:60027, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,44303,1696384805319 2023-10-04 02:00:15,435 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-10-04 02:00:15,436 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-04 02:00:15,436 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-10-04 02:00:15,437 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,39045,1696384805392 2023-10-04 02:00:15,437 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,35175,1696384805436 2023-10-04 02:00:15,437 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44303,1696384805319 2023-10-04 02:00:15,438 DEBUG [(jenkins-hbase9.apache.org,39651,1696384803959)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39651-0x1010f1b55330000, quorum=127.0.0.1:60027, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,39045,1696384805392 2023-10-04 02:00:15,438 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-04 02:00:15,438 DEBUG [(jenkins-hbase9.apache.org,39651,1696384803959)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39651-0x1010f1b55330000, quorum=127.0.0.1:60027, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,35175,1696384805436 2023-10-04 02:00:15,438 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-10-04 02:00:15,439 DEBUG [(jenkins-hbase9.apache.org,39651,1696384803959)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39651-0x1010f1b55330000, quorum=127.0.0.1:60027, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,44303,1696384805319 2023-10-04 02:00:15,439 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,39045,1696384805392 2023-10-04 02:00:15,439 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,35175,1696384805436 2023-10-04 02:00:15,440 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44303,1696384805319 2023-10-04 02:00:15,450 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): regionserver:35175-0x1010f1b55330003, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-04 02:00:15,450 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): regionserver:44303-0x1010f1b55330001, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-04 02:00:15,450 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-04 02:00:15,450 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-04 02:00:15,450 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): regionserver:35175-0x1010f1b55330003, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-04 02:00:15,450 DEBUG [(jenkins-hbase9.apache.org,39651,1696384803959)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-04 02:00:15,450 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): regionserver:39045-0x1010f1b55330002, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-04 02:00:15,450 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): master:39651-0x1010f1b55330000, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,44303,1696384805319 2023-10-04 02:00:15,451 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): regionserver:39045-0x1010f1b55330002, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-04 02:00:15,451 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-04 02:00:15,451 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-04 02:00:15,450 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportWithTargetName 2023-10-04 02:00:15,450 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-04 02:00:15,451 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportWithTargetName 2023-10-04 02:00:15,450 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-04 02:00:15,450 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): regionserver:44303-0x1010f1b55330001, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-04 02:00:15,452 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 90c8eeaaf01a24f585da11044309be71, NAME => 'testtb-testExportWithTargetName,.mob,0.90c8eeaaf01a24f585da11044309be71.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testExportWithTargetName 2023-10-04 02:00:15,451 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): master:39651-0x1010f1b55330000, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-10-04 02:00:15,452 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-10-04 02:00:15,452 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): master:39651-0x1010f1b55330000, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,35175,1696384805436 2023-10-04 02:00:15,452 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): master:39651-0x1010f1b55330000, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,39045,1696384805392 2023-10-04 02:00:15,452 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): master:39651-0x1010f1b55330000, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-10-04 02:00:15,452 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): master:39651-0x1010f1b55330000, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,44303,1696384805319 2023-10-04 02:00:15,452 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): master:39651-0x1010f1b55330000, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-10-04 02:00:15,452 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): master:39651-0x1010f1b55330000, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,35175,1696384805436 2023-10-04 02:00:15,452 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): master:39651-0x1010f1b55330000, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,39045,1696384805392 2023-10-04 02:00:15,452 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): master:39651-0x1010f1b55330000, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-10-04 02:00:15,452 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): master:39651-0x1010f1b55330000, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-10-04 02:00:15,452 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-04 02:00:15,452 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-04 02:00:15,452 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-04 02:00:15,452 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-04 02:00:15,453 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-04 02:00:15,452 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-04 02:00:15,453 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b20231004dcf60096095d4cae9ae8c2d4fd484aa7, hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e202310045465b6a07df344bfbad822a6bf6e4ee6] mob files 2023-10-04 02:00:15,453 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b20231004dcf60096095d4cae9ae8c2d4fd484aa7 2023-10-04 02:00:15,453 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e202310045465b6a07df344bfbad822a6bf6e4ee6 2023-10-04 02:00:15,469 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportWithTargetName 2023-10-04 02:00:15,470 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName 2023-10-04 02:00:15,506 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName to hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/.hbase-snapshot/snaptb0-testExportWithTargetName 2023-10-04 02:00:15,508 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed 2023-10-04 02:00:15,508 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName 2023-10-04 02:00:15,508 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName 2023-10-04 02:00:15,508 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName at 1696384814734Completed referencing HFiles for the mob region of table: testtb-testExportWithTargetName at 1696384815469 (+735 ms)Consolidate snapshot: snaptb0-testExportWithTargetName at 1696384815469Loading Region manifests for snaptb0-testExportWithTargetName at 1696384815469Writing data manifest for snaptb0-testExportWithTargetName at 1696384815477 (+8 ms)Verifying snapshot: snaptb0-testExportWithTargetName at 1696384815496 (+19 ms)Snapshot snaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed at 1696384815508 (+12 ms) 2023-10-04 02:00:15,511 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=20, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-10-04 02:00:15,514 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=20, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED in 777 msec 2023-10-04 02:00:15,842 DEBUG [Listener at jenkins-hbase9.apache.org/33899] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-04 02:00:15,846 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39651] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-10-04 02:00:15,846 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39651] snapshot.SnapshotManager(403): Snapshot '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' has completed, notifying client. 2023-10-04 02:00:15,846 INFO [Listener at jenkins-hbase9.apache.org/33899] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/export-test/export-1696384815846 2023-10-04 02:00:15,847 INFO [Listener at jenkins-hbase9.apache.org/33899] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:38449, tgtDir=hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/export-test/export-1696384815846, rawTgtDir=hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/export-test/export-1696384815846, srcFsUri=hdfs://localhost:38449, srcDir=hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51 2023-10-04 02:00:15,887 DEBUG [Listener at jenkins-hbase9.apache.org/33899] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:38449, inputRoot=hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51 2023-10-04 02:00:15,887 DEBUG [Listener at jenkins-hbase9.apache.org/33899] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1270974069_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/export-test/export-1696384815846, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/export-test/export-1696384815846/.hbase-snapshot/.tmp/testExportWithTargetName 2023-10-04 02:00:15,887 INFO [Listener at jenkins-hbase9.apache.org/33899] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:38449, inputRoot=hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51, snapshotDir=hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/.hbase-snapshot/snaptb0-testExportWithTargetName. 2023-10-04 02:00:15,908 INFO [Listener at jenkins-hbase9.apache.org/33899] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/.hbase-snapshot/snaptb0-testExportWithTargetName to hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/export-test/export-1696384815846/.hbase-snapshot/.tmp/testExportWithTargetName 2023-10-04 02:00:15,973 DEBUG [Listener at jenkins-hbase9.apache.org/33899] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-10-04 02:00:15,974 DEBUG [Listener at jenkins-hbase9.apache.org/33899] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-10-04 02:00:15,975 DEBUG [Listener at jenkins-hbase9.apache.org/33899] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-10-04 02:00:15,975 DEBUG [Listener at jenkins-hbase9.apache.org/33899] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-10-04 02:00:15,976 DEBUG [Listener at jenkins-hbase9.apache.org/33899] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar 2023-10-04 02:00:15,976 DEBUG [Listener at jenkins-hbase9.apache.org/33899] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-10-04 02:00:15,977 DEBUG [Listener at jenkins-hbase9.apache.org/33899] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-10-04 02:00:16,059 DEBUG [Listener at jenkins-hbase9.apache.org/33899] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/757a468a-9656-cc80-ec19-d6f68f36be5a/hadoop-3479274397834933363.jar 2023-10-04 02:00:16,060 DEBUG [Listener at jenkins-hbase9.apache.org/33899] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-10-04 02:00:16,060 DEBUG [Listener at jenkins-hbase9.apache.org/33899] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-10-04 02:00:16,061 DEBUG [Listener at jenkins-hbase9.apache.org/33899] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-10-04 02:00:16,061 DEBUG [Listener at jenkins-hbase9.apache.org/33899] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-10-04 02:00:16,062 DEBUG [Listener at jenkins-hbase9.apache.org/33899] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-10-04 02:00:16,062 DEBUG [Listener at jenkins-hbase9.apache.org/33899] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-10-04 02:00:16,063 DEBUG [Listener at jenkins-hbase9.apache.org/33899] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-10-04 02:00:16,064 DEBUG [Listener at jenkins-hbase9.apache.org/33899] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-10-04 02:00:16,065 DEBUG [Listener at jenkins-hbase9.apache.org/33899] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-10-04 02:00:16,065 DEBUG [Listener at jenkins-hbase9.apache.org/33899] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-10-04 02:00:16,066 DEBUG [Listener at jenkins-hbase9.apache.org/33899] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-10-04 02:00:16,067 DEBUG [Listener at jenkins-hbase9.apache.org/33899] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-10-04 02:00:16,067 DEBUG [Listener at jenkins-hbase9.apache.org/33899] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-10-04 02:00:16,068 DEBUG [Listener at jenkins-hbase9.apache.org/33899] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-10-04 02:00:16,069 DEBUG [Listener at jenkins-hbase9.apache.org/33899] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-10-04 02:00:16,070 DEBUG [Listener at jenkins-hbase9.apache.org/33899] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-10-04 02:00:16,074 DEBUG [Listener at jenkins-hbase9.apache.org/33899] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-04 02:00:16,075 DEBUG [Listener at jenkins-hbase9.apache.org/33899] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-04 02:00:16,075 DEBUG [Listener at jenkins-hbase9.apache.org/33899] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-10-04 02:00:16,076 DEBUG [Listener at jenkins-hbase9.apache.org/33899] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-04 02:00:16,076 DEBUG [Listener at jenkins-hbase9.apache.org/33899] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-04 02:00:16,077 DEBUG [Listener at jenkins-hbase9.apache.org/33899] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-10-04 02:00:16,077 DEBUG [Listener at jenkins-hbase9.apache.org/33899] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-10-04 02:00:16,867 WARN [Listener at jenkins-hbase9.apache.org/33899] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-10-04 02:00:16,872 INFO [Listener at jenkins-hbase9.apache.org/33899] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportWithTargetName' hfile list 2023-10-04 02:00:16,881 DEBUG [Listener at jenkins-hbase9.apache.org/33899] snapshot.ExportSnapshot(671): export split=0 size=30.9 K 2023-10-04 02:00:17,332 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-10-04 02:00:17,334 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-10-04 02:00:17,855 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696384811997_0001_000001 (auth:SIMPLE) 2023-10-04 02:00:19,107 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-10-04 02:00:22,114 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696384811997_0001_000001 (auth:SIMPLE) 2023-10-04 02:00:24,380 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696384811997_0001_000001 (auth:SIMPLE) 2023-10-04 02:00:27,086 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696384811997_0001_000001 (auth:SIMPLE) 2023-10-04 02:00:28,686 INFO [Listener at jenkins-hbase9.apache.org/33899] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-10-04 02:00:28,690 INFO [Listener at jenkins-hbase9.apache.org/33899] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-10-04 02:00:28,706 INFO [Listener at jenkins-hbase9.apache.org/33899] snapshot.ExportSnapshot(1127): Export Completed: testExportWithTargetName 2023-10-04 02:00:28,707 INFO [Listener at jenkins-hbase9.apache.org/33899] snapshot.TestExportSnapshot(279): Exported snapshot 2023-10-04 02:00:28,707 INFO [Listener at jenkins-hbase9.apache.org/33899] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-10-04 02:00:28,708 DEBUG [Listener at jenkins-hbase9.apache.org/33899] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-737588810_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/.hbase-snapshot/snaptb0-testExportWithTargetName at hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/.hbase-snapshot/snaptb0-testExportWithTargetName 2023-10-04 02:00:28,708 DEBUG [Listener at jenkins-hbase9.apache.org/33899] snapshot.TestExportSnapshot(367): hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/.hbase-snapshot/snaptb0-testExportWithTargetName/.snapshotinfo 2023-10-04 02:00:28,709 DEBUG [Listener at jenkins-hbase9.apache.org/33899] snapshot.TestExportSnapshot(367): hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/.hbase-snapshot/snaptb0-testExportWithTargetName/data.manifest 2023-10-04 02:00:28,709 DEBUG [Listener at jenkins-hbase9.apache.org/33899] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-737588810_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/export-test/export-1696384815846/.hbase-snapshot/testExportWithTargetName at hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/export-test/export-1696384815846/.hbase-snapshot/testExportWithTargetName 2023-10-04 02:00:28,709 DEBUG [Listener at jenkins-hbase9.apache.org/33899] snapshot.TestExportSnapshot(367): hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/export-test/export-1696384815846/.hbase-snapshot/testExportWithTargetName/.snapshotinfo 2023-10-04 02:00:28,709 DEBUG [Listener at jenkins-hbase9.apache.org/33899] snapshot.TestExportSnapshot(367): hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/export-test/export-1696384815846/.hbase-snapshot/testExportWithTargetName/data.manifest 2023-10-04 02:00:28,720 INFO [Listener at jenkins-hbase9.apache.org/33899] client.HBaseAdmin$15(890): Started disable of testtb-testExportWithTargetName 2023-10-04 02:00:28,725 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39651] master.HMaster$11(2418): Client=jenkins//172.31.2.10 disable testtb-testExportWithTargetName 2023-10-04 02:00:28,734 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39651] procedure2.ProcedureExecutor(1028): Stored pid=21, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportWithTargetName 2023-10-04 02:00:28,739 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696384828739"}]},"ts":"1696384828739"} 2023-10-04 02:00:28,740 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39651] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-10-04 02:00:28,741 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=DISABLING in hbase:meta 2023-10-04 02:00:28,743 INFO [PEWorker-4] procedure.DisableTableProcedure(293): Set testtb-testExportWithTargetName to state=DISABLING 2023-10-04 02:00:28,744 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=22, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=5de56d0448b25922e7a6d562d9fb2f8c, UNASSIGN}, {pid=23, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=66724f2ee238f5ca8201ddf6308997b3, UNASSIGN}] 2023-10-04 02:00:28,747 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=22, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=5de56d0448b25922e7a6d562d9fb2f8c, UNASSIGN 2023-10-04 02:00:28,747 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=23, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=66724f2ee238f5ca8201ddf6308997b3, UNASSIGN 2023-10-04 02:00:28,748 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=22 updating hbase:meta row=5de56d0448b25922e7a6d562d9fb2f8c, regionState=CLOSING, regionLocation=jenkins-hbase9.apache.org,44303,1696384805319 2023-10-04 02:00:28,748 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=23 updating hbase:meta row=66724f2ee238f5ca8201ddf6308997b3, regionState=CLOSING, regionLocation=jenkins-hbase9.apache.org,35175,1696384805436 2023-10-04 02:00:28,748 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,,1696384813038.5de56d0448b25922e7a6d562d9fb2f8c.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1696384828748"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696384828748"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696384828748"}]},"ts":"1696384828748"} 2023-10-04 02:00:28,748 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,1,1696384813038.66724f2ee238f5ca8201ddf6308997b3.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1696384828748"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696384828748"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696384828748"}]},"ts":"1696384828748"} 2023-10-04 02:00:28,750 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=24, ppid=22, state=RUNNABLE; CloseRegionProcedure 5de56d0448b25922e7a6d562d9fb2f8c, server=jenkins-hbase9.apache.org,44303,1696384805319}] 2023-10-04 02:00:28,750 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=25, ppid=23, state=RUNNABLE; CloseRegionProcedure 66724f2ee238f5ca8201ddf6308997b3, server=jenkins-hbase9.apache.org,35175,1696384805436}] 2023-10-04 02:00:28,841 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39651] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-10-04 02:00:28,910 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(111): Close 5de56d0448b25922e7a6d562d9fb2f8c 2023-10-04 02:00:28,910 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(111): Close 66724f2ee238f5ca8201ddf6308997b3 2023-10-04 02:00:28,910 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1604): Closing 66724f2ee238f5ca8201ddf6308997b3, disabling compactions & flushes 2023-10-04 02:00:28,911 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1604): Closing 5de56d0448b25922e7a6d562d9fb2f8c, disabling compactions & flushes 2023-10-04 02:00:28,911 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,1,1696384813038.66724f2ee238f5ca8201ddf6308997b3. 2023-10-04 02:00:28,911 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,,1696384813038.5de56d0448b25922e7a6d562d9fb2f8c. 2023-10-04 02:00:28,911 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,1,1696384813038.66724f2ee238f5ca8201ddf6308997b3. 2023-10-04 02:00:28,911 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,,1696384813038.5de56d0448b25922e7a6d562d9fb2f8c. 2023-10-04 02:00:28,911 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,1,1696384813038.66724f2ee238f5ca8201ddf6308997b3. after waiting 0 ms 2023-10-04 02:00:28,911 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,,1696384813038.5de56d0448b25922e7a6d562d9fb2f8c. after waiting 0 ms 2023-10-04 02:00:28,911 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,1,1696384813038.66724f2ee238f5ca8201ddf6308997b3. 2023-10-04 02:00:28,911 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,,1696384813038.5de56d0448b25922e7a6d562d9fb2f8c. 2023-10-04 02:00:28,932 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/data/default/testtb-testExportWithTargetName/5de56d0448b25922e7a6d562d9fb2f8c/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-10-04 02:00:28,933 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/data/default/testtb-testExportWithTargetName/66724f2ee238f5ca8201ddf6308997b3/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-10-04 02:00:28,933 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-10-04 02:00:28,933 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-10-04 02:00:28,934 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,,1696384813038.5de56d0448b25922e7a6d562d9fb2f8c. 2023-10-04 02:00:28,934 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,1,1696384813038.66724f2ee238f5ca8201ddf6308997b3. 2023-10-04 02:00:28,934 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1558): Region close journal for 5de56d0448b25922e7a6d562d9fb2f8c: 2023-10-04 02:00:28,934 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1558): Region close journal for 66724f2ee238f5ca8201ddf6308997b3: 2023-10-04 02:00:28,937 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(149): Closed 5de56d0448b25922e7a6d562d9fb2f8c 2023-10-04 02:00:28,937 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=22 updating hbase:meta row=5de56d0448b25922e7a6d562d9fb2f8c, regionState=CLOSED 2023-10-04 02:00:28,938 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,,1696384813038.5de56d0448b25922e7a6d562d9fb2f8c.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1696384828937"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696384828937"}]},"ts":"1696384828937"} 2023-10-04 02:00:28,938 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(149): Closed 66724f2ee238f5ca8201ddf6308997b3 2023-10-04 02:00:28,942 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=23 updating hbase:meta row=66724f2ee238f5ca8201ddf6308997b3, regionState=CLOSED 2023-10-04 02:00:28,942 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,1,1696384813038.66724f2ee238f5ca8201ddf6308997b3.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1696384828942"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696384828942"}]},"ts":"1696384828942"} 2023-10-04 02:00:28,945 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=24, resume processing ppid=22 2023-10-04 02:00:28,945 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=24, ppid=22, state=SUCCESS; CloseRegionProcedure 5de56d0448b25922e7a6d562d9fb2f8c, server=jenkins-hbase9.apache.org,44303,1696384805319 in 189 msec 2023-10-04 02:00:28,947 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=22, ppid=21, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=5de56d0448b25922e7a6d562d9fb2f8c, UNASSIGN in 201 msec 2023-10-04 02:00:28,947 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=25, resume processing ppid=23 2023-10-04 02:00:28,948 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=25, ppid=23, state=SUCCESS; CloseRegionProcedure 66724f2ee238f5ca8201ddf6308997b3, server=jenkins-hbase9.apache.org,35175,1696384805436 in 195 msec 2023-10-04 02:00:28,950 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=23, resume processing ppid=21 2023-10-04 02:00:28,950 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=23, ppid=21, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=66724f2ee238f5ca8201ddf6308997b3, UNASSIGN in 204 msec 2023-10-04 02:00:28,951 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696384828951"}]},"ts":"1696384828951"} 2023-10-04 02:00:28,952 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=DISABLED in hbase:meta 2023-10-04 02:00:28,954 INFO [PEWorker-1] procedure.DisableTableProcedure(305): Set testtb-testExportWithTargetName to state=DISABLED 2023-10-04 02:00:28,957 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=21, state=SUCCESS; DisableTableProcedure table=testtb-testExportWithTargetName in 226 msec 2023-10-04 02:00:29,043 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39651] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-10-04 02:00:29,043 INFO [Listener at jenkins-hbase9.apache.org/33899] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportWithTargetName, procId: 21 completed 2023-10-04 02:00:29,048 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39651] master.HMaster$5(2228): Client=jenkins//172.31.2.10 delete testtb-testExportWithTargetName 2023-10-04 02:00:29,056 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39651] procedure2.ProcedureExecutor(1028): Stored pid=26, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-10-04 02:00:29,059 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=26, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-10-04 02:00:29,060 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39651] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportWithTargetName 2023-10-04 02:00:29,061 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=26, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-10-04 02:00:29,064 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=44303] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportWithTargetName 2023-10-04 02:00:29,067 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/.tmp/data/default/testtb-testExportWithTargetName/5de56d0448b25922e7a6d562d9fb2f8c 2023-10-04 02:00:29,067 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/.tmp/data/default/testtb-testExportWithTargetName/66724f2ee238f5ca8201ddf6308997b3 2023-10-04 02:00:29,071 DEBUG [HFileArchiver-5] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/.tmp/data/default/testtb-testExportWithTargetName/5de56d0448b25922e7a6d562d9fb2f8c/cf, FileablePath, hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/.tmp/data/default/testtb-testExportWithTargetName/5de56d0448b25922e7a6d562d9fb2f8c/recovered.edits] 2023-10-04 02:00:29,071 DEBUG [HFileArchiver-6] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/.tmp/data/default/testtb-testExportWithTargetName/66724f2ee238f5ca8201ddf6308997b3/cf, FileablePath, hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/.tmp/data/default/testtb-testExportWithTargetName/66724f2ee238f5ca8201ddf6308997b3/recovered.edits] 2023-10-04 02:00:29,079 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/.tmp/data/default/testtb-testExportWithTargetName/66724f2ee238f5ca8201ddf6308997b3/cf/1bf79b8618d441f3a3f43f97540d6691 to hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/archive/data/default/testtb-testExportWithTargetName/66724f2ee238f5ca8201ddf6308997b3/cf/1bf79b8618d441f3a3f43f97540d6691 2023-10-04 02:00:29,080 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/.tmp/data/default/testtb-testExportWithTargetName/5de56d0448b25922e7a6d562d9fb2f8c/cf/bf393de1ff9449d4b607069660f9e713 to hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/archive/data/default/testtb-testExportWithTargetName/5de56d0448b25922e7a6d562d9fb2f8c/cf/bf393de1ff9449d4b607069660f9e713 2023-10-04 02:00:29,084 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/.tmp/data/default/testtb-testExportWithTargetName/66724f2ee238f5ca8201ddf6308997b3/recovered.edits/9.seqid to hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/archive/data/default/testtb-testExportWithTargetName/66724f2ee238f5ca8201ddf6308997b3/recovered.edits/9.seqid 2023-10-04 02:00:29,084 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/.tmp/data/default/testtb-testExportWithTargetName/5de56d0448b25922e7a6d562d9fb2f8c/recovered.edits/9.seqid to hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/archive/data/default/testtb-testExportWithTargetName/5de56d0448b25922e7a6d562d9fb2f8c/recovered.edits/9.seqid 2023-10-04 02:00:29,085 DEBUG [HFileArchiver-6] backup.HFileArchiver(596): Deleted hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/.tmp/data/default/testtb-testExportWithTargetName/66724f2ee238f5ca8201ddf6308997b3 2023-10-04 02:00:29,085 DEBUG [HFileArchiver-5] backup.HFileArchiver(596): Deleted hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/.tmp/data/default/testtb-testExportWithTargetName/5de56d0448b25922e7a6d562d9fb2f8c 2023-10-04 02:00:29,085 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testtb-testExportWithTargetName regions 2023-10-04 02:00:29,085 DEBUG [PEWorker-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71 2023-10-04 02:00:29,086 DEBUG [PEWorker-2] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf] 2023-10-04 02:00:29,093 DEBUG [PEWorker-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b20231004dcf60096095d4cae9ae8c2d4fd484aa7 to hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/archive/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b20231004dcf60096095d4cae9ae8c2d4fd484aa7 2023-10-04 02:00:29,095 DEBUG [PEWorker-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e202310045465b6a07df344bfbad822a6bf6e4ee6 to hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/archive/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e202310045465b6a07df344bfbad822a6bf6e4ee6 2023-10-04 02:00:29,096 DEBUG [PEWorker-2] backup.HFileArchiver(596): Deleted hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71 2023-10-04 02:00:29,099 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=26, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-10-04 02:00:29,120 WARN [PEWorker-2] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportWithTargetName from hbase:meta 2023-10-04 02:00:29,183 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): regionserver:44303-0x1010f1b55330001, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-10-04 02:00:29,185 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): regionserver:39045-0x1010f1b55330002, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-10-04 02:00:29,183 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): master:39651-0x1010f1b55330000, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-10-04 02:00:29,183 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): regionserver:35175-0x1010f1b55330003, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-10-04 02:00:29,187 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportWithTargetName' descriptor. 2023-10-04 02:00:29,189 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=26, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-10-04 02:00:29,189 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportWithTargetName' from region states. 2023-10-04 02:00:29,189 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportWithTargetName,,1696384813038.5de56d0448b25922e7a6d562d9fb2f8c.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1696384829189"}]},"ts":"9223372036854775807"} 2023-10-04 02:00:29,189 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportWithTargetName,1,1696384813038.66724f2ee238f5ca8201ddf6308997b3.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1696384829189"}]},"ts":"9223372036854775807"} 2023-10-04 02:00:29,192 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): regionserver:44303-0x1010f1b55330001, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-04 02:00:29,192 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): regionserver:35175-0x1010f1b55330003, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-04 02:00:29,192 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): regionserver:39045-0x1010f1b55330002, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-04 02:00:29,192 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data null 2023-10-04 02:00:29,192 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): master:39651-0x1010f1b55330000, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-04 02:00:29,192 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-10-04 02:00:29,192 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data null 2023-10-04 02:00:29,192 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-10-04 02:00:29,192 INFO [PEWorker-2] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-10-04 02:00:29,192 DEBUG [PEWorker-2] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 5de56d0448b25922e7a6d562d9fb2f8c, NAME => 'testtb-testExportWithTargetName,,1696384813038.5de56d0448b25922e7a6d562d9fb2f8c.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 66724f2ee238f5ca8201ddf6308997b3, NAME => 'testtb-testExportWithTargetName,1,1696384813038.66724f2ee238f5ca8201ddf6308997b3.', STARTKEY => '1', ENDKEY => ''}] 2023-10-04 02:00:29,192 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportWithTargetName' as deleted. 2023-10-04 02:00:29,193 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data null 2023-10-04 02:00:29,193 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-10-04 02:00:29,193 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1696384829193"}]},"ts":"9223372036854775807"} 2023-10-04 02:00:29,193 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data null 2023-10-04 02:00:29,193 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-10-04 02:00:29,195 INFO [PEWorker-2] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportWithTargetName state from META 2023-10-04 02:00:29,195 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39651] master.MasterRpcServices(1230): Checking to see if procedure is done pid=26 2023-10-04 02:00:29,200 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(130): Finished pid=26, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-10-04 02:00:29,201 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=26, state=SUCCESS; DeleteTableProcedure table=testtb-testExportWithTargetName in 150 msec 2023-10-04 02:00:29,297 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39651] master.MasterRpcServices(1230): Checking to see if procedure is done pid=26 2023-10-04 02:00:29,297 INFO [Listener at jenkins-hbase9.apache.org/33899] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportWithTargetName, procId: 26 completed 2023-10-04 02:00:29,315 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39651] master.MasterRpcServices(751): Client=jenkins//172.31.2.10 delete name: "emptySnaptb0-testExportWithTargetName" 2023-10-04 02:00:29,318 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39651] snapshot.SnapshotManager(335): Deleting snapshot: emptySnaptb0-testExportWithTargetName 2023-10-04 02:00:29,321 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39651] master.MasterRpcServices(751): Client=jenkins//172.31.2.10 delete name: "snaptb0-testExportWithTargetName" 2023-10-04 02:00:29,323 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39651] snapshot.SnapshotManager(335): Deleting snapshot: snaptb0-testExportWithTargetName 2023-10-04 02:00:29,350 INFO [Listener at jenkins-hbase9.apache.org/33899] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testExportWithTargetName Thread=749 (was 702) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/757a468a-9656-cc80-ec19-d6f68f36be5a/cluster_99689198-45bf-8fbc-bd30-def9ae3ef530/dfs/data/data4/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: member: 'jenkins-hbase9.apache.org,35175,1696384805436' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-4 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-737588810_17 at /127.0.0.1:42244 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Parameter Sending Thread #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/757a468a-9656-cc80-ec19-d6f68f36be5a/cluster_99689198-45bf-8fbc-bd30-def9ae3ef530/dfs/data/data1/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-1281 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x20d1013d-shared-pool-9 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Timer for 'JobHistoryServer' metrics system java.lang.Object.wait(Native Method) java.util.TimerThread.mainLoop(Timer.java:552) java.util.TimerThread.run(Timer.java:505) Potentially hanging thread: hconnection-0x20d1013d-shared-pool-10 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Container metrics unregistration java.lang.Object.wait(Native Method) java.util.TimerThread.mainLoop(Timer.java:552) java.util.TimerThread.run(Timer.java:505) Potentially hanging thread: IPC Client (905985230) connection to jenkins-hbase9.apache.org/172.31.2.10:41857 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: HFileArchiver-5 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MutableQuantiles-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ContainersLauncher #0 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.read1(BufferedReader.java:212) java.io.BufferedReader.read(BufferedReader.java:286) org.apache.hadoop.util.Shell$ShellCommandExecutor.parseExecResult(Shell.java:1229) org.apache.hadoop.util.Shell.runCommand(Shell.java:984) org.apache.hadoop.util.Shell.run(Shell.java:884) org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:1216) org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor.launchContainer(DefaultContainerExecutor.java:294) org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.launchContainer(ContainerLaunch.java:442) org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:293) org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:97) java.util.concurrent.FutureTask.run(FutureTask.java:266) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-2 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: htable-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (905985230) connection to jenkins-hbase9.apache.org/172.31.2.10:44823 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: (jenkins-hbase9.apache.org,39651,1696384803959)-proc-coordinator-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (905985230) connection to jenkins-hbase9.apache.org/172.31.2.10:46813 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: htable-pool-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x20d1013d-shared-pool-12 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x20d1013d-shared-pool-11 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-3 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/757a468a-9656-cc80-ec19-d6f68f36be5a/cluster_99689198-45bf-8fbc-bd30-def9ae3ef530/dfs/data/data2/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1270974069_17 at /127.0.0.1:36948 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ContainersLauncher #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/757a468a-9656-cc80-ec19-d6f68f36be5a/cluster_99689198-45bf-8fbc-bd30-def9ae3ef530/dfs/data/data3/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/757a468a-9656-cc80-ec19-d6f68f36be5a/cluster_99689198-45bf-8fbc-bd30-def9ae3ef530/dfs/data/data5/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-6 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: member: 'jenkins-hbase9.apache.org,39045,1696384805392' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: member: 'jenkins-hbase9.apache.org,44303,1696384805319' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-737588810_17 at /127.0.0.1:50324 [Waiting for operation #6] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1769436605_1 at /127.0.0.1:36900 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/757a468a-9656-cc80-ec19-d6f68f36be5a/cluster_99689198-45bf-8fbc-bd30-def9ae3ef530/dfs/data/data6/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=926 (was 902) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=247 (was 222) - SystemLoadAverage LEAK? -, ProcessCount=168 (was 165) - ProcessCount LEAK? -, AvailableMemoryMB=11114 (was 11900) 2023-10-04 02:00:29,351 WARN [Listener at jenkins-hbase9.apache.org/33899] hbase.ResourceChecker(130): Thread=749 is superior to 500 2023-10-04 02:00:29,370 INFO [Listener at jenkins-hbase9.apache.org/33899] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testExportFileSystemState Thread=749, OpenFileDescriptor=926, MaxFileDescriptor=60000, SystemLoadAverage=247, ProcessCount=168, AvailableMemoryMB=11114 2023-10-04 02:00:29,370 WARN [Listener at jenkins-hbase9.apache.org/33899] hbase.ResourceChecker(130): Thread=749 is superior to 500 2023-10-04 02:00:29,372 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39651] master.HMaster$4(2112): Client=jenkins//172.31.2.10 create 'testtb-testExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-10-04 02:00:29,375 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39651] procedure2.ProcedureExecutor(1028): Stored pid=27, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemState 2023-10-04 02:00:29,377 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_PRE_OPERATION 2023-10-04 02:00:29,378 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39651] master.MasterRpcServices(700): Client=jenkins//172.31.2.10 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemState" procId is: 27 2023-10-04 02:00:29,379 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-10-04 02:00:29,380 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39651] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-10-04 02:00:29,383 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/.tmp/data/default/testtb-testExportFileSystemState/c4077678ce34c812f7ddedefaa28ee4d 2023-10-04 02:00:29,383 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/.tmp/data/default/testtb-testExportFileSystemState/9ec52cdf4bc03952ff9cfca008868a1a 2023-10-04 02:00:29,384 DEBUG [HFileArchiver-7] backup.HFileArchiver(153): Directory hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/.tmp/data/default/testtb-testExportFileSystemState/c4077678ce34c812f7ddedefaa28ee4d empty. 2023-10-04 02:00:29,384 DEBUG [HFileArchiver-8] backup.HFileArchiver(153): Directory hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/.tmp/data/default/testtb-testExportFileSystemState/9ec52cdf4bc03952ff9cfca008868a1a empty. 2023-10-04 02:00:29,384 DEBUG [HFileArchiver-7] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/.tmp/data/default/testtb-testExportFileSystemState/c4077678ce34c812f7ddedefaa28ee4d 2023-10-04 02:00:29,384 DEBUG [HFileArchiver-8] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/.tmp/data/default/testtb-testExportFileSystemState/9ec52cdf4bc03952ff9cfca008868a1a 2023-10-04 02:00:29,384 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemState regions 2023-10-04 02:00:29,396 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/.tmp/data/default/testtb-testExportFileSystemState/.tabledesc/.tableinfo.0000000001 2023-10-04 02:00:29,397 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(7675): creating {ENCODED => c4077678ce34c812f7ddedefaa28ee4d, NAME => 'testtb-testExportFileSystemState,,1696384829372.c4077678ce34c812f7ddedefaa28ee4d.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/.tmp 2023-10-04 02:00:29,398 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(7675): creating {ENCODED => 9ec52cdf4bc03952ff9cfca008868a1a, NAME => 'testtb-testExportFileSystemState,1,1696384829372.9ec52cdf4bc03952ff9cfca008868a1a.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/.tmp 2023-10-04 02:00:29,419 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,,1696384829372.c4077678ce34c812f7ddedefaa28ee4d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-04 02:00:29,420 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1604): Closing c4077678ce34c812f7ddedefaa28ee4d, disabling compactions & flushes 2023-10-04 02:00:29,420 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,,1696384829372.c4077678ce34c812f7ddedefaa28ee4d. 2023-10-04 02:00:29,420 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,,1696384829372.c4077678ce34c812f7ddedefaa28ee4d. 2023-10-04 02:00:29,420 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,,1696384829372.c4077678ce34c812f7ddedefaa28ee4d. after waiting 0 ms 2023-10-04 02:00:29,420 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,,1696384829372.c4077678ce34c812f7ddedefaa28ee4d. 2023-10-04 02:00:29,420 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,,1696384829372.c4077678ce34c812f7ddedefaa28ee4d. 2023-10-04 02:00:29,420 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,1,1696384829372.9ec52cdf4bc03952ff9cfca008868a1a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-04 02:00:29,420 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1558): Region close journal for c4077678ce34c812f7ddedefaa28ee4d: 2023-10-04 02:00:29,421 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1604): Closing 9ec52cdf4bc03952ff9cfca008868a1a, disabling compactions & flushes 2023-10-04 02:00:29,421 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,1,1696384829372.9ec52cdf4bc03952ff9cfca008868a1a. 2023-10-04 02:00:29,421 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,1,1696384829372.9ec52cdf4bc03952ff9cfca008868a1a. 2023-10-04 02:00:29,421 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,1,1696384829372.9ec52cdf4bc03952ff9cfca008868a1a. after waiting 0 ms 2023-10-04 02:00:29,421 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,1,1696384829372.9ec52cdf4bc03952ff9cfca008868a1a. 2023-10-04 02:00:29,421 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,1,1696384829372.9ec52cdf4bc03952ff9cfca008868a1a. 2023-10-04 02:00:29,421 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1558): Region close journal for 9ec52cdf4bc03952ff9cfca008868a1a: 2023-10-04 02:00:29,424 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_ADD_TO_META 2023-10-04 02:00:29,425 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,,1696384829372.c4077678ce34c812f7ddedefaa28ee4d.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1696384829425"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696384829425"}]},"ts":"1696384829425"} 2023-10-04 02:00:29,426 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,1,1696384829372.9ec52cdf4bc03952ff9cfca008868a1a.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1696384829425"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696384829425"}]},"ts":"1696384829425"} 2023-10-04 02:00:29,428 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-10-04 02:00:29,429 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-10-04 02:00:29,429 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696384829429"}]},"ts":"1696384829429"} 2023-10-04 02:00:29,431 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=ENABLING in hbase:meta 2023-10-04 02:00:29,435 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase9.apache.org=0} racks are {/default-rack=0} 2023-10-04 02:00:29,437 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-10-04 02:00:29,437 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-10-04 02:00:29,437 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-10-04 02:00:29,437 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-10-04 02:00:29,437 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=c4077678ce34c812f7ddedefaa28ee4d, ASSIGN}, {pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=9ec52cdf4bc03952ff9cfca008868a1a, ASSIGN}] 2023-10-04 02:00:29,441 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=c4077678ce34c812f7ddedefaa28ee4d, ASSIGN 2023-10-04 02:00:29,441 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=9ec52cdf4bc03952ff9cfca008868a1a, ASSIGN 2023-10-04 02:00:29,442 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=c4077678ce34c812f7ddedefaa28ee4d, ASSIGN; state=OFFLINE, location=jenkins-hbase9.apache.org,35175,1696384805436; forceNewPlan=false, retain=false 2023-10-04 02:00:29,442 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=9ec52cdf4bc03952ff9cfca008868a1a, ASSIGN; state=OFFLINE, location=jenkins-hbase9.apache.org,39045,1696384805392; forceNewPlan=false, retain=false 2023-10-04 02:00:29,481 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39651] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-10-04 02:00:29,592 INFO [jenkins-hbase9:39651] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-10-04 02:00:29,595 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=29 updating hbase:meta row=9ec52cdf4bc03952ff9cfca008868a1a, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,39045,1696384805392 2023-10-04 02:00:29,595 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=28 updating hbase:meta row=c4077678ce34c812f7ddedefaa28ee4d, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,35175,1696384805436 2023-10-04 02:00:29,595 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,1,1696384829372.9ec52cdf4bc03952ff9cfca008868a1a.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1696384829595"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696384829595"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696384829595"}]},"ts":"1696384829595"} 2023-10-04 02:00:29,595 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,,1696384829372.c4077678ce34c812f7ddedefaa28ee4d.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1696384829595"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696384829595"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696384829595"}]},"ts":"1696384829595"} 2023-10-04 02:00:29,597 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=30, ppid=29, state=RUNNABLE; OpenRegionProcedure 9ec52cdf4bc03952ff9cfca008868a1a, server=jenkins-hbase9.apache.org,39045,1696384805392}] 2023-10-04 02:00:29,598 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=31, ppid=28, state=RUNNABLE; OpenRegionProcedure c4077678ce34c812f7ddedefaa28ee4d, server=jenkins-hbase9.apache.org,35175,1696384805436}] 2023-10-04 02:00:29,682 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39651] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-10-04 02:00:29,752 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(712): New admin connection to jenkins-hbase9.apache.org,39045,1696384805392 2023-10-04 02:00:29,752 DEBUG [RSProcedureDispatcher-pool-1] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-10-04 02:00:29,757 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:41096, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-10-04 02:00:29,763 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemState,,1696384829372.c4077678ce34c812f7ddedefaa28ee4d. 2023-10-04 02:00:29,763 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => c4077678ce34c812f7ddedefaa28ee4d, NAME => 'testtb-testExportFileSystemState,,1696384829372.c4077678ce34c812f7ddedefaa28ee4d.', STARTKEY => '', ENDKEY => '1'} 2023-10-04 02:00:29,763 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemState,,1696384829372.c4077678ce34c812f7ddedefaa28ee4d. service=AccessControlService 2023-10-04 02:00:29,764 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-10-04 02:00:29,764 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemState c4077678ce34c812f7ddedefaa28ee4d 2023-10-04 02:00:29,764 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,,1696384829372.c4077678ce34c812f7ddedefaa28ee4d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-04 02:00:29,764 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7894): checking encryption for c4077678ce34c812f7ddedefaa28ee4d 2023-10-04 02:00:29,764 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7897): checking classloading for c4077678ce34c812f7ddedefaa28ee4d 2023-10-04 02:00:29,765 INFO [StoreOpener-c4077678ce34c812f7ddedefaa28ee4d-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region c4077678ce34c812f7ddedefaa28ee4d 2023-10-04 02:00:29,765 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemState,1,1696384829372.9ec52cdf4bc03952ff9cfca008868a1a. 2023-10-04 02:00:29,766 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 9ec52cdf4bc03952ff9cfca008868a1a, NAME => 'testtb-testExportFileSystemState,1,1696384829372.9ec52cdf4bc03952ff9cfca008868a1a.', STARTKEY => '1', ENDKEY => ''} 2023-10-04 02:00:29,766 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemState,1,1696384829372.9ec52cdf4bc03952ff9cfca008868a1a. service=AccessControlService 2023-10-04 02:00:29,766 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-10-04 02:00:29,767 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemState 9ec52cdf4bc03952ff9cfca008868a1a 2023-10-04 02:00:29,767 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,1,1696384829372.9ec52cdf4bc03952ff9cfca008868a1a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-04 02:00:29,767 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7894): checking encryption for 9ec52cdf4bc03952ff9cfca008868a1a 2023-10-04 02:00:29,767 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7897): checking classloading for 9ec52cdf4bc03952ff9cfca008868a1a 2023-10-04 02:00:29,767 DEBUG [StoreOpener-c4077678ce34c812f7ddedefaa28ee4d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/data/default/testtb-testExportFileSystemState/c4077678ce34c812f7ddedefaa28ee4d/cf 2023-10-04 02:00:29,767 DEBUG [StoreOpener-c4077678ce34c812f7ddedefaa28ee4d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/data/default/testtb-testExportFileSystemState/c4077678ce34c812f7ddedefaa28ee4d/cf 2023-10-04 02:00:29,768 INFO [StoreOpener-c4077678ce34c812f7ddedefaa28ee4d-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region c4077678ce34c812f7ddedefaa28ee4d columnFamilyName cf 2023-10-04 02:00:29,768 INFO [StoreOpener-9ec52cdf4bc03952ff9cfca008868a1a-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 9ec52cdf4bc03952ff9cfca008868a1a 2023-10-04 02:00:29,769 INFO [StoreOpener-c4077678ce34c812f7ddedefaa28ee4d-1] regionserver.HStore(310): Store=c4077678ce34c812f7ddedefaa28ee4d/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-04 02:00:29,771 DEBUG [StoreOpener-9ec52cdf4bc03952ff9cfca008868a1a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/data/default/testtb-testExportFileSystemState/9ec52cdf4bc03952ff9cfca008868a1a/cf 2023-10-04 02:00:29,771 DEBUG [StoreOpener-9ec52cdf4bc03952ff9cfca008868a1a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/data/default/testtb-testExportFileSystemState/9ec52cdf4bc03952ff9cfca008868a1a/cf 2023-10-04 02:00:29,771 INFO [StoreOpener-9ec52cdf4bc03952ff9cfca008868a1a-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 9ec52cdf4bc03952ff9cfca008868a1a columnFamilyName cf 2023-10-04 02:00:29,772 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/data/default/testtb-testExportFileSystemState/c4077678ce34c812f7ddedefaa28ee4d 2023-10-04 02:00:29,772 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/data/default/testtb-testExportFileSystemState/c4077678ce34c812f7ddedefaa28ee4d 2023-10-04 02:00:29,772 INFO [StoreOpener-9ec52cdf4bc03952ff9cfca008868a1a-1] regionserver.HStore(310): Store=9ec52cdf4bc03952ff9cfca008868a1a/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-04 02:00:29,777 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/data/default/testtb-testExportFileSystemState/9ec52cdf4bc03952ff9cfca008868a1a 2023-10-04 02:00:29,777 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/data/default/testtb-testExportFileSystemState/9ec52cdf4bc03952ff9cfca008868a1a 2023-10-04 02:00:29,778 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1055): writing seq id for c4077678ce34c812f7ddedefaa28ee4d 2023-10-04 02:00:29,780 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1055): writing seq id for 9ec52cdf4bc03952ff9cfca008868a1a 2023-10-04 02:00:29,781 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/data/default/testtb-testExportFileSystemState/c4077678ce34c812f7ddedefaa28ee4d/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-04 02:00:29,781 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1072): Opened c4077678ce34c812f7ddedefaa28ee4d; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65153835, jitterRate=-0.02913220226764679}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-10-04 02:00:29,781 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(965): Region open journal for c4077678ce34c812f7ddedefaa28ee4d: 2023-10-04 02:00:29,786 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemState,,1696384829372.c4077678ce34c812f7ddedefaa28ee4d., pid=31, masterSystemTime=1696384829752 2023-10-04 02:00:29,786 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/data/default/testtb-testExportFileSystemState/9ec52cdf4bc03952ff9cfca008868a1a/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-04 02:00:29,786 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1072): Opened 9ec52cdf4bc03952ff9cfca008868a1a; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61394904, jitterRate=-0.08514463901519775}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-10-04 02:00:29,787 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(965): Region open journal for 9ec52cdf4bc03952ff9cfca008868a1a: 2023-10-04 02:00:29,787 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemState,1,1696384829372.9ec52cdf4bc03952ff9cfca008868a1a., pid=30, masterSystemTime=1696384829752 2023-10-04 02:00:29,790 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemState,,1696384829372.c4077678ce34c812f7ddedefaa28ee4d. 2023-10-04 02:00:29,790 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemState,,1696384829372.c4077678ce34c812f7ddedefaa28ee4d. 2023-10-04 02:00:29,791 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=28 updating hbase:meta row=c4077678ce34c812f7ddedefaa28ee4d, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase9.apache.org,35175,1696384805436 2023-10-04 02:00:29,791 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemState,,1696384829372.c4077678ce34c812f7ddedefaa28ee4d.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1696384829791"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1696384829791"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1696384829791"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1696384829791"}]},"ts":"1696384829791"} 2023-10-04 02:00:29,791 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemState,1,1696384829372.9ec52cdf4bc03952ff9cfca008868a1a. 2023-10-04 02:00:29,792 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemState,1,1696384829372.9ec52cdf4bc03952ff9cfca008868a1a. 2023-10-04 02:00:29,793 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=29 updating hbase:meta row=9ec52cdf4bc03952ff9cfca008868a1a, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase9.apache.org,39045,1696384805392 2023-10-04 02:00:29,793 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemState,1,1696384829372.9ec52cdf4bc03952ff9cfca008868a1a.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1696384829792"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1696384829792"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1696384829792"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1696384829792"}]},"ts":"1696384829792"} 2023-10-04 02:00:29,796 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=31, resume processing ppid=28 2023-10-04 02:00:29,796 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=31, ppid=28, state=SUCCESS; OpenRegionProcedure c4077678ce34c812f7ddedefaa28ee4d, server=jenkins-hbase9.apache.org,35175,1696384805436 in 196 msec 2023-10-04 02:00:29,798 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=30, resume processing ppid=29 2023-10-04 02:00:29,798 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=30, ppid=29, state=SUCCESS; OpenRegionProcedure 9ec52cdf4bc03952ff9cfca008868a1a, server=jenkins-hbase9.apache.org,39045,1696384805392 in 198 msec 2023-10-04 02:00:29,800 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=28, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=c4077678ce34c812f7ddedefaa28ee4d, ASSIGN in 359 msec 2023-10-04 02:00:29,801 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=29, resume processing ppid=27 2023-10-04 02:00:29,801 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=29, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=9ec52cdf4bc03952ff9cfca008868a1a, ASSIGN in 361 msec 2023-10-04 02:00:29,802 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-10-04 02:00:29,802 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696384829802"}]},"ts":"1696384829802"} 2023-10-04 02:00:29,804 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=ENABLED in hbase:meta 2023-10-04 02:00:29,811 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_POST_OPERATION 2023-10-04 02:00:29,812 DEBUG [PEWorker-5] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemState jenkins: RWXCA 2023-10-04 02:00:29,814 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=44303] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemState], kv [jenkins: RWXCA] 2023-10-04 02:00:29,815 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): regionserver:44303-0x1010f1b55330001, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-04 02:00:29,816 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): regionserver:35175-0x1010f1b55330003, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-04 02:00:29,816 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): regionserver:39045-0x1010f1b55330002, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-04 02:00:29,816 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): master:39651-0x1010f1b55330000, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-04 02:00:29,817 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-10-04 02:00:29,817 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-10-04 02:00:29,817 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-10-04 02:00:29,818 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-10-04 02:00:29,820 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=27, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemState in 444 msec 2023-10-04 02:00:29,984 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39651] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-10-04 02:00:29,984 INFO [Listener at jenkins-hbase9.apache.org/33899] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemState, procId: 27 completed 2023-10-04 02:00:29,988 DEBUG [Listener at jenkins-hbase9.apache.org/33899] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemState 2023-10-04 02:00:29,988 DEBUG [Listener at jenkins-hbase9.apache.org/33899] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemState,,1696384829372.c4077678ce34c812f7ddedefaa28ee4d. 2023-10-04 02:00:29,990 INFO [Listener at jenkins-hbase9.apache.org/33899] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-10-04 02:00:30,003 DEBUG [hconnection-0x4d455589-shared-pool-11] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-04 02:00:30,009 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:41102, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-04 02:00:30,013 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39651] master.MasterRpcServices(1583): Client=jenkins//172.31.2.10 snapshot request for:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-10-04 02:00:30,014 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39651] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1696384830014 (current time:1696384830014). 2023-10-04 02:00:30,014 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39651] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-10-04 02:00:30,015 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39651] zookeeper.ReadOnlyZKClient(139): Connect 0x13db1298 to 127.0.0.1:60027 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-04 02:00:30,021 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39651] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3232f536, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-04 02:00:30,023 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39651] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-04 02:00:30,026 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:52930, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-04 02:00:30,027 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39651] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x13db1298 to 127.0.0.1:60027 2023-10-04 02:00:30,027 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39651] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-04 02:00:30,029 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39651] zookeeper.ReadOnlyZKClient(139): Connect 0x65eb85cf to 127.0.0.1:60027 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-04 02:00:30,037 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39651] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2eef0438, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-04 02:00:30,038 DEBUG [hconnection-0xbd1cf96-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-04 02:00:30,039 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:52942, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-04 02:00:30,045 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39651] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x65eb85cf to 127.0.0.1:60027 2023-10-04 02:00:30,046 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39651] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-04 02:00:30,046 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39651] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemState], kv [jenkins: RWXCA] 2023-10-04 02:00:30,047 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39651] snapshot.SnapshotManager(637): No existing snapshot, attempting snapshot... 2023-10-04 02:00:30,047 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39651] snapshot.SnapshotManager(684): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-10-04 02:00:30,051 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39651] snapshot.SnapshotManager(519): Unable to retrieve ACL status for path: hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/.hbase-snapshot, current working dir path: hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState org.apache.hadoop.hdfs.protocol.AclException: The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.ipc.RemoteException.instantiateException(RemoteException.java:121) at org.apache.hadoop.ipc.RemoteException.unwrapRemoteException(RemoteException.java:88) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2736) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2294) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2291) at org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81) at org.apache.hadoop.hdfs.DistributedFileSystem.getAclStatus(DistributedFileSystem.java:2291) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.updateWorkingDirAclsIfRequired(SnapshotManager.java:517) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.prepareToTakeSnapshot(SnapshotManager.java:490) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.snapshotEnabledTable(SnapshotManager.java:559) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshotInternal(SnapshotManager.java:687) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshot(SnapshotManager.java:623) at org.apache.hadoop.hbase.master.MasterRpcServices.snapshot(MasterRpcServices.java:1588) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) Caused by: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.hdfs.protocol.AclException): The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at org.apache.hadoop.ipc.Client.getRpcResponse(Client.java:1540) at org.apache.hadoop.ipc.Client.call(Client.java:1486) at org.apache.hadoop.ipc.Client.call(Client.java:1385) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:232) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:118) at com.sun.proxy.$Proxy32.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.getAclStatus(ClientNamenodeProtocolTranslatorPB.java:1385) at sun.reflect.GeneratedMethodAccessor61.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:422) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeMethod(RetryInvocationHandler.java:165) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invoke(RetryInvocationHandler.java:157) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeOnce(RetryInvocationHandler.java:95) at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:359) at com.sun.proxy.$Proxy35.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor61.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2734) ... 15 more 2023-10-04 02:00:30,053 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39651] procedure2.ProcedureExecutor(1028): Stored pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-10-04 02:00:30,054 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-10-04 02:00:30,055 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=32, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1696385430055 2023-10-04 02:00:30,055 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39651] snapshot.SnapshotManager(689): Started snapshot: { ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-10-04 02:00:30,055 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState 2023-10-04 02:00:30,056 DEBUG [Listener at jenkins-hbase9.apache.org/33899] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-10-04 02:00:30,056 DEBUG [Listener at jenkins-hbase9.apache.org/33899] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-10-04 02:00:30,058 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=32, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-10-04 02:00:30,058 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] procedure2.ProcedureExecutor(1028): Stored pid=33, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-10-04 02:00:30,060 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=32, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE in 6 msec 2023-10-04 02:00:30,061 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=33, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-10-04 02:00:30,062 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=33, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED; timeout=600000, timestamp=1696385430062 2023-10-04 02:00:30,076 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportFileSystemState 2023-10-04 02:00:30,076 INFO [(jenkins-hbase9.apache.org,39651,1696384803959)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportFileSystemState' 2023-10-04 02:00:30,076 DEBUG [(jenkins-hbase9.apache.org,39651,1696384803959)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-04 02:00:30,077 DEBUG [(jenkins-hbase9.apache.org,39651,1696384803959)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' 2023-10-04 02:00:30,077 DEBUG [(jenkins-hbase9.apache.org,39651,1696384803959)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportFileSystemState', kicking off acquire phase on members. 2023-10-04 02:00:30,078 DEBUG [(jenkins-hbase9.apache.org,39651,1696384803959)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39651-0x1010f1b55330000, quorum=127.0.0.1:60027, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-10-04 02:00:30,078 DEBUG [(jenkins-hbase9.apache.org,39651,1696384803959)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-10-04 02:00:30,080 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): regionserver:39045-0x1010f1b55330002, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-04 02:00:30,080 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): regionserver:35175-0x1010f1b55330003, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-04 02:00:30,080 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-04 02:00:30,080 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-04 02:00:30,080 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-04 02:00:30,080 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-04 02:00:30,080 DEBUG [(jenkins-hbase9.apache.org,39651,1696384803959)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,39045,1696384805392 2023-10-04 02:00:30,080 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): regionserver:44303-0x1010f1b55330001, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-04 02:00:30,080 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-04 02:00:30,080 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-04 02:00:30,080 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-10-04 02:00:30,080 DEBUG [(jenkins-hbase9.apache.org,39651,1696384803959)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39651-0x1010f1b55330000, quorum=127.0.0.1:60027, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,39045,1696384805392 2023-10-04 02:00:30,081 DEBUG [(jenkins-hbase9.apache.org,39651,1696384803959)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,35175,1696384805436 2023-10-04 02:00:30,081 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-10-04 02:00:30,080 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-10-04 02:00:30,081 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39045-0x1010f1b55330002, quorum=127.0.0.1:60027, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-10-04 02:00:30,081 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35175-0x1010f1b55330003, quorum=127.0.0.1:60027, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-10-04 02:00:30,081 DEBUG [(jenkins-hbase9.apache.org,39651,1696384803959)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39651-0x1010f1b55330000, quorum=127.0.0.1:60027, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,35175,1696384805436 2023-10-04 02:00:30,081 DEBUG [(jenkins-hbase9.apache.org,39651,1696384803959)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-04 02:00:30,081 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 174 2023-10-04 02:00:30,081 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-10-04 02:00:30,081 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44303-0x1010f1b55330001, quorum=127.0.0.1:60027, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-10-04 02:00:30,081 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-10-04 02:00:30,081 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 174 2023-10-04 02:00:30,081 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-10-04 02:00:30,082 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-10-04 02:00:30,082 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemState 2023-10-04 02:00:30,082 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 174 2023-10-04 02:00:30,082 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-10-04 02:00:30,082 DEBUG [member: 'jenkins-hbase9.apache.org,39045,1696384805392' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemState' with timeout 300000ms 2023-10-04 02:00:30,082 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemState 2023-10-04 02:00:30,082 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-10-04 02:00:30,082 DEBUG [member: 'jenkins-hbase9.apache.org,35175,1696384805436' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemState' with timeout 300000ms 2023-10-04 02:00:30,082 DEBUG [member: 'jenkins-hbase9.apache.org,35175,1696384805436' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-04 02:00:30,082 DEBUG [member: 'jenkins-hbase9.apache.org,39045,1696384805392' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-04 02:00:30,083 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemState 2023-10-04 02:00:30,083 DEBUG [member: 'jenkins-hbase9.apache.org,35175,1696384805436' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' stage 2023-10-04 02:00:30,084 DEBUG [member: 'jenkins-hbase9.apache.org,44303,1696384805319' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemState' with timeout 300000ms 2023-10-04 02:00:30,084 DEBUG [member: 'jenkins-hbase9.apache.org,44303,1696384805319' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-04 02:00:30,084 DEBUG [member: 'jenkins-hbase9.apache.org,35175,1696384805436' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally acquired 2023-10-04 02:00:30,084 DEBUG [member: 'jenkins-hbase9.apache.org,44303,1696384805319' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' stage 2023-10-04 02:00:30,084 DEBUG [member: 'jenkins-hbase9.apache.org,44303,1696384805319' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally acquired 2023-10-04 02:00:30,085 DEBUG [member: 'jenkins-hbase9.apache.org,44303,1696384805319' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,44303,1696384805319' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemState) in zk 2023-10-04 02:00:30,083 DEBUG [member: 'jenkins-hbase9.apache.org,39045,1696384805392' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' stage 2023-10-04 02:00:30,085 DEBUG [member: 'jenkins-hbase9.apache.org,39045,1696384805392' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally acquired 2023-10-04 02:00:30,084 DEBUG [member: 'jenkins-hbase9.apache.org,35175,1696384805436' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,35175,1696384805436' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemState) in zk 2023-10-04 02:00:30,085 DEBUG [member: 'jenkins-hbase9.apache.org,39045,1696384805392' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,39045,1696384805392' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemState) in zk 2023-10-04 02:00:30,087 DEBUG [member: 'jenkins-hbase9.apache.org,44303,1696384805319' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-10-04 02:00:30,095 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): master:39651-0x1010f1b55330000, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,35175,1696384805436 2023-10-04 02:00:30,095 DEBUG [member: 'jenkins-hbase9.apache.org,35175,1696384805436' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-10-04 02:00:30,095 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,35175,1696384805436 2023-10-04 02:00:30,095 DEBUG [member: 'jenkins-hbase9.apache.org,39045,1696384805392' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-10-04 02:00:30,095 DEBUG [member: 'jenkins-hbase9.apache.org,44303,1696384805319' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44303-0x1010f1b55330001, quorum=127.0.0.1:60027, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-10-04 02:00:30,095 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-04 02:00:30,095 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-04 02:00:30,095 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): master:39651-0x1010f1b55330000, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,39045,1696384805392 2023-10-04 02:00:30,095 DEBUG [member: 'jenkins-hbase9.apache.org,35175,1696384805436' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35175-0x1010f1b55330003, quorum=127.0.0.1:60027, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-10-04 02:00:30,095 DEBUG [member: 'jenkins-hbase9.apache.org,35175,1696384805436' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-04 02:00:30,095 DEBUG [member: 'jenkins-hbase9.apache.org,39045,1696384805392' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39045-0x1010f1b55330002, quorum=127.0.0.1:60027, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-10-04 02:00:30,095 DEBUG [member: 'jenkins-hbase9.apache.org,39045,1696384805392' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-04 02:00:30,095 DEBUG [member: 'jenkins-hbase9.apache.org,44303,1696384805319' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-04 02:00:30,095 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-04 02:00:30,096 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-04 02:00:30,096 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-10-04 02:00:30,096 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,39045,1696384805392 2023-10-04 02:00:30,097 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,35175,1696384805436 2023-10-04 02:00:30,097 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44303,1696384805319 2023-10-04 02:00:30,097 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-04 02:00:30,097 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,35175,1696384805436' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemState' on coordinator 2023-10-04 02:00:30,098 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4cab4d1b[Count = 1] remaining members to acquire global barrier 2023-10-04 02:00:30,098 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,39045,1696384805392 2023-10-04 02:00:30,098 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-04 02:00:30,098 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-04 02:00:30,098 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-04 02:00:30,098 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-04 02:00:30,098 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-10-04 02:00:30,099 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,39045,1696384805392 2023-10-04 02:00:30,099 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,35175,1696384805436 2023-10-04 02:00:30,099 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44303,1696384805319 2023-10-04 02:00:30,100 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-04 02:00:30,100 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,39045,1696384805392' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemState' on coordinator 2023-10-04 02:00:30,100 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4cab4d1b[Count = 0] remaining members to acquire global barrier 2023-10-04 02:00:30,100 DEBUG [(jenkins-hbase9.apache.org,39651,1696384803959)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportFileSystemState' starting 'in-barrier' execution. 2023-10-04 02:00:30,100 DEBUG [(jenkins-hbase9.apache.org,39651,1696384803959)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-10-04 02:00:30,101 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): regionserver:35175-0x1010f1b55330003, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-10-04 02:00:30,101 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): regionserver:39045-0x1010f1b55330002, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-10-04 02:00:30,102 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-10-04 02:00:30,102 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-10-04 02:00:30,102 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): regionserver:44303-0x1010f1b55330001, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-10-04 02:00:30,102 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-10-04 02:00:30,102 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-10-04 02:00:30,102 DEBUG [(jenkins-hbase9.apache.org,39651,1696384803959)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39651-0x1010f1b55330000, quorum=127.0.0.1:60027, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,35175,1696384805436 2023-10-04 02:00:30,102 DEBUG [member: 'jenkins-hbase9.apache.org,35175,1696384805436' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-10-04 02:00:30,102 DEBUG [member: 'jenkins-hbase9.apache.org,39045,1696384805392' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-10-04 02:00:30,102 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-10-04 02:00:30,102 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-10-04 02:00:30,102 DEBUG [member: 'jenkins-hbase9.apache.org,35175,1696384805436' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-04 02:00:30,102 DEBUG [member: 'jenkins-hbase9.apache.org,35175,1696384805436' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-04 02:00:30,102 DEBUG [member: 'jenkins-hbase9.apache.org,44303,1696384805319' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-10-04 02:00:30,102 DEBUG [(jenkins-hbase9.apache.org,39651,1696384803959)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39651-0x1010f1b55330000, quorum=127.0.0.1:60027, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,39045,1696384805392 2023-10-04 02:00:30,102 DEBUG [(jenkins-hbase9.apache.org,39651,1696384803959)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-04 02:00:30,102 DEBUG [rs(jenkins-hbase9.apache.org,39045,1696384805392)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,1,1696384829372.9ec52cdf4bc03952ff9cfca008868a1a. 2023-10-04 02:00:30,102 DEBUG [member: 'jenkins-hbase9.apache.org,44303,1696384805319' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally completed 2023-10-04 02:00:30,102 DEBUG [rs(jenkins-hbase9.apache.org,39045,1696384805392)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,1,1696384829372.9ec52cdf4bc03952ff9cfca008868a1a. started... 2023-10-04 02:00:30,102 DEBUG [rs(jenkins-hbase9.apache.org,35175,1696384805436)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,,1696384829372.c4077678ce34c812f7ddedefaa28ee4d. 2023-10-04 02:00:30,102 DEBUG [member: 'jenkins-hbase9.apache.org,39045,1696384805392' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-04 02:00:30,103 DEBUG [rs(jenkins-hbase9.apache.org,35175,1696384805436)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,,1696384829372.c4077678ce34c812f7ddedefaa28ee4d. started... 2023-10-04 02:00:30,102 DEBUG [member: 'jenkins-hbase9.apache.org,44303,1696384805319' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemState' completed for member 'jenkins-hbase9.apache.org,44303,1696384805319' in zk 2023-10-04 02:00:30,103 DEBUG [member: 'jenkins-hbase9.apache.org,39045,1696384805392' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-04 02:00:30,104 DEBUG [rs(jenkins-hbase9.apache.org,39045,1696384805392)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 9ec52cdf4bc03952ff9cfca008868a1a: 2023-10-04 02:00:30,104 DEBUG [rs(jenkins-hbase9.apache.org,35175,1696384805436)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for c4077678ce34c812f7ddedefaa28ee4d: 2023-10-04 02:00:30,104 DEBUG [rs(jenkins-hbase9.apache.org,39045,1696384805392)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,1,1696384829372.9ec52cdf4bc03952ff9cfca008868a1a.' region-info for snapshot=emptySnaptb0-testExportFileSystemState 2023-10-04 02:00:30,104 DEBUG [rs(jenkins-hbase9.apache.org,35175,1696384805436)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,,1696384829372.c4077678ce34c812f7ddedefaa28ee4d.' region-info for snapshot=emptySnaptb0-testExportFileSystemState 2023-10-04 02:00:30,104 DEBUG [rs(jenkins-hbase9.apache.org,39045,1696384805392)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-04 02:00:30,104 DEBUG [rs(jenkins-hbase9.apache.org,35175,1696384805436)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-04 02:00:30,104 DEBUG [rs(jenkins-hbase9.apache.org,39045,1696384805392)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-10-04 02:00:30,104 DEBUG [rs(jenkins-hbase9.apache.org,35175,1696384805436)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-10-04 02:00:30,107 DEBUG [member: 'jenkins-hbase9.apache.org,44303,1696384805319' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemState' has notified controller of completion 2023-10-04 02:00:30,107 DEBUG [member: 'jenkins-hbase9.apache.org,44303,1696384805319' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-04 02:00:30,107 DEBUG [member: 'jenkins-hbase9.apache.org,44303,1696384805319' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemState' completed. 2023-10-04 02:00:30,131 DEBUG [rs(jenkins-hbase9.apache.org,39045,1696384805392)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,1,1696384829372.9ec52cdf4bc03952ff9cfca008868a1a. completed. 2023-10-04 02:00:30,131 DEBUG [rs(jenkins-hbase9.apache.org,35175,1696384805436)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,,1696384829372.c4077678ce34c812f7ddedefaa28ee4d. completed. 2023-10-04 02:00:30,132 DEBUG [rs(jenkins-hbase9.apache.org,39045,1696384805392)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,1,1696384829372.9ec52cdf4bc03952ff9cfca008868a1a. 2023-10-04 02:00:30,132 DEBUG [rs(jenkins-hbase9.apache.org,35175,1696384805436)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,,1696384829372.c4077678ce34c812f7ddedefaa28ee4d. 2023-10-04 02:00:30,132 DEBUG [member: 'jenkins-hbase9.apache.org,35175,1696384805436' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-04 02:00:30,132 DEBUG [member: 'jenkins-hbase9.apache.org,35175,1696384805436' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-04 02:00:30,132 DEBUG [member: 'jenkins-hbase9.apache.org,35175,1696384805436' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase9.apache.org,35175,1696384805436 2023-10-04 02:00:30,132 DEBUG [member: 'jenkins-hbase9.apache.org,39045,1696384805392' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-04 02:00:30,132 DEBUG [member: 'jenkins-hbase9.apache.org,39045,1696384805392' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-04 02:00:30,132 DEBUG [member: 'jenkins-hbase9.apache.org,39045,1696384805392' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase9.apache.org,39045,1696384805392 2023-10-04 02:00:30,132 DEBUG [member: 'jenkins-hbase9.apache.org,35175,1696384805436' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally completed 2023-10-04 02:00:30,132 DEBUG [member: 'jenkins-hbase9.apache.org,39045,1696384805392' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally completed 2023-10-04 02:00:30,132 DEBUG [member: 'jenkins-hbase9.apache.org,39045,1696384805392' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemState' completed for member 'jenkins-hbase9.apache.org,39045,1696384805392' in zk 2023-10-04 02:00:30,132 DEBUG [member: 'jenkins-hbase9.apache.org,35175,1696384805436' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemState' completed for member 'jenkins-hbase9.apache.org,35175,1696384805436' in zk 2023-10-04 02:00:30,135 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): master:39651-0x1010f1b55330000, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,39045,1696384805392 2023-10-04 02:00:30,135 DEBUG [member: 'jenkins-hbase9.apache.org,39045,1696384805392' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemState' has notified controller of completion 2023-10-04 02:00:30,135 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,39045,1696384805392 2023-10-04 02:00:30,135 DEBUG [member: 'jenkins-hbase9.apache.org,39045,1696384805392' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-04 02:00:30,135 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-04 02:00:30,137 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-04 02:00:30,137 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): master:39651-0x1010f1b55330000, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,35175,1696384805436 2023-10-04 02:00:30,137 DEBUG [member: 'jenkins-hbase9.apache.org,35175,1696384805436' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemState' has notified controller of completion 2023-10-04 02:00:30,137 DEBUG [member: 'jenkins-hbase9.apache.org,35175,1696384805436' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-04 02:00:30,137 DEBUG [member: 'jenkins-hbase9.apache.org,35175,1696384805436' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemState' completed. 2023-10-04 02:00:30,138 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-04 02:00:30,136 DEBUG [member: 'jenkins-hbase9.apache.org,39045,1696384805392' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemState' completed. 2023-10-04 02:00:30,138 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-04 02:00:30,139 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-10-04 02:00:30,139 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,39045,1696384805392 2023-10-04 02:00:30,139 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,35175,1696384805436 2023-10-04 02:00:30,139 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44303,1696384805319 2023-10-04 02:00:30,140 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-04 02:00:30,140 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-10-04 02:00:30,140 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,39045,1696384805392 2023-10-04 02:00:30,140 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,35175,1696384805436 2023-10-04 02:00:30,141 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44303,1696384805319 2023-10-04 02:00:30,141 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemState' member 'jenkins-hbase9.apache.org,39045,1696384805392': 2023-10-04 02:00:30,141 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,39045,1696384805392' released barrier for procedure'emptySnaptb0-testExportFileSystemState', counting down latch. Waiting for 1 more 2023-10-04 02:00:30,141 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,35175,1696384805436 2023-10-04 02:00:30,141 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-04 02:00:30,141 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-04 02:00:30,142 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-04 02:00:30,142 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-04 02:00:30,142 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-10-04 02:00:30,142 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,39045,1696384805392 2023-10-04 02:00:30,143 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,35175,1696384805436 2023-10-04 02:00:30,143 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44303,1696384805319 2023-10-04 02:00:30,143 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-04 02:00:30,144 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-10-04 02:00:30,144 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,39045,1696384805392 2023-10-04 02:00:30,144 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,35175,1696384805436 2023-10-04 02:00:30,145 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44303,1696384805319 2023-10-04 02:00:30,145 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemState' member 'jenkins-hbase9.apache.org,35175,1696384805436': 2023-10-04 02:00:30,145 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,35175,1696384805436' released barrier for procedure'emptySnaptb0-testExportFileSystemState', counting down latch. Waiting for 0 more 2023-10-04 02:00:30,145 INFO [(jenkins-hbase9.apache.org,39651,1696384803959)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportFileSystemState' execution completed 2023-10-04 02:00:30,145 DEBUG [(jenkins-hbase9.apache.org,39651,1696384803959)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-04 02:00:30,145 DEBUG [(jenkins-hbase9.apache.org,39651,1696384803959)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-04 02:00:30,146 DEBUG [(jenkins-hbase9.apache.org,39651,1696384803959)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportFileSystemState 2023-10-04 02:00:30,146 INFO [(jenkins-hbase9.apache.org,39651,1696384803959)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-10-04 02:00:30,148 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): master:39651-0x1010f1b55330000, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-10-04 02:00:30,148 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): regionserver:44303-0x1010f1b55330001, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-10-04 02:00:30,148 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-10-04 02:00:30,148 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-10-04 02:00:30,148 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-04 02:00:30,148 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-04 02:00:30,148 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): regionserver:44303-0x1010f1b55330001, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-04 02:00:30,148 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): regionserver:35175-0x1010f1b55330003, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-10-04 02:00:30,148 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): regionserver:39045-0x1010f1b55330002, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-10-04 02:00:30,148 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-10-04 02:00:30,148 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-10-04 02:00:30,148 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): regionserver:39045-0x1010f1b55330002, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-04 02:00:30,148 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): regionserver:35175-0x1010f1b55330003, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-04 02:00:30,148 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-04 02:00:30,148 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-10-04 02:00:30,148 DEBUG [(jenkins-hbase9.apache.org,39651,1696384803959)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39651-0x1010f1b55330000, quorum=127.0.0.1:60027, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,39045,1696384805392 2023-10-04 02:00:30,148 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-10-04 02:00:30,148 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-10-04 02:00:30,149 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-10-04 02:00:30,149 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-04 02:00:30,149 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-04 02:00:30,149 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-04 02:00:30,149 DEBUG [(jenkins-hbase9.apache.org,39651,1696384803959)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39651-0x1010f1b55330000, quorum=127.0.0.1:60027, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,35175,1696384805436 2023-10-04 02:00:30,149 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-04 02:00:30,149 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-04 02:00:30,149 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-04 02:00:30,149 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-04 02:00:30,149 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-10-04 02:00:30,150 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-10-04 02:00:30,150 DEBUG [(jenkins-hbase9.apache.org,39651,1696384803959)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39651-0x1010f1b55330000, quorum=127.0.0.1:60027, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,44303,1696384805319 2023-10-04 02:00:30,150 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-10-04 02:00:30,150 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-10-04 02:00:30,150 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,39045,1696384805392 2023-10-04 02:00:30,151 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,35175,1696384805436 2023-10-04 02:00:30,151 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44303,1696384805319 2023-10-04 02:00:30,151 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-04 02:00:30,152 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-10-04 02:00:30,152 DEBUG [(jenkins-hbase9.apache.org,39651,1696384803959)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39651-0x1010f1b55330000, quorum=127.0.0.1:60027, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,39045,1696384805392 2023-10-04 02:00:30,152 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,39045,1696384805392 2023-10-04 02:00:30,152 DEBUG [(jenkins-hbase9.apache.org,39651,1696384803959)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39651-0x1010f1b55330000, quorum=127.0.0.1:60027, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,35175,1696384805436 2023-10-04 02:00:30,152 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,35175,1696384805436 2023-10-04 02:00:30,153 DEBUG [(jenkins-hbase9.apache.org,39651,1696384803959)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39651-0x1010f1b55330000, quorum=127.0.0.1:60027, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,44303,1696384805319 2023-10-04 02:00:30,153 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44303,1696384805319 2023-10-04 02:00:30,156 DEBUG [Listener at jenkins-hbase9.apache.org/33899] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-04 02:00:30,157 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): master:39651-0x1010f1b55330000, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,44303,1696384805319 2023-10-04 02:00:30,157 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): master:39651-0x1010f1b55330000, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-10-04 02:00:30,157 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): master:39651-0x1010f1b55330000, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,35175,1696384805436 2023-10-04 02:00:30,157 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): master:39651-0x1010f1b55330000, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,39045,1696384805392 2023-10-04 02:00:30,157 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): regionserver:35175-0x1010f1b55330003, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-04 02:00:30,157 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): regionserver:39045-0x1010f1b55330002, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-04 02:00:30,157 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): master:39651-0x1010f1b55330000, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-10-04 02:00:30,157 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-04 02:00:30,157 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-04 02:00:30,157 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): regionserver:44303-0x1010f1b55330001, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-04 02:00:30,157 DEBUG [(jenkins-hbase9.apache.org,39651,1696384803959)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-04 02:00:30,157 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): regionserver:39045-0x1010f1b55330002, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-04 02:00:30,157 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-04 02:00:30,159 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-04 02:00:30,157 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): regionserver:44303-0x1010f1b55330001, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-04 02:00:30,157 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportFileSystemState 2023-10-04 02:00:30,159 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-04 02:00:30,159 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemState 2023-10-04 02:00:30,157 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): master:39651-0x1010f1b55330000, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,44303,1696384805319 2023-10-04 02:00:30,157 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-04 02:00:30,157 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): regionserver:35175-0x1010f1b55330003, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-04 02:00:30,159 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-04 02:00:30,159 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-04 02:00:30,159 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-04 02:00:30,159 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): master:39651-0x1010f1b55330000, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-10-04 02:00:30,159 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 8c2558c0b59bb3a4e2e578c2c8e8915d, NAME => 'testtb-testExportFileSystemState,.mob,0.8c2558c0b59bb3a4e2e578c2c8e8915d.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testExportFileSystemState 2023-10-04 02:00:30,159 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-04 02:00:30,160 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-10-04 02:00:30,159 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39651] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-10-04 02:00:30,160 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): master:39651-0x1010f1b55330000, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,35175,1696384805436 2023-10-04 02:00:30,160 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39651] snapshot.SnapshotManager(406): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-10-04 02:00:30,160 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): master:39651-0x1010f1b55330000, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,39045,1696384805392 2023-10-04 02:00:30,160 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): master:39651-0x1010f1b55330000, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-10-04 02:00:30,160 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): master:39651-0x1010f1b55330000, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-10-04 02:00:30,160 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-04 02:00:30,160 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-04 02:00:30,160 DEBUG [Listener at jenkins-hbase9.apache.org/33899] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-10-04 02:00:30,161 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-10-04 02:00:30,172 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportFileSystemState 2023-10-04 02:00:30,173 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState 2023-10-04 02:00:30,198 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState to hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/.hbase-snapshot/emptySnaptb0-testExportFileSystemState 2023-10-04 02:00:30,199 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed 2023-10-04 02:00:30,199 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState 2023-10-04 02:00:30,199 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState 2023-10-04 02:00:30,199 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState at 1696384830055Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemState at 1696384830172 (+117 ms)Consolidate snapshot: emptySnaptb0-testExportFileSystemState at 1696384830172Loading Region manifests for emptySnaptb0-testExportFileSystemState at 1696384830172Writing data manifest for emptySnaptb0-testExportFileSystemState at 1696384830177 (+5 ms)Verifying snapshot: emptySnaptb0-testExportFileSystemState at 1696384830190 (+13 ms)Snapshot emptySnaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed at 1696384830199 (+9 ms) 2023-10-04 02:00:30,202 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=33, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-10-04 02:00:30,204 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=33, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED in 146 msec 2023-10-04 02:00:30,360 DEBUG [Listener at jenkins-hbase9.apache.org/33899] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-04 02:00:30,362 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39651] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-10-04 02:00:30,362 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39651] snapshot.SnapshotManager(403): Snapshot '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-10-04 02:00:30,365 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35175] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemState,,1696384829372.c4077678ce34c812f7ddedefaa28ee4d. with WAL disabled. Data may be lost in the event of a crash. 2023-10-04 02:00:30,367 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39045] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemState,1,1696384829372.9ec52cdf4bc03952ff9cfca008868a1a. with WAL disabled. Data may be lost in the event of a crash. 2023-10-04 02:00:30,371 DEBUG [Listener at jenkins-hbase9.apache.org/33899] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemState 2023-10-04 02:00:30,371 DEBUG [Listener at jenkins-hbase9.apache.org/33899] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemState,,1696384829372.c4077678ce34c812f7ddedefaa28ee4d. 2023-10-04 02:00:30,371 INFO [Listener at jenkins-hbase9.apache.org/33899] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-10-04 02:00:30,384 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39651] master.MasterRpcServices(1583): Client=jenkins//172.31.2.10 snapshot request for:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-10-04 02:00:30,384 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39651] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1696384830384 (current time:1696384830384). 2023-10-04 02:00:30,384 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39651] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-10-04 02:00:30,386 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39651] zookeeper.ReadOnlyZKClient(139): Connect 0x7701cd51 to 127.0.0.1:60027 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-04 02:00:30,393 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39651] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@d0baa19, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-04 02:00:30,394 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39651] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-04 02:00:30,397 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:52950, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-04 02:00:30,398 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39651] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7701cd51 to 127.0.0.1:60027 2023-10-04 02:00:30,398 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39651] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-04 02:00:30,399 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39651] zookeeper.ReadOnlyZKClient(139): Connect 0x6b1d02a5 to 127.0.0.1:60027 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-04 02:00:30,405 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39651] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@42041ae8, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-04 02:00:30,406 DEBUG [hconnection-0x118914f9-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-04 02:00:30,409 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:52952, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-04 02:00:30,413 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39651] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6b1d02a5 to 127.0.0.1:60027 2023-10-04 02:00:30,414 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39651] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-04 02:00:30,414 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39651] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemState], kv [jenkins: RWXCA] 2023-10-04 02:00:30,414 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39651] snapshot.SnapshotManager(637): No existing snapshot, attempting snapshot... 2023-10-04 02:00:30,415 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39651] snapshot.SnapshotManager(684): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-10-04 02:00:30,417 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39651] snapshot.SnapshotManager(519): Unable to retrieve ACL status for path: hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/.hbase-snapshot, current working dir path: hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState org.apache.hadoop.hdfs.protocol.AclException: The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.ipc.RemoteException.instantiateException(RemoteException.java:121) at org.apache.hadoop.ipc.RemoteException.unwrapRemoteException(RemoteException.java:88) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2736) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2294) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2291) at org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81) at org.apache.hadoop.hdfs.DistributedFileSystem.getAclStatus(DistributedFileSystem.java:2291) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.updateWorkingDirAclsIfRequired(SnapshotManager.java:517) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.prepareToTakeSnapshot(SnapshotManager.java:490) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.snapshotEnabledTable(SnapshotManager.java:559) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshotInternal(SnapshotManager.java:687) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshot(SnapshotManager.java:623) at org.apache.hadoop.hbase.master.MasterRpcServices.snapshot(MasterRpcServices.java:1588) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) Caused by: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.hdfs.protocol.AclException): The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at org.apache.hadoop.ipc.Client.getRpcResponse(Client.java:1540) at org.apache.hadoop.ipc.Client.call(Client.java:1486) at org.apache.hadoop.ipc.Client.call(Client.java:1385) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:232) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:118) at com.sun.proxy.$Proxy32.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.getAclStatus(ClientNamenodeProtocolTranslatorPB.java:1385) at sun.reflect.GeneratedMethodAccessor61.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:422) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeMethod(RetryInvocationHandler.java:165) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invoke(RetryInvocationHandler.java:157) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeOnce(RetryInvocationHandler.java:95) at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:359) at com.sun.proxy.$Proxy35.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor61.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor61.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor61.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor61.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor61.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2734) ... 15 more 2023-10-04 02:00:30,419 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39651] procedure2.ProcedureExecutor(1028): Stored pid=34, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-10-04 02:00:30,420 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=34, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-10-04 02:00:30,421 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=34, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1696385430421 2023-10-04 02:00:30,421 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39651] snapshot.SnapshotManager(689): Started snapshot: { ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-10-04 02:00:30,421 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState 2023-10-04 02:00:30,423 DEBUG [Listener at jenkins-hbase9.apache.org/33899] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-10-04 02:00:30,423 DEBUG [Listener at jenkins-hbase9.apache.org/33899] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-10-04 02:00:30,424 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=34, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-10-04 02:00:30,424 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] procedure2.ProcedureExecutor(1028): Stored pid=35, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-10-04 02:00:30,426 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=34, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE in 6 msec 2023-10-04 02:00:30,426 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=35, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-10-04 02:00:30,427 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=35, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED; timeout=600000, timestamp=1696385430427 2023-10-04 02:00:30,442 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemState 2023-10-04 02:00:30,442 INFO [(jenkins-hbase9.apache.org,39651,1696384803959)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemState' 2023-10-04 02:00:30,442 DEBUG [(jenkins-hbase9.apache.org,39651,1696384803959)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-04 02:00:30,444 DEBUG [(jenkins-hbase9.apache.org,39651,1696384803959)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemState' starting 'acquire' 2023-10-04 02:00:30,444 DEBUG [(jenkins-hbase9.apache.org,39651,1696384803959)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemState', kicking off acquire phase on members. 2023-10-04 02:00:30,444 DEBUG [(jenkins-hbase9.apache.org,39651,1696384803959)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39651-0x1010f1b55330000, quorum=127.0.0.1:60027, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-10-04 02:00:30,444 DEBUG [(jenkins-hbase9.apache.org,39651,1696384803959)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-10-04 02:00:30,446 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): regionserver:39045-0x1010f1b55330002, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-04 02:00:30,446 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): regionserver:35175-0x1010f1b55330003, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-04 02:00:30,446 DEBUG [(jenkins-hbase9.apache.org,39651,1696384803959)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,39045,1696384805392 2023-10-04 02:00:30,446 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-04 02:00:30,446 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-04 02:00:30,446 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-04 02:00:30,446 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): regionserver:44303-0x1010f1b55330001, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-04 02:00:30,446 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-04 02:00:30,446 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-04 02:00:30,446 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-04 02:00:30,446 DEBUG [(jenkins-hbase9.apache.org,39651,1696384803959)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39651-0x1010f1b55330000, quorum=127.0.0.1:60027, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,39045,1696384805392 2023-10-04 02:00:30,446 DEBUG [(jenkins-hbase9.apache.org,39651,1696384803959)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,35175,1696384805436 2023-10-04 02:00:30,446 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-10-04 02:00:30,446 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-10-04 02:00:30,446 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-10-04 02:00:30,447 DEBUG [(jenkins-hbase9.apache.org,39651,1696384803959)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39651-0x1010f1b55330000, quorum=127.0.0.1:60027, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,35175,1696384805436 2023-10-04 02:00:30,447 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39045-0x1010f1b55330002, quorum=127.0.0.1:60027, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-10-04 02:00:30,447 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35175-0x1010f1b55330003, quorum=127.0.0.1:60027, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-10-04 02:00:30,447 DEBUG [(jenkins-hbase9.apache.org,39651,1696384803959)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-04 02:00:30,447 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44303-0x1010f1b55330001, quorum=127.0.0.1:60027, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-10-04 02:00:30,447 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 169 2023-10-04 02:00:30,447 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 169 2023-10-04 02:00:30,447 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 169 2023-10-04 02:00:30,447 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-10-04 02:00:30,447 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-10-04 02:00:30,447 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-10-04 02:00:30,448 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-10-04 02:00:30,448 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-10-04 02:00:30,448 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-10-04 02:00:30,448 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemState 2023-10-04 02:00:30,448 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemState 2023-10-04 02:00:30,448 DEBUG [member: 'jenkins-hbase9.apache.org,44303,1696384805319' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemState' with timeout 300000ms 2023-10-04 02:00:30,448 DEBUG [member: 'jenkins-hbase9.apache.org,39045,1696384805392' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemState' with timeout 300000ms 2023-10-04 02:00:30,448 DEBUG [member: 'jenkins-hbase9.apache.org,39045,1696384805392' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-04 02:00:30,448 DEBUG [member: 'jenkins-hbase9.apache.org,44303,1696384805319' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-04 02:00:30,449 DEBUG [member: 'jenkins-hbase9.apache.org,39045,1696384805392' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemState' starting 'acquire' stage 2023-10-04 02:00:30,450 DEBUG [member: 'jenkins-hbase9.apache.org,44303,1696384805319' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemState' starting 'acquire' stage 2023-10-04 02:00:30,450 DEBUG [member: 'jenkins-hbase9.apache.org,44303,1696384805319' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemState' locally acquired 2023-10-04 02:00:30,450 DEBUG [member: 'jenkins-hbase9.apache.org,44303,1696384805319' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,44303,1696384805319' joining acquired barrier for procedure (snaptb0-testExportFileSystemState) in zk 2023-10-04 02:00:30,448 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemState 2023-10-04 02:00:30,450 DEBUG [member: 'jenkins-hbase9.apache.org,39045,1696384805392' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemState' locally acquired 2023-10-04 02:00:30,450 DEBUG [member: 'jenkins-hbase9.apache.org,35175,1696384805436' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemState' with timeout 300000ms 2023-10-04 02:00:30,451 DEBUG [member: 'jenkins-hbase9.apache.org,35175,1696384805436' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-04 02:00:30,450 DEBUG [member: 'jenkins-hbase9.apache.org,39045,1696384805392' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,39045,1696384805392' joining acquired barrier for procedure (snaptb0-testExportFileSystemState) in zk 2023-10-04 02:00:30,451 DEBUG [member: 'jenkins-hbase9.apache.org,35175,1696384805436' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemState' starting 'acquire' stage 2023-10-04 02:00:30,451 DEBUG [member: 'jenkins-hbase9.apache.org,35175,1696384805436' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemState' locally acquired 2023-10-04 02:00:30,452 DEBUG [member: 'jenkins-hbase9.apache.org,35175,1696384805436' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,35175,1696384805436' joining acquired barrier for procedure (snaptb0-testExportFileSystemState) in zk 2023-10-04 02:00:30,453 DEBUG [member: 'jenkins-hbase9.apache.org,44303,1696384805319' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-10-04 02:00:30,454 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): master:39651-0x1010f1b55330000, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,35175,1696384805436 2023-10-04 02:00:30,454 DEBUG [member: 'jenkins-hbase9.apache.org,44303,1696384805319' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44303-0x1010f1b55330001, quorum=127.0.0.1:60027, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-10-04 02:00:30,454 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,35175,1696384805436 2023-10-04 02:00:30,454 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-04 02:00:30,454 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-04 02:00:30,454 DEBUG [member: 'jenkins-hbase9.apache.org,44303,1696384805319' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-04 02:00:30,454 DEBUG [member: 'jenkins-hbase9.apache.org,39045,1696384805392' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-10-04 02:00:30,454 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): master:39651-0x1010f1b55330000, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,39045,1696384805392 2023-10-04 02:00:30,454 DEBUG [member: 'jenkins-hbase9.apache.org,35175,1696384805436' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-10-04 02:00:30,455 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-04 02:00:30,455 DEBUG [member: 'jenkins-hbase9.apache.org,39045,1696384805392' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39045-0x1010f1b55330002, quorum=127.0.0.1:60027, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-10-04 02:00:30,455 DEBUG [member: 'jenkins-hbase9.apache.org,39045,1696384805392' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-04 02:00:30,455 DEBUG [member: 'jenkins-hbase9.apache.org,35175,1696384805436' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35175-0x1010f1b55330003, quorum=127.0.0.1:60027, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-10-04 02:00:30,455 DEBUG [member: 'jenkins-hbase9.apache.org,35175,1696384805436' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-04 02:00:30,455 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-04 02:00:30,455 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-10-04 02:00:30,455 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,39045,1696384805392 2023-10-04 02:00:30,456 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,35175,1696384805436 2023-10-04 02:00:30,456 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44303,1696384805319 2023-10-04 02:00:30,456 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-04 02:00:30,457 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,35175,1696384805436' joining acquired barrier for procedure 'snaptb0-testExportFileSystemState' on coordinator 2023-10-04 02:00:30,457 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5c436b1b[Count = 1] remaining members to acquire global barrier 2023-10-04 02:00:30,457 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,39045,1696384805392 2023-10-04 02:00:30,457 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-04 02:00:30,457 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-04 02:00:30,457 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-04 02:00:30,457 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-04 02:00:30,457 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-10-04 02:00:30,458 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,39045,1696384805392 2023-10-04 02:00:30,458 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,35175,1696384805436 2023-10-04 02:00:30,458 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44303,1696384805319 2023-10-04 02:00:30,458 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-04 02:00:30,459 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,39045,1696384805392' joining acquired barrier for procedure 'snaptb0-testExportFileSystemState' on coordinator 2023-10-04 02:00:30,459 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5c436b1b[Count = 0] remaining members to acquire global barrier 2023-10-04 02:00:30,459 DEBUG [(jenkins-hbase9.apache.org,39651,1696384803959)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemState' starting 'in-barrier' execution. 2023-10-04 02:00:30,459 DEBUG [(jenkins-hbase9.apache.org,39651,1696384803959)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-10-04 02:00:30,461 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): regionserver:39045-0x1010f1b55330002, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-10-04 02:00:30,461 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): regionserver:44303-0x1010f1b55330001, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-10-04 02:00:30,461 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-10-04 02:00:30,461 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-10-04 02:00:30,461 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-10-04 02:00:30,461 DEBUG [(jenkins-hbase9.apache.org,39651,1696384803959)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39651-0x1010f1b55330000, quorum=127.0.0.1:60027, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,35175,1696384805436 2023-10-04 02:00:30,461 DEBUG [member: 'jenkins-hbase9.apache.org,44303,1696384805319' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-10-04 02:00:30,461 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): regionserver:35175-0x1010f1b55330003, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-10-04 02:00:30,461 DEBUG [member: 'jenkins-hbase9.apache.org,44303,1696384805319' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemState' locally completed 2023-10-04 02:00:30,461 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-10-04 02:00:30,461 DEBUG [member: 'jenkins-hbase9.apache.org,44303,1696384805319' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemState' completed for member 'jenkins-hbase9.apache.org,44303,1696384805319' in zk 2023-10-04 02:00:30,461 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-10-04 02:00:30,462 DEBUG [(jenkins-hbase9.apache.org,39651,1696384803959)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39651-0x1010f1b55330000, quorum=127.0.0.1:60027, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,39045,1696384805392 2023-10-04 02:00:30,462 DEBUG [member: 'jenkins-hbase9.apache.org,39045,1696384805392' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-10-04 02:00:30,461 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-10-04 02:00:30,462 DEBUG [(jenkins-hbase9.apache.org,39651,1696384803959)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-04 02:00:30,462 DEBUG [member: 'jenkins-hbase9.apache.org,35175,1696384805436' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-10-04 02:00:30,462 DEBUG [member: 'jenkins-hbase9.apache.org,39045,1696384805392' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-04 02:00:30,462 DEBUG [member: 'jenkins-hbase9.apache.org,39045,1696384805392' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-04 02:00:30,462 DEBUG [rs(jenkins-hbase9.apache.org,39045,1696384805392)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,1,1696384829372.9ec52cdf4bc03952ff9cfca008868a1a. 2023-10-04 02:00:30,462 DEBUG [member: 'jenkins-hbase9.apache.org,35175,1696384805436' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-04 02:00:30,462 DEBUG [member: 'jenkins-hbase9.apache.org,35175,1696384805436' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-04 02:00:30,462 DEBUG [rs(jenkins-hbase9.apache.org,39045,1696384805392)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,1,1696384829372.9ec52cdf4bc03952ff9cfca008868a1a. started... 2023-10-04 02:00:30,462 DEBUG [rs(jenkins-hbase9.apache.org,35175,1696384805436)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,,1696384829372.c4077678ce34c812f7ddedefaa28ee4d. 2023-10-04 02:00:30,462 DEBUG [rs(jenkins-hbase9.apache.org,35175,1696384805436)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,,1696384829372.c4077678ce34c812f7ddedefaa28ee4d. started... 2023-10-04 02:00:30,462 INFO [rs(jenkins-hbase9.apache.org,35175,1696384805436)-snapshot-pool-0] regionserver.HRegion(2745): Flushing c4077678ce34c812f7ddedefaa28ee4d 1/1 column families, dataSize=132 B heapSize=544 B 2023-10-04 02:00:30,462 INFO [rs(jenkins-hbase9.apache.org,39045,1696384805392)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 9ec52cdf4bc03952ff9cfca008868a1a 1/1 column families, dataSize=3.13 KB heapSize=7 KB 2023-10-04 02:00:30,463 DEBUG [member: 'jenkins-hbase9.apache.org,44303,1696384805319' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemState' has notified controller of completion 2023-10-04 02:00:30,464 DEBUG [member: 'jenkins-hbase9.apache.org,44303,1696384805319' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-04 02:00:30,464 DEBUG [member: 'jenkins-hbase9.apache.org,44303,1696384805319' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemState' completed. 2023-10-04 02:00:30,488 INFO [rs(jenkins-hbase9.apache.org,35175,1696384805436)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202310041876bb6978f44f0e975534bcc3009c67 to hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e202310041876bb6978f44f0e975534bcc3009c67 2023-10-04 02:00:30,490 INFO [rs(jenkins-hbase9.apache.org,39045,1696384805392)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20231004a20c420535cd48b587c58792a24fed22 to hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b20231004a20c420535cd48b587c58792a24fed22 2023-10-04 02:00:30,500 INFO [rs(jenkins-hbase9.apache.org,35175,1696384805436)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=132, hasBloomFilter=true, into tmp file hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/data/default/testtb-testExportFileSystemState/c4077678ce34c812f7ddedefaa28ee4d/.tmp/cf/1a0913a3e0a24da2aacfb5573e295ff7 2023-10-04 02:00:30,505 INFO [rs(jenkins-hbase9.apache.org,39045,1696384805392)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=3.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/data/default/testtb-testExportFileSystemState/9ec52cdf4bc03952ff9cfca008868a1a/.tmp/cf/1487d9f868ef4f398098689db05b448f 2023-10-04 02:00:30,509 DEBUG [rs(jenkins-hbase9.apache.org,35175,1696384805436)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/data/default/testtb-testExportFileSystemState/c4077678ce34c812f7ddedefaa28ee4d/.tmp/cf/1a0913a3e0a24da2aacfb5573e295ff7 as hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/data/default/testtb-testExportFileSystemState/c4077678ce34c812f7ddedefaa28ee4d/cf/1a0913a3e0a24da2aacfb5573e295ff7 2023-10-04 02:00:30,511 DEBUG [rs(jenkins-hbase9.apache.org,39045,1696384805392)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/data/default/testtb-testExportFileSystemState/9ec52cdf4bc03952ff9cfca008868a1a/.tmp/cf/1487d9f868ef4f398098689db05b448f as hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/data/default/testtb-testExportFileSystemState/9ec52cdf4bc03952ff9cfca008868a1a/cf/1487d9f868ef4f398098689db05b448f 2023-10-04 02:00:30,515 INFO [rs(jenkins-hbase9.apache.org,35175,1696384805436)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/data/default/testtb-testExportFileSystemState/c4077678ce34c812f7ddedefaa28ee4d/cf/1a0913a3e0a24da2aacfb5573e295ff7, entries=2, sequenceid=6, filesize=5.2 K 2023-10-04 02:00:30,517 INFO [rs(jenkins-hbase9.apache.org,39045,1696384805392)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/data/default/testtb-testExportFileSystemState/9ec52cdf4bc03952ff9cfca008868a1a/cf/1487d9f868ef4f398098689db05b448f, entries=48, sequenceid=6, filesize=13.0 K 2023-10-04 02:00:30,518 INFO [rs(jenkins-hbase9.apache.org,35175,1696384805436)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~132 B/132, heapSize ~528 B/528, currentSize=0 B/0 for c4077678ce34c812f7ddedefaa28ee4d in 55ms, sequenceid=6, compaction requested=false 2023-10-04 02:00:30,518 DEBUG [rs(jenkins-hbase9.apache.org,35175,1696384805436)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemState' 2023-10-04 02:00:30,518 DEBUG [rs(jenkins-hbase9.apache.org,35175,1696384805436)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for c4077678ce34c812f7ddedefaa28ee4d: 2023-10-04 02:00:30,518 INFO [rs(jenkins-hbase9.apache.org,39045,1696384805392)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.13 KB/3204, heapSize ~6.98 KB/7152, currentSize=0 B/0 for 9ec52cdf4bc03952ff9cfca008868a1a in 56ms, sequenceid=6, compaction requested=false 2023-10-04 02:00:30,520 DEBUG [rs(jenkins-hbase9.apache.org,39045,1696384805392)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 9ec52cdf4bc03952ff9cfca008868a1a: 2023-10-04 02:00:30,520 DEBUG [rs(jenkins-hbase9.apache.org,35175,1696384805436)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,,1696384829372.c4077678ce34c812f7ddedefaa28ee4d.' region-info for snapshot=snaptb0-testExportFileSystemState 2023-10-04 02:00:30,520 DEBUG [rs(jenkins-hbase9.apache.org,35175,1696384805436)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-04 02:00:30,520 DEBUG [rs(jenkins-hbase9.apache.org,39045,1696384805392)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,1,1696384829372.9ec52cdf4bc03952ff9cfca008868a1a.' region-info for snapshot=snaptb0-testExportFileSystemState 2023-10-04 02:00:30,520 DEBUG [rs(jenkins-hbase9.apache.org,35175,1696384805436)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/data/default/testtb-testExportFileSystemState/c4077678ce34c812f7ddedefaa28ee4d/cf/1a0913a3e0a24da2aacfb5573e295ff7] hfiles 2023-10-04 02:00:30,520 DEBUG [rs(jenkins-hbase9.apache.org,35175,1696384805436)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/data/default/testtb-testExportFileSystemState/c4077678ce34c812f7ddedefaa28ee4d/cf/1a0913a3e0a24da2aacfb5573e295ff7 for snapshot=snaptb0-testExportFileSystemState 2023-10-04 02:00:30,520 DEBUG [rs(jenkins-hbase9.apache.org,39045,1696384805392)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-04 02:00:30,521 DEBUG [rs(jenkins-hbase9.apache.org,39045,1696384805392)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/data/default/testtb-testExportFileSystemState/9ec52cdf4bc03952ff9cfca008868a1a/cf/1487d9f868ef4f398098689db05b448f] hfiles 2023-10-04 02:00:30,521 DEBUG [rs(jenkins-hbase9.apache.org,39045,1696384805392)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/data/default/testtb-testExportFileSystemState/9ec52cdf4bc03952ff9cfca008868a1a/cf/1487d9f868ef4f398098689db05b448f for snapshot=snaptb0-testExportFileSystemState 2023-10-04 02:00:30,523 DEBUG [Listener at jenkins-hbase9.apache.org/33899] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-04 02:00:30,524 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39651] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-10-04 02:00:30,524 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39651] snapshot.SnapshotManager(406): Snapshoting '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-10-04 02:00:30,525 DEBUG [Listener at jenkins-hbase9.apache.org/33899] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-10-04 02:00:30,545 DEBUG [rs(jenkins-hbase9.apache.org,35175,1696384805436)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,,1696384829372.c4077678ce34c812f7ddedefaa28ee4d. completed. 2023-10-04 02:00:30,545 DEBUG [rs(jenkins-hbase9.apache.org,35175,1696384805436)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,,1696384829372.c4077678ce34c812f7ddedefaa28ee4d. 2023-10-04 02:00:30,545 DEBUG [member: 'jenkins-hbase9.apache.org,35175,1696384805436' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-04 02:00:30,545 DEBUG [member: 'jenkins-hbase9.apache.org,35175,1696384805436' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-04 02:00:30,545 DEBUG [member: 'jenkins-hbase9.apache.org,35175,1696384805436' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase9.apache.org,35175,1696384805436 2023-10-04 02:00:30,545 DEBUG [member: 'jenkins-hbase9.apache.org,35175,1696384805436' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemState' locally completed 2023-10-04 02:00:30,545 DEBUG [member: 'jenkins-hbase9.apache.org,35175,1696384805436' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemState' completed for member 'jenkins-hbase9.apache.org,35175,1696384805436' in zk 2023-10-04 02:00:30,549 DEBUG [rs(jenkins-hbase9.apache.org,39045,1696384805392)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,1,1696384829372.9ec52cdf4bc03952ff9cfca008868a1a. completed. 2023-10-04 02:00:30,549 DEBUG [rs(jenkins-hbase9.apache.org,39045,1696384805392)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,1,1696384829372.9ec52cdf4bc03952ff9cfca008868a1a. 2023-10-04 02:00:30,549 DEBUG [member: 'jenkins-hbase9.apache.org,39045,1696384805392' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-04 02:00:30,549 DEBUG [member: 'jenkins-hbase9.apache.org,39045,1696384805392' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-04 02:00:30,549 DEBUG [member: 'jenkins-hbase9.apache.org,39045,1696384805392' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase9.apache.org,39045,1696384805392 2023-10-04 02:00:30,549 DEBUG [member: 'jenkins-hbase9.apache.org,39045,1696384805392' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemState' locally completed 2023-10-04 02:00:30,549 DEBUG [member: 'jenkins-hbase9.apache.org,39045,1696384805392' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemState' completed for member 'jenkins-hbase9.apache.org,39045,1696384805392' in zk 2023-10-04 02:00:30,550 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): master:39651-0x1010f1b55330000, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,35175,1696384805436 2023-10-04 02:00:30,550 DEBUG [member: 'jenkins-hbase9.apache.org,35175,1696384805436' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemState' has notified controller of completion 2023-10-04 02:00:30,550 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,35175,1696384805436 2023-10-04 02:00:30,550 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-04 02:00:30,550 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-04 02:00:30,550 DEBUG [member: 'jenkins-hbase9.apache.org,35175,1696384805436' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-04 02:00:30,550 DEBUG [member: 'jenkins-hbase9.apache.org,35175,1696384805436' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemState' completed. 2023-10-04 02:00:30,557 DEBUG [member: 'jenkins-hbase9.apache.org,39045,1696384805392' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemState' has notified controller of completion 2023-10-04 02:00:30,557 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): master:39651-0x1010f1b55330000, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,39045,1696384805392 2023-10-04 02:00:30,557 DEBUG [member: 'jenkins-hbase9.apache.org,39045,1696384805392' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-04 02:00:30,557 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-04 02:00:30,557 DEBUG [member: 'jenkins-hbase9.apache.org,39045,1696384805392' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemState' completed. 2023-10-04 02:00:30,559 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-04 02:00:30,560 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-10-04 02:00:30,560 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,39045,1696384805392 2023-10-04 02:00:30,561 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,35175,1696384805436 2023-10-04 02:00:30,561 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44303,1696384805319 2023-10-04 02:00:30,561 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-04 02:00:30,561 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-10-04 02:00:30,562 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,39045,1696384805392 2023-10-04 02:00:30,562 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,35175,1696384805436 2023-10-04 02:00:30,562 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44303,1696384805319 2023-10-04 02:00:30,563 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemState' member 'jenkins-hbase9.apache.org,35175,1696384805436': 2023-10-04 02:00:30,563 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,35175,1696384805436' released barrier for procedure'snaptb0-testExportFileSystemState', counting down latch. Waiting for 1 more 2023-10-04 02:00:30,563 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,39045,1696384805392 2023-10-04 02:00:30,563 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-04 02:00:30,563 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-04 02:00:30,564 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-04 02:00:30,564 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-04 02:00:30,564 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-10-04 02:00:30,564 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,39045,1696384805392 2023-10-04 02:00:30,565 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,35175,1696384805436 2023-10-04 02:00:30,565 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44303,1696384805319 2023-10-04 02:00:30,565 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-04 02:00:30,565 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-10-04 02:00:30,566 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,39045,1696384805392 2023-10-04 02:00:30,566 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,35175,1696384805436 2023-10-04 02:00:30,566 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44303,1696384805319 2023-10-04 02:00:30,567 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemState' member 'jenkins-hbase9.apache.org,39045,1696384805392': 2023-10-04 02:00:30,567 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,39045,1696384805392' released barrier for procedure'snaptb0-testExportFileSystemState', counting down latch. Waiting for 0 more 2023-10-04 02:00:30,567 INFO [(jenkins-hbase9.apache.org,39651,1696384803959)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemState' execution completed 2023-10-04 02:00:30,567 DEBUG [(jenkins-hbase9.apache.org,39651,1696384803959)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-04 02:00:30,567 DEBUG [(jenkins-hbase9.apache.org,39651,1696384803959)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-04 02:00:30,567 DEBUG [(jenkins-hbase9.apache.org,39651,1696384803959)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemState 2023-10-04 02:00:30,567 INFO [(jenkins-hbase9.apache.org,39651,1696384803959)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-10-04 02:00:30,569 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): master:39651-0x1010f1b55330000, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-10-04 02:00:30,569 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): regionserver:39045-0x1010f1b55330002, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-10-04 02:00:30,569 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): regionserver:44303-0x1010f1b55330001, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-10-04 02:00:30,569 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-10-04 02:00:30,569 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-10-04 02:00:30,569 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): regionserver:35175-0x1010f1b55330003, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-10-04 02:00:30,570 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): regionserver:35175-0x1010f1b55330003, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-04 02:00:30,570 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-10-04 02:00:30,570 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-10-04 02:00:30,570 DEBUG [(jenkins-hbase9.apache.org,39651,1696384803959)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39651-0x1010f1b55330000, quorum=127.0.0.1:60027, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,39045,1696384805392 2023-10-04 02:00:30,570 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-04 02:00:30,570 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-04 02:00:30,570 DEBUG [(jenkins-hbase9.apache.org,39651,1696384803959)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39651-0x1010f1b55330000, quorum=127.0.0.1:60027, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,35175,1696384805436 2023-10-04 02:00:30,571 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-10-04 02:00:30,571 DEBUG [(jenkins-hbase9.apache.org,39651,1696384803959)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39651-0x1010f1b55330000, quorum=127.0.0.1:60027, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,44303,1696384805319 2023-10-04 02:00:30,569 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): regionserver:44303-0x1010f1b55330001, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-04 02:00:30,569 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-10-04 02:00:30,571 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-04 02:00:30,571 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-04 02:00:30,569 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): regionserver:39045-0x1010f1b55330002, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-04 02:00:30,569 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-10-04 02:00:30,571 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-10-04 02:00:30,571 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-04 02:00:30,571 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-04 02:00:30,571 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-04 02:00:30,572 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-04 02:00:30,572 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-04 02:00:30,572 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-10-04 02:00:30,572 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-10-04 02:00:30,572 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-10-04 02:00:30,572 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-04 02:00:30,573 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-10-04 02:00:30,573 DEBUG [(jenkins-hbase9.apache.org,39651,1696384803959)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39651-0x1010f1b55330000, quorum=127.0.0.1:60027, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,39045,1696384805392 2023-10-04 02:00:30,573 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,39045,1696384805392 2023-10-04 02:00:30,574 DEBUG [(jenkins-hbase9.apache.org,39651,1696384803959)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39651-0x1010f1b55330000, quorum=127.0.0.1:60027, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,35175,1696384805436 2023-10-04 02:00:30,574 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,35175,1696384805436 2023-10-04 02:00:30,574 DEBUG [(jenkins-hbase9.apache.org,39651,1696384803959)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39651-0x1010f1b55330000, quorum=127.0.0.1:60027, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,44303,1696384805319 2023-10-04 02:00:30,574 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44303,1696384805319 2023-10-04 02:00:30,575 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-04 02:00:30,575 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-10-04 02:00:30,576 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,39045,1696384805392 2023-10-04 02:00:30,576 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,35175,1696384805436 2023-10-04 02:00:30,578 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): regionserver:35175-0x1010f1b55330003, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-04 02:00:30,578 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-04 02:00:30,578 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): master:39651-0x1010f1b55330000, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,44303,1696384805319 2023-10-04 02:00:30,578 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): regionserver:35175-0x1010f1b55330003, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-04 02:00:30,578 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): master:39651-0x1010f1b55330000, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-10-04 02:00:30,578 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): master:39651-0x1010f1b55330000, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,35175,1696384805436 2023-10-04 02:00:30,578 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): regionserver:39045-0x1010f1b55330002, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-04 02:00:30,578 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): master:39651-0x1010f1b55330000, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,39045,1696384805392 2023-10-04 02:00:30,578 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-04 02:00:30,578 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): master:39651-0x1010f1b55330000, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-10-04 02:00:30,578 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-04 02:00:30,578 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-04 02:00:30,578 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): regionserver:39045-0x1010f1b55330002, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-04 02:00:30,578 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): regionserver:44303-0x1010f1b55330001, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-04 02:00:30,578 DEBUG [(jenkins-hbase9.apache.org,39651,1696384803959)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-04 02:00:30,578 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-04 02:00:30,579 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44303,1696384805319 2023-10-04 02:00:30,578 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): regionserver:44303-0x1010f1b55330001, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-04 02:00:30,578 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemState 2023-10-04 02:00:30,581 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemState 2023-10-04 02:00:30,578 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): master:39651-0x1010f1b55330000, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,44303,1696384805319 2023-10-04 02:00:30,581 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-04 02:00:30,581 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-04 02:00:30,581 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): master:39651-0x1010f1b55330000, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-10-04 02:00:30,581 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 8c2558c0b59bb3a4e2e578c2c8e8915d, NAME => 'testtb-testExportFileSystemState,.mob,0.8c2558c0b59bb3a4e2e578c2c8e8915d.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testExportFileSystemState 2023-10-04 02:00:30,579 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-04 02:00:30,581 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-10-04 02:00:30,581 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-04 02:00:30,581 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-04 02:00:30,581 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): master:39651-0x1010f1b55330000, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,35175,1696384805436 2023-10-04 02:00:30,581 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): master:39651-0x1010f1b55330000, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,39045,1696384805392 2023-10-04 02:00:30,581 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): master:39651-0x1010f1b55330000, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-10-04 02:00:30,581 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): master:39651-0x1010f1b55330000, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-10-04 02:00:30,582 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b20231004a20c420535cd48b587c58792a24fed22, hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e202310041876bb6978f44f0e975534bcc3009c67] mob files 2023-10-04 02:00:30,582 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b20231004a20c420535cd48b587c58792a24fed22 2023-10-04 02:00:30,582 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e202310041876bb6978f44f0e975534bcc3009c67 2023-10-04 02:00:30,583 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-04 02:00:30,583 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-04 02:00:30,583 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:39651-0x1010f1b55330000, quorum=127.0.0.1:60027, baseZNode=/hbase Unable to get data of znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState because node does not exist (not an error) 2023-10-04 02:00:30,603 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemState 2023-10-04 02:00:30,604 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-10-04 02:00:30,633 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState to hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/.hbase-snapshot/snaptb0-testExportFileSystemState 2023-10-04 02:00:30,634 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed 2023-10-04 02:00:30,634 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-10-04 02:00:30,635 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-10-04 02:00:30,635 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState at 1696384830422Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemState at 1696384830603 (+181 ms)Consolidate snapshot: snaptb0-testExportFileSystemState at 1696384830603Loading Region manifests for snaptb0-testExportFileSystemState at 1696384830604 (+1 ms)Writing data manifest for snaptb0-testExportFileSystemState at 1696384830609 (+5 ms)Verifying snapshot: snaptb0-testExportFileSystemState at 1696384830621 (+12 ms)Snapshot snaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed at 1696384830634 (+13 ms) 2023-10-04 02:00:30,637 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=35, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-10-04 02:00:30,640 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=35, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED in 215 msec 2023-10-04 02:00:30,725 DEBUG [Listener at jenkins-hbase9.apache.org/33899] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-04 02:00:30,726 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39651] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-10-04 02:00:30,726 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39651] snapshot.SnapshotManager(403): Snapshot '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-10-04 02:00:30,727 INFO [Listener at jenkins-hbase9.apache.org/33899] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/export-test/export-1696384830727 2023-10-04 02:00:30,727 INFO [Listener at jenkins-hbase9.apache.org/33899] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:38449, tgtDir=hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/export-test/export-1696384830727, rawTgtDir=hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/export-test/export-1696384830727, srcFsUri=hdfs://localhost:38449, srcDir=hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51 2023-10-04 02:00:30,756 DEBUG [Listener at jenkins-hbase9.apache.org/33899] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:38449, inputRoot=hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51 2023-10-04 02:00:30,756 DEBUG [Listener at jenkins-hbase9.apache.org/33899] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_979790290_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/export-test/export-1696384830727, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/export-test/export-1696384830727/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-10-04 02:00:30,757 INFO [Listener at jenkins-hbase9.apache.org/33899] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:38449, inputRoot=hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51, snapshotDir=hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/.hbase-snapshot/snaptb0-testExportFileSystemState. 2023-10-04 02:00:30,773 INFO [Listener at jenkins-hbase9.apache.org/33899] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/.hbase-snapshot/snaptb0-testExportFileSystemState to hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/export-test/export-1696384830727/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-10-04 02:00:30,806 DEBUG [Listener at jenkins-hbase9.apache.org/33899] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-10-04 02:00:30,807 DEBUG [Listener at jenkins-hbase9.apache.org/33899] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-10-04 02:00:30,808 DEBUG [Listener at jenkins-hbase9.apache.org/33899] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-10-04 02:00:30,808 DEBUG [Listener at jenkins-hbase9.apache.org/33899] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-10-04 02:00:30,809 DEBUG [Listener at jenkins-hbase9.apache.org/33899] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar 2023-10-04 02:00:30,809 DEBUG [Listener at jenkins-hbase9.apache.org/33899] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-10-04 02:00:30,810 DEBUG [Listener at jenkins-hbase9.apache.org/33899] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-10-04 02:00:30,896 DEBUG [Listener at jenkins-hbase9.apache.org/33899] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/757a468a-9656-cc80-ec19-d6f68f36be5a/hadoop-7156959229134093339.jar 2023-10-04 02:00:30,897 DEBUG [Listener at jenkins-hbase9.apache.org/33899] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-10-04 02:00:30,897 DEBUG [Listener at jenkins-hbase9.apache.org/33899] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-10-04 02:00:30,898 DEBUG [Listener at jenkins-hbase9.apache.org/33899] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-10-04 02:00:30,898 DEBUG [Listener at jenkins-hbase9.apache.org/33899] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-10-04 02:00:30,898 DEBUG [Listener at jenkins-hbase9.apache.org/33899] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-10-04 02:00:30,899 DEBUG [Listener at jenkins-hbase9.apache.org/33899] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-10-04 02:00:30,899 DEBUG [Listener at jenkins-hbase9.apache.org/33899] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-10-04 02:00:30,899 DEBUG [Listener at jenkins-hbase9.apache.org/33899] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-10-04 02:00:30,900 DEBUG [Listener at jenkins-hbase9.apache.org/33899] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-10-04 02:00:30,900 DEBUG [Listener at jenkins-hbase9.apache.org/33899] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-10-04 02:00:30,901 DEBUG [Listener at jenkins-hbase9.apache.org/33899] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-10-04 02:00:30,901 DEBUG [Listener at jenkins-hbase9.apache.org/33899] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-10-04 02:00:30,901 DEBUG [Listener at jenkins-hbase9.apache.org/33899] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-10-04 02:00:30,902 DEBUG [Listener at jenkins-hbase9.apache.org/33899] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-10-04 02:00:30,902 DEBUG [Listener at jenkins-hbase9.apache.org/33899] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-10-04 02:00:30,903 DEBUG [Listener at jenkins-hbase9.apache.org/33899] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-10-04 02:00:30,903 DEBUG [Listener at jenkins-hbase9.apache.org/33899] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-04 02:00:30,903 DEBUG [Listener at jenkins-hbase9.apache.org/33899] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-04 02:00:30,904 DEBUG [Listener at jenkins-hbase9.apache.org/33899] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-10-04 02:00:30,904 DEBUG [Listener at jenkins-hbase9.apache.org/33899] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-04 02:00:30,904 DEBUG [Listener at jenkins-hbase9.apache.org/33899] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-04 02:00:30,905 DEBUG [Listener at jenkins-hbase9.apache.org/33899] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-10-04 02:00:30,905 DEBUG [Listener at jenkins-hbase9.apache.org/33899] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-10-04 02:00:31,354 WARN [Listener at jenkins-hbase9.apache.org/33899] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-10-04 02:00:31,357 INFO [Listener at jenkins-hbase9.apache.org/33899] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportFileSystemState' hfile list 2023-10-04 02:00:31,359 DEBUG [Listener at jenkins-hbase9.apache.org/33899] snapshot.ExportSnapshot(671): export split=0 size=30.9 K 2023-10-04 02:00:33,289 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-10-04 02:00:33,289 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-10-04 02:00:33,295 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696384811997_0001_000001 (auth:SIMPLE) 2023-10-04 02:00:33,943 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696384811997_0002_000001 (auth:SIMPLE) 2023-10-04 02:00:34,522 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-10-04 02:00:37,965 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696384811997_0002_000001 (auth:SIMPLE) 2023-10-04 02:00:40,179 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696384811997_0002_000001 (auth:SIMPLE) 2023-10-04 02:00:43,420 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696384811997_0002_000001 (auth:SIMPLE) 2023-10-04 02:00:44,572 INFO [Listener at jenkins-hbase9.apache.org/33899] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-10-04 02:00:44,572 INFO [Listener at jenkins-hbase9.apache.org/33899] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-10-04 02:00:44,581 INFO [Listener at jenkins-hbase9.apache.org/33899] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testExportFileSystemState 2023-10-04 02:00:44,581 INFO [Listener at jenkins-hbase9.apache.org/33899] snapshot.TestExportSnapshot(279): Exported snapshot 2023-10-04 02:00:44,581 INFO [Listener at jenkins-hbase9.apache.org/33899] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-10-04 02:00:44,581 DEBUG [Listener at jenkins-hbase9.apache.org/33899] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-737588810_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/.hbase-snapshot/snaptb0-testExportFileSystemState at hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/.hbase-snapshot/snaptb0-testExportFileSystemState 2023-10-04 02:00:44,582 DEBUG [Listener at jenkins-hbase9.apache.org/33899] snapshot.TestExportSnapshot(367): hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/.hbase-snapshot/snaptb0-testExportFileSystemState/.snapshotinfo 2023-10-04 02:00:44,582 DEBUG [Listener at jenkins-hbase9.apache.org/33899] snapshot.TestExportSnapshot(367): hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/.hbase-snapshot/snaptb0-testExportFileSystemState/data.manifest 2023-10-04 02:00:44,582 DEBUG [Listener at jenkins-hbase9.apache.org/33899] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-737588810_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/export-test/export-1696384830727/.hbase-snapshot/snaptb0-testExportFileSystemState at hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/export-test/export-1696384830727/.hbase-snapshot/snaptb0-testExportFileSystemState 2023-10-04 02:00:44,582 DEBUG [Listener at jenkins-hbase9.apache.org/33899] snapshot.TestExportSnapshot(367): hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/export-test/export-1696384830727/.hbase-snapshot/snaptb0-testExportFileSystemState/.snapshotinfo 2023-10-04 02:00:44,582 DEBUG [Listener at jenkins-hbase9.apache.org/33899] snapshot.TestExportSnapshot(367): hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/export-test/export-1696384830727/.hbase-snapshot/snaptb0-testExportFileSystemState/data.manifest 2023-10-04 02:00:44,589 INFO [Listener at jenkins-hbase9.apache.org/33899] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemState 2023-10-04 02:00:44,590 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39651] master.HMaster$11(2418): Client=jenkins//172.31.2.10 disable testtb-testExportFileSystemState 2023-10-04 02:00:44,591 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39651] procedure2.ProcedureExecutor(1028): Stored pid=36, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemState 2023-10-04 02:00:44,594 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39651] master.MasterRpcServices(1230): Checking to see if procedure is done pid=36 2023-10-04 02:00:44,595 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696384844595"}]},"ts":"1696384844595"} 2023-10-04 02:00:44,597 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=DISABLING in hbase:meta 2023-10-04 02:00:44,598 INFO [PEWorker-4] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemState to state=DISABLING 2023-10-04 02:00:44,599 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=37, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=c4077678ce34c812f7ddedefaa28ee4d, UNASSIGN}, {pid=38, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=9ec52cdf4bc03952ff9cfca008868a1a, UNASSIGN}] 2023-10-04 02:00:44,602 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=37, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=c4077678ce34c812f7ddedefaa28ee4d, UNASSIGN 2023-10-04 02:00:44,602 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=38, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=9ec52cdf4bc03952ff9cfca008868a1a, UNASSIGN 2023-10-04 02:00:44,603 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=37 updating hbase:meta row=c4077678ce34c812f7ddedefaa28ee4d, regionState=CLOSING, regionLocation=jenkins-hbase9.apache.org,35175,1696384805436 2023-10-04 02:00:44,603 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,,1696384829372.c4077678ce34c812f7ddedefaa28ee4d.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1696384844602"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696384844602"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696384844602"}]},"ts":"1696384844602"} 2023-10-04 02:00:44,603 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=38 updating hbase:meta row=9ec52cdf4bc03952ff9cfca008868a1a, regionState=CLOSING, regionLocation=jenkins-hbase9.apache.org,39045,1696384805392 2023-10-04 02:00:44,603 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,1,1696384829372.9ec52cdf4bc03952ff9cfca008868a1a.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1696384844603"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696384844603"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696384844603"}]},"ts":"1696384844603"} 2023-10-04 02:00:44,604 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=39, ppid=37, state=RUNNABLE; CloseRegionProcedure c4077678ce34c812f7ddedefaa28ee4d, server=jenkins-hbase9.apache.org,35175,1696384805436}] 2023-10-04 02:00:44,605 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=40, ppid=38, state=RUNNABLE; CloseRegionProcedure 9ec52cdf4bc03952ff9cfca008868a1a, server=jenkins-hbase9.apache.org,39045,1696384805392}] 2023-10-04 02:00:44,696 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39651] master.MasterRpcServices(1230): Checking to see if procedure is done pid=36 2023-10-04 02:00:44,757 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(111): Close c4077678ce34c812f7ddedefaa28ee4d 2023-10-04 02:00:44,758 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1604): Closing c4077678ce34c812f7ddedefaa28ee4d, disabling compactions & flushes 2023-10-04 02:00:44,758 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,,1696384829372.c4077678ce34c812f7ddedefaa28ee4d. 2023-10-04 02:00:44,758 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,,1696384829372.c4077678ce34c812f7ddedefaa28ee4d. 2023-10-04 02:00:44,758 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,,1696384829372.c4077678ce34c812f7ddedefaa28ee4d. after waiting 0 ms 2023-10-04 02:00:44,758 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,,1696384829372.c4077678ce34c812f7ddedefaa28ee4d. 2023-10-04 02:00:44,762 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(111): Close 9ec52cdf4bc03952ff9cfca008868a1a 2023-10-04 02:00:44,762 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1604): Closing 9ec52cdf4bc03952ff9cfca008868a1a, disabling compactions & flushes 2023-10-04 02:00:44,762 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,1,1696384829372.9ec52cdf4bc03952ff9cfca008868a1a. 2023-10-04 02:00:44,763 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,1,1696384829372.9ec52cdf4bc03952ff9cfca008868a1a. 2023-10-04 02:00:44,763 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,1,1696384829372.9ec52cdf4bc03952ff9cfca008868a1a. after waiting 0 ms 2023-10-04 02:00:44,763 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,1,1696384829372.9ec52cdf4bc03952ff9cfca008868a1a. 2023-10-04 02:00:44,768 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/data/default/testtb-testExportFileSystemState/c4077678ce34c812f7ddedefaa28ee4d/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-10-04 02:00:44,768 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-10-04 02:00:44,769 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,,1696384829372.c4077678ce34c812f7ddedefaa28ee4d. 2023-10-04 02:00:44,769 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1558): Region close journal for c4077678ce34c812f7ddedefaa28ee4d: 2023-10-04 02:00:44,769 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/data/default/testtb-testExportFileSystemState/9ec52cdf4bc03952ff9cfca008868a1a/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-10-04 02:00:44,770 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-10-04 02:00:44,771 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,1,1696384829372.9ec52cdf4bc03952ff9cfca008868a1a. 2023-10-04 02:00:44,771 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1558): Region close journal for 9ec52cdf4bc03952ff9cfca008868a1a: 2023-10-04 02:00:44,772 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(149): Closed c4077678ce34c812f7ddedefaa28ee4d 2023-10-04 02:00:44,773 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=37 updating hbase:meta row=c4077678ce34c812f7ddedefaa28ee4d, regionState=CLOSED 2023-10-04 02:00:44,773 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,,1696384829372.c4077678ce34c812f7ddedefaa28ee4d.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1696384844773"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696384844773"}]},"ts":"1696384844773"} 2023-10-04 02:00:44,773 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(149): Closed 9ec52cdf4bc03952ff9cfca008868a1a 2023-10-04 02:00:44,774 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=38 updating hbase:meta row=9ec52cdf4bc03952ff9cfca008868a1a, regionState=CLOSED 2023-10-04 02:00:44,774 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,1,1696384829372.9ec52cdf4bc03952ff9cfca008868a1a.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1696384844774"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696384844774"}]},"ts":"1696384844774"} 2023-10-04 02:00:44,777 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=39, resume processing ppid=37 2023-10-04 02:00:44,777 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=39, ppid=37, state=SUCCESS; CloseRegionProcedure c4077678ce34c812f7ddedefaa28ee4d, server=jenkins-hbase9.apache.org,35175,1696384805436 in 171 msec 2023-10-04 02:00:44,778 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=40, resume processing ppid=38 2023-10-04 02:00:44,778 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=40, ppid=38, state=SUCCESS; CloseRegionProcedure 9ec52cdf4bc03952ff9cfca008868a1a, server=jenkins-hbase9.apache.org,39045,1696384805392 in 171 msec 2023-10-04 02:00:44,779 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=37, ppid=36, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=c4077678ce34c812f7ddedefaa28ee4d, UNASSIGN in 178 msec 2023-10-04 02:00:44,780 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=38, resume processing ppid=36 2023-10-04 02:00:44,780 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=38, ppid=36, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=9ec52cdf4bc03952ff9cfca008868a1a, UNASSIGN in 179 msec 2023-10-04 02:00:44,781 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696384844780"}]},"ts":"1696384844780"} 2023-10-04 02:00:44,782 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=DISABLED in hbase:meta 2023-10-04 02:00:44,784 INFO [PEWorker-1] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemState to state=DISABLED 2023-10-04 02:00:44,786 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=36, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemState in 195 msec 2023-10-04 02:00:44,897 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39651] master.MasterRpcServices(1230): Checking to see if procedure is done pid=36 2023-10-04 02:00:44,897 INFO [Listener at jenkins-hbase9.apache.org/33899] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemState, procId: 36 completed 2023-10-04 02:00:44,898 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39651] master.HMaster$5(2228): Client=jenkins//172.31.2.10 delete testtb-testExportFileSystemState 2023-10-04 02:00:44,899 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39651] procedure2.ProcedureExecutor(1028): Stored pid=41, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-10-04 02:00:44,902 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=41, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-10-04 02:00:44,902 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39651] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemState 2023-10-04 02:00:44,903 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=41, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-10-04 02:00:44,904 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=44303] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemState 2023-10-04 02:00:44,908 DEBUG [HFileArchiver-9] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/.tmp/data/default/testtb-testExportFileSystemState/c4077678ce34c812f7ddedefaa28ee4d 2023-10-04 02:00:44,908 DEBUG [HFileArchiver-10] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/.tmp/data/default/testtb-testExportFileSystemState/9ec52cdf4bc03952ff9cfca008868a1a 2023-10-04 02:00:44,909 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): master:39651-0x1010f1b55330000, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-10-04 02:00:44,909 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): regionserver:39045-0x1010f1b55330002, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-10-04 02:00:44,909 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): regionserver:35175-0x1010f1b55330003, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-10-04 02:00:44,909 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): regionserver:44303-0x1010f1b55330001, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-10-04 02:00:44,910 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-10-04 02:00:44,910 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-10-04 02:00:44,910 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-10-04 02:00:44,910 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-10-04 02:00:44,911 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): regionserver:39045-0x1010f1b55330002, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-10-04 02:00:44,911 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): regionserver:35175-0x1010f1b55330003, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-10-04 02:00:44,911 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): regionserver:39045-0x1010f1b55330002, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-04 02:00:44,911 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): regionserver:44303-0x1010f1b55330001, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-10-04 02:00:44,911 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): master:39651-0x1010f1b55330000, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-10-04 02:00:44,911 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): master:39651-0x1010f1b55330000, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-04 02:00:44,911 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): regionserver:35175-0x1010f1b55330003, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-04 02:00:44,911 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): regionserver:44303-0x1010f1b55330001, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-04 02:00:44,912 DEBUG [HFileArchiver-9] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/.tmp/data/default/testtb-testExportFileSystemState/c4077678ce34c812f7ddedefaa28ee4d/cf, FileablePath, hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/.tmp/data/default/testtb-testExportFileSystemState/c4077678ce34c812f7ddedefaa28ee4d/recovered.edits] 2023-10-04 02:00:44,912 DEBUG [HFileArchiver-10] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/.tmp/data/default/testtb-testExportFileSystemState/9ec52cdf4bc03952ff9cfca008868a1a/cf, FileablePath, hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/.tmp/data/default/testtb-testExportFileSystemState/9ec52cdf4bc03952ff9cfca008868a1a/recovered.edits] 2023-10-04 02:00:44,913 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39651] master.MasterRpcServices(1230): Checking to see if procedure is done pid=41 2023-10-04 02:00:44,918 DEBUG [HFileArchiver-9] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/.tmp/data/default/testtb-testExportFileSystemState/c4077678ce34c812f7ddedefaa28ee4d/cf/1a0913a3e0a24da2aacfb5573e295ff7 to hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/archive/data/default/testtb-testExportFileSystemState/c4077678ce34c812f7ddedefaa28ee4d/cf/1a0913a3e0a24da2aacfb5573e295ff7 2023-10-04 02:00:44,919 DEBUG [HFileArchiver-10] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/.tmp/data/default/testtb-testExportFileSystemState/9ec52cdf4bc03952ff9cfca008868a1a/cf/1487d9f868ef4f398098689db05b448f to hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/archive/data/default/testtb-testExportFileSystemState/9ec52cdf4bc03952ff9cfca008868a1a/cf/1487d9f868ef4f398098689db05b448f 2023-10-04 02:00:44,923 DEBUG [HFileArchiver-9] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/.tmp/data/default/testtb-testExportFileSystemState/c4077678ce34c812f7ddedefaa28ee4d/recovered.edits/9.seqid to hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/archive/data/default/testtb-testExportFileSystemState/c4077678ce34c812f7ddedefaa28ee4d/recovered.edits/9.seqid 2023-10-04 02:00:44,924 DEBUG [HFileArchiver-10] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/.tmp/data/default/testtb-testExportFileSystemState/9ec52cdf4bc03952ff9cfca008868a1a/recovered.edits/9.seqid to hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/archive/data/default/testtb-testExportFileSystemState/9ec52cdf4bc03952ff9cfca008868a1a/recovered.edits/9.seqid 2023-10-04 02:00:44,924 DEBUG [HFileArchiver-9] backup.HFileArchiver(596): Deleted hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/.tmp/data/default/testtb-testExportFileSystemState/c4077678ce34c812f7ddedefaa28ee4d 2023-10-04 02:00:44,924 DEBUG [HFileArchiver-10] backup.HFileArchiver(596): Deleted hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/.tmp/data/default/testtb-testExportFileSystemState/9ec52cdf4bc03952ff9cfca008868a1a 2023-10-04 02:00:44,924 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemState regions 2023-10-04 02:00:44,925 DEBUG [PEWorker-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d 2023-10-04 02:00:44,926 DEBUG [PEWorker-4] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf] 2023-10-04 02:00:44,931 DEBUG [PEWorker-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b20231004a20c420535cd48b587c58792a24fed22 to hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/archive/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b20231004a20c420535cd48b587c58792a24fed22 2023-10-04 02:00:44,933 DEBUG [PEWorker-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e202310041876bb6978f44f0e975534bcc3009c67 to hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/archive/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e202310041876bb6978f44f0e975534bcc3009c67 2023-10-04 02:00:44,934 DEBUG [PEWorker-4] backup.HFileArchiver(596): Deleted hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d 2023-10-04 02:00:44,939 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=41, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-10-04 02:00:44,942 WARN [PEWorker-4] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportFileSystemState from hbase:meta 2023-10-04 02:00:44,945 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemState' descriptor. 2023-10-04 02:00:44,947 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=41, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-10-04 02:00:44,947 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemState' from region states. 2023-10-04 02:00:44,947 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemState,,1696384829372.c4077678ce34c812f7ddedefaa28ee4d.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1696384844947"}]},"ts":"9223372036854775807"} 2023-10-04 02:00:44,947 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemState,1,1696384829372.9ec52cdf4bc03952ff9cfca008868a1a.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1696384844947"}]},"ts":"9223372036854775807"} 2023-10-04 02:00:44,949 INFO [PEWorker-4] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-10-04 02:00:44,949 DEBUG [PEWorker-4] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => c4077678ce34c812f7ddedefaa28ee4d, NAME => 'testtb-testExportFileSystemState,,1696384829372.c4077678ce34c812f7ddedefaa28ee4d.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 9ec52cdf4bc03952ff9cfca008868a1a, NAME => 'testtb-testExportFileSystemState,1,1696384829372.9ec52cdf4bc03952ff9cfca008868a1a.', STARTKEY => '1', ENDKEY => ''}] 2023-10-04 02:00:44,950 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemState' as deleted. 2023-10-04 02:00:44,950 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1696384844950"}]},"ts":"9223372036854775807"} 2023-10-04 02:00:44,952 INFO [PEWorker-4] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemState state from META 2023-10-04 02:00:44,954 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(130): Finished pid=41, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-10-04 02:00:44,956 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=41, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemState in 56 msec 2023-10-04 02:00:45,014 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39651] master.MasterRpcServices(1230): Checking to see if procedure is done pid=41 2023-10-04 02:00:45,015 INFO [Listener at jenkins-hbase9.apache.org/33899] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemState, procId: 41 completed 2023-10-04 02:00:45,025 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39651] master.MasterRpcServices(751): Client=jenkins//172.31.2.10 delete name: "emptySnaptb0-testExportFileSystemState" 2023-10-04 02:00:45,027 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39651] snapshot.SnapshotManager(335): Deleting snapshot: emptySnaptb0-testExportFileSystemState 2023-10-04 02:00:45,029 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39651] master.MasterRpcServices(751): Client=jenkins//172.31.2.10 delete name: "snaptb0-testExportFileSystemState" 2023-10-04 02:00:45,031 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39651] snapshot.SnapshotManager(335): Deleting snapshot: snaptb0-testExportFileSystemState 2023-10-04 02:00:45,057 INFO [Listener at jenkins-hbase9.apache.org/33899] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testExportFileSystemState Thread=762 (was 749) Potentially hanging thread: LogDeleter #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-737588810_17 at /127.0.0.1:55364 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-737588810_17 at /127.0.0.1:49414 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x20d1013d-shared-pool-16 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (905985230) connection to jenkins-hbase9.apache.org/172.31.2.10:43685 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: hconnection-0x20d1013d-shared-pool-15 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-10 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-737588810_17 at /127.0.0.1:49376 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x20d1013d-shared-pool-18 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-8 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-4-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-7 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-1962 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: IPC Client (905985230) connection to jenkins-hbase9.apache.org/172.31.2.10:33899 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: ApplicationMasterLauncher #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-4 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-9 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_179190330_1 at /127.0.0.1:55354 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-4-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x20d1013d-shared-pool-17 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=938 (was 926) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=316 (was 247) - SystemLoadAverage LEAK? -, ProcessCount=168 (was 168), AvailableMemoryMB=10998 (was 11114) 2023-10-04 02:00:45,057 WARN [Listener at jenkins-hbase9.apache.org/33899] hbase.ResourceChecker(130): Thread=762 is superior to 500 2023-10-04 02:00:45,076 INFO [Listener at jenkins-hbase9.apache.org/33899] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testConsecutiveExports Thread=762, OpenFileDescriptor=938, MaxFileDescriptor=60000, SystemLoadAverage=316, ProcessCount=168, AvailableMemoryMB=10996 2023-10-04 02:00:45,076 WARN [Listener at jenkins-hbase9.apache.org/33899] hbase.ResourceChecker(130): Thread=762 is superior to 500 2023-10-04 02:00:45,079 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39651] master.HMaster$4(2112): Client=jenkins//172.31.2.10 create 'testtb-testConsecutiveExports', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-10-04 02:00:45,080 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39651] procedure2.ProcedureExecutor(1028): Stored pid=42, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testConsecutiveExports 2023-10-04 02:00:45,083 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_PRE_OPERATION 2023-10-04 02:00:45,083 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39651] master.MasterRpcServices(700): Client=jenkins//172.31.2.10 procedure request for creating table: namespace: "default" qualifier: "testtb-testConsecutiveExports" procId is: 42 2023-10-04 02:00:45,084 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-10-04 02:00:45,084 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39651] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-10-04 02:00:45,086 DEBUG [HFileArchiver-11] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/.tmp/data/default/testtb-testConsecutiveExports/3c37a247c41cfe6705e84b208102faab 2023-10-04 02:00:45,087 DEBUG [HFileArchiver-12] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/.tmp/data/default/testtb-testConsecutiveExports/1e754cc94e1e4025807fe47095eba9a0 2023-10-04 02:00:45,087 DEBUG [HFileArchiver-11] backup.HFileArchiver(153): Directory hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/.tmp/data/default/testtb-testConsecutiveExports/3c37a247c41cfe6705e84b208102faab empty. 2023-10-04 02:00:45,087 DEBUG [HFileArchiver-12] backup.HFileArchiver(153): Directory hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/.tmp/data/default/testtb-testConsecutiveExports/1e754cc94e1e4025807fe47095eba9a0 empty. 2023-10-04 02:00:45,088 DEBUG [HFileArchiver-11] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/.tmp/data/default/testtb-testConsecutiveExports/3c37a247c41cfe6705e84b208102faab 2023-10-04 02:00:45,088 DEBUG [HFileArchiver-12] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/.tmp/data/default/testtb-testConsecutiveExports/1e754cc94e1e4025807fe47095eba9a0 2023-10-04 02:00:45,088 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testtb-testConsecutiveExports regions 2023-10-04 02:00:45,104 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/.tmp/data/default/testtb-testConsecutiveExports/.tabledesc/.tableinfo.0000000001 2023-10-04 02:00:45,105 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(7675): creating {ENCODED => 3c37a247c41cfe6705e84b208102faab, NAME => 'testtb-testConsecutiveExports,,1696384845078.3c37a247c41cfe6705e84b208102faab.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testConsecutiveExports', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/.tmp 2023-10-04 02:00:45,105 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(7675): creating {ENCODED => 1e754cc94e1e4025807fe47095eba9a0, NAME => 'testtb-testConsecutiveExports,1,1696384845078.1e754cc94e1e4025807fe47095eba9a0.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testConsecutiveExports', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/.tmp 2023-10-04 02:00:45,127 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,1,1696384845078.1e754cc94e1e4025807fe47095eba9a0.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-04 02:00:45,127 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1604): Closing 1e754cc94e1e4025807fe47095eba9a0, disabling compactions & flushes 2023-10-04 02:00:45,127 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,1,1696384845078.1e754cc94e1e4025807fe47095eba9a0. 2023-10-04 02:00:45,127 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,1,1696384845078.1e754cc94e1e4025807fe47095eba9a0. 2023-10-04 02:00:45,127 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,1,1696384845078.1e754cc94e1e4025807fe47095eba9a0. after waiting 0 ms 2023-10-04 02:00:45,127 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,,1696384845078.3c37a247c41cfe6705e84b208102faab.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-04 02:00:45,127 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,1,1696384845078.1e754cc94e1e4025807fe47095eba9a0. 2023-10-04 02:00:45,127 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1604): Closing 3c37a247c41cfe6705e84b208102faab, disabling compactions & flushes 2023-10-04 02:00:45,127 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,1,1696384845078.1e754cc94e1e4025807fe47095eba9a0. 2023-10-04 02:00:45,127 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,,1696384845078.3c37a247c41cfe6705e84b208102faab. 2023-10-04 02:00:45,127 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1558): Region close journal for 1e754cc94e1e4025807fe47095eba9a0: 2023-10-04 02:00:45,127 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,,1696384845078.3c37a247c41cfe6705e84b208102faab. 2023-10-04 02:00:45,128 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,,1696384845078.3c37a247c41cfe6705e84b208102faab. after waiting 0 ms 2023-10-04 02:00:45,128 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,,1696384845078.3c37a247c41cfe6705e84b208102faab. 2023-10-04 02:00:45,128 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,,1696384845078.3c37a247c41cfe6705e84b208102faab. 2023-10-04 02:00:45,128 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1558): Region close journal for 3c37a247c41cfe6705e84b208102faab: 2023-10-04 02:00:45,131 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_ADD_TO_META 2023-10-04 02:00:45,132 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,1,1696384845078.1e754cc94e1e4025807fe47095eba9a0.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1696384845132"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696384845132"}]},"ts":"1696384845132"} 2023-10-04 02:00:45,132 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,,1696384845078.3c37a247c41cfe6705e84b208102faab.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1696384845132"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696384845132"}]},"ts":"1696384845132"} 2023-10-04 02:00:45,135 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-10-04 02:00:45,136 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-10-04 02:00:45,137 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696384845136"}]},"ts":"1696384845136"} 2023-10-04 02:00:45,138 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=ENABLING in hbase:meta 2023-10-04 02:00:45,143 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase9.apache.org=0} racks are {/default-rack=0} 2023-10-04 02:00:45,145 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-10-04 02:00:45,145 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-10-04 02:00:45,145 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-10-04 02:00:45,145 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-10-04 02:00:45,146 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=43, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=3c37a247c41cfe6705e84b208102faab, ASSIGN}, {pid=44, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=1e754cc94e1e4025807fe47095eba9a0, ASSIGN}] 2023-10-04 02:00:45,150 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=44, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=1e754cc94e1e4025807fe47095eba9a0, ASSIGN 2023-10-04 02:00:45,150 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=43, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=3c37a247c41cfe6705e84b208102faab, ASSIGN 2023-10-04 02:00:45,151 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=44, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=1e754cc94e1e4025807fe47095eba9a0, ASSIGN; state=OFFLINE, location=jenkins-hbase9.apache.org,39045,1696384805392; forceNewPlan=false, retain=false 2023-10-04 02:00:45,151 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=43, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=3c37a247c41cfe6705e84b208102faab, ASSIGN; state=OFFLINE, location=jenkins-hbase9.apache.org,44303,1696384805319; forceNewPlan=false, retain=false 2023-10-04 02:00:45,186 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39651] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-10-04 02:00:45,301 INFO [jenkins-hbase9:39651] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-10-04 02:00:45,304 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=44 updating hbase:meta row=1e754cc94e1e4025807fe47095eba9a0, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,39045,1696384805392 2023-10-04 02:00:45,304 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=43 updating hbase:meta row=3c37a247c41cfe6705e84b208102faab, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,44303,1696384805319 2023-10-04 02:00:45,304 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,1,1696384845078.1e754cc94e1e4025807fe47095eba9a0.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1696384845304"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696384845304"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696384845304"}]},"ts":"1696384845304"} 2023-10-04 02:00:45,304 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,,1696384845078.3c37a247c41cfe6705e84b208102faab.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1696384845304"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696384845304"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696384845304"}]},"ts":"1696384845304"} 2023-10-04 02:00:45,306 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=45, ppid=44, state=RUNNABLE; OpenRegionProcedure 1e754cc94e1e4025807fe47095eba9a0, server=jenkins-hbase9.apache.org,39045,1696384805392}] 2023-10-04 02:00:45,307 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=46, ppid=43, state=RUNNABLE; OpenRegionProcedure 3c37a247c41cfe6705e84b208102faab, server=jenkins-hbase9.apache.org,44303,1696384805319}] 2023-10-04 02:00:45,387 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39651] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-10-04 02:00:45,462 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(130): Open testtb-testConsecutiveExports,1,1696384845078.1e754cc94e1e4025807fe47095eba9a0. 2023-10-04 02:00:45,462 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 1e754cc94e1e4025807fe47095eba9a0, NAME => 'testtb-testConsecutiveExports,1,1696384845078.1e754cc94e1e4025807fe47095eba9a0.', STARTKEY => '1', ENDKEY => ''} 2023-10-04 02:00:45,462 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(130): Open testtb-testConsecutiveExports,,1696384845078.3c37a247c41cfe6705e84b208102faab. 2023-10-04 02:00:45,462 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 3c37a247c41cfe6705e84b208102faab, NAME => 'testtb-testConsecutiveExports,,1696384845078.3c37a247c41cfe6705e84b208102faab.', STARTKEY => '', ENDKEY => '1'} 2023-10-04 02:00:45,463 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testConsecutiveExports,1,1696384845078.1e754cc94e1e4025807fe47095eba9a0. service=AccessControlService 2023-10-04 02:00:45,463 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testConsecutiveExports,,1696384845078.3c37a247c41cfe6705e84b208102faab. service=AccessControlService 2023-10-04 02:00:45,463 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-10-04 02:00:45,463 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-10-04 02:00:45,463 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testConsecutiveExports 1e754cc94e1e4025807fe47095eba9a0 2023-10-04 02:00:45,463 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testConsecutiveExports 3c37a247c41cfe6705e84b208102faab 2023-10-04 02:00:45,463 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,1,1696384845078.1e754cc94e1e4025807fe47095eba9a0.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-04 02:00:45,463 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,,1696384845078.3c37a247c41cfe6705e84b208102faab.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-04 02:00:45,463 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7894): checking encryption for 1e754cc94e1e4025807fe47095eba9a0 2023-10-04 02:00:45,463 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7894): checking encryption for 3c37a247c41cfe6705e84b208102faab 2023-10-04 02:00:45,463 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7897): checking classloading for 1e754cc94e1e4025807fe47095eba9a0 2023-10-04 02:00:45,463 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7897): checking classloading for 3c37a247c41cfe6705e84b208102faab 2023-10-04 02:00:45,464 INFO [StoreOpener-1e754cc94e1e4025807fe47095eba9a0-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 1e754cc94e1e4025807fe47095eba9a0 2023-10-04 02:00:45,465 INFO [StoreOpener-3c37a247c41cfe6705e84b208102faab-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 3c37a247c41cfe6705e84b208102faab 2023-10-04 02:00:45,466 DEBUG [StoreOpener-1e754cc94e1e4025807fe47095eba9a0-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/data/default/testtb-testConsecutiveExports/1e754cc94e1e4025807fe47095eba9a0/cf 2023-10-04 02:00:45,466 DEBUG [StoreOpener-1e754cc94e1e4025807fe47095eba9a0-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/data/default/testtb-testConsecutiveExports/1e754cc94e1e4025807fe47095eba9a0/cf 2023-10-04 02:00:45,466 DEBUG [StoreOpener-3c37a247c41cfe6705e84b208102faab-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/data/default/testtb-testConsecutiveExports/3c37a247c41cfe6705e84b208102faab/cf 2023-10-04 02:00:45,466 DEBUG [StoreOpener-3c37a247c41cfe6705e84b208102faab-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/data/default/testtb-testConsecutiveExports/3c37a247c41cfe6705e84b208102faab/cf 2023-10-04 02:00:45,466 INFO [StoreOpener-1e754cc94e1e4025807fe47095eba9a0-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1e754cc94e1e4025807fe47095eba9a0 columnFamilyName cf 2023-10-04 02:00:45,466 INFO [StoreOpener-3c37a247c41cfe6705e84b208102faab-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 3c37a247c41cfe6705e84b208102faab columnFamilyName cf 2023-10-04 02:00:45,468 INFO [StoreOpener-1e754cc94e1e4025807fe47095eba9a0-1] regionserver.HStore(310): Store=1e754cc94e1e4025807fe47095eba9a0/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-04 02:00:45,468 INFO [StoreOpener-3c37a247c41cfe6705e84b208102faab-1] regionserver.HStore(310): Store=3c37a247c41cfe6705e84b208102faab/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-04 02:00:45,469 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/data/default/testtb-testConsecutiveExports/1e754cc94e1e4025807fe47095eba9a0 2023-10-04 02:00:45,469 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/data/default/testtb-testConsecutiveExports/3c37a247c41cfe6705e84b208102faab 2023-10-04 02:00:45,469 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/data/default/testtb-testConsecutiveExports/1e754cc94e1e4025807fe47095eba9a0 2023-10-04 02:00:45,470 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/data/default/testtb-testConsecutiveExports/3c37a247c41cfe6705e84b208102faab 2023-10-04 02:00:45,472 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1055): writing seq id for 1e754cc94e1e4025807fe47095eba9a0 2023-10-04 02:00:45,473 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1055): writing seq id for 3c37a247c41cfe6705e84b208102faab 2023-10-04 02:00:45,474 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/data/default/testtb-testConsecutiveExports/1e754cc94e1e4025807fe47095eba9a0/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-04 02:00:45,475 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/data/default/testtb-testConsecutiveExports/3c37a247c41cfe6705e84b208102faab/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-04 02:00:45,475 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1072): Opened 1e754cc94e1e4025807fe47095eba9a0; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69713828, jitterRate=0.038816988468170166}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-10-04 02:00:45,475 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(965): Region open journal for 1e754cc94e1e4025807fe47095eba9a0: 2023-10-04 02:00:45,475 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1072): Opened 3c37a247c41cfe6705e84b208102faab; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59836144, jitterRate=-0.10837197303771973}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-10-04 02:00:45,475 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(965): Region open journal for 3c37a247c41cfe6705e84b208102faab: 2023-10-04 02:00:45,476 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testConsecutiveExports,1,1696384845078.1e754cc94e1e4025807fe47095eba9a0., pid=45, masterSystemTime=1696384845458 2023-10-04 02:00:45,476 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testConsecutiveExports,,1696384845078.3c37a247c41cfe6705e84b208102faab., pid=46, masterSystemTime=1696384845459 2023-10-04 02:00:45,478 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testConsecutiveExports,1,1696384845078.1e754cc94e1e4025807fe47095eba9a0. 2023-10-04 02:00:45,478 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(158): Opened testtb-testConsecutiveExports,1,1696384845078.1e754cc94e1e4025807fe47095eba9a0. 2023-10-04 02:00:45,479 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=44 updating hbase:meta row=1e754cc94e1e4025807fe47095eba9a0, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase9.apache.org,39045,1696384805392 2023-10-04 02:00:45,479 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testConsecutiveExports,,1696384845078.3c37a247c41cfe6705e84b208102faab. 2023-10-04 02:00:45,479 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(158): Opened testtb-testConsecutiveExports,,1696384845078.3c37a247c41cfe6705e84b208102faab. 2023-10-04 02:00:45,479 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testConsecutiveExports,1,1696384845078.1e754cc94e1e4025807fe47095eba9a0.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1696384845478"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1696384845478"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1696384845478"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1696384845478"}]},"ts":"1696384845478"} 2023-10-04 02:00:45,479 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=43 updating hbase:meta row=3c37a247c41cfe6705e84b208102faab, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase9.apache.org,44303,1696384805319 2023-10-04 02:00:45,480 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testConsecutiveExports,,1696384845078.3c37a247c41cfe6705e84b208102faab.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1696384845479"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1696384845479"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1696384845479"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1696384845479"}]},"ts":"1696384845479"} 2023-10-04 02:00:45,483 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=45, resume processing ppid=44 2023-10-04 02:00:45,483 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=45, ppid=44, state=SUCCESS; OpenRegionProcedure 1e754cc94e1e4025807fe47095eba9a0, server=jenkins-hbase9.apache.org,39045,1696384805392 in 175 msec 2023-10-04 02:00:45,484 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=46, resume processing ppid=43 2023-10-04 02:00:45,484 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=46, ppid=43, state=SUCCESS; OpenRegionProcedure 3c37a247c41cfe6705e84b208102faab, server=jenkins-hbase9.apache.org,44303,1696384805319 in 175 msec 2023-10-04 02:00:45,484 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=44, ppid=42, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=1e754cc94e1e4025807fe47095eba9a0, ASSIGN in 337 msec 2023-10-04 02:00:45,486 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=43, resume processing ppid=42 2023-10-04 02:00:45,486 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=43, ppid=42, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=3c37a247c41cfe6705e84b208102faab, ASSIGN in 338 msec 2023-10-04 02:00:45,487 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-10-04 02:00:45,487 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696384845487"}]},"ts":"1696384845487"} 2023-10-04 02:00:45,488 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=ENABLED in hbase:meta 2023-10-04 02:00:45,491 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_POST_OPERATION 2023-10-04 02:00:45,491 DEBUG [PEWorker-5] access.PermissionStorage(175): Writing permission with rowKey testtb-testConsecutiveExports jenkins: RWXCA 2023-10-04 02:00:45,493 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=44303] access.PermissionStorage(611): Read acl: entry[testtb-testConsecutiveExports], kv [jenkins: RWXCA] 2023-10-04 02:00:45,494 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): master:39651-0x1010f1b55330000, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-04 02:00:45,494 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): regionserver:39045-0x1010f1b55330002, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-04 02:00:45,494 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): regionserver:35175-0x1010f1b55330003, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-04 02:00:45,495 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): regionserver:44303-0x1010f1b55330001, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-04 02:00:45,496 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-10-04 02:00:45,497 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-10-04 02:00:45,497 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-10-04 02:00:45,497 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-10-04 02:00:45,498 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=42, state=SUCCESS; CreateTableProcedure table=testtb-testConsecutiveExports in 418 msec 2023-10-04 02:00:45,688 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39651] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-10-04 02:00:45,689 INFO [Listener at jenkins-hbase9.apache.org/33899] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testConsecutiveExports, procId: 42 completed 2023-10-04 02:00:45,691 DEBUG [Listener at jenkins-hbase9.apache.org/33899] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testConsecutiveExports 2023-10-04 02:00:45,691 DEBUG [Listener at jenkins-hbase9.apache.org/33899] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testConsecutiveExports,,1696384845078.3c37a247c41cfe6705e84b208102faab. 2023-10-04 02:00:45,693 INFO [Listener at jenkins-hbase9.apache.org/33899] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-10-04 02:00:45,706 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39651] master.MasterRpcServices(1583): Client=jenkins//172.31.2.10 snapshot request for:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-10-04 02:00:45,706 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39651] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1696384845706 (current time:1696384845706). 2023-10-04 02:00:45,706 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39651] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-10-04 02:00:45,707 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39651] zookeeper.ReadOnlyZKClient(139): Connect 0x0c0b183e to 127.0.0.1:60027 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-04 02:00:45,715 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39651] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@18abc1ee, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-04 02:00:45,716 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39651] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-04 02:00:45,717 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:37554, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-04 02:00:45,718 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39651] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x0c0b183e to 127.0.0.1:60027 2023-10-04 02:00:45,718 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39651] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-04 02:00:45,720 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39651] zookeeper.ReadOnlyZKClient(139): Connect 0x3b00ae94 to 127.0.0.1:60027 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-04 02:00:45,728 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39651] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6f1e8b22, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-04 02:00:45,737 DEBUG [hconnection-0x29fc839e-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-04 02:00:45,740 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:37566, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-04 02:00:45,745 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39651] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x3b00ae94 to 127.0.0.1:60027 2023-10-04 02:00:45,745 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39651] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-04 02:00:45,745 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39651] access.PermissionStorage(611): Read acl: entry[testtb-testConsecutiveExports], kv [jenkins: RWXCA] 2023-10-04 02:00:45,745 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39651] snapshot.SnapshotManager(637): No existing snapshot, attempting snapshot... 2023-10-04 02:00:45,746 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39651] snapshot.SnapshotManager(684): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-10-04 02:00:45,748 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39651] snapshot.SnapshotManager(519): Unable to retrieve ACL status for path: hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/.hbase-snapshot, current working dir path: hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports org.apache.hadoop.hdfs.protocol.AclException: The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.ipc.RemoteException.instantiateException(RemoteException.java:121) at org.apache.hadoop.ipc.RemoteException.unwrapRemoteException(RemoteException.java:88) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2736) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2294) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2291) at org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81) at org.apache.hadoop.hdfs.DistributedFileSystem.getAclStatus(DistributedFileSystem.java:2291) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.updateWorkingDirAclsIfRequired(SnapshotManager.java:517) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.prepareToTakeSnapshot(SnapshotManager.java:490) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.snapshotEnabledTable(SnapshotManager.java:559) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshotInternal(SnapshotManager.java:687) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshot(SnapshotManager.java:623) at org.apache.hadoop.hbase.master.MasterRpcServices.snapshot(MasterRpcServices.java:1588) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) Caused by: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.hdfs.protocol.AclException): The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at org.apache.hadoop.ipc.Client.getRpcResponse(Client.java:1540) at org.apache.hadoop.ipc.Client.call(Client.java:1486) at org.apache.hadoop.ipc.Client.call(Client.java:1385) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:232) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:118) at com.sun.proxy.$Proxy32.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.getAclStatus(ClientNamenodeProtocolTranslatorPB.java:1385) at sun.reflect.GeneratedMethodAccessor61.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:422) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeMethod(RetryInvocationHandler.java:165) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invoke(RetryInvocationHandler.java:157) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeOnce(RetryInvocationHandler.java:95) at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:359) at com.sun.proxy.$Proxy35.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor61.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor61.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor61.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor61.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor61.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2734) ... 15 more 2023-10-04 02:00:45,750 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39651] procedure2.ProcedureExecutor(1028): Stored pid=47, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-10-04 02:00:45,751 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=47, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-10-04 02:00:45,752 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=47, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE; timeout=600000, timestamp=1696385445752 2023-10-04 02:00:45,752 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39651] snapshot.SnapshotManager(689): Started snapshot: { ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-10-04 02:00:45,752 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports 2023-10-04 02:00:45,753 DEBUG [Listener at jenkins-hbase9.apache.org/33899] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-10-04 02:00:45,753 DEBUG [Listener at jenkins-hbase9.apache.org/33899] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-10-04 02:00:45,753 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] procedure2.ProcedureExecutor(1028): Stored pid=48, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-10-04 02:00:45,754 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=47, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-10-04 02:00:45,755 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=47, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE in 5 msec 2023-10-04 02:00:45,756 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=48, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-10-04 02:00:45,757 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=48, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED; timeout=600000, timestamp=1696385445757 2023-10-04 02:00:45,768 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testConsecutiveExports 2023-10-04 02:00:45,769 INFO [(jenkins-hbase9.apache.org,39651,1696384803959)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testConsecutiveExports' 2023-10-04 02:00:45,769 DEBUG [(jenkins-hbase9.apache.org,39651,1696384803959)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-04 02:00:45,770 DEBUG [(jenkins-hbase9.apache.org,39651,1696384803959)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' 2023-10-04 02:00:45,770 DEBUG [(jenkins-hbase9.apache.org,39651,1696384803959)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testConsecutiveExports', kicking off acquire phase on members. 2023-10-04 02:00:45,770 DEBUG [(jenkins-hbase9.apache.org,39651,1696384803959)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39651-0x1010f1b55330000, quorum=127.0.0.1:60027, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-10-04 02:00:45,770 DEBUG [(jenkins-hbase9.apache.org,39651,1696384803959)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-10-04 02:00:45,773 DEBUG [(jenkins-hbase9.apache.org,39651,1696384803959)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,39045,1696384805392 2023-10-04 02:00:45,773 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): regionserver:35175-0x1010f1b55330003, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-04 02:00:45,773 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): regionserver:44303-0x1010f1b55330001, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-04 02:00:45,773 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-04 02:00:45,773 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): regionserver:39045-0x1010f1b55330002, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-04 02:00:45,773 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-04 02:00:45,773 DEBUG [(jenkins-hbase9.apache.org,39651,1696384803959)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39651-0x1010f1b55330000, quorum=127.0.0.1:60027, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,39045,1696384805392 2023-10-04 02:00:45,773 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-04 02:00:45,773 DEBUG [(jenkins-hbase9.apache.org,39651,1696384803959)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,44303,1696384805319 2023-10-04 02:00:45,773 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-04 02:00:45,773 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-04 02:00:45,773 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-04 02:00:45,773 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-10-04 02:00:45,774 DEBUG [(jenkins-hbase9.apache.org,39651,1696384803959)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39651-0x1010f1b55330000, quorum=127.0.0.1:60027, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,44303,1696384805319 2023-10-04 02:00:45,774 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-10-04 02:00:45,774 DEBUG [(jenkins-hbase9.apache.org,39651,1696384803959)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-04 02:00:45,774 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-10-04 02:00:45,774 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35175-0x1010f1b55330003, quorum=127.0.0.1:60027, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-10-04 02:00:45,774 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44303-0x1010f1b55330001, quorum=127.0.0.1:60027, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-10-04 02:00:45,774 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39045-0x1010f1b55330002, quorum=127.0.0.1:60027, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-10-04 02:00:45,774 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 165 2023-10-04 02:00:45,774 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-10-04 02:00:45,774 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-10-04 02:00:45,774 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 165 2023-10-04 02:00:45,774 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 165 2023-10-04 02:00:45,775 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-10-04 02:00:45,774 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-10-04 02:00:45,775 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testConsecutiveExports 2023-10-04 02:00:45,775 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-10-04 02:00:45,775 DEBUG [member: 'jenkins-hbase9.apache.org,35175,1696384805436' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testConsecutiveExports' with timeout 300000ms 2023-10-04 02:00:45,775 DEBUG [member: 'jenkins-hbase9.apache.org,35175,1696384805436' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-04 02:00:45,775 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-10-04 02:00:45,776 DEBUG [member: 'jenkins-hbase9.apache.org,35175,1696384805436' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' stage 2023-10-04 02:00:45,776 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testConsecutiveExports 2023-10-04 02:00:45,776 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testConsecutiveExports 2023-10-04 02:00:45,776 DEBUG [member: 'jenkins-hbase9.apache.org,39045,1696384805392' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testConsecutiveExports' with timeout 300000ms 2023-10-04 02:00:45,776 DEBUG [member: 'jenkins-hbase9.apache.org,44303,1696384805319' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testConsecutiveExports' with timeout 300000ms 2023-10-04 02:00:45,776 DEBUG [member: 'jenkins-hbase9.apache.org,35175,1696384805436' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally acquired 2023-10-04 02:00:45,776 DEBUG [member: 'jenkins-hbase9.apache.org,44303,1696384805319' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-04 02:00:45,776 DEBUG [member: 'jenkins-hbase9.apache.org,39045,1696384805392' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-04 02:00:45,777 DEBUG [member: 'jenkins-hbase9.apache.org,44303,1696384805319' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' stage 2023-10-04 02:00:45,776 DEBUG [member: 'jenkins-hbase9.apache.org,35175,1696384805436' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,35175,1696384805436' joining acquired barrier for procedure (emptySnaptb0-testConsecutiveExports) in zk 2023-10-04 02:00:45,780 DEBUG [member: 'jenkins-hbase9.apache.org,44303,1696384805319' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally acquired 2023-10-04 02:00:45,780 DEBUG [member: 'jenkins-hbase9.apache.org,39045,1696384805392' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' stage 2023-10-04 02:00:45,780 DEBUG [member: 'jenkins-hbase9.apache.org,39045,1696384805392' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally acquired 2023-10-04 02:00:45,780 DEBUG [member: 'jenkins-hbase9.apache.org,39045,1696384805392' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,39045,1696384805392' joining acquired barrier for procedure (emptySnaptb0-testConsecutiveExports) in zk 2023-10-04 02:00:45,780 DEBUG [member: 'jenkins-hbase9.apache.org,44303,1696384805319' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,44303,1696384805319' joining acquired barrier for procedure (emptySnaptb0-testConsecutiveExports) in zk 2023-10-04 02:00:45,782 DEBUG [member: 'jenkins-hbase9.apache.org,35175,1696384805436' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-10-04 02:00:45,782 DEBUG [member: 'jenkins-hbase9.apache.org,39045,1696384805392' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-10-04 02:00:45,782 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): master:39651-0x1010f1b55330000, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,39045,1696384805392 2023-10-04 02:00:45,782 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,39045,1696384805392 2023-10-04 02:00:45,782 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-04 02:00:45,782 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-04 02:00:45,783 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): master:39651-0x1010f1b55330000, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,44303,1696384805319 2023-10-04 02:00:45,783 DEBUG [member: 'jenkins-hbase9.apache.org,44303,1696384805319' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-10-04 02:00:45,783 DEBUG [member: 'jenkins-hbase9.apache.org,39045,1696384805392' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39045-0x1010f1b55330002, quorum=127.0.0.1:60027, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-10-04 02:00:45,783 DEBUG [member: 'jenkins-hbase9.apache.org,39045,1696384805392' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-04 02:00:45,783 DEBUG [member: 'jenkins-hbase9.apache.org,35175,1696384805436' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35175-0x1010f1b55330003, quorum=127.0.0.1:60027, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-10-04 02:00:45,783 DEBUG [member: 'jenkins-hbase9.apache.org,35175,1696384805436' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-04 02:00:45,783 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-04 02:00:45,783 DEBUG [member: 'jenkins-hbase9.apache.org,44303,1696384805319' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44303-0x1010f1b55330001, quorum=127.0.0.1:60027, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-10-04 02:00:45,783 DEBUG [member: 'jenkins-hbase9.apache.org,44303,1696384805319' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-04 02:00:45,783 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-04 02:00:45,784 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-10-04 02:00:45,784 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,39045,1696384805392 2023-10-04 02:00:45,784 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,35175,1696384805436 2023-10-04 02:00:45,785 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44303,1696384805319 2023-10-04 02:00:45,785 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-04 02:00:45,785 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,39045,1696384805392' joining acquired barrier for procedure 'emptySnaptb0-testConsecutiveExports' on coordinator 2023-10-04 02:00:45,785 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@664e1de9[Count = 1] remaining members to acquire global barrier 2023-10-04 02:00:45,785 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,44303,1696384805319 2023-10-04 02:00:45,785 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-04 02:00:45,785 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-04 02:00:45,785 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-04 02:00:45,786 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-04 02:00:45,786 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-10-04 02:00:45,786 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,39045,1696384805392 2023-10-04 02:00:45,786 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,35175,1696384805436 2023-10-04 02:00:45,787 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44303,1696384805319 2023-10-04 02:00:45,787 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-04 02:00:45,787 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,44303,1696384805319' joining acquired barrier for procedure 'emptySnaptb0-testConsecutiveExports' on coordinator 2023-10-04 02:00:45,787 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@664e1de9[Count = 0] remaining members to acquire global barrier 2023-10-04 02:00:45,787 DEBUG [(jenkins-hbase9.apache.org,39651,1696384803959)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testConsecutiveExports' starting 'in-barrier' execution. 2023-10-04 02:00:45,787 DEBUG [(jenkins-hbase9.apache.org,39651,1696384803959)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-10-04 02:00:45,789 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): regionserver:35175-0x1010f1b55330003, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-10-04 02:00:45,789 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): regionserver:44303-0x1010f1b55330001, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-10-04 02:00:45,789 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-10-04 02:00:45,789 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-10-04 02:00:45,789 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-10-04 02:00:45,789 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-10-04 02:00:45,789 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): regionserver:39045-0x1010f1b55330002, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-10-04 02:00:45,789 DEBUG [member: 'jenkins-hbase9.apache.org,44303,1696384805319' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-10-04 02:00:45,789 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-10-04 02:00:45,789 DEBUG [(jenkins-hbase9.apache.org,39651,1696384803959)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39651-0x1010f1b55330000, quorum=127.0.0.1:60027, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,39045,1696384805392 2023-10-04 02:00:45,789 DEBUG [member: 'jenkins-hbase9.apache.org,35175,1696384805436' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-10-04 02:00:45,789 DEBUG [member: 'jenkins-hbase9.apache.org,44303,1696384805319' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-04 02:00:45,789 DEBUG [rs(jenkins-hbase9.apache.org,44303,1696384805319)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,,1696384845078.3c37a247c41cfe6705e84b208102faab. 2023-10-04 02:00:45,789 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-10-04 02:00:45,789 DEBUG [member: 'jenkins-hbase9.apache.org,44303,1696384805319' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-04 02:00:45,789 DEBUG [(jenkins-hbase9.apache.org,39651,1696384803959)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39651-0x1010f1b55330000, quorum=127.0.0.1:60027, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,44303,1696384805319 2023-10-04 02:00:45,789 DEBUG [(jenkins-hbase9.apache.org,39651,1696384803959)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-04 02:00:45,789 DEBUG [member: 'jenkins-hbase9.apache.org,35175,1696384805436' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally completed 2023-10-04 02:00:45,789 DEBUG [member: 'jenkins-hbase9.apache.org,39045,1696384805392' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-10-04 02:00:45,789 DEBUG [rs(jenkins-hbase9.apache.org,44303,1696384805319)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,,1696384845078.3c37a247c41cfe6705e84b208102faab. started... 2023-10-04 02:00:45,789 DEBUG [member: 'jenkins-hbase9.apache.org,35175,1696384805436' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testConsecutiveExports' completed for member 'jenkins-hbase9.apache.org,35175,1696384805436' in zk 2023-10-04 02:00:45,790 DEBUG [member: 'jenkins-hbase9.apache.org,39045,1696384805392' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-04 02:00:45,790 DEBUG [member: 'jenkins-hbase9.apache.org,39045,1696384805392' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-04 02:00:45,790 DEBUG [rs(jenkins-hbase9.apache.org,39045,1696384805392)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,1,1696384845078.1e754cc94e1e4025807fe47095eba9a0. 2023-10-04 02:00:45,790 DEBUG [rs(jenkins-hbase9.apache.org,39045,1696384805392)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,1,1696384845078.1e754cc94e1e4025807fe47095eba9a0. started... 2023-10-04 02:00:45,790 DEBUG [rs(jenkins-hbase9.apache.org,44303,1696384805319)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 3c37a247c41cfe6705e84b208102faab: 2023-10-04 02:00:45,791 DEBUG [rs(jenkins-hbase9.apache.org,39045,1696384805392)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 1e754cc94e1e4025807fe47095eba9a0: 2023-10-04 02:00:45,791 DEBUG [rs(jenkins-hbase9.apache.org,44303,1696384805319)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,,1696384845078.3c37a247c41cfe6705e84b208102faab.' region-info for snapshot=emptySnaptb0-testConsecutiveExports 2023-10-04 02:00:45,791 DEBUG [rs(jenkins-hbase9.apache.org,39045,1696384805392)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,1,1696384845078.1e754cc94e1e4025807fe47095eba9a0.' region-info for snapshot=emptySnaptb0-testConsecutiveExports 2023-10-04 02:00:45,791 DEBUG [rs(jenkins-hbase9.apache.org,44303,1696384805319)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-04 02:00:45,792 DEBUG [rs(jenkins-hbase9.apache.org,39045,1696384805392)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-04 02:00:45,792 DEBUG [rs(jenkins-hbase9.apache.org,44303,1696384805319)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-10-04 02:00:45,792 DEBUG [rs(jenkins-hbase9.apache.org,39045,1696384805392)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-10-04 02:00:45,801 DEBUG [member: 'jenkins-hbase9.apache.org,35175,1696384805436' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testConsecutiveExports' has notified controller of completion 2023-10-04 02:00:45,801 DEBUG [member: 'jenkins-hbase9.apache.org,35175,1696384805436' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-04 02:00:45,801 DEBUG [member: 'jenkins-hbase9.apache.org,35175,1696384805436' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testConsecutiveExports' completed. 2023-10-04 02:00:45,808 DEBUG [rs(jenkins-hbase9.apache.org,44303,1696384805319)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,,1696384845078.3c37a247c41cfe6705e84b208102faab. completed. 2023-10-04 02:00:45,808 DEBUG [rs(jenkins-hbase9.apache.org,44303,1696384805319)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,,1696384845078.3c37a247c41cfe6705e84b208102faab. 2023-10-04 02:00:45,808 DEBUG [member: 'jenkins-hbase9.apache.org,44303,1696384805319' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-04 02:00:45,809 DEBUG [member: 'jenkins-hbase9.apache.org,44303,1696384805319' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-04 02:00:45,809 DEBUG [member: 'jenkins-hbase9.apache.org,44303,1696384805319' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase9.apache.org,44303,1696384805319 2023-10-04 02:00:45,809 DEBUG [rs(jenkins-hbase9.apache.org,39045,1696384805392)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,1,1696384845078.1e754cc94e1e4025807fe47095eba9a0. completed. 2023-10-04 02:00:45,809 DEBUG [member: 'jenkins-hbase9.apache.org,44303,1696384805319' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally completed 2023-10-04 02:00:45,809 DEBUG [member: 'jenkins-hbase9.apache.org,44303,1696384805319' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testConsecutiveExports' completed for member 'jenkins-hbase9.apache.org,44303,1696384805319' in zk 2023-10-04 02:00:45,809 DEBUG [rs(jenkins-hbase9.apache.org,39045,1696384805392)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,1,1696384845078.1e754cc94e1e4025807fe47095eba9a0. 2023-10-04 02:00:45,809 DEBUG [member: 'jenkins-hbase9.apache.org,39045,1696384805392' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-04 02:00:45,809 DEBUG [member: 'jenkins-hbase9.apache.org,39045,1696384805392' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-04 02:00:45,809 DEBUG [member: 'jenkins-hbase9.apache.org,39045,1696384805392' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase9.apache.org,39045,1696384805392 2023-10-04 02:00:45,809 DEBUG [member: 'jenkins-hbase9.apache.org,39045,1696384805392' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally completed 2023-10-04 02:00:45,809 DEBUG [member: 'jenkins-hbase9.apache.org,39045,1696384805392' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testConsecutiveExports' completed for member 'jenkins-hbase9.apache.org,39045,1696384805392' in zk 2023-10-04 02:00:45,810 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): master:39651-0x1010f1b55330000, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,44303,1696384805319 2023-10-04 02:00:45,810 DEBUG [member: 'jenkins-hbase9.apache.org,44303,1696384805319' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testConsecutiveExports' has notified controller of completion 2023-10-04 02:00:45,810 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,44303,1696384805319 2023-10-04 02:00:45,810 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-04 02:00:45,810 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-04 02:00:45,810 DEBUG [member: 'jenkins-hbase9.apache.org,44303,1696384805319' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-04 02:00:45,811 DEBUG [member: 'jenkins-hbase9.apache.org,44303,1696384805319' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testConsecutiveExports' completed. 2023-10-04 02:00:45,812 DEBUG [member: 'jenkins-hbase9.apache.org,39045,1696384805392' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testConsecutiveExports' has notified controller of completion 2023-10-04 02:00:45,812 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): master:39651-0x1010f1b55330000, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,39045,1696384805392 2023-10-04 02:00:45,812 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-04 02:00:45,812 DEBUG [member: 'jenkins-hbase9.apache.org,39045,1696384805392' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-04 02:00:45,812 DEBUG [member: 'jenkins-hbase9.apache.org,39045,1696384805392' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testConsecutiveExports' completed. 2023-10-04 02:00:45,813 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-04 02:00:45,813 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-10-04 02:00:45,814 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,39045,1696384805392 2023-10-04 02:00:45,814 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,35175,1696384805436 2023-10-04 02:00:45,814 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44303,1696384805319 2023-10-04 02:00:45,815 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-04 02:00:45,815 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-10-04 02:00:45,815 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,39045,1696384805392 2023-10-04 02:00:45,815 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,35175,1696384805436 2023-10-04 02:00:45,816 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44303,1696384805319 2023-10-04 02:00:45,817 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testConsecutiveExports' member 'jenkins-hbase9.apache.org,44303,1696384805319': 2023-10-04 02:00:45,817 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,44303,1696384805319' released barrier for procedure'emptySnaptb0-testConsecutiveExports', counting down latch. Waiting for 1 more 2023-10-04 02:00:45,817 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,39045,1696384805392 2023-10-04 02:00:45,817 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-04 02:00:45,817 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-04 02:00:45,817 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-04 02:00:45,817 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-04 02:00:45,818 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-10-04 02:00:45,818 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,39045,1696384805392 2023-10-04 02:00:45,818 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,35175,1696384805436 2023-10-04 02:00:45,818 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44303,1696384805319 2023-10-04 02:00:45,819 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-04 02:00:45,819 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-10-04 02:00:45,819 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,39045,1696384805392 2023-10-04 02:00:45,819 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,35175,1696384805436 2023-10-04 02:00:45,821 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44303,1696384805319 2023-10-04 02:00:45,821 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testConsecutiveExports' member 'jenkins-hbase9.apache.org,39045,1696384805392': 2023-10-04 02:00:45,821 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,39045,1696384805392' released barrier for procedure'emptySnaptb0-testConsecutiveExports', counting down latch. Waiting for 0 more 2023-10-04 02:00:45,821 INFO [(jenkins-hbase9.apache.org,39651,1696384803959)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testConsecutiveExports' execution completed 2023-10-04 02:00:45,821 DEBUG [(jenkins-hbase9.apache.org,39651,1696384803959)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-04 02:00:45,821 DEBUG [(jenkins-hbase9.apache.org,39651,1696384803959)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-04 02:00:45,821 DEBUG [(jenkins-hbase9.apache.org,39651,1696384803959)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testConsecutiveExports 2023-10-04 02:00:45,821 INFO [(jenkins-hbase9.apache.org,39651,1696384803959)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testConsecutiveExportsincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-10-04 02:00:45,823 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): master:39651-0x1010f1b55330000, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-10-04 02:00:45,823 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): regionserver:35175-0x1010f1b55330003, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-10-04 02:00:45,823 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-10-04 02:00:45,823 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-10-04 02:00:45,823 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-04 02:00:45,823 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-04 02:00:45,823 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): regionserver:39045-0x1010f1b55330002, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-10-04 02:00:45,823 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): regionserver:35175-0x1010f1b55330003, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-04 02:00:45,824 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-10-04 02:00:45,823 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): regionserver:44303-0x1010f1b55330001, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-10-04 02:00:45,824 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-10-04 02:00:45,824 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): regionserver:44303-0x1010f1b55330001, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-04 02:00:45,824 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): regionserver:39045-0x1010f1b55330002, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-04 02:00:45,823 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-10-04 02:00:45,824 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-10-04 02:00:45,824 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-10-04 02:00:45,824 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-04 02:00:45,824 DEBUG [(jenkins-hbase9.apache.org,39651,1696384803959)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39651-0x1010f1b55330000, quorum=127.0.0.1:60027, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,39045,1696384805392 2023-10-04 02:00:45,824 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-04 02:00:45,824 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-04 02:00:45,824 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-04 02:00:45,824 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-04 02:00:45,825 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-04 02:00:45,825 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-04 02:00:45,825 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-10-04 02:00:45,825 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-10-04 02:00:45,825 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-10-04 02:00:45,826 DEBUG [(jenkins-hbase9.apache.org,39651,1696384803959)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39651-0x1010f1b55330000, quorum=127.0.0.1:60027, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,35175,1696384805436 2023-10-04 02:00:45,826 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-10-04 02:00:45,826 DEBUG [(jenkins-hbase9.apache.org,39651,1696384803959)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39651-0x1010f1b55330000, quorum=127.0.0.1:60027, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,44303,1696384805319 2023-10-04 02:00:45,826 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-04 02:00:45,827 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-10-04 02:00:45,827 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,39045,1696384805392 2023-10-04 02:00:45,827 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,35175,1696384805436 2023-10-04 02:00:45,828 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44303,1696384805319 2023-10-04 02:00:45,828 DEBUG [(jenkins-hbase9.apache.org,39651,1696384803959)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39651-0x1010f1b55330000, quorum=127.0.0.1:60027, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,39045,1696384805392 2023-10-04 02:00:45,828 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-04 02:00:45,828 DEBUG [(jenkins-hbase9.apache.org,39651,1696384803959)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39651-0x1010f1b55330000, quorum=127.0.0.1:60027, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,35175,1696384805436 2023-10-04 02:00:45,828 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-10-04 02:00:45,828 DEBUG [(jenkins-hbase9.apache.org,39651,1696384803959)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39651-0x1010f1b55330000, quorum=127.0.0.1:60027, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,44303,1696384805319 2023-10-04 02:00:45,829 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,39045,1696384805392 2023-10-04 02:00:45,829 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,35175,1696384805436 2023-10-04 02:00:45,829 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44303,1696384805319 2023-10-04 02:00:45,832 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): master:39651-0x1010f1b55330000, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,44303,1696384805319 2023-10-04 02:00:45,832 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): regionserver:44303-0x1010f1b55330001, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-04 02:00:45,832 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): regionserver:39045-0x1010f1b55330002, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-04 02:00:45,832 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-04 02:00:45,832 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): master:39651-0x1010f1b55330000, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-10-04 02:00:45,832 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): regionserver:35175-0x1010f1b55330003, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-04 02:00:45,832 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): regionserver:44303-0x1010f1b55330001, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-04 02:00:45,833 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-04 02:00:45,833 DEBUG [(jenkins-hbase9.apache.org,39651,1696384803959)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-04 02:00:45,833 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testConsecutiveExports 2023-10-04 02:00:45,833 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-04 02:00:45,833 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): regionserver:35175-0x1010f1b55330003, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-04 02:00:45,833 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): master:39651-0x1010f1b55330000, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,35175,1696384805436 2023-10-04 02:00:45,832 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-04 02:00:45,832 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-04 02:00:45,832 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): regionserver:39045-0x1010f1b55330002, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-04 02:00:45,834 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-04 02:00:45,834 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): master:39651-0x1010f1b55330000, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,39045,1696384805392 2023-10-04 02:00:45,834 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-04 02:00:45,834 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-04 02:00:45,834 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testConsecutiveExports 2023-10-04 02:00:45,834 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-04 02:00:45,834 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-04 02:00:45,834 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): master:39651-0x1010f1b55330000, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-10-04 02:00:45,835 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-04 02:00:45,835 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-04 02:00:45,835 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => c7b48a2e62736c517f8bfa7d64fc37ac, NAME => 'testtb-testConsecutiveExports,.mob,0.c7b48a2e62736c517f8bfa7d64fc37ac.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testConsecutiveExports 2023-10-04 02:00:45,835 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): master:39651-0x1010f1b55330000, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,44303,1696384805319 2023-10-04 02:00:45,835 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-10-04 02:00:45,835 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): master:39651-0x1010f1b55330000, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-10-04 02:00:45,835 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): master:39651-0x1010f1b55330000, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,35175,1696384805436 2023-10-04 02:00:45,835 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): master:39651-0x1010f1b55330000, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,39045,1696384805392 2023-10-04 02:00:45,835 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): master:39651-0x1010f1b55330000, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-10-04 02:00:45,835 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): master:39651-0x1010f1b55330000, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-10-04 02:00:45,836 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-10-04 02:00:45,851 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testConsecutiveExports 2023-10-04 02:00:45,852 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports 2023-10-04 02:00:45,853 DEBUG [Listener at jenkins-hbase9.apache.org/33899] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-04 02:00:45,857 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39651] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-10-04 02:00:45,857 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39651] snapshot.SnapshotManager(406): Snapshoting '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' is still in progress! 2023-10-04 02:00:45,857 DEBUG [Listener at jenkins-hbase9.apache.org/33899] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-10-04 02:00:45,878 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports to hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/.hbase-snapshot/emptySnaptb0-testConsecutiveExports 2023-10-04 02:00:45,879 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed 2023-10-04 02:00:45,879 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports 2023-10-04 02:00:45,880 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports 2023-10-04 02:00:45,880 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports at 1696384845752Completed referencing HFiles for the mob region of table: testtb-testConsecutiveExports at 1696384845851 (+99 ms)Consolidate snapshot: emptySnaptb0-testConsecutiveExports at 1696384845851Loading Region manifests for emptySnaptb0-testConsecutiveExports at 1696384845851Writing data manifest for emptySnaptb0-testConsecutiveExports at 1696384845861 (+10 ms)Verifying snapshot: emptySnaptb0-testConsecutiveExports at 1696384845872 (+11 ms)Snapshot emptySnaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed at 1696384845879 (+7 ms) 2023-10-04 02:00:45,882 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=48, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-10-04 02:00:45,884 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=48, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED in 129 msec 2023-10-04 02:00:46,057 DEBUG [Listener at jenkins-hbase9.apache.org/33899] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-04 02:00:46,058 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39651] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-10-04 02:00:46,058 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39651] snapshot.SnapshotManager(403): Snapshot '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' has completed, notifying client. 2023-10-04 02:00:46,062 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44303] regionserver.HRegion(8805): writing data to region testtb-testConsecutiveExports,,1696384845078.3c37a247c41cfe6705e84b208102faab. with WAL disabled. Data may be lost in the event of a crash. 2023-10-04 02:00:46,063 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39045] regionserver.HRegion(8805): writing data to region testtb-testConsecutiveExports,1,1696384845078.1e754cc94e1e4025807fe47095eba9a0. with WAL disabled. Data may be lost in the event of a crash. 2023-10-04 02:00:46,067 DEBUG [Listener at jenkins-hbase9.apache.org/33899] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testConsecutiveExports 2023-10-04 02:00:46,067 DEBUG [Listener at jenkins-hbase9.apache.org/33899] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testConsecutiveExports,,1696384845078.3c37a247c41cfe6705e84b208102faab. 2023-10-04 02:00:46,067 INFO [Listener at jenkins-hbase9.apache.org/33899] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-10-04 02:00:46,079 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39651] master.MasterRpcServices(1583): Client=jenkins//172.31.2.10 snapshot request for:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-10-04 02:00:46,079 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39651] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1696384846079 (current time:1696384846079). 2023-10-04 02:00:46,079 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39651] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-10-04 02:00:46,081 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39651] zookeeper.ReadOnlyZKClient(139): Connect 0x0a56ce06 to 127.0.0.1:60027 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-04 02:00:46,091 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39651] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@702d03a3, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-04 02:00:46,093 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39651] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-04 02:00:46,096 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:37582, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-04 02:00:46,098 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39651] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x0a56ce06 to 127.0.0.1:60027 2023-10-04 02:00:46,098 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39651] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-04 02:00:46,099 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39651] zookeeper.ReadOnlyZKClient(139): Connect 0x69b72867 to 127.0.0.1:60027 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-04 02:00:46,107 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39651] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@552dfda9, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-04 02:00:46,108 DEBUG [hconnection-0x4d05ccb4-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-04 02:00:46,110 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:37584, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-04 02:00:46,115 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39651] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x69b72867 to 127.0.0.1:60027 2023-10-04 02:00:46,116 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39651] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-04 02:00:46,116 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39651] access.PermissionStorage(611): Read acl: entry[testtb-testConsecutiveExports], kv [jenkins: RWXCA] 2023-10-04 02:00:46,117 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39651] snapshot.SnapshotManager(637): No existing snapshot, attempting snapshot... 2023-10-04 02:00:46,117 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39651] snapshot.SnapshotManager(684): Table enabled, starting distributed snapshots for { ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-10-04 02:00:46,121 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39651] snapshot.SnapshotManager(519): Unable to retrieve ACL status for path: hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/.hbase-snapshot, current working dir path: hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports org.apache.hadoop.hdfs.protocol.AclException: The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.ipc.RemoteException.instantiateException(RemoteException.java:121) at org.apache.hadoop.ipc.RemoteException.unwrapRemoteException(RemoteException.java:88) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2736) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2294) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2291) at org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81) at org.apache.hadoop.hdfs.DistributedFileSystem.getAclStatus(DistributedFileSystem.java:2291) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.updateWorkingDirAclsIfRequired(SnapshotManager.java:517) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.prepareToTakeSnapshot(SnapshotManager.java:490) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.snapshotEnabledTable(SnapshotManager.java:559) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshotInternal(SnapshotManager.java:687) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshot(SnapshotManager.java:623) at org.apache.hadoop.hbase.master.MasterRpcServices.snapshot(MasterRpcServices.java:1588) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) Caused by: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.hdfs.protocol.AclException): The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at org.apache.hadoop.ipc.Client.getRpcResponse(Client.java:1540) at org.apache.hadoop.ipc.Client.call(Client.java:1486) at org.apache.hadoop.ipc.Client.call(Client.java:1385) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:232) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:118) at com.sun.proxy.$Proxy32.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.getAclStatus(ClientNamenodeProtocolTranslatorPB.java:1385) at sun.reflect.GeneratedMethodAccessor61.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:422) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeMethod(RetryInvocationHandler.java:165) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invoke(RetryInvocationHandler.java:157) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeOnce(RetryInvocationHandler.java:95) at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:359) at com.sun.proxy.$Proxy35.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor61.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor61.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor61.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor61.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor61.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2734) ... 15 more 2023-10-04 02:00:46,123 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39651] procedure2.ProcedureExecutor(1028): Stored pid=49, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-10-04 02:00:46,124 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=49, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-10-04 02:00:46,124 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=49, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE; timeout=600000, timestamp=1696385446124 2023-10-04 02:00:46,125 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports 2023-10-04 02:00:46,125 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39651] snapshot.SnapshotManager(689): Started snapshot: { ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-10-04 02:00:46,126 DEBUG [Listener at jenkins-hbase9.apache.org/33899] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-10-04 02:00:46,126 DEBUG [Listener at jenkins-hbase9.apache.org/33899] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-10-04 02:00:46,126 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] procedure2.ProcedureExecutor(1028): Stored pid=50, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-10-04 02:00:46,127 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=49, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-10-04 02:00:46,129 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=49, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE in 5 msec 2023-10-04 02:00:46,130 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=50, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-10-04 02:00:46,131 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=50, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED; timeout=600000, timestamp=1696385446131 2023-10-04 02:00:46,149 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testConsecutiveExports 2023-10-04 02:00:46,149 INFO [(jenkins-hbase9.apache.org,39651,1696384803959)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testConsecutiveExports' 2023-10-04 02:00:46,149 DEBUG [(jenkins-hbase9.apache.org,39651,1696384803959)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-04 02:00:46,151 DEBUG [(jenkins-hbase9.apache.org,39651,1696384803959)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testConsecutiveExports' starting 'acquire' 2023-10-04 02:00:46,151 DEBUG [(jenkins-hbase9.apache.org,39651,1696384803959)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testConsecutiveExports', kicking off acquire phase on members. 2023-10-04 02:00:46,151 DEBUG [(jenkins-hbase9.apache.org,39651,1696384803959)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39651-0x1010f1b55330000, quorum=127.0.0.1:60027, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-10-04 02:00:46,151 DEBUG [(jenkins-hbase9.apache.org,39651,1696384803959)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-10-04 02:00:46,153 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): regionserver:35175-0x1010f1b55330003, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-04 02:00:46,153 DEBUG [(jenkins-hbase9.apache.org,39651,1696384803959)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,39045,1696384805392 2023-10-04 02:00:46,153 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-04 02:00:46,153 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-04 02:00:46,153 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): regionserver:44303-0x1010f1b55330001, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-04 02:00:46,153 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): regionserver:39045-0x1010f1b55330002, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-04 02:00:46,154 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-04 02:00:46,154 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-04 02:00:46,154 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-04 02:00:46,154 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-10-04 02:00:46,154 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-04 02:00:46,154 DEBUG [(jenkins-hbase9.apache.org,39651,1696384803959)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39651-0x1010f1b55330000, quorum=127.0.0.1:60027, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,39045,1696384805392 2023-10-04 02:00:46,154 DEBUG [(jenkins-hbase9.apache.org,39651,1696384803959)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,44303,1696384805319 2023-10-04 02:00:46,154 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-10-04 02:00:46,154 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-10-04 02:00:46,154 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35175-0x1010f1b55330003, quorum=127.0.0.1:60027, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-10-04 02:00:46,155 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39045-0x1010f1b55330002, quorum=127.0.0.1:60027, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-10-04 02:00:46,155 DEBUG [(jenkins-hbase9.apache.org,39651,1696384803959)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39651-0x1010f1b55330000, quorum=127.0.0.1:60027, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,44303,1696384805319 2023-10-04 02:00:46,155 DEBUG [(jenkins-hbase9.apache.org,39651,1696384803959)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-04 02:00:46,155 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44303-0x1010f1b55330001, quorum=127.0.0.1:60027, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-10-04 02:00:46,155 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 160 2023-10-04 02:00:46,155 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-10-04 02:00:46,155 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 160 2023-10-04 02:00:46,155 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-10-04 02:00:46,155 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-10-04 02:00:46,155 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 160 2023-10-04 02:00:46,155 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-10-04 02:00:46,155 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-10-04 02:00:46,155 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-10-04 02:00:46,156 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testConsecutiveExports 2023-10-04 02:00:46,156 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testConsecutiveExports 2023-10-04 02:00:46,156 DEBUG [member: 'jenkins-hbase9.apache.org,35175,1696384805436' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testConsecutiveExports' with timeout 300000ms 2023-10-04 02:00:46,156 DEBUG [member: 'jenkins-hbase9.apache.org,44303,1696384805319' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testConsecutiveExports' with timeout 300000ms 2023-10-04 02:00:46,156 DEBUG [member: 'jenkins-hbase9.apache.org,35175,1696384805436' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-04 02:00:46,156 DEBUG [member: 'jenkins-hbase9.apache.org,44303,1696384805319' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-04 02:00:46,162 DEBUG [member: 'jenkins-hbase9.apache.org,35175,1696384805436' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testConsecutiveExports' starting 'acquire' stage 2023-10-04 02:00:46,162 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testConsecutiveExports 2023-10-04 02:00:46,162 DEBUG [member: 'jenkins-hbase9.apache.org,35175,1696384805436' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testConsecutiveExports' locally acquired 2023-10-04 02:00:46,162 DEBUG [member: 'jenkins-hbase9.apache.org,35175,1696384805436' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,35175,1696384805436' joining acquired barrier for procedure (snaptb0-testConsecutiveExports) in zk 2023-10-04 02:00:46,162 DEBUG [member: 'jenkins-hbase9.apache.org,44303,1696384805319' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testConsecutiveExports' starting 'acquire' stage 2023-10-04 02:00:46,162 DEBUG [member: 'jenkins-hbase9.apache.org,44303,1696384805319' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testConsecutiveExports' locally acquired 2023-10-04 02:00:46,162 DEBUG [member: 'jenkins-hbase9.apache.org,44303,1696384805319' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,44303,1696384805319' joining acquired barrier for procedure (snaptb0-testConsecutiveExports) in zk 2023-10-04 02:00:46,162 DEBUG [member: 'jenkins-hbase9.apache.org,39045,1696384805392' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testConsecutiveExports' with timeout 300000ms 2023-10-04 02:00:46,162 DEBUG [member: 'jenkins-hbase9.apache.org,39045,1696384805392' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-04 02:00:46,163 DEBUG [member: 'jenkins-hbase9.apache.org,39045,1696384805392' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testConsecutiveExports' starting 'acquire' stage 2023-10-04 02:00:46,163 DEBUG [member: 'jenkins-hbase9.apache.org,39045,1696384805392' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testConsecutiveExports' locally acquired 2023-10-04 02:00:46,163 DEBUG [member: 'jenkins-hbase9.apache.org,39045,1696384805392' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,39045,1696384805392' joining acquired barrier for procedure (snaptb0-testConsecutiveExports) in zk 2023-10-04 02:00:46,165 DEBUG [member: 'jenkins-hbase9.apache.org,35175,1696384805436' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-10-04 02:00:46,165 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): master:39651-0x1010f1b55330000, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,44303,1696384805319 2023-10-04 02:00:46,165 DEBUG [member: 'jenkins-hbase9.apache.org,44303,1696384805319' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-10-04 02:00:46,165 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,44303,1696384805319 2023-10-04 02:00:46,165 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-04 02:00:46,165 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-04 02:00:46,167 DEBUG [member: 'jenkins-hbase9.apache.org,39045,1696384805392' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-10-04 02:00:46,167 DEBUG [member: 'jenkins-hbase9.apache.org,44303,1696384805319' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44303-0x1010f1b55330001, quorum=127.0.0.1:60027, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-10-04 02:00:46,167 DEBUG [member: 'jenkins-hbase9.apache.org,44303,1696384805319' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-04 02:00:46,167 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): master:39651-0x1010f1b55330000, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,39045,1696384805392 2023-10-04 02:00:46,167 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-04 02:00:46,167 DEBUG [member: 'jenkins-hbase9.apache.org,35175,1696384805436' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35175-0x1010f1b55330003, quorum=127.0.0.1:60027, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-10-04 02:00:46,167 DEBUG [member: 'jenkins-hbase9.apache.org,35175,1696384805436' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-04 02:00:46,167 DEBUG [member: 'jenkins-hbase9.apache.org,39045,1696384805392' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39045-0x1010f1b55330002, quorum=127.0.0.1:60027, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-10-04 02:00:46,167 DEBUG [member: 'jenkins-hbase9.apache.org,39045,1696384805392' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-04 02:00:46,167 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-04 02:00:46,168 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-10-04 02:00:46,168 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,39045,1696384805392 2023-10-04 02:00:46,168 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,35175,1696384805436 2023-10-04 02:00:46,169 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44303,1696384805319 2023-10-04 02:00:46,169 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-04 02:00:46,169 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,44303,1696384805319' joining acquired barrier for procedure 'snaptb0-testConsecutiveExports' on coordinator 2023-10-04 02:00:46,169 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2be6b8b8[Count = 1] remaining members to acquire global barrier 2023-10-04 02:00:46,169 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,39045,1696384805392 2023-10-04 02:00:46,169 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-04 02:00:46,169 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-04 02:00:46,170 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-04 02:00:46,170 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-04 02:00:46,170 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-10-04 02:00:46,170 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,39045,1696384805392 2023-10-04 02:00:46,171 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,35175,1696384805436 2023-10-04 02:00:46,171 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44303,1696384805319 2023-10-04 02:00:46,171 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-04 02:00:46,172 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,39045,1696384805392' joining acquired barrier for procedure 'snaptb0-testConsecutiveExports' on coordinator 2023-10-04 02:00:46,172 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2be6b8b8[Count = 0] remaining members to acquire global barrier 2023-10-04 02:00:46,172 DEBUG [(jenkins-hbase9.apache.org,39651,1696384803959)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testConsecutiveExports' starting 'in-barrier' execution. 2023-10-04 02:00:46,172 DEBUG [(jenkins-hbase9.apache.org,39651,1696384803959)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-10-04 02:00:46,174 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): regionserver:35175-0x1010f1b55330003, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-10-04 02:00:46,174 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): regionserver:44303-0x1010f1b55330001, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-10-04 02:00:46,174 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-10-04 02:00:46,174 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): regionserver:39045-0x1010f1b55330002, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-10-04 02:00:46,174 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-10-04 02:00:46,174 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-10-04 02:00:46,174 DEBUG [member: 'jenkins-hbase9.apache.org,35175,1696384805436' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-10-04 02:00:46,174 DEBUG [(jenkins-hbase9.apache.org,39651,1696384803959)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39651-0x1010f1b55330000, quorum=127.0.0.1:60027, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,44303,1696384805319 2023-10-04 02:00:46,174 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-10-04 02:00:46,174 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-10-04 02:00:46,174 DEBUG [member: 'jenkins-hbase9.apache.org,35175,1696384805436' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testConsecutiveExports' locally completed 2023-10-04 02:00:46,174 DEBUG [member: 'jenkins-hbase9.apache.org,39045,1696384805392' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-10-04 02:00:46,174 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-10-04 02:00:46,174 DEBUG [member: 'jenkins-hbase9.apache.org,44303,1696384805319' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-10-04 02:00:46,174 DEBUG [member: 'jenkins-hbase9.apache.org,39045,1696384805392' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-04 02:00:46,175 DEBUG [member: 'jenkins-hbase9.apache.org,39045,1696384805392' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-04 02:00:46,175 DEBUG [rs(jenkins-hbase9.apache.org,39045,1696384805392)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,1,1696384845078.1e754cc94e1e4025807fe47095eba9a0. 2023-10-04 02:00:46,174 DEBUG [member: 'jenkins-hbase9.apache.org,35175,1696384805436' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testConsecutiveExports' completed for member 'jenkins-hbase9.apache.org,35175,1696384805436' in zk 2023-10-04 02:00:46,175 DEBUG [rs(jenkins-hbase9.apache.org,39045,1696384805392)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,1,1696384845078.1e754cc94e1e4025807fe47095eba9a0. started... 2023-10-04 02:00:46,175 DEBUG [(jenkins-hbase9.apache.org,39651,1696384803959)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39651-0x1010f1b55330000, quorum=127.0.0.1:60027, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,39045,1696384805392 2023-10-04 02:00:46,175 DEBUG [(jenkins-hbase9.apache.org,39651,1696384803959)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-04 02:00:46,175 INFO [rs(jenkins-hbase9.apache.org,39045,1696384805392)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 1e754cc94e1e4025807fe47095eba9a0 1/1 column families, dataSize=3.00 KB heapSize=6.72 KB 2023-10-04 02:00:46,176 DEBUG [member: 'jenkins-hbase9.apache.org,35175,1696384805436' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testConsecutiveExports' has notified controller of completion 2023-10-04 02:00:46,176 DEBUG [member: 'jenkins-hbase9.apache.org,35175,1696384805436' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-04 02:00:46,176 DEBUG [member: 'jenkins-hbase9.apache.org,35175,1696384805436' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testConsecutiveExports' completed. 2023-10-04 02:00:46,181 DEBUG [member: 'jenkins-hbase9.apache.org,44303,1696384805319' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-04 02:00:46,181 DEBUG [member: 'jenkins-hbase9.apache.org,44303,1696384805319' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-04 02:00:46,181 DEBUG [rs(jenkins-hbase9.apache.org,44303,1696384805319)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,,1696384845078.3c37a247c41cfe6705e84b208102faab. 2023-10-04 02:00:46,182 DEBUG [rs(jenkins-hbase9.apache.org,44303,1696384805319)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,,1696384845078.3c37a247c41cfe6705e84b208102faab. started... 2023-10-04 02:00:46,182 INFO [rs(jenkins-hbase9.apache.org,44303,1696384805319)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 3c37a247c41cfe6705e84b208102faab 1/1 column families, dataSize=266 B heapSize=832 B 2023-10-04 02:00:46,220 INFO [rs(jenkins-hbase9.apache.org,44303,1696384805319)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202310041f1d1e4227124e5a82ade6cac16de102 to hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e202310041f1d1e4227124e5a82ade6cac16de102 2023-10-04 02:00:46,221 INFO [rs(jenkins-hbase9.apache.org,39045,1696384805392)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202310041d90ce9abd3b487693bda8364a895901 to hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b202310041d90ce9abd3b487693bda8364a895901 2023-10-04 02:00:46,226 DEBUG [Listener at jenkins-hbase9.apache.org/33899] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-04 02:00:46,227 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39651] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-10-04 02:00:46,227 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39651] snapshot.SnapshotManager(406): Snapshoting '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' is still in progress! 2023-10-04 02:00:46,228 DEBUG [Listener at jenkins-hbase9.apache.org/33899] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-10-04 02:00:46,238 INFO [rs(jenkins-hbase9.apache.org,39045,1696384805392)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=3.0 K, hasBloomFilter=true, into tmp file hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/data/default/testtb-testConsecutiveExports/1e754cc94e1e4025807fe47095eba9a0/.tmp/cf/7feb76776ab64a6b8744c76e952e82c7 2023-10-04 02:00:46,238 INFO [rs(jenkins-hbase9.apache.org,44303,1696384805319)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=266, hasBloomFilter=true, into tmp file hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/data/default/testtb-testConsecutiveExports/3c37a247c41cfe6705e84b208102faab/.tmp/cf/d1ce6d4c85674b5ea06058d81ab104b7 2023-10-04 02:00:46,244 DEBUG [rs(jenkins-hbase9.apache.org,39045,1696384805392)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/data/default/testtb-testConsecutiveExports/1e754cc94e1e4025807fe47095eba9a0/.tmp/cf/7feb76776ab64a6b8744c76e952e82c7 as hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/data/default/testtb-testConsecutiveExports/1e754cc94e1e4025807fe47095eba9a0/cf/7feb76776ab64a6b8744c76e952e82c7 2023-10-04 02:00:46,245 DEBUG [rs(jenkins-hbase9.apache.org,44303,1696384805319)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/data/default/testtb-testConsecutiveExports/3c37a247c41cfe6705e84b208102faab/.tmp/cf/d1ce6d4c85674b5ea06058d81ab104b7 as hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/data/default/testtb-testConsecutiveExports/3c37a247c41cfe6705e84b208102faab/cf/d1ce6d4c85674b5ea06058d81ab104b7 2023-10-04 02:00:46,250 INFO [rs(jenkins-hbase9.apache.org,39045,1696384805392)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/data/default/testtb-testConsecutiveExports/1e754cc94e1e4025807fe47095eba9a0/cf/7feb76776ab64a6b8744c76e952e82c7, entries=46, sequenceid=6, filesize=12.5 K 2023-10-04 02:00:46,250 INFO [rs(jenkins-hbase9.apache.org,44303,1696384805319)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/data/default/testtb-testConsecutiveExports/3c37a247c41cfe6705e84b208102faab/cf/d1ce6d4c85674b5ea06058d81ab104b7, entries=4, sequenceid=6, filesize=5.5 K 2023-10-04 02:00:46,251 INFO [rs(jenkins-hbase9.apache.org,39045,1696384805392)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.00 KB/3070, heapSize ~6.70 KB/6864, currentSize=0 B/0 for 1e754cc94e1e4025807fe47095eba9a0 in 76ms, sequenceid=6, compaction requested=false 2023-10-04 02:00:46,251 DEBUG [rs(jenkins-hbase9.apache.org,39045,1696384805392)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testConsecutiveExports' 2023-10-04 02:00:46,251 INFO [rs(jenkins-hbase9.apache.org,44303,1696384805319)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~266 B/266, heapSize ~816 B/816, currentSize=0 B/0 for 3c37a247c41cfe6705e84b208102faab in 69ms, sequenceid=6, compaction requested=false 2023-10-04 02:00:46,251 DEBUG [rs(jenkins-hbase9.apache.org,44303,1696384805319)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testConsecutiveExports' 2023-10-04 02:00:46,253 DEBUG [rs(jenkins-hbase9.apache.org,39045,1696384805392)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 1e754cc94e1e4025807fe47095eba9a0: 2023-10-04 02:00:46,253 DEBUG [rs(jenkins-hbase9.apache.org,44303,1696384805319)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 3c37a247c41cfe6705e84b208102faab: 2023-10-04 02:00:46,254 DEBUG [rs(jenkins-hbase9.apache.org,39045,1696384805392)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,1,1696384845078.1e754cc94e1e4025807fe47095eba9a0.' region-info for snapshot=snaptb0-testConsecutiveExports 2023-10-04 02:00:46,254 DEBUG [rs(jenkins-hbase9.apache.org,44303,1696384805319)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,,1696384845078.3c37a247c41cfe6705e84b208102faab.' region-info for snapshot=snaptb0-testConsecutiveExports 2023-10-04 02:00:46,254 DEBUG [rs(jenkins-hbase9.apache.org,39045,1696384805392)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-04 02:00:46,254 DEBUG [rs(jenkins-hbase9.apache.org,44303,1696384805319)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-04 02:00:46,254 DEBUG [rs(jenkins-hbase9.apache.org,39045,1696384805392)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/data/default/testtb-testConsecutiveExports/1e754cc94e1e4025807fe47095eba9a0/cf/7feb76776ab64a6b8744c76e952e82c7] hfiles 2023-10-04 02:00:46,254 DEBUG [rs(jenkins-hbase9.apache.org,44303,1696384805319)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/data/default/testtb-testConsecutiveExports/3c37a247c41cfe6705e84b208102faab/cf/d1ce6d4c85674b5ea06058d81ab104b7] hfiles 2023-10-04 02:00:46,254 DEBUG [rs(jenkins-hbase9.apache.org,44303,1696384805319)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/data/default/testtb-testConsecutiveExports/3c37a247c41cfe6705e84b208102faab/cf/d1ce6d4c85674b5ea06058d81ab104b7 for snapshot=snaptb0-testConsecutiveExports 2023-10-04 02:00:46,254 DEBUG [rs(jenkins-hbase9.apache.org,39045,1696384805392)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/data/default/testtb-testConsecutiveExports/1e754cc94e1e4025807fe47095eba9a0/cf/7feb76776ab64a6b8744c76e952e82c7 for snapshot=snaptb0-testConsecutiveExports 2023-10-04 02:00:46,267 DEBUG [rs(jenkins-hbase9.apache.org,39045,1696384805392)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,1,1696384845078.1e754cc94e1e4025807fe47095eba9a0. completed. 2023-10-04 02:00:46,267 DEBUG [rs(jenkins-hbase9.apache.org,39045,1696384805392)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,1,1696384845078.1e754cc94e1e4025807fe47095eba9a0. 2023-10-04 02:00:46,267 DEBUG [member: 'jenkins-hbase9.apache.org,39045,1696384805392' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-04 02:00:46,267 DEBUG [member: 'jenkins-hbase9.apache.org,39045,1696384805392' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-04 02:00:46,267 DEBUG [member: 'jenkins-hbase9.apache.org,39045,1696384805392' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase9.apache.org,39045,1696384805392 2023-10-04 02:00:46,272 DEBUG [member: 'jenkins-hbase9.apache.org,39045,1696384805392' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testConsecutiveExports' locally completed 2023-10-04 02:00:46,272 DEBUG [member: 'jenkins-hbase9.apache.org,39045,1696384805392' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testConsecutiveExports' completed for member 'jenkins-hbase9.apache.org,39045,1696384805392' in zk 2023-10-04 02:00:46,274 DEBUG [member: 'jenkins-hbase9.apache.org,39045,1696384805392' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testConsecutiveExports' has notified controller of completion 2023-10-04 02:00:46,274 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): master:39651-0x1010f1b55330000, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,39045,1696384805392 2023-10-04 02:00:46,274 DEBUG [member: 'jenkins-hbase9.apache.org,39045,1696384805392' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-04 02:00:46,274 DEBUG [rs(jenkins-hbase9.apache.org,44303,1696384805319)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,,1696384845078.3c37a247c41cfe6705e84b208102faab. completed. 2023-10-04 02:00:46,275 DEBUG [member: 'jenkins-hbase9.apache.org,39045,1696384805392' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testConsecutiveExports' completed. 2023-10-04 02:00:46,274 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,39045,1696384805392 2023-10-04 02:00:46,276 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-04 02:00:46,276 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-04 02:00:46,276 DEBUG [rs(jenkins-hbase9.apache.org,44303,1696384805319)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,,1696384845078.3c37a247c41cfe6705e84b208102faab. 2023-10-04 02:00:46,276 DEBUG [member: 'jenkins-hbase9.apache.org,44303,1696384805319' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-04 02:00:46,276 DEBUG [member: 'jenkins-hbase9.apache.org,44303,1696384805319' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-04 02:00:46,276 DEBUG [member: 'jenkins-hbase9.apache.org,44303,1696384805319' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase9.apache.org,44303,1696384805319 2023-10-04 02:00:46,276 DEBUG [member: 'jenkins-hbase9.apache.org,44303,1696384805319' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testConsecutiveExports' locally completed 2023-10-04 02:00:46,277 DEBUG [member: 'jenkins-hbase9.apache.org,44303,1696384805319' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testConsecutiveExports' completed for member 'jenkins-hbase9.apache.org,44303,1696384805319' in zk 2023-10-04 02:00:46,277 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-04 02:00:46,277 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-04 02:00:46,278 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): master:39651-0x1010f1b55330000, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,44303,1696384805319 2023-10-04 02:00:46,278 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-10-04 02:00:46,278 DEBUG [member: 'jenkins-hbase9.apache.org,44303,1696384805319' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testConsecutiveExports' has notified controller of completion 2023-10-04 02:00:46,279 DEBUG [member: 'jenkins-hbase9.apache.org,44303,1696384805319' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-04 02:00:46,279 DEBUG [member: 'jenkins-hbase9.apache.org,44303,1696384805319' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testConsecutiveExports' completed. 2023-10-04 02:00:46,280 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,39045,1696384805392 2023-10-04 02:00:46,280 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,35175,1696384805436 2023-10-04 02:00:46,281 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44303,1696384805319 2023-10-04 02:00:46,281 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-04 02:00:46,281 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-10-04 02:00:46,281 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,39045,1696384805392 2023-10-04 02:00:46,282 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,35175,1696384805436 2023-10-04 02:00:46,282 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44303,1696384805319 2023-10-04 02:00:46,282 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testConsecutiveExports' member 'jenkins-hbase9.apache.org,39045,1696384805392': 2023-10-04 02:00:46,283 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,39045,1696384805392' released barrier for procedure'snaptb0-testConsecutiveExports', counting down latch. Waiting for 1 more 2023-10-04 02:00:46,283 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,44303,1696384805319 2023-10-04 02:00:46,283 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-04 02:00:46,283 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-04 02:00:46,283 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-04 02:00:46,283 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-04 02:00:46,283 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-10-04 02:00:46,284 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,39045,1696384805392 2023-10-04 02:00:46,284 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,35175,1696384805436 2023-10-04 02:00:46,284 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44303,1696384805319 2023-10-04 02:00:46,284 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-04 02:00:46,285 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-10-04 02:00:46,285 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,39045,1696384805392 2023-10-04 02:00:46,285 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,35175,1696384805436 2023-10-04 02:00:46,286 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44303,1696384805319 2023-10-04 02:00:46,286 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testConsecutiveExports' member 'jenkins-hbase9.apache.org,44303,1696384805319': 2023-10-04 02:00:46,286 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,44303,1696384805319' released barrier for procedure'snaptb0-testConsecutiveExports', counting down latch. Waiting for 0 more 2023-10-04 02:00:46,286 INFO [(jenkins-hbase9.apache.org,39651,1696384803959)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testConsecutiveExports' execution completed 2023-10-04 02:00:46,286 DEBUG [(jenkins-hbase9.apache.org,39651,1696384803959)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-04 02:00:46,286 DEBUG [(jenkins-hbase9.apache.org,39651,1696384803959)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-04 02:00:46,286 DEBUG [(jenkins-hbase9.apache.org,39651,1696384803959)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testConsecutiveExports 2023-10-04 02:00:46,286 INFO [(jenkins-hbase9.apache.org,39651,1696384803959)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testConsecutiveExportsincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-10-04 02:00:46,289 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): regionserver:39045-0x1010f1b55330002, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-10-04 02:00:46,289 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): master:39651-0x1010f1b55330000, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-10-04 02:00:46,289 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-10-04 02:00:46,289 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-10-04 02:00:46,289 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-04 02:00:46,290 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-04 02:00:46,289 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-10-04 02:00:46,289 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): regionserver:39045-0x1010f1b55330002, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-04 02:00:46,289 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): regionserver:44303-0x1010f1b55330001, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-10-04 02:00:46,289 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): regionserver:35175-0x1010f1b55330003, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-10-04 02:00:46,290 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-10-04 02:00:46,290 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-10-04 02:00:46,290 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-10-04 02:00:46,290 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): regionserver:35175-0x1010f1b55330003, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-04 02:00:46,290 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-04 02:00:46,290 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-04 02:00:46,290 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-04 02:00:46,290 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): regionserver:44303-0x1010f1b55330001, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-04 02:00:46,290 DEBUG [(jenkins-hbase9.apache.org,39651,1696384803959)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39651-0x1010f1b55330000, quorum=127.0.0.1:60027, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,39045,1696384805392 2023-10-04 02:00:46,290 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-04 02:00:46,290 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-04 02:00:46,290 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-10-04 02:00:46,290 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-10-04 02:00:46,290 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-10-04 02:00:46,291 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-10-04 02:00:46,291 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-04 02:00:46,291 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-04 02:00:46,291 DEBUG [(jenkins-hbase9.apache.org,39651,1696384803959)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39651-0x1010f1b55330000, quorum=127.0.0.1:60027, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,35175,1696384805436 2023-10-04 02:00:46,291 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-10-04 02:00:46,291 DEBUG [(jenkins-hbase9.apache.org,39651,1696384803959)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39651-0x1010f1b55330000, quorum=127.0.0.1:60027, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,44303,1696384805319 2023-10-04 02:00:46,291 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-04 02:00:46,292 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-10-04 02:00:46,292 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,39045,1696384805392 2023-10-04 02:00:46,293 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,35175,1696384805436 2023-10-04 02:00:46,293 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44303,1696384805319 2023-10-04 02:00:46,293 DEBUG [(jenkins-hbase9.apache.org,39651,1696384803959)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39651-0x1010f1b55330000, quorum=127.0.0.1:60027, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,39045,1696384805392 2023-10-04 02:00:46,293 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-04 02:00:46,294 DEBUG [(jenkins-hbase9.apache.org,39651,1696384803959)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39651-0x1010f1b55330000, quorum=127.0.0.1:60027, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,35175,1696384805436 2023-10-04 02:00:46,294 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-10-04 02:00:46,294 DEBUG [(jenkins-hbase9.apache.org,39651,1696384803959)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39651-0x1010f1b55330000, quorum=127.0.0.1:60027, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,44303,1696384805319 2023-10-04 02:00:46,294 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,39045,1696384805392 2023-10-04 02:00:46,294 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,35175,1696384805436 2023-10-04 02:00:46,295 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44303,1696384805319 2023-10-04 02:00:46,301 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): regionserver:35175-0x1010f1b55330003, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-04 02:00:46,301 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): regionserver:44303-0x1010f1b55330001, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-04 02:00:46,301 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): regionserver:44303-0x1010f1b55330001, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-04 02:00:46,301 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): regionserver:39045-0x1010f1b55330002, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-04 02:00:46,301 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-04 02:00:46,301 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-04 02:00:46,301 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-04 02:00:46,301 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): master:39651-0x1010f1b55330000, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,44303,1696384805319 2023-10-04 02:00:46,301 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): regionserver:39045-0x1010f1b55330002, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-04 02:00:46,301 DEBUG [(jenkins-hbase9.apache.org,39651,1696384803959)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-04 02:00:46,301 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-04 02:00:46,301 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-04 02:00:46,301 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testConsecutiveExports 2023-10-04 02:00:46,301 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): master:39651-0x1010f1b55330000, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-10-04 02:00:46,301 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): regionserver:35175-0x1010f1b55330003, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-04 02:00:46,301 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-04 02:00:46,302 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-04 02:00:46,301 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): master:39651-0x1010f1b55330000, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,35175,1696384805436 2023-10-04 02:00:46,301 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testConsecutiveExports 2023-10-04 02:00:46,302 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): master:39651-0x1010f1b55330000, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,39045,1696384805392 2023-10-04 02:00:46,302 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): master:39651-0x1010f1b55330000, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-10-04 02:00:46,302 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): master:39651-0x1010f1b55330000, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,44303,1696384805319 2023-10-04 02:00:46,302 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => c7b48a2e62736c517f8bfa7d64fc37ac, NAME => 'testtb-testConsecutiveExports,.mob,0.c7b48a2e62736c517f8bfa7d64fc37ac.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testConsecutiveExports 2023-10-04 02:00:46,302 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-10-04 02:00:46,302 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-04 02:00:46,302 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-04 02:00:46,302 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-04 02:00:46,302 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): master:39651-0x1010f1b55330000, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-10-04 02:00:46,302 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): master:39651-0x1010f1b55330000, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,35175,1696384805436 2023-10-04 02:00:46,302 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): master:39651-0x1010f1b55330000, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,39045,1696384805392 2023-10-04 02:00:46,302 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): master:39651-0x1010f1b55330000, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-10-04 02:00:46,302 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): master:39651-0x1010f1b55330000, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-10-04 02:00:46,302 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-04 02:00:46,302 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-04 02:00:46,303 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b202310041d90ce9abd3b487693bda8364a895901, hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e202310041f1d1e4227124e5a82ade6cac16de102] mob files 2023-10-04 02:00:46,303 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b202310041d90ce9abd3b487693bda8364a895901 2023-10-04 02:00:46,303 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e202310041f1d1e4227124e5a82ade6cac16de102 2023-10-04 02:00:46,312 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testConsecutiveExports 2023-10-04 02:00:46,313 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-10-04 02:00:46,343 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports to hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-10-04 02:00:46,344 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed 2023-10-04 02:00:46,344 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-10-04 02:00:46,344 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-10-04 02:00:46,344 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports at 1696384846125Completed referencing HFiles for the mob region of table: testtb-testConsecutiveExports at 1696384846312 (+187 ms)Consolidate snapshot: snaptb0-testConsecutiveExports at 1696384846312Loading Region manifests for snaptb0-testConsecutiveExports at 1696384846313 (+1 ms)Writing data manifest for snaptb0-testConsecutiveExports at 1696384846316 (+3 ms)Verifying snapshot: snaptb0-testConsecutiveExports at 1696384846335 (+19 ms)Snapshot snaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed at 1696384846344 (+9 ms) 2023-10-04 02:00:46,347 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=50, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-10-04 02:00:46,349 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=50, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED in 221 msec 2023-10-04 02:00:46,428 DEBUG [Listener at jenkins-hbase9.apache.org/33899] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-04 02:00:46,429 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39651] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-10-04 02:00:46,429 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39651] snapshot.SnapshotManager(403): Snapshot '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' has completed, notifying client. 2023-10-04 02:00:46,429 INFO [Listener at jenkins-hbase9.apache.org/33899] snapshot.TestExportSnapshot(389): Local export destination path: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/757a468a-9656-cc80-ec19-d6f68f36be5a/local-export-1696384846429 2023-10-04 02:00:46,429 INFO [Listener at jenkins-hbase9.apache.org/33899] snapshot.TestExportSnapshot(255): tgtFsUri=file:///, tgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/757a468a-9656-cc80-ec19-d6f68f36be5a/local-export-1696384846429, rawTgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/757a468a-9656-cc80-ec19-d6f68f36be5a/local-export-1696384846429, srcFsUri=hdfs://localhost:38449, srcDir=hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51 2023-10-04 02:00:46,451 DEBUG [Listener at jenkins-hbase9.apache.org/33899] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:38449, inputRoot=hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51 2023-10-04 02:00:46,451 DEBUG [Listener at jenkins-hbase9.apache.org/33899] snapshot.ExportSnapshot(999): outputFs=org.apache.hadoop.fs.LocalFileSystem@58d4792b, outputRoot=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/757a468a-9656-cc80-ec19-d6f68f36be5a/local-export-1696384846429, skipTmp=false, initialOutputSnapshotDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/757a468a-9656-cc80-ec19-d6f68f36be5a/local-export-1696384846429/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-10-04 02:00:46,451 INFO [Listener at jenkins-hbase9.apache.org/33899] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:38449, inputRoot=hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51, snapshotDir=hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/.hbase-snapshot/snaptb0-testConsecutiveExports. 2023-10-04 02:00:46,460 INFO [Listener at jenkins-hbase9.apache.org/33899] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/.hbase-snapshot/snaptb0-testConsecutiveExports to file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/757a468a-9656-cc80-ec19-d6f68f36be5a/local-export-1696384846429/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-10-04 02:00:46,476 DEBUG [Listener at jenkins-hbase9.apache.org/33899] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-10-04 02:00:46,477 DEBUG [Listener at jenkins-hbase9.apache.org/33899] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-10-04 02:00:46,477 DEBUG [Listener at jenkins-hbase9.apache.org/33899] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-10-04 02:00:46,477 DEBUG [Listener at jenkins-hbase9.apache.org/33899] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-10-04 02:00:46,478 DEBUG [Listener at jenkins-hbase9.apache.org/33899] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar 2023-10-04 02:00:46,478 DEBUG [Listener at jenkins-hbase9.apache.org/33899] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-10-04 02:00:46,478 DEBUG [Listener at jenkins-hbase9.apache.org/33899] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-10-04 02:00:46,546 DEBUG [Listener at jenkins-hbase9.apache.org/33899] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/757a468a-9656-cc80-ec19-d6f68f36be5a/hadoop-4908200956999298208.jar 2023-10-04 02:00:46,547 DEBUG [Listener at jenkins-hbase9.apache.org/33899] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-10-04 02:00:46,548 DEBUG [Listener at jenkins-hbase9.apache.org/33899] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-10-04 02:00:46,548 DEBUG [Listener at jenkins-hbase9.apache.org/33899] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-10-04 02:00:46,549 DEBUG [Listener at jenkins-hbase9.apache.org/33899] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-10-04 02:00:46,549 DEBUG [Listener at jenkins-hbase9.apache.org/33899] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-10-04 02:00:46,549 DEBUG [Listener at jenkins-hbase9.apache.org/33899] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-10-04 02:00:46,550 DEBUG [Listener at jenkins-hbase9.apache.org/33899] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-10-04 02:00:46,550 DEBUG [Listener at jenkins-hbase9.apache.org/33899] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-10-04 02:00:46,551 DEBUG [Listener at jenkins-hbase9.apache.org/33899] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-10-04 02:00:46,551 DEBUG [Listener at jenkins-hbase9.apache.org/33899] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-10-04 02:00:46,551 DEBUG [Listener at jenkins-hbase9.apache.org/33899] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-10-04 02:00:46,552 DEBUG [Listener at jenkins-hbase9.apache.org/33899] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-10-04 02:00:46,552 DEBUG [Listener at jenkins-hbase9.apache.org/33899] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-10-04 02:00:46,552 DEBUG [Listener at jenkins-hbase9.apache.org/33899] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-10-04 02:00:46,553 DEBUG [Listener at jenkins-hbase9.apache.org/33899] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-10-04 02:00:46,553 DEBUG [Listener at jenkins-hbase9.apache.org/33899] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-10-04 02:00:46,554 DEBUG [Listener at jenkins-hbase9.apache.org/33899] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-04 02:00:46,554 DEBUG [Listener at jenkins-hbase9.apache.org/33899] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-04 02:00:46,554 DEBUG [Listener at jenkins-hbase9.apache.org/33899] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-10-04 02:00:46,554 DEBUG [Listener at jenkins-hbase9.apache.org/33899] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-04 02:00:46,555 DEBUG [Listener at jenkins-hbase9.apache.org/33899] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-04 02:00:46,555 DEBUG [Listener at jenkins-hbase9.apache.org/33899] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-10-04 02:00:46,555 DEBUG [Listener at jenkins-hbase9.apache.org/33899] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-10-04 02:00:46,973 WARN [Listener at jenkins-hbase9.apache.org/33899] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-10-04 02:00:46,975 INFO [Listener at jenkins-hbase9.apache.org/33899] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testConsecutiveExports' hfile list 2023-10-04 02:00:46,978 DEBUG [Listener at jenkins-hbase9.apache.org/33899] snapshot.ExportSnapshot(671): export split=0 size=30.8 K 2023-10-04 02:00:49,595 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-10-04 02:00:49,596 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-10-04 02:00:49,598 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696384811997_0002_000001 (auth:SIMPLE) 2023-10-04 02:00:50,350 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-10-04 02:00:50,411 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696384811997_0003_000001 (auth:SIMPLE) 2023-10-04 02:00:54,338 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696384811997_0003_000001 (auth:SIMPLE) 2023-10-04 02:00:56,561 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696384811997_0003_000001 (auth:SIMPLE) 2023-10-04 02:00:59,039 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696384811997_0003_000001 (auth:SIMPLE) 2023-10-04 02:01:00,163 INFO [Listener at jenkins-hbase9.apache.org/33899] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-10-04 02:01:00,164 INFO [Listener at jenkins-hbase9.apache.org/33899] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-10-04 02:01:00,169 INFO [Listener at jenkins-hbase9.apache.org/33899] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testConsecutiveExports 2023-10-04 02:01:00,169 INFO [Listener at jenkins-hbase9.apache.org/33899] snapshot.TestExportSnapshot(279): Exported snapshot 2023-10-04 02:01:00,169 INFO [Listener at jenkins-hbase9.apache.org/33899] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-10-04 02:01:00,170 DEBUG [Listener at jenkins-hbase9.apache.org/33899] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-737588810_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/.hbase-snapshot/snaptb0-testConsecutiveExports at hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-10-04 02:01:00,172 DEBUG [Listener at jenkins-hbase9.apache.org/33899] snapshot.TestExportSnapshot(367): hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-10-04 02:01:00,172 DEBUG [Listener at jenkins-hbase9.apache.org/33899] snapshot.TestExportSnapshot(367): hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-10-04 02:01:00,172 DEBUG [Listener at jenkins-hbase9.apache.org/33899] snapshot.TestExportSnapshot(362): List files in org.apache.hadoop.fs.LocalFileSystem@4230697d in root file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/757a468a-9656-cc80-ec19-d6f68f36be5a/local-export-1696384846429/.hbase-snapshot/snaptb0-testConsecutiveExports at file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/757a468a-9656-cc80-ec19-d6f68f36be5a/local-export-1696384846429/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-10-04 02:01:00,173 DEBUG [Listener at jenkins-hbase9.apache.org/33899] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/757a468a-9656-cc80-ec19-d6f68f36be5a/local-export-1696384846429/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-10-04 02:01:00,173 DEBUG [Listener at jenkins-hbase9.apache.org/33899] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/757a468a-9656-cc80-ec19-d6f68f36be5a/local-export-1696384846429/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-10-04 02:01:00,174 INFO [Listener at jenkins-hbase9.apache.org/33899] snapshot.TestExportSnapshot(255): tgtFsUri=file:///, tgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/757a468a-9656-cc80-ec19-d6f68f36be5a/local-export-1696384846429, rawTgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/757a468a-9656-cc80-ec19-d6f68f36be5a/local-export-1696384846429, srcFsUri=hdfs://localhost:38449, srcDir=hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51 2023-10-04 02:01:00,196 DEBUG [Listener at jenkins-hbase9.apache.org/33899] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:38449, inputRoot=hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51 2023-10-04 02:01:00,196 DEBUG [Listener at jenkins-hbase9.apache.org/33899] snapshot.ExportSnapshot(999): outputFs=org.apache.hadoop.fs.LocalFileSystem@4a52ce31, outputRoot=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/757a468a-9656-cc80-ec19-d6f68f36be5a/local-export-1696384846429, skipTmp=false, initialOutputSnapshotDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/757a468a-9656-cc80-ec19-d6f68f36be5a/local-export-1696384846429/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-10-04 02:01:00,196 INFO [Listener at jenkins-hbase9.apache.org/33899] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:38449, inputRoot=hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51, snapshotDir=hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/.hbase-snapshot/snaptb0-testConsecutiveExports. 2023-10-04 02:01:00,209 INFO [Listener at jenkins-hbase9.apache.org/33899] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/.hbase-snapshot/snaptb0-testConsecutiveExports to file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/757a468a-9656-cc80-ec19-d6f68f36be5a/local-export-1696384846429/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-10-04 02:01:00,221 DEBUG [Listener at jenkins-hbase9.apache.org/33899] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-10-04 02:01:00,221 DEBUG [Listener at jenkins-hbase9.apache.org/33899] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-10-04 02:01:00,222 DEBUG [Listener at jenkins-hbase9.apache.org/33899] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-10-04 02:01:00,222 DEBUG [Listener at jenkins-hbase9.apache.org/33899] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-10-04 02:01:00,222 DEBUG [Listener at jenkins-hbase9.apache.org/33899] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar 2023-10-04 02:01:00,223 DEBUG [Listener at jenkins-hbase9.apache.org/33899] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-10-04 02:01:00,223 DEBUG [Listener at jenkins-hbase9.apache.org/33899] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-10-04 02:01:00,296 DEBUG [Listener at jenkins-hbase9.apache.org/33899] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/757a468a-9656-cc80-ec19-d6f68f36be5a/hadoop-4323459731089021228.jar 2023-10-04 02:01:00,296 DEBUG [Listener at jenkins-hbase9.apache.org/33899] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-10-04 02:01:00,297 DEBUG [Listener at jenkins-hbase9.apache.org/33899] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-10-04 02:01:00,297 DEBUG [Listener at jenkins-hbase9.apache.org/33899] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-10-04 02:01:00,297 DEBUG [Listener at jenkins-hbase9.apache.org/33899] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-10-04 02:01:00,298 DEBUG [Listener at jenkins-hbase9.apache.org/33899] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-10-04 02:01:00,298 DEBUG [Listener at jenkins-hbase9.apache.org/33899] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-10-04 02:01:00,298 DEBUG [Listener at jenkins-hbase9.apache.org/33899] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-10-04 02:01:00,299 DEBUG [Listener at jenkins-hbase9.apache.org/33899] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-10-04 02:01:00,299 DEBUG [Listener at jenkins-hbase9.apache.org/33899] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-10-04 02:01:00,300 DEBUG [Listener at jenkins-hbase9.apache.org/33899] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-10-04 02:01:00,300 DEBUG [Listener at jenkins-hbase9.apache.org/33899] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-10-04 02:01:00,300 DEBUG [Listener at jenkins-hbase9.apache.org/33899] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-10-04 02:01:00,301 DEBUG [Listener at jenkins-hbase9.apache.org/33899] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-10-04 02:01:00,301 DEBUG [Listener at jenkins-hbase9.apache.org/33899] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-10-04 02:01:00,301 DEBUG [Listener at jenkins-hbase9.apache.org/33899] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-10-04 02:01:00,302 DEBUG [Listener at jenkins-hbase9.apache.org/33899] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-10-04 02:01:00,302 DEBUG [Listener at jenkins-hbase9.apache.org/33899] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-04 02:01:00,303 DEBUG [Listener at jenkins-hbase9.apache.org/33899] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-04 02:01:00,303 DEBUG [Listener at jenkins-hbase9.apache.org/33899] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-10-04 02:01:00,303 DEBUG [Listener at jenkins-hbase9.apache.org/33899] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-04 02:01:00,303 DEBUG [Listener at jenkins-hbase9.apache.org/33899] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-04 02:01:00,304 DEBUG [Listener at jenkins-hbase9.apache.org/33899] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-10-04 02:01:00,304 DEBUG [Listener at jenkins-hbase9.apache.org/33899] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-10-04 02:01:00,709 WARN [Listener at jenkins-hbase9.apache.org/33899] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-10-04 02:01:00,711 INFO [Listener at jenkins-hbase9.apache.org/33899] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testConsecutiveExports' hfile list 2023-10-04 02:01:00,713 DEBUG [Listener at jenkins-hbase9.apache.org/33899] snapshot.ExportSnapshot(671): export split=0 size=30.8 K 2023-10-04 02:01:05,217 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-10-04 02:01:05,217 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-10-04 02:01:05,220 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696384811997_0003_000001 (auth:SIMPLE) 2023-10-04 02:01:05,608 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696384811997_0004_000001 (auth:SIMPLE) 2023-10-04 02:01:09,289 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696384811997_0004_000001 (auth:SIMPLE) 2023-10-04 02:01:11,497 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696384811997_0004_000001 (auth:SIMPLE) 2023-10-04 02:01:13,771 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696384811997_0004_000001 (auth:SIMPLE) 2023-10-04 02:01:14,874 INFO [Listener at jenkins-hbase9.apache.org/33899] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-10-04 02:01:14,874 INFO [Listener at jenkins-hbase9.apache.org/33899] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-10-04 02:01:14,878 INFO [Listener at jenkins-hbase9.apache.org/33899] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testConsecutiveExports 2023-10-04 02:01:14,878 INFO [Listener at jenkins-hbase9.apache.org/33899] snapshot.TestExportSnapshot(279): Exported snapshot 2023-10-04 02:01:14,878 INFO [Listener at jenkins-hbase9.apache.org/33899] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-10-04 02:01:14,878 DEBUG [Listener at jenkins-hbase9.apache.org/33899] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-737588810_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/.hbase-snapshot/snaptb0-testConsecutiveExports at hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-10-04 02:01:14,882 DEBUG [Listener at jenkins-hbase9.apache.org/33899] snapshot.TestExportSnapshot(367): hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-10-04 02:01:14,882 DEBUG [Listener at jenkins-hbase9.apache.org/33899] snapshot.TestExportSnapshot(367): hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-10-04 02:01:14,882 DEBUG [Listener at jenkins-hbase9.apache.org/33899] snapshot.TestExportSnapshot(362): List files in org.apache.hadoop.fs.LocalFileSystem@4230697d in root file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/757a468a-9656-cc80-ec19-d6f68f36be5a/local-export-1696384846429/.hbase-snapshot/snaptb0-testConsecutiveExports at file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/757a468a-9656-cc80-ec19-d6f68f36be5a/local-export-1696384846429/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-10-04 02:01:14,882 DEBUG [Listener at jenkins-hbase9.apache.org/33899] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/757a468a-9656-cc80-ec19-d6f68f36be5a/local-export-1696384846429/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-10-04 02:01:14,882 DEBUG [Listener at jenkins-hbase9.apache.org/33899] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/757a468a-9656-cc80-ec19-d6f68f36be5a/local-export-1696384846429/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-10-04 02:01:14,894 INFO [Listener at jenkins-hbase9.apache.org/33899] client.HBaseAdmin$15(890): Started disable of testtb-testConsecutiveExports 2023-10-04 02:01:14,895 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39651] master.HMaster$11(2418): Client=jenkins//172.31.2.10 disable testtb-testConsecutiveExports 2023-10-04 02:01:14,896 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39651] procedure2.ProcedureExecutor(1028): Stored pid=51, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testConsecutiveExports 2023-10-04 02:01:14,898 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39651] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-10-04 02:01:14,899 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696384874899"}]},"ts":"1696384874899"} 2023-10-04 02:01:14,900 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=DISABLING in hbase:meta 2023-10-04 02:01:14,902 INFO [PEWorker-2] procedure.DisableTableProcedure(293): Set testtb-testConsecutiveExports to state=DISABLING 2023-10-04 02:01:14,903 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=52, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=3c37a247c41cfe6705e84b208102faab, UNASSIGN}, {pid=53, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=1e754cc94e1e4025807fe47095eba9a0, UNASSIGN}] 2023-10-04 02:01:14,905 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=52, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=3c37a247c41cfe6705e84b208102faab, UNASSIGN 2023-10-04 02:01:14,905 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=53, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=1e754cc94e1e4025807fe47095eba9a0, UNASSIGN 2023-10-04 02:01:14,905 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=52 updating hbase:meta row=3c37a247c41cfe6705e84b208102faab, regionState=CLOSING, regionLocation=jenkins-hbase9.apache.org,44303,1696384805319 2023-10-04 02:01:14,905 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=53 updating hbase:meta row=1e754cc94e1e4025807fe47095eba9a0, regionState=CLOSING, regionLocation=jenkins-hbase9.apache.org,39045,1696384805392 2023-10-04 02:01:14,906 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,1,1696384845078.1e754cc94e1e4025807fe47095eba9a0.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1696384874905"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696384874905"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696384874905"}]},"ts":"1696384874905"} 2023-10-04 02:01:14,906 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,,1696384845078.3c37a247c41cfe6705e84b208102faab.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1696384874905"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696384874905"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696384874905"}]},"ts":"1696384874905"} 2023-10-04 02:01:14,907 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=54, ppid=52, state=RUNNABLE; CloseRegionProcedure 3c37a247c41cfe6705e84b208102faab, server=jenkins-hbase9.apache.org,44303,1696384805319}] 2023-10-04 02:01:14,908 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=55, ppid=53, state=RUNNABLE; CloseRegionProcedure 1e754cc94e1e4025807fe47095eba9a0, server=jenkins-hbase9.apache.org,39045,1696384805392}] 2023-10-04 02:01:14,999 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39651] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-10-04 02:01:15,059 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(111): Close 1e754cc94e1e4025807fe47095eba9a0 2023-10-04 02:01:15,059 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(111): Close 3c37a247c41cfe6705e84b208102faab 2023-10-04 02:01:15,060 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1604): Closing 1e754cc94e1e4025807fe47095eba9a0, disabling compactions & flushes 2023-10-04 02:01:15,060 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1604): Closing 3c37a247c41cfe6705e84b208102faab, disabling compactions & flushes 2023-10-04 02:01:15,060 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,1,1696384845078.1e754cc94e1e4025807fe47095eba9a0. 2023-10-04 02:01:15,060 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,,1696384845078.3c37a247c41cfe6705e84b208102faab. 2023-10-04 02:01:15,060 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,1,1696384845078.1e754cc94e1e4025807fe47095eba9a0. 2023-10-04 02:01:15,060 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,,1696384845078.3c37a247c41cfe6705e84b208102faab. 2023-10-04 02:01:15,060 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,1,1696384845078.1e754cc94e1e4025807fe47095eba9a0. after waiting 0 ms 2023-10-04 02:01:15,060 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,1,1696384845078.1e754cc94e1e4025807fe47095eba9a0. 2023-10-04 02:01:15,060 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,,1696384845078.3c37a247c41cfe6705e84b208102faab. after waiting 0 ms 2023-10-04 02:01:15,060 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,,1696384845078.3c37a247c41cfe6705e84b208102faab. 2023-10-04 02:01:15,070 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/data/default/testtb-testConsecutiveExports/3c37a247c41cfe6705e84b208102faab/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-10-04 02:01:15,070 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/data/default/testtb-testConsecutiveExports/1e754cc94e1e4025807fe47095eba9a0/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-10-04 02:01:15,071 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-10-04 02:01:15,071 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-10-04 02:01:15,071 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,,1696384845078.3c37a247c41cfe6705e84b208102faab. 2023-10-04 02:01:15,072 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,1,1696384845078.1e754cc94e1e4025807fe47095eba9a0. 2023-10-04 02:01:15,072 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1558): Region close journal for 3c37a247c41cfe6705e84b208102faab: 2023-10-04 02:01:15,072 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1558): Region close journal for 1e754cc94e1e4025807fe47095eba9a0: 2023-10-04 02:01:15,074 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(149): Closed 3c37a247c41cfe6705e84b208102faab 2023-10-04 02:01:15,074 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=52 updating hbase:meta row=3c37a247c41cfe6705e84b208102faab, regionState=CLOSED 2023-10-04 02:01:15,074 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(149): Closed 1e754cc94e1e4025807fe47095eba9a0 2023-10-04 02:01:15,074 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,,1696384845078.3c37a247c41cfe6705e84b208102faab.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1696384875074"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696384875074"}]},"ts":"1696384875074"} 2023-10-04 02:01:15,075 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=53 updating hbase:meta row=1e754cc94e1e4025807fe47095eba9a0, regionState=CLOSED 2023-10-04 02:01:15,075 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,1,1696384845078.1e754cc94e1e4025807fe47095eba9a0.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1696384875075"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696384875075"}]},"ts":"1696384875075"} 2023-10-04 02:01:15,078 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=54, resume processing ppid=52 2023-10-04 02:01:15,078 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=54, ppid=52, state=SUCCESS; CloseRegionProcedure 3c37a247c41cfe6705e84b208102faab, server=jenkins-hbase9.apache.org,44303,1696384805319 in 169 msec 2023-10-04 02:01:15,079 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=55, resume processing ppid=53 2023-10-04 02:01:15,079 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=55, ppid=53, state=SUCCESS; CloseRegionProcedure 1e754cc94e1e4025807fe47095eba9a0, server=jenkins-hbase9.apache.org,39045,1696384805392 in 169 msec 2023-10-04 02:01:15,079 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=52, ppid=51, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=3c37a247c41cfe6705e84b208102faab, UNASSIGN in 175 msec 2023-10-04 02:01:15,080 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=53, resume processing ppid=51 2023-10-04 02:01:15,080 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=53, ppid=51, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=1e754cc94e1e4025807fe47095eba9a0, UNASSIGN in 176 msec 2023-10-04 02:01:15,081 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696384875081"}]},"ts":"1696384875081"} 2023-10-04 02:01:15,082 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=DISABLED in hbase:meta 2023-10-04 02:01:15,084 INFO [PEWorker-4] procedure.DisableTableProcedure(305): Set testtb-testConsecutiveExports to state=DISABLED 2023-10-04 02:01:15,085 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=51, state=SUCCESS; DisableTableProcedure table=testtb-testConsecutiveExports in 189 msec 2023-10-04 02:01:15,201 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39651] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-10-04 02:01:15,201 INFO [Listener at jenkins-hbase9.apache.org/33899] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testConsecutiveExports, procId: 51 completed 2023-10-04 02:01:15,202 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39651] master.HMaster$5(2228): Client=jenkins//172.31.2.10 delete testtb-testConsecutiveExports 2023-10-04 02:01:15,203 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39651] procedure2.ProcedureExecutor(1028): Stored pid=56, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-10-04 02:01:15,205 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=56, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-10-04 02:01:15,205 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39651] access.PermissionStorage(259): Removing permissions of removed table testtb-testConsecutiveExports 2023-10-04 02:01:15,206 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=56, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-10-04 02:01:15,208 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=44303] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testConsecutiveExports 2023-10-04 02:01:15,212 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/.tmp/data/default/testtb-testConsecutiveExports/3c37a247c41cfe6705e84b208102faab 2023-10-04 02:01:15,212 DEBUG [HFileArchiver-14] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/.tmp/data/default/testtb-testConsecutiveExports/1e754cc94e1e4025807fe47095eba9a0 2023-10-04 02:01:15,213 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): regionserver:35175-0x1010f1b55330003, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-10-04 02:01:15,213 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): regionserver:44303-0x1010f1b55330001, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-10-04 02:01:15,213 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): master:39651-0x1010f1b55330000, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-10-04 02:01:15,213 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): regionserver:39045-0x1010f1b55330002, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-10-04 02:01:15,214 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-10-04 02:01:15,214 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-10-04 02:01:15,214 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-10-04 02:01:15,214 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-10-04 02:01:15,214 DEBUG [HFileArchiver-14] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/.tmp/data/default/testtb-testConsecutiveExports/1e754cc94e1e4025807fe47095eba9a0/cf, FileablePath, hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/.tmp/data/default/testtb-testConsecutiveExports/1e754cc94e1e4025807fe47095eba9a0/recovered.edits] 2023-10-04 02:01:15,214 DEBUG [HFileArchiver-13] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/.tmp/data/default/testtb-testConsecutiveExports/3c37a247c41cfe6705e84b208102faab/cf, FileablePath, hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/.tmp/data/default/testtb-testConsecutiveExports/3c37a247c41cfe6705e84b208102faab/recovered.edits] 2023-10-04 02:01:15,215 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): regionserver:35175-0x1010f1b55330003, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-10-04 02:01:15,215 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): regionserver:39045-0x1010f1b55330002, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-10-04 02:01:15,218 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): master:39651-0x1010f1b55330000, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-10-04 02:01:15,218 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): regionserver:35175-0x1010f1b55330003, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-04 02:01:15,219 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): regionserver:44303-0x1010f1b55330001, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-10-04 02:01:15,219 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): regionserver:39045-0x1010f1b55330002, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-04 02:01:15,219 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): master:39651-0x1010f1b55330000, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-04 02:01:15,219 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): regionserver:44303-0x1010f1b55330001, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-04 02:01:15,220 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39651] master.MasterRpcServices(1230): Checking to see if procedure is done pid=56 2023-10-04 02:01:15,223 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/.tmp/data/default/testtb-testConsecutiveExports/1e754cc94e1e4025807fe47095eba9a0/cf/7feb76776ab64a6b8744c76e952e82c7 to hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/archive/data/default/testtb-testConsecutiveExports/1e754cc94e1e4025807fe47095eba9a0/cf/7feb76776ab64a6b8744c76e952e82c7 2023-10-04 02:01:15,223 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/.tmp/data/default/testtb-testConsecutiveExports/3c37a247c41cfe6705e84b208102faab/cf/d1ce6d4c85674b5ea06058d81ab104b7 to hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/archive/data/default/testtb-testConsecutiveExports/3c37a247c41cfe6705e84b208102faab/cf/d1ce6d4c85674b5ea06058d81ab104b7 2023-10-04 02:01:15,228 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/.tmp/data/default/testtb-testConsecutiveExports/3c37a247c41cfe6705e84b208102faab/recovered.edits/9.seqid to hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/archive/data/default/testtb-testConsecutiveExports/3c37a247c41cfe6705e84b208102faab/recovered.edits/9.seqid 2023-10-04 02:01:15,229 DEBUG [HFileArchiver-13] backup.HFileArchiver(596): Deleted hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/.tmp/data/default/testtb-testConsecutiveExports/3c37a247c41cfe6705e84b208102faab 2023-10-04 02:01:15,229 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/.tmp/data/default/testtb-testConsecutiveExports/1e754cc94e1e4025807fe47095eba9a0/recovered.edits/9.seqid to hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/archive/data/default/testtb-testConsecutiveExports/1e754cc94e1e4025807fe47095eba9a0/recovered.edits/9.seqid 2023-10-04 02:01:15,230 DEBUG [HFileArchiver-14] backup.HFileArchiver(596): Deleted hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/.tmp/data/default/testtb-testConsecutiveExports/1e754cc94e1e4025807fe47095eba9a0 2023-10-04 02:01:15,230 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testtb-testConsecutiveExports regions 2023-10-04 02:01:15,230 DEBUG [PEWorker-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac 2023-10-04 02:01:15,231 DEBUG [PEWorker-1] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf] 2023-10-04 02:01:15,234 DEBUG [PEWorker-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b202310041d90ce9abd3b487693bda8364a895901 to hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/archive/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b202310041d90ce9abd3b487693bda8364a895901 2023-10-04 02:01:15,236 DEBUG [PEWorker-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e202310041f1d1e4227124e5a82ade6cac16de102 to hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/archive/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e202310041f1d1e4227124e5a82ade6cac16de102 2023-10-04 02:01:15,236 DEBUG [PEWorker-1] backup.HFileArchiver(596): Deleted hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac 2023-10-04 02:01:15,239 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=56, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-10-04 02:01:15,241 WARN [PEWorker-1] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testConsecutiveExports from hbase:meta 2023-10-04 02:01:15,243 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(421): Removing 'testtb-testConsecutiveExports' descriptor. 2023-10-04 02:01:15,244 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=56, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-10-04 02:01:15,244 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(411): Removing 'testtb-testConsecutiveExports' from region states. 2023-10-04 02:01:15,244 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testConsecutiveExports,,1696384845078.3c37a247c41cfe6705e84b208102faab.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1696384875244"}]},"ts":"9223372036854775807"} 2023-10-04 02:01:15,244 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testConsecutiveExports,1,1696384845078.1e754cc94e1e4025807fe47095eba9a0.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1696384875244"}]},"ts":"9223372036854775807"} 2023-10-04 02:01:15,246 INFO [PEWorker-1] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-10-04 02:01:15,246 DEBUG [PEWorker-1] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 3c37a247c41cfe6705e84b208102faab, NAME => 'testtb-testConsecutiveExports,,1696384845078.3c37a247c41cfe6705e84b208102faab.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 1e754cc94e1e4025807fe47095eba9a0, NAME => 'testtb-testConsecutiveExports,1,1696384845078.1e754cc94e1e4025807fe47095eba9a0.', STARTKEY => '1', ENDKEY => ''}] 2023-10-04 02:01:15,246 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(415): Marking 'testtb-testConsecutiveExports' as deleted. 2023-10-04 02:01:15,246 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1696384875246"}]},"ts":"9223372036854775807"} 2023-10-04 02:01:15,248 INFO [PEWorker-1] hbase.MetaTableAccessor(1658): Deleted table testtb-testConsecutiveExports state from META 2023-10-04 02:01:15,250 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(130): Finished pid=56, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-10-04 02:01:15,251 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=56, state=SUCCESS; DeleteTableProcedure table=testtb-testConsecutiveExports in 48 msec 2023-10-04 02:01:15,321 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39651] master.MasterRpcServices(1230): Checking to see if procedure is done pid=56 2023-10-04 02:01:15,321 INFO [Listener at jenkins-hbase9.apache.org/33899] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testConsecutiveExports, procId: 56 completed 2023-10-04 02:01:15,331 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39651] master.MasterRpcServices(751): Client=jenkins//172.31.2.10 delete name: "emptySnaptb0-testConsecutiveExports" 2023-10-04 02:01:15,333 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39651] snapshot.SnapshotManager(335): Deleting snapshot: emptySnaptb0-testConsecutiveExports 2023-10-04 02:01:15,334 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39651] master.MasterRpcServices(751): Client=jenkins//172.31.2.10 delete name: "snaptb0-testConsecutiveExports" 2023-10-04 02:01:15,336 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39651] snapshot.SnapshotManager(335): Deleting snapshot: snaptb0-testConsecutiveExports 2023-10-04 02:01:15,362 INFO [Listener at jenkins-hbase9.apache.org/33899] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testConsecutiveExports Thread=751 (was 762), OpenFileDescriptor=907 (was 938), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=257 (was 316), ProcessCount=168 (was 168), AvailableMemoryMB=10823 (was 10996) 2023-10-04 02:01:15,362 WARN [Listener at jenkins-hbase9.apache.org/33899] hbase.ResourceChecker(130): Thread=751 is superior to 500 2023-10-04 02:01:15,384 INFO [Listener at jenkins-hbase9.apache.org/33899] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testExportFileSystemStateWithMergeRegion Thread=751, OpenFileDescriptor=907, MaxFileDescriptor=60000, SystemLoadAverage=257, ProcessCount=168, AvailableMemoryMB=10822 2023-10-04 02:01:15,384 WARN [Listener at jenkins-hbase9.apache.org/33899] hbase.ResourceChecker(130): Thread=751 is superior to 500 2023-10-04 02:01:15,386 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39651] master.HMaster$4(2112): Client=jenkins//172.31.2.10 create 'testtb-testExportFileSystemStateWithMergeRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-10-04 02:01:15,387 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39651] procedure2.ProcedureExecutor(1028): Stored pid=57, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-10-04 02:01:15,390 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_PRE_OPERATION 2023-10-04 02:01:15,390 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39651] master.MasterRpcServices(700): Client=jenkins//172.31.2.10 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemStateWithMergeRegion" procId is: 57 2023-10-04 02:01:15,390 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-10-04 02:01:15,391 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39651] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-10-04 02:01:15,393 DEBUG [HFileArchiver-15] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/0111ae2bc128c718ba0469aa41d435ee 2023-10-04 02:01:15,393 DEBUG [HFileArchiver-16] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/a9dfc2e86ffa31dcf326539b4c556dd1 2023-10-04 02:01:15,394 DEBUG [HFileArchiver-15] backup.HFileArchiver(153): Directory hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/0111ae2bc128c718ba0469aa41d435ee empty. 2023-10-04 02:01:15,394 DEBUG [HFileArchiver-16] backup.HFileArchiver(153): Directory hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/a9dfc2e86ffa31dcf326539b4c556dd1 empty. 2023-10-04 02:01:15,394 DEBUG [HFileArchiver-15] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/0111ae2bc128c718ba0469aa41d435ee 2023-10-04 02:01:15,394 DEBUG [HFileArchiver-16] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/a9dfc2e86ffa31dcf326539b4c556dd1 2023-10-04 02:01:15,394 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion regions 2023-10-04 02:01:15,407 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/.tabledesc/.tableinfo.0000000001 2023-10-04 02:01:15,408 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(7675): creating {ENCODED => 0111ae2bc128c718ba0469aa41d435ee, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,,1696384875386.0111ae2bc128c718ba0469aa41d435ee.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/.tmp 2023-10-04 02:01:15,409 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(7675): creating {ENCODED => a9dfc2e86ffa31dcf326539b4c556dd1, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,1,1696384875386.a9dfc2e86ffa31dcf326539b4c556dd1.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/.tmp 2023-10-04 02:01:15,428 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,1,1696384875386.a9dfc2e86ffa31dcf326539b4c556dd1.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-04 02:01:15,428 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,,1696384875386.0111ae2bc128c718ba0469aa41d435ee.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-04 02:01:15,428 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1604): Closing a9dfc2e86ffa31dcf326539b4c556dd1, disabling compactions & flushes 2023-10-04 02:01:15,429 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1604): Closing 0111ae2bc128c718ba0469aa41d435ee, disabling compactions & flushes 2023-10-04 02:01:15,429 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,1,1696384875386.a9dfc2e86ffa31dcf326539b4c556dd1. 2023-10-04 02:01:15,429 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,,1696384875386.0111ae2bc128c718ba0469aa41d435ee. 2023-10-04 02:01:15,429 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1696384875386.a9dfc2e86ffa31dcf326539b4c556dd1. 2023-10-04 02:01:15,429 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,,1696384875386.0111ae2bc128c718ba0469aa41d435ee. 2023-10-04 02:01:15,429 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1696384875386.a9dfc2e86ffa31dcf326539b4c556dd1. after waiting 0 ms 2023-10-04 02:01:15,429 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,1,1696384875386.a9dfc2e86ffa31dcf326539b4c556dd1. 2023-10-04 02:01:15,429 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,,1696384875386.0111ae2bc128c718ba0469aa41d435ee. after waiting 0 ms 2023-10-04 02:01:15,429 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,1,1696384875386.a9dfc2e86ffa31dcf326539b4c556dd1. 2023-10-04 02:01:15,429 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1558): Region close journal for a9dfc2e86ffa31dcf326539b4c556dd1: 2023-10-04 02:01:15,429 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,,1696384875386.0111ae2bc128c718ba0469aa41d435ee. 2023-10-04 02:01:15,429 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,,1696384875386.0111ae2bc128c718ba0469aa41d435ee. 2023-10-04 02:01:15,429 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1558): Region close journal for 0111ae2bc128c718ba0469aa41d435ee: 2023-10-04 02:01:15,432 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_ADD_TO_META 2023-10-04 02:01:15,433 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1696384875386.a9dfc2e86ffa31dcf326539b4c556dd1.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1696384875433"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696384875433"}]},"ts":"1696384875433"} 2023-10-04 02:01:15,433 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1696384875386.0111ae2bc128c718ba0469aa41d435ee.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1696384875433"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696384875433"}]},"ts":"1696384875433"} 2023-10-04 02:01:15,442 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-10-04 02:01:15,443 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-10-04 02:01:15,443 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696384875443"}]},"ts":"1696384875443"} 2023-10-04 02:01:15,445 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=ENABLING in hbase:meta 2023-10-04 02:01:15,449 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase9.apache.org=0} racks are {/default-rack=0} 2023-10-04 02:01:15,450 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-10-04 02:01:15,450 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-10-04 02:01:15,450 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-10-04 02:01:15,450 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-10-04 02:01:15,450 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=58, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=0111ae2bc128c718ba0469aa41d435ee, ASSIGN}, {pid=59, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=a9dfc2e86ffa31dcf326539b4c556dd1, ASSIGN}] 2023-10-04 02:01:15,453 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=58, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=0111ae2bc128c718ba0469aa41d435ee, ASSIGN 2023-10-04 02:01:15,453 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=59, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=a9dfc2e86ffa31dcf326539b4c556dd1, ASSIGN 2023-10-04 02:01:15,454 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=58, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=0111ae2bc128c718ba0469aa41d435ee, ASSIGN; state=OFFLINE, location=jenkins-hbase9.apache.org,39045,1696384805392; forceNewPlan=false, retain=false 2023-10-04 02:01:15,454 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=59, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=a9dfc2e86ffa31dcf326539b4c556dd1, ASSIGN; state=OFFLINE, location=jenkins-hbase9.apache.org,35175,1696384805436; forceNewPlan=false, retain=false 2023-10-04 02:01:15,492 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39651] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-10-04 02:01:15,604 INFO [jenkins-hbase9:39651] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-10-04 02:01:15,607 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=58 updating hbase:meta row=0111ae2bc128c718ba0469aa41d435ee, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,39045,1696384805392 2023-10-04 02:01:15,607 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=59 updating hbase:meta row=a9dfc2e86ffa31dcf326539b4c556dd1, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,35175,1696384805436 2023-10-04 02:01:15,607 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1696384875386.a9dfc2e86ffa31dcf326539b4c556dd1.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1696384875607"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696384875607"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696384875607"}]},"ts":"1696384875607"} 2023-10-04 02:01:15,607 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1696384875386.0111ae2bc128c718ba0469aa41d435ee.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1696384875607"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696384875607"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696384875607"}]},"ts":"1696384875607"} 2023-10-04 02:01:15,609 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=60, ppid=59, state=RUNNABLE; OpenRegionProcedure a9dfc2e86ffa31dcf326539b4c556dd1, server=jenkins-hbase9.apache.org,35175,1696384805436}] 2023-10-04 02:01:15,610 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=61, ppid=58, state=RUNNABLE; OpenRegionProcedure 0111ae2bc128c718ba0469aa41d435ee, server=jenkins-hbase9.apache.org,39045,1696384805392}] 2023-10-04 02:01:15,694 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39651] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-10-04 02:01:15,768 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion,,1696384875386.0111ae2bc128c718ba0469aa41d435ee. 2023-10-04 02:01:15,768 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion,1,1696384875386.a9dfc2e86ffa31dcf326539b4c556dd1. 2023-10-04 02:01:15,768 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 0111ae2bc128c718ba0469aa41d435ee, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,,1696384875386.0111ae2bc128c718ba0469aa41d435ee.', STARTKEY => '', ENDKEY => '1'} 2023-10-04 02:01:15,768 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => a9dfc2e86ffa31dcf326539b4c556dd1, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,1,1696384875386.a9dfc2e86ffa31dcf326539b4c556dd1.', STARTKEY => '1', ENDKEY => ''} 2023-10-04 02:01:15,769 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion,,1696384875386.0111ae2bc128c718ba0469aa41d435ee. service=AccessControlService 2023-10-04 02:01:15,769 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion,1,1696384875386.a9dfc2e86ffa31dcf326539b4c556dd1. service=AccessControlService 2023-10-04 02:01:15,769 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-10-04 02:01:15,769 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-10-04 02:01:15,769 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion 0111ae2bc128c718ba0469aa41d435ee 2023-10-04 02:01:15,769 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion a9dfc2e86ffa31dcf326539b4c556dd1 2023-10-04 02:01:15,769 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,,1696384875386.0111ae2bc128c718ba0469aa41d435ee.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-04 02:01:15,769 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,1,1696384875386.a9dfc2e86ffa31dcf326539b4c556dd1.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-04 02:01:15,769 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7894): checking encryption for 0111ae2bc128c718ba0469aa41d435ee 2023-10-04 02:01:15,769 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7894): checking encryption for a9dfc2e86ffa31dcf326539b4c556dd1 2023-10-04 02:01:15,769 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7897): checking classloading for 0111ae2bc128c718ba0469aa41d435ee 2023-10-04 02:01:15,769 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7897): checking classloading for a9dfc2e86ffa31dcf326539b4c556dd1 2023-10-04 02:01:15,771 INFO [StoreOpener-a9dfc2e86ffa31dcf326539b4c556dd1-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region a9dfc2e86ffa31dcf326539b4c556dd1 2023-10-04 02:01:15,771 INFO [StoreOpener-0111ae2bc128c718ba0469aa41d435ee-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 0111ae2bc128c718ba0469aa41d435ee 2023-10-04 02:01:15,776 DEBUG [StoreOpener-a9dfc2e86ffa31dcf326539b4c556dd1-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/data/default/testtb-testExportFileSystemStateWithMergeRegion/a9dfc2e86ffa31dcf326539b4c556dd1/cf 2023-10-04 02:01:15,776 DEBUG [StoreOpener-0111ae2bc128c718ba0469aa41d435ee-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/data/default/testtb-testExportFileSystemStateWithMergeRegion/0111ae2bc128c718ba0469aa41d435ee/cf 2023-10-04 02:01:15,776 DEBUG [StoreOpener-0111ae2bc128c718ba0469aa41d435ee-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/data/default/testtb-testExportFileSystemStateWithMergeRegion/0111ae2bc128c718ba0469aa41d435ee/cf 2023-10-04 02:01:15,776 DEBUG [StoreOpener-a9dfc2e86ffa31dcf326539b4c556dd1-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/data/default/testtb-testExportFileSystemStateWithMergeRegion/a9dfc2e86ffa31dcf326539b4c556dd1/cf 2023-10-04 02:01:15,777 INFO [StoreOpener-0111ae2bc128c718ba0469aa41d435ee-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 0111ae2bc128c718ba0469aa41d435ee columnFamilyName cf 2023-10-04 02:01:15,777 INFO [StoreOpener-a9dfc2e86ffa31dcf326539b4c556dd1-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region a9dfc2e86ffa31dcf326539b4c556dd1 columnFamilyName cf 2023-10-04 02:01:15,779 INFO [StoreOpener-a9dfc2e86ffa31dcf326539b4c556dd1-1] regionserver.HStore(310): Store=a9dfc2e86ffa31dcf326539b4c556dd1/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-04 02:01:15,779 INFO [StoreOpener-0111ae2bc128c718ba0469aa41d435ee-1] regionserver.HStore(310): Store=0111ae2bc128c718ba0469aa41d435ee/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-04 02:01:15,780 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/data/default/testtb-testExportFileSystemStateWithMergeRegion/a9dfc2e86ffa31dcf326539b4c556dd1 2023-10-04 02:01:15,780 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/data/default/testtb-testExportFileSystemStateWithMergeRegion/0111ae2bc128c718ba0469aa41d435ee 2023-10-04 02:01:15,780 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/data/default/testtb-testExportFileSystemStateWithMergeRegion/a9dfc2e86ffa31dcf326539b4c556dd1 2023-10-04 02:01:15,780 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/data/default/testtb-testExportFileSystemStateWithMergeRegion/0111ae2bc128c718ba0469aa41d435ee 2023-10-04 02:01:15,783 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1055): writing seq id for 0111ae2bc128c718ba0469aa41d435ee 2023-10-04 02:01:15,783 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1055): writing seq id for a9dfc2e86ffa31dcf326539b4c556dd1 2023-10-04 02:01:15,785 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/data/default/testtb-testExportFileSystemStateWithMergeRegion/0111ae2bc128c718ba0469aa41d435ee/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-04 02:01:15,785 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/data/default/testtb-testExportFileSystemStateWithMergeRegion/a9dfc2e86ffa31dcf326539b4c556dd1/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-04 02:01:15,785 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1072): Opened 0111ae2bc128c718ba0469aa41d435ee; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65367541, jitterRate=-0.025947734713554382}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-10-04 02:01:15,785 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1072): Opened a9dfc2e86ffa31dcf326539b4c556dd1; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60925312, jitterRate=-0.09214210510253906}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-10-04 02:01:15,785 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(965): Region open journal for 0111ae2bc128c718ba0469aa41d435ee: 2023-10-04 02:01:15,786 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(965): Region open journal for a9dfc2e86ffa31dcf326539b4c556dd1: 2023-10-04 02:01:15,786 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion,1,1696384875386.a9dfc2e86ffa31dcf326539b4c556dd1., pid=60, masterSystemTime=1696384875761 2023-10-04 02:01:15,787 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion,,1696384875386.0111ae2bc128c718ba0469aa41d435ee., pid=61, masterSystemTime=1696384875761 2023-10-04 02:01:15,788 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion,1,1696384875386.a9dfc2e86ffa31dcf326539b4c556dd1. 2023-10-04 02:01:15,788 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion,1,1696384875386.a9dfc2e86ffa31dcf326539b4c556dd1. 2023-10-04 02:01:15,789 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=59 updating hbase:meta row=a9dfc2e86ffa31dcf326539b4c556dd1, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase9.apache.org,35175,1696384805436 2023-10-04 02:01:15,789 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion,,1696384875386.0111ae2bc128c718ba0469aa41d435ee. 2023-10-04 02:01:15,789 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion,,1696384875386.0111ae2bc128c718ba0469aa41d435ee. 2023-10-04 02:01:15,789 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1696384875386.a9dfc2e86ffa31dcf326539b4c556dd1.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1696384875789"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1696384875789"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1696384875789"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1696384875789"}]},"ts":"1696384875789"} 2023-10-04 02:01:15,789 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=58 updating hbase:meta row=0111ae2bc128c718ba0469aa41d435ee, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase9.apache.org,39045,1696384805392 2023-10-04 02:01:15,790 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1696384875386.0111ae2bc128c718ba0469aa41d435ee.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1696384875789"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1696384875789"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1696384875789"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1696384875789"}]},"ts":"1696384875789"} 2023-10-04 02:01:15,793 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=60, resume processing ppid=59 2023-10-04 02:01:15,793 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=60, ppid=59, state=SUCCESS; OpenRegionProcedure a9dfc2e86ffa31dcf326539b4c556dd1, server=jenkins-hbase9.apache.org,35175,1696384805436 in 182 msec 2023-10-04 02:01:15,793 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=61, resume processing ppid=58 2023-10-04 02:01:15,793 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=61, ppid=58, state=SUCCESS; OpenRegionProcedure 0111ae2bc128c718ba0469aa41d435ee, server=jenkins-hbase9.apache.org,39045,1696384805392 in 182 msec 2023-10-04 02:01:15,794 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=59, ppid=57, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=a9dfc2e86ffa31dcf326539b4c556dd1, ASSIGN in 343 msec 2023-10-04 02:01:15,795 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=58, resume processing ppid=57 2023-10-04 02:01:15,795 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=58, ppid=57, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=0111ae2bc128c718ba0469aa41d435ee, ASSIGN in 343 msec 2023-10-04 02:01:15,796 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-10-04 02:01:15,796 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696384875796"}]},"ts":"1696384875796"} 2023-10-04 02:01:15,797 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=ENABLED in hbase:meta 2023-10-04 02:01:15,799 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_POST_OPERATION 2023-10-04 02:01:15,799 DEBUG [PEWorker-3] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemStateWithMergeRegion jenkins: RWXCA 2023-10-04 02:01:15,801 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=44303] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion], kv [jenkins: RWXCA] 2023-10-04 02:01:15,803 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): regionserver:44303-0x1010f1b55330001, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-04 02:01:15,803 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): master:39651-0x1010f1b55330000, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-04 02:01:15,803 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): regionserver:35175-0x1010f1b55330003, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-04 02:01:15,803 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): regionserver:39045-0x1010f1b55330002, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-04 02:01:15,804 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-10-04 02:01:15,805 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-10-04 02:01:15,804 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-10-04 02:01:15,805 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-10-04 02:01:15,806 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=57, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion in 418 msec 2023-10-04 02:01:15,995 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39651] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-10-04 02:01:15,995 INFO [Listener at jenkins-hbase9.apache.org/33899] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion, procId: 57 completed 2023-10-04 02:01:15,997 DEBUG [Listener at jenkins-hbase9.apache.org/33899] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithMergeRegion 2023-10-04 02:01:15,998 DEBUG [Listener at jenkins-hbase9.apache.org/33899] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithMergeRegion,,1696384875386.0111ae2bc128c718ba0469aa41d435ee. 2023-10-04 02:01:16,000 INFO [Listener at jenkins-hbase9.apache.org/33899] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-10-04 02:01:16,011 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39651] master.MasterRpcServices(1583): Client=jenkins//172.31.2.10 snapshot request for:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-10-04 02:01:16,011 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39651] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1696384876011 (current time:1696384876011). 2023-10-04 02:01:16,012 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39651] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-10-04 02:01:16,012 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39651] zookeeper.ReadOnlyZKClient(139): Connect 0x29658f7d to 127.0.0.1:60027 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-04 02:01:16,021 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39651] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@13b7bd97, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-04 02:01:16,022 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39651] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-04 02:01:16,025 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:35060, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-04 02:01:16,026 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39651] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x29658f7d to 127.0.0.1:60027 2023-10-04 02:01:16,026 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39651] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-04 02:01:16,027 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39651] zookeeper.ReadOnlyZKClient(139): Connect 0x4c3f477b to 127.0.0.1:60027 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-04 02:01:16,032 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39651] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@492427e6, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-04 02:01:16,033 DEBUG [hconnection-0x67d16050-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-04 02:01:16,036 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:35074, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-04 02:01:16,040 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39651] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4c3f477b to 127.0.0.1:60027 2023-10-04 02:01:16,040 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39651] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-04 02:01:16,040 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39651] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion], kv [jenkins: RWXCA] 2023-10-04 02:01:16,041 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39651] snapshot.SnapshotManager(637): No existing snapshot, attempting snapshot... 2023-10-04 02:01:16,041 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39651] snapshot.SnapshotManager(684): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-10-04 02:01:16,043 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39651] snapshot.SnapshotManager(519): Unable to retrieve ACL status for path: hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/.hbase-snapshot, current working dir path: hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion org.apache.hadoop.hdfs.protocol.AclException: The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.ipc.RemoteException.instantiateException(RemoteException.java:121) at org.apache.hadoop.ipc.RemoteException.unwrapRemoteException(RemoteException.java:88) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2736) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2294) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2291) at org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81) at org.apache.hadoop.hdfs.DistributedFileSystem.getAclStatus(DistributedFileSystem.java:2291) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.updateWorkingDirAclsIfRequired(SnapshotManager.java:517) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.prepareToTakeSnapshot(SnapshotManager.java:490) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.snapshotEnabledTable(SnapshotManager.java:559) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshotInternal(SnapshotManager.java:687) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshot(SnapshotManager.java:623) at org.apache.hadoop.hbase.master.MasterRpcServices.snapshot(MasterRpcServices.java:1588) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) Caused by: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.hdfs.protocol.AclException): The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at org.apache.hadoop.ipc.Client.getRpcResponse(Client.java:1540) at org.apache.hadoop.ipc.Client.call(Client.java:1486) at org.apache.hadoop.ipc.Client.call(Client.java:1385) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:232) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:118) at com.sun.proxy.$Proxy32.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.getAclStatus(ClientNamenodeProtocolTranslatorPB.java:1385) at sun.reflect.GeneratedMethodAccessor61.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:422) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeMethod(RetryInvocationHandler.java:165) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invoke(RetryInvocationHandler.java:157) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeOnce(RetryInvocationHandler.java:95) at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:359) at com.sun.proxy.$Proxy35.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor61.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor61.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor61.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor61.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor61.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2734) ... 15 more 2023-10-04 02:01:16,045 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39651] procedure2.ProcedureExecutor(1028): Stored pid=62, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-10-04 02:01:16,046 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=62, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-10-04 02:01:16,046 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=62, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE; timeout=600000, timestamp=1696385476046 2023-10-04 02:01:16,046 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39651] snapshot.SnapshotManager(689): Started snapshot: { ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-10-04 02:01:16,046 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion 2023-10-04 02:01:16,048 DEBUG [Listener at jenkins-hbase9.apache.org/33899] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-10-04 02:01:16,048 DEBUG [Listener at jenkins-hbase9.apache.org/33899] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-10-04 02:01:16,049 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=62, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-10-04 02:01:16,049 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] procedure2.ProcedureExecutor(1028): Stored pid=63, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-10-04 02:01:16,050 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=62, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE in 5 msec 2023-10-04 02:01:16,050 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=63, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-10-04 02:01:16,051 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=63, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED; timeout=600000, timestamp=1696385476051 2023-10-04 02:01:16,059 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 02:01:16,059 INFO [(jenkins-hbase9.apache.org,39651,1696384803959)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' 2023-10-04 02:01:16,060 DEBUG [(jenkins-hbase9.apache.org,39651,1696384803959)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-04 02:01:16,061 DEBUG [(jenkins-hbase9.apache.org,39651,1696384803959)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' 2023-10-04 02:01:16,061 DEBUG [(jenkins-hbase9.apache.org,39651,1696384803959)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion', kicking off acquire phase on members. 2023-10-04 02:01:16,061 DEBUG [(jenkins-hbase9.apache.org,39651,1696384803959)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39651-0x1010f1b55330000, quorum=127.0.0.1:60027, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 02:01:16,061 DEBUG [(jenkins-hbase9.apache.org,39651,1696384803959)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 02:01:16,064 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): regionserver:44303-0x1010f1b55330001, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-04 02:01:16,064 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): regionserver:35175-0x1010f1b55330003, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-04 02:01:16,064 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-04 02:01:16,064 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-04 02:01:16,064 DEBUG [(jenkins-hbase9.apache.org,39651,1696384803959)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,39045,1696384805392 2023-10-04 02:01:16,064 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): regionserver:39045-0x1010f1b55330002, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-04 02:01:16,064 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-04 02:01:16,065 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-04 02:01:16,065 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-04 02:01:16,065 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-04 02:01:16,065 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 02:01:16,065 DEBUG [(jenkins-hbase9.apache.org,39651,1696384803959)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39651-0x1010f1b55330000, quorum=127.0.0.1:60027, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,39045,1696384805392 2023-10-04 02:01:16,065 DEBUG [(jenkins-hbase9.apache.org,39651,1696384803959)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,35175,1696384805436 2023-10-04 02:01:16,065 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 02:01:16,065 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 02:01:16,065 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44303-0x1010f1b55330001, quorum=127.0.0.1:60027, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 02:01:16,065 DEBUG [(jenkins-hbase9.apache.org,39651,1696384803959)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39651-0x1010f1b55330000, quorum=127.0.0.1:60027, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,35175,1696384805436 2023-10-04 02:01:16,065 DEBUG [(jenkins-hbase9.apache.org,39651,1696384803959)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-04 02:01:16,065 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39045-0x1010f1b55330002, quorum=127.0.0.1:60027, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 02:01:16,066 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35175-0x1010f1b55330003, quorum=127.0.0.1:60027, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 02:01:16,066 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 219 2023-10-04 02:01:16,066 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 02:01:16,066 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 219 2023-10-04 02:01:16,066 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 219 2023-10-04 02:01:16,066 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 02:01:16,066 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 02:01:16,066 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-10-04 02:01:16,066 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-10-04 02:01:16,066 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-10-04 02:01:16,066 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 02:01:16,066 DEBUG [member: 'jenkins-hbase9.apache.org,44303,1696384805319' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-10-04 02:01:16,066 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 02:01:16,066 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 02:01:16,066 DEBUG [member: 'jenkins-hbase9.apache.org,44303,1696384805319' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-04 02:01:16,067 DEBUG [member: 'jenkins-hbase9.apache.org,35175,1696384805436' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-10-04 02:01:16,068 DEBUG [member: 'jenkins-hbase9.apache.org,44303,1696384805319' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-10-04 02:01:16,068 DEBUG [member: 'jenkins-hbase9.apache.org,44303,1696384805319' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-10-04 02:01:16,066 DEBUG [member: 'jenkins-hbase9.apache.org,39045,1696384805392' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-10-04 02:01:16,068 DEBUG [member: 'jenkins-hbase9.apache.org,44303,1696384805319' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,44303,1696384805319' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-10-04 02:01:16,068 DEBUG [member: 'jenkins-hbase9.apache.org,35175,1696384805436' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-04 02:01:16,068 DEBUG [member: 'jenkins-hbase9.apache.org,39045,1696384805392' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-04 02:01:16,069 DEBUG [member: 'jenkins-hbase9.apache.org,35175,1696384805436' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-10-04 02:01:16,070 DEBUG [member: 'jenkins-hbase9.apache.org,35175,1696384805436' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-10-04 02:01:16,070 DEBUG [member: 'jenkins-hbase9.apache.org,39045,1696384805392' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-10-04 02:01:16,070 DEBUG [member: 'jenkins-hbase9.apache.org,39045,1696384805392' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-10-04 02:01:16,070 DEBUG [member: 'jenkins-hbase9.apache.org,35175,1696384805436' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,35175,1696384805436' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-10-04 02:01:16,070 DEBUG [member: 'jenkins-hbase9.apache.org,39045,1696384805392' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,39045,1696384805392' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-10-04 02:01:16,072 DEBUG [member: 'jenkins-hbase9.apache.org,44303,1696384805319' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 02:01:16,073 DEBUG [member: 'jenkins-hbase9.apache.org,39045,1696384805392' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 02:01:16,073 DEBUG [member: 'jenkins-hbase9.apache.org,44303,1696384805319' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44303-0x1010f1b55330001, quorum=127.0.0.1:60027, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 02:01:16,073 DEBUG [member: 'jenkins-hbase9.apache.org,44303,1696384805319' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-04 02:01:16,073 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): master:39651-0x1010f1b55330000, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,39045,1696384805392 2023-10-04 02:01:16,073 DEBUG [member: 'jenkins-hbase9.apache.org,35175,1696384805436' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 02:01:16,074 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,39045,1696384805392 2023-10-04 02:01:16,074 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-04 02:01:16,074 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-04 02:01:16,074 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): master:39651-0x1010f1b55330000, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,35175,1696384805436 2023-10-04 02:01:16,074 DEBUG [member: 'jenkins-hbase9.apache.org,39045,1696384805392' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39045-0x1010f1b55330002, quorum=127.0.0.1:60027, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 02:01:16,074 DEBUG [member: 'jenkins-hbase9.apache.org,39045,1696384805392' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-04 02:01:16,074 DEBUG [member: 'jenkins-hbase9.apache.org,35175,1696384805436' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35175-0x1010f1b55330003, quorum=127.0.0.1:60027, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 02:01:16,074 DEBUG [member: 'jenkins-hbase9.apache.org,35175,1696384805436' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-04 02:01:16,074 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-04 02:01:16,074 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-04 02:01:16,074 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 02:01:16,075 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,39045,1696384805392 2023-10-04 02:01:16,075 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,35175,1696384805436 2023-10-04 02:01:16,075 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44303,1696384805319 2023-10-04 02:01:16,076 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-04 02:01:16,076 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,39045,1696384805392' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-10-04 02:01:16,076 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3db3eb4a[Count = 1] remaining members to acquire global barrier 2023-10-04 02:01:16,076 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,35175,1696384805436 2023-10-04 02:01:16,076 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-04 02:01:16,076 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-04 02:01:16,076 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-04 02:01:16,076 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-04 02:01:16,077 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 02:01:16,077 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,39045,1696384805392 2023-10-04 02:01:16,077 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,35175,1696384805436 2023-10-04 02:01:16,077 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44303,1696384805319 2023-10-04 02:01:16,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-04 02:01:16,078 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,35175,1696384805436' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-10-04 02:01:16,078 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3db3eb4a[Count = 0] remaining members to acquire global barrier 2023-10-04 02:01:16,078 DEBUG [(jenkins-hbase9.apache.org,39651,1696384803959)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'in-barrier' execution. 2023-10-04 02:01:16,078 DEBUG [(jenkins-hbase9.apache.org,39651,1696384803959)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 02:01:16,080 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): regionserver:39045-0x1010f1b55330002, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 02:01:16,080 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): regionserver:35175-0x1010f1b55330003, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 02:01:16,080 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 02:01:16,080 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): regionserver:44303-0x1010f1b55330001, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 02:01:16,080 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 02:01:16,080 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 02:01:16,080 DEBUG [member: 'jenkins-hbase9.apache.org,39045,1696384805392' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-10-04 02:01:16,080 DEBUG [(jenkins-hbase9.apache.org,39651,1696384803959)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39651-0x1010f1b55330000, quorum=127.0.0.1:60027, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,39045,1696384805392 2023-10-04 02:01:16,080 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 02:01:16,080 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 02:01:16,080 DEBUG [member: 'jenkins-hbase9.apache.org,35175,1696384805436' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-10-04 02:01:16,080 DEBUG [member: 'jenkins-hbase9.apache.org,39045,1696384805392' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-04 02:01:16,081 DEBUG [rs(jenkins-hbase9.apache.org,39045,1696384805392)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1696384875386.0111ae2bc128c718ba0469aa41d435ee. 2023-10-04 02:01:16,081 DEBUG [member: 'jenkins-hbase9.apache.org,35175,1696384805436' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-04 02:01:16,081 DEBUG [rs(jenkins-hbase9.apache.org,39045,1696384805392)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1696384875386.0111ae2bc128c718ba0469aa41d435ee. started... 2023-10-04 02:01:16,081 DEBUG [rs(jenkins-hbase9.apache.org,35175,1696384805436)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1696384875386.a9dfc2e86ffa31dcf326539b4c556dd1. 2023-10-04 02:01:16,080 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 02:01:16,081 DEBUG [rs(jenkins-hbase9.apache.org,35175,1696384805436)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1696384875386.a9dfc2e86ffa31dcf326539b4c556dd1. started... 2023-10-04 02:01:16,081 DEBUG [rs(jenkins-hbase9.apache.org,39045,1696384805392)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 0111ae2bc128c718ba0469aa41d435ee: 2023-10-04 02:01:16,081 DEBUG [member: 'jenkins-hbase9.apache.org,35175,1696384805436' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-04 02:01:16,081 DEBUG [(jenkins-hbase9.apache.org,39651,1696384803959)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39651-0x1010f1b55330000, quorum=127.0.0.1:60027, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,35175,1696384805436 2023-10-04 02:01:16,082 DEBUG [(jenkins-hbase9.apache.org,39651,1696384803959)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-04 02:01:16,082 DEBUG [rs(jenkins-hbase9.apache.org,35175,1696384805436)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for a9dfc2e86ffa31dcf326539b4c556dd1: 2023-10-04 02:01:16,081 DEBUG [member: 'jenkins-hbase9.apache.org,39045,1696384805392' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-04 02:01:16,082 DEBUG [rs(jenkins-hbase9.apache.org,39045,1696384805392)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,,1696384875386.0111ae2bc128c718ba0469aa41d435ee.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 02:01:16,081 DEBUG [member: 'jenkins-hbase9.apache.org,44303,1696384805319' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-10-04 02:01:16,082 DEBUG [rs(jenkins-hbase9.apache.org,39045,1696384805392)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-04 02:01:16,082 DEBUG [rs(jenkins-hbase9.apache.org,35175,1696384805436)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,1,1696384875386.a9dfc2e86ffa31dcf326539b4c556dd1.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 02:01:16,082 DEBUG [member: 'jenkins-hbase9.apache.org,44303,1696384805319' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-10-04 02:01:16,083 DEBUG [member: 'jenkins-hbase9.apache.org,44303,1696384805319' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase9.apache.org,44303,1696384805319' in zk 2023-10-04 02:01:16,083 DEBUG [rs(jenkins-hbase9.apache.org,35175,1696384805436)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-04 02:01:16,082 DEBUG [rs(jenkins-hbase9.apache.org,39045,1696384805392)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-10-04 02:01:16,083 DEBUG [rs(jenkins-hbase9.apache.org,35175,1696384805436)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-10-04 02:01:16,091 DEBUG [member: 'jenkins-hbase9.apache.org,44303,1696384805319' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-10-04 02:01:16,091 DEBUG [member: 'jenkins-hbase9.apache.org,44303,1696384805319' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-04 02:01:16,093 DEBUG [member: 'jenkins-hbase9.apache.org,44303,1696384805319' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-10-04 02:01:16,104 DEBUG [rs(jenkins-hbase9.apache.org,39045,1696384805392)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1696384875386.0111ae2bc128c718ba0469aa41d435ee. completed. 2023-10-04 02:01:16,104 DEBUG [rs(jenkins-hbase9.apache.org,39045,1696384805392)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1696384875386.0111ae2bc128c718ba0469aa41d435ee. 2023-10-04 02:01:16,104 DEBUG [member: 'jenkins-hbase9.apache.org,39045,1696384805392' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-04 02:01:16,104 DEBUG [member: 'jenkins-hbase9.apache.org,39045,1696384805392' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-04 02:01:16,104 DEBUG [member: 'jenkins-hbase9.apache.org,39045,1696384805392' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase9.apache.org,39045,1696384805392 2023-10-04 02:01:16,104 DEBUG [member: 'jenkins-hbase9.apache.org,39045,1696384805392' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-10-04 02:01:16,105 DEBUG [member: 'jenkins-hbase9.apache.org,39045,1696384805392' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase9.apache.org,39045,1696384805392' in zk 2023-10-04 02:01:16,105 DEBUG [rs(jenkins-hbase9.apache.org,35175,1696384805436)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1696384875386.a9dfc2e86ffa31dcf326539b4c556dd1. completed. 2023-10-04 02:01:16,105 DEBUG [rs(jenkins-hbase9.apache.org,35175,1696384805436)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1696384875386.a9dfc2e86ffa31dcf326539b4c556dd1. 2023-10-04 02:01:16,105 DEBUG [member: 'jenkins-hbase9.apache.org,35175,1696384805436' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-04 02:01:16,105 DEBUG [member: 'jenkins-hbase9.apache.org,35175,1696384805436' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-04 02:01:16,105 DEBUG [member: 'jenkins-hbase9.apache.org,35175,1696384805436' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase9.apache.org,35175,1696384805436 2023-10-04 02:01:16,105 DEBUG [member: 'jenkins-hbase9.apache.org,35175,1696384805436' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-10-04 02:01:16,105 DEBUG [member: 'jenkins-hbase9.apache.org,35175,1696384805436' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase9.apache.org,35175,1696384805436' in zk 2023-10-04 02:01:16,107 DEBUG [member: 'jenkins-hbase9.apache.org,39045,1696384805392' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-10-04 02:01:16,107 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): master:39651-0x1010f1b55330000, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,39045,1696384805392 2023-10-04 02:01:16,107 DEBUG [member: 'jenkins-hbase9.apache.org,39045,1696384805392' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-04 02:01:16,107 DEBUG [member: 'jenkins-hbase9.apache.org,39045,1696384805392' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-10-04 02:01:16,107 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,39045,1696384805392 2023-10-04 02:01:16,108 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-04 02:01:16,108 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-04 02:01:16,109 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): master:39651-0x1010f1b55330000, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,35175,1696384805436 2023-10-04 02:01:16,109 DEBUG [member: 'jenkins-hbase9.apache.org,35175,1696384805436' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-10-04 02:01:16,109 DEBUG [member: 'jenkins-hbase9.apache.org,35175,1696384805436' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-04 02:01:16,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-04 02:01:16,109 DEBUG [member: 'jenkins-hbase9.apache.org,35175,1696384805436' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-10-04 02:01:16,110 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-04 02:01:16,110 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 02:01:16,110 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,39045,1696384805392 2023-10-04 02:01:16,111 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,35175,1696384805436 2023-10-04 02:01:16,111 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44303,1696384805319 2023-10-04 02:01:16,111 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-04 02:01:16,111 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 02:01:16,111 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,39045,1696384805392 2023-10-04 02:01:16,112 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,35175,1696384805436 2023-10-04 02:01:16,112 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44303,1696384805319 2023-10-04 02:01:16,112 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase9.apache.org,39045,1696384805392': 2023-10-04 02:01:16,112 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,39045,1696384805392' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 1 more 2023-10-04 02:01:16,113 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,35175,1696384805436 2023-10-04 02:01:16,113 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-04 02:01:16,113 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-04 02:01:16,113 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-04 02:01:16,113 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-04 02:01:16,113 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 02:01:16,113 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,39045,1696384805392 2023-10-04 02:01:16,114 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,35175,1696384805436 2023-10-04 02:01:16,114 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44303,1696384805319 2023-10-04 02:01:16,114 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-04 02:01:16,114 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 02:01:16,114 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,39045,1696384805392 2023-10-04 02:01:16,115 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,35175,1696384805436 2023-10-04 02:01:16,115 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44303,1696384805319 2023-10-04 02:01:16,115 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase9.apache.org,35175,1696384805436': 2023-10-04 02:01:16,115 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,35175,1696384805436' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 0 more 2023-10-04 02:01:16,115 INFO [(jenkins-hbase9.apache.org,39651,1696384803959)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' execution completed 2023-10-04 02:01:16,116 DEBUG [(jenkins-hbase9.apache.org,39651,1696384803959)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-04 02:01:16,116 DEBUG [(jenkins-hbase9.apache.org,39651,1696384803959)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-04 02:01:16,116 DEBUG [(jenkins-hbase9.apache.org,39651,1696384803959)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 02:01:16,116 INFO [(jenkins-hbase9.apache.org,39651,1696384803959)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportFileSystemStateWithMergeRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-10-04 02:01:16,118 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): regionserver:39045-0x1010f1b55330002, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 02:01:16,118 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): regionserver:44303-0x1010f1b55330001, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 02:01:16,118 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): regionserver:39045-0x1010f1b55330002, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-04 02:01:16,118 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 02:01:16,118 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): master:39651-0x1010f1b55330000, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 02:01:16,118 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): regionserver:35175-0x1010f1b55330003, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 02:01:16,118 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 02:01:16,118 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): regionserver:35175-0x1010f1b55330003, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-04 02:01:16,118 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-04 02:01:16,118 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-04 02:01:16,118 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 02:01:16,118 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 02:01:16,118 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 02:01:16,118 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 02:01:16,118 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): regionserver:44303-0x1010f1b55330001, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-04 02:01:16,118 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 02:01:16,118 DEBUG [(jenkins-hbase9.apache.org,39651,1696384803959)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39651-0x1010f1b55330000, quorum=127.0.0.1:60027, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,39045,1696384805392 2023-10-04 02:01:16,118 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-04 02:01:16,119 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-04 02:01:16,119 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-04 02:01:16,119 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-04 02:01:16,119 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-04 02:01:16,119 DEBUG [(jenkins-hbase9.apache.org,39651,1696384803959)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39651-0x1010f1b55330000, quorum=127.0.0.1:60027, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,35175,1696384805436 2023-10-04 02:01:16,119 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-04 02:01:16,119 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-04 02:01:16,119 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 02:01:16,119 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 02:01:16,119 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 02:01:16,119 DEBUG [(jenkins-hbase9.apache.org,39651,1696384803959)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39651-0x1010f1b55330000, quorum=127.0.0.1:60027, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,44303,1696384805319 2023-10-04 02:01:16,120 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 02:01:16,120 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-04 02:01:16,120 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 02:01:16,121 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,39045,1696384805392 2023-10-04 02:01:16,121 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,35175,1696384805436 2023-10-04 02:01:16,121 DEBUG [(jenkins-hbase9.apache.org,39651,1696384803959)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39651-0x1010f1b55330000, quorum=127.0.0.1:60027, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,39045,1696384805392 2023-10-04 02:01:16,121 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44303,1696384805319 2023-10-04 02:01:16,122 DEBUG [(jenkins-hbase9.apache.org,39651,1696384803959)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39651-0x1010f1b55330000, quorum=127.0.0.1:60027, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,35175,1696384805436 2023-10-04 02:01:16,122 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-04 02:01:16,122 DEBUG [(jenkins-hbase9.apache.org,39651,1696384803959)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39651-0x1010f1b55330000, quorum=127.0.0.1:60027, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,44303,1696384805319 2023-10-04 02:01:16,122 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 02:01:16,122 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,39045,1696384805392 2023-10-04 02:01:16,122 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,35175,1696384805436 2023-10-04 02:01:16,123 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44303,1696384805319 2023-10-04 02:01:16,125 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): master:39651-0x1010f1b55330000, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,44303,1696384805319 2023-10-04 02:01:16,125 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): regionserver:39045-0x1010f1b55330002, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-04 02:01:16,126 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): regionserver:35175-0x1010f1b55330003, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-04 02:01:16,126 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): regionserver:44303-0x1010f1b55330001, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-04 02:01:16,126 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): master:39651-0x1010f1b55330000, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 02:01:16,126 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-04 02:01:16,126 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-04 02:01:16,126 DEBUG [(jenkins-hbase9.apache.org,39651,1696384803959)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-04 02:01:16,126 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): master:39651-0x1010f1b55330000, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,35175,1696384805436 2023-10-04 02:01:16,126 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): regionserver:44303-0x1010f1b55330001, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-04 02:01:16,126 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): regionserver:39045-0x1010f1b55330002, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-04 02:01:16,126 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): regionserver:35175-0x1010f1b55330003, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-04 02:01:16,126 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-04 02:01:16,128 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-04 02:01:16,127 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): master:39651-0x1010f1b55330000, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,39045,1696384805392 2023-10-04 02:01:16,126 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-04 02:01:16,126 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 02:01:16,126 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-04 02:01:16,129 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemStateWithMergeRegion 2023-10-04 02:01:16,129 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): master:39651-0x1010f1b55330000, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 02:01:16,129 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): master:39651-0x1010f1b55330000, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,44303,1696384805319 2023-10-04 02:01:16,129 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => aaca68e56e63a701f5c1ec9dc2f0511c, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,.mob,0.aaca68e56e63a701f5c1ec9dc2f0511c.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 02:01:16,129 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-04 02:01:16,129 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-04 02:01:16,129 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): master:39651-0x1010f1b55330000, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 02:01:16,129 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-04 02:01:16,129 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-04 02:01:16,129 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-10-04 02:01:16,129 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-04 02:01:16,129 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): master:39651-0x1010f1b55330000, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,35175,1696384805436 2023-10-04 02:01:16,129 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-04 02:01:16,129 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): master:39651-0x1010f1b55330000, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,39045,1696384805392 2023-10-04 02:01:16,129 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): master:39651-0x1010f1b55330000, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 02:01:16,129 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): master:39651-0x1010f1b55330000, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 02:01:16,130 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-10-04 02:01:16,137 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 02:01:16,137 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 02:01:16,148 DEBUG [Listener at jenkins-hbase9.apache.org/33899] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-04 02:01:16,150 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39651] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-10-04 02:01:16,150 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39651] snapshot.SnapshotManager(406): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-10-04 02:01:16,150 DEBUG [Listener at jenkins-hbase9.apache.org/33899] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-10-04 02:01:16,158 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion to hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/.hbase-snapshot/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 02:01:16,159 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed 2023-10-04 02:01:16,159 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 02:01:16,160 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 02:01:16,160 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion at 1696384876047Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemStateWithMergeRegion at 1696384876137 (+90 ms)Consolidate snapshot: emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1696384876137Loading Region manifests for emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1696384876137Writing data manifest for emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1696384876141 (+4 ms)Verifying snapshot: emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1696384876153 (+12 ms)Snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed at 1696384876159 (+6 ms) 2023-10-04 02:01:16,162 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=63, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-10-04 02:01:16,163 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=63, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED in 115 msec 2023-10-04 02:01:16,350 DEBUG [Listener at jenkins-hbase9.apache.org/33899] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-04 02:01:16,352 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39651] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-10-04 02:01:16,352 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39651] snapshot.SnapshotManager(403): Snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' has completed, notifying client. 2023-10-04 02:01:16,354 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39045] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithMergeRegion,,1696384875386.0111ae2bc128c718ba0469aa41d435ee. with WAL disabled. Data may be lost in the event of a crash. 2023-10-04 02:01:16,355 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35175] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithMergeRegion,1,1696384875386.a9dfc2e86ffa31dcf326539b4c556dd1. with WAL disabled. Data may be lost in the event of a crash. 2023-10-04 02:01:16,358 DEBUG [Listener at jenkins-hbase9.apache.org/33899] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithMergeRegion 2023-10-04 02:01:16,358 DEBUG [Listener at jenkins-hbase9.apache.org/33899] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithMergeRegion,,1696384875386.0111ae2bc128c718ba0469aa41d435ee. 2023-10-04 02:01:16,358 INFO [Listener at jenkins-hbase9.apache.org/33899] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-10-04 02:01:16,368 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39651] master.MasterRpcServices(1583): Client=jenkins//172.31.2.10 snapshot request for:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-10-04 02:01:16,368 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39651] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1696384876368 (current time:1696384876368). 2023-10-04 02:01:16,368 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39651] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-10-04 02:01:16,369 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39651] zookeeper.ReadOnlyZKClient(139): Connect 0x0f0efed2 to 127.0.0.1:60027 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-04 02:01:16,375 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39651] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4747b2f3, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-04 02:01:16,376 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39651] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-04 02:01:16,377 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:35082, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-04 02:01:16,378 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39651] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x0f0efed2 to 127.0.0.1:60027 2023-10-04 02:01:16,378 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39651] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-04 02:01:16,379 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39651] zookeeper.ReadOnlyZKClient(139): Connect 0x7ddc1e73 to 127.0.0.1:60027 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-04 02:01:16,384 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39651] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5dc9774, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-04 02:01:16,385 DEBUG [hconnection-0x7f766d16-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-04 02:01:16,387 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:35098, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-04 02:01:16,392 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39651] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7ddc1e73 to 127.0.0.1:60027 2023-10-04 02:01:16,392 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39651] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-04 02:01:16,392 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39651] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion], kv [jenkins: RWXCA] 2023-10-04 02:01:16,393 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39651] snapshot.SnapshotManager(637): No existing snapshot, attempting snapshot... 2023-10-04 02:01:16,393 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39651] snapshot.SnapshotManager(684): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-10-04 02:01:16,395 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39651] snapshot.SnapshotManager(519): Unable to retrieve ACL status for path: hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/.hbase-snapshot, current working dir path: hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion org.apache.hadoop.hdfs.protocol.AclException: The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.ipc.RemoteException.instantiateException(RemoteException.java:121) at org.apache.hadoop.ipc.RemoteException.unwrapRemoteException(RemoteException.java:88) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2736) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2294) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2291) at org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81) at org.apache.hadoop.hdfs.DistributedFileSystem.getAclStatus(DistributedFileSystem.java:2291) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.updateWorkingDirAclsIfRequired(SnapshotManager.java:517) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.prepareToTakeSnapshot(SnapshotManager.java:490) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.snapshotEnabledTable(SnapshotManager.java:559) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshotInternal(SnapshotManager.java:687) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshot(SnapshotManager.java:623) at org.apache.hadoop.hbase.master.MasterRpcServices.snapshot(MasterRpcServices.java:1588) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) Caused by: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.hdfs.protocol.AclException): The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at org.apache.hadoop.ipc.Client.getRpcResponse(Client.java:1540) at org.apache.hadoop.ipc.Client.call(Client.java:1486) at org.apache.hadoop.ipc.Client.call(Client.java:1385) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:232) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:118) at com.sun.proxy.$Proxy32.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.getAclStatus(ClientNamenodeProtocolTranslatorPB.java:1385) at sun.reflect.GeneratedMethodAccessor61.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:422) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeMethod(RetryInvocationHandler.java:165) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invoke(RetryInvocationHandler.java:157) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeOnce(RetryInvocationHandler.java:95) at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:359) at com.sun.proxy.$Proxy35.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor61.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor61.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor61.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor61.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor61.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2734) ... 15 more 2023-10-04 02:01:16,396 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39651] procedure2.ProcedureExecutor(1028): Stored pid=64, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-10-04 02:01:16,397 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=64, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-10-04 02:01:16,398 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=64, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE; timeout=600000, timestamp=1696385476398 2023-10-04 02:01:16,398 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion 2023-10-04 02:01:16,398 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39651] snapshot.SnapshotManager(689): Started snapshot: { ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-10-04 02:01:16,399 DEBUG [Listener at jenkins-hbase9.apache.org/33899] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-10-04 02:01:16,399 DEBUG [Listener at jenkins-hbase9.apache.org/33899] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-10-04 02:01:16,400 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=64, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-10-04 02:01:16,400 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] procedure2.ProcedureExecutor(1028): Stored pid=65, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-10-04 02:01:16,401 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=64, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE in 4 msec 2023-10-04 02:01:16,402 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=65, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-10-04 02:01:16,402 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=65, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED; timeout=600000, timestamp=1696385476402 2023-10-04 02:01:16,410 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 02:01:16,410 INFO [(jenkins-hbase9.apache.org,39651,1696384803959)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' 2023-10-04 02:01:16,410 DEBUG [(jenkins-hbase9.apache.org,39651,1696384803959)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-04 02:01:16,412 DEBUG [(jenkins-hbase9.apache.org,39651,1696384803959)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' 2023-10-04 02:01:16,412 DEBUG [(jenkins-hbase9.apache.org,39651,1696384803959)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion', kicking off acquire phase on members. 2023-10-04 02:01:16,412 DEBUG [(jenkins-hbase9.apache.org,39651,1696384803959)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39651-0x1010f1b55330000, quorum=127.0.0.1:60027, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 02:01:16,412 DEBUG [(jenkins-hbase9.apache.org,39651,1696384803959)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 02:01:16,413 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): regionserver:35175-0x1010f1b55330003, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-04 02:01:16,413 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): regionserver:39045-0x1010f1b55330002, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-04 02:01:16,413 DEBUG [(jenkins-hbase9.apache.org,39651,1696384803959)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,39045,1696384805392 2023-10-04 02:01:16,413 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): regionserver:44303-0x1010f1b55330001, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-04 02:01:16,413 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-04 02:01:16,413 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-04 02:01:16,413 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-04 02:01:16,413 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-04 02:01:16,413 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-04 02:01:16,414 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-04 02:01:16,414 DEBUG [(jenkins-hbase9.apache.org,39651,1696384803959)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39651-0x1010f1b55330000, quorum=127.0.0.1:60027, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,39045,1696384805392 2023-10-04 02:01:16,414 DEBUG [(jenkins-hbase9.apache.org,39651,1696384803959)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,35175,1696384805436 2023-10-04 02:01:16,414 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 02:01:16,414 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 02:01:16,414 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 02:01:16,414 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35175-0x1010f1b55330003, quorum=127.0.0.1:60027, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 02:01:16,414 DEBUG [(jenkins-hbase9.apache.org,39651,1696384803959)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39651-0x1010f1b55330000, quorum=127.0.0.1:60027, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,35175,1696384805436 2023-10-04 02:01:16,414 DEBUG [(jenkins-hbase9.apache.org,39651,1696384803959)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-04 02:01:16,414 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39045-0x1010f1b55330002, quorum=127.0.0.1:60027, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 02:01:16,414 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44303-0x1010f1b55330001, quorum=127.0.0.1:60027, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 02:01:16,414 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 214 2023-10-04 02:01:16,415 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 02:01:16,415 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-10-04 02:01:16,415 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 214 2023-10-04 02:01:16,415 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 02:01:16,415 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 214 2023-10-04 02:01:16,415 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 02:01:16,415 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-10-04 02:01:16,415 DEBUG [member: 'jenkins-hbase9.apache.org,35175,1696384805436' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-10-04 02:01:16,415 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 02:01:16,415 DEBUG [member: 'jenkins-hbase9.apache.org,35175,1696384805436' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-04 02:01:16,415 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 02:01:16,416 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-10-04 02:01:16,416 DEBUG [member: 'jenkins-hbase9.apache.org,39045,1696384805392' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-10-04 02:01:16,416 DEBUG [member: 'jenkins-hbase9.apache.org,39045,1696384805392' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-04 02:01:16,416 DEBUG [member: 'jenkins-hbase9.apache.org,35175,1696384805436' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-10-04 02:01:16,417 DEBUG [member: 'jenkins-hbase9.apache.org,39045,1696384805392' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-10-04 02:01:16,417 DEBUG [member: 'jenkins-hbase9.apache.org,39045,1696384805392' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-10-04 02:01:16,417 DEBUG [member: 'jenkins-hbase9.apache.org,35175,1696384805436' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-10-04 02:01:16,418 DEBUG [member: 'jenkins-hbase9.apache.org,35175,1696384805436' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,35175,1696384805436' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-10-04 02:01:16,416 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 02:01:16,417 DEBUG [member: 'jenkins-hbase9.apache.org,39045,1696384805392' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,39045,1696384805392' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-10-04 02:01:16,418 DEBUG [member: 'jenkins-hbase9.apache.org,44303,1696384805319' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-10-04 02:01:16,418 DEBUG [member: 'jenkins-hbase9.apache.org,44303,1696384805319' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-04 02:01:16,419 DEBUG [member: 'jenkins-hbase9.apache.org,44303,1696384805319' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-10-04 02:01:16,419 DEBUG [member: 'jenkins-hbase9.apache.org,44303,1696384805319' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-10-04 02:01:16,419 DEBUG [member: 'jenkins-hbase9.apache.org,44303,1696384805319' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,44303,1696384805319' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-10-04 02:01:16,420 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): master:39651-0x1010f1b55330000, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,35175,1696384805436 2023-10-04 02:01:16,420 DEBUG [member: 'jenkins-hbase9.apache.org,39045,1696384805392' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 02:01:16,420 DEBUG [member: 'jenkins-hbase9.apache.org,35175,1696384805436' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 02:01:16,420 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,35175,1696384805436 2023-10-04 02:01:16,420 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-04 02:01:16,420 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-04 02:01:16,420 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): master:39651-0x1010f1b55330000, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,39045,1696384805392 2023-10-04 02:01:16,421 DEBUG [member: 'jenkins-hbase9.apache.org,44303,1696384805319' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 02:01:16,421 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-04 02:01:16,421 DEBUG [member: 'jenkins-hbase9.apache.org,35175,1696384805436' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35175-0x1010f1b55330003, quorum=127.0.0.1:60027, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 02:01:16,421 DEBUG [member: 'jenkins-hbase9.apache.org,35175,1696384805436' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-04 02:01:16,421 DEBUG [member: 'jenkins-hbase9.apache.org,39045,1696384805392' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39045-0x1010f1b55330002, quorum=127.0.0.1:60027, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 02:01:16,421 DEBUG [member: 'jenkins-hbase9.apache.org,39045,1696384805392' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-04 02:01:16,421 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-04 02:01:16,421 DEBUG [member: 'jenkins-hbase9.apache.org,44303,1696384805319' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44303-0x1010f1b55330001, quorum=127.0.0.1:60027, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 02:01:16,421 DEBUG [member: 'jenkins-hbase9.apache.org,44303,1696384805319' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-04 02:01:16,422 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 02:01:16,422 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,39045,1696384805392 2023-10-04 02:01:16,422 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,35175,1696384805436 2023-10-04 02:01:16,422 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44303,1696384805319 2023-10-04 02:01:16,423 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-04 02:01:16,423 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,35175,1696384805436' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-10-04 02:01:16,423 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7aef5454[Count = 1] remaining members to acquire global barrier 2023-10-04 02:01:16,423 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,39045,1696384805392 2023-10-04 02:01:16,423 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-04 02:01:16,423 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-04 02:01:16,423 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-04 02:01:16,424 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-04 02:01:16,424 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 02:01:16,424 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,39045,1696384805392 2023-10-04 02:01:16,424 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,35175,1696384805436 2023-10-04 02:01:16,424 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44303,1696384805319 2023-10-04 02:01:16,425 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-04 02:01:16,425 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,39045,1696384805392' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-10-04 02:01:16,425 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7aef5454[Count = 0] remaining members to acquire global barrier 2023-10-04 02:01:16,425 DEBUG [(jenkins-hbase9.apache.org,39651,1696384803959)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'in-barrier' execution. 2023-10-04 02:01:16,425 DEBUG [(jenkins-hbase9.apache.org,39651,1696384803959)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 02:01:16,427 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): regionserver:39045-0x1010f1b55330002, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 02:01:16,427 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): regionserver:35175-0x1010f1b55330003, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 02:01:16,427 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 02:01:16,427 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 02:01:16,427 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 02:01:16,427 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): regionserver:44303-0x1010f1b55330001, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 02:01:16,427 DEBUG [member: 'jenkins-hbase9.apache.org,35175,1696384805436' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-10-04 02:01:16,427 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 02:01:16,427 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 02:01:16,427 DEBUG [(jenkins-hbase9.apache.org,39651,1696384803959)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39651-0x1010f1b55330000, quorum=127.0.0.1:60027, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,35175,1696384805436 2023-10-04 02:01:16,427 DEBUG [member: 'jenkins-hbase9.apache.org,35175,1696384805436' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-04 02:01:16,427 DEBUG [member: 'jenkins-hbase9.apache.org,35175,1696384805436' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-04 02:01:16,427 DEBUG [rs(jenkins-hbase9.apache.org,35175,1696384805436)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1696384875386.a9dfc2e86ffa31dcf326539b4c556dd1. 2023-10-04 02:01:16,427 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 02:01:16,427 DEBUG [rs(jenkins-hbase9.apache.org,35175,1696384805436)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1696384875386.a9dfc2e86ffa31dcf326539b4c556dd1. started... 2023-10-04 02:01:16,427 DEBUG [member: 'jenkins-hbase9.apache.org,39045,1696384805392' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-10-04 02:01:16,427 DEBUG [member: 'jenkins-hbase9.apache.org,44303,1696384805319' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-10-04 02:01:16,427 DEBUG [(jenkins-hbase9.apache.org,39651,1696384803959)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39651-0x1010f1b55330000, quorum=127.0.0.1:60027, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,39045,1696384805392 2023-10-04 02:01:16,427 DEBUG [member: 'jenkins-hbase9.apache.org,39045,1696384805392' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-04 02:01:16,428 INFO [rs(jenkins-hbase9.apache.org,35175,1696384805436)-snapshot-pool-0] regionserver.HRegion(2745): Flushing a9dfc2e86ffa31dcf326539b4c556dd1 1/1 column families, dataSize=2.93 KB heapSize=6.58 KB 2023-10-04 02:01:16,428 DEBUG [rs(jenkins-hbase9.apache.org,39045,1696384805392)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1696384875386.0111ae2bc128c718ba0469aa41d435ee. 2023-10-04 02:01:16,428 DEBUG [member: 'jenkins-hbase9.apache.org,39045,1696384805392' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-04 02:01:16,427 DEBUG [(jenkins-hbase9.apache.org,39651,1696384803959)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-04 02:01:16,427 DEBUG [member: 'jenkins-hbase9.apache.org,44303,1696384805319' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-10-04 02:01:16,428 DEBUG [rs(jenkins-hbase9.apache.org,39045,1696384805392)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1696384875386.0111ae2bc128c718ba0469aa41d435ee. started... 2023-10-04 02:01:16,428 DEBUG [member: 'jenkins-hbase9.apache.org,44303,1696384805319' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase9.apache.org,44303,1696384805319' in zk 2023-10-04 02:01:16,428 INFO [rs(jenkins-hbase9.apache.org,39045,1696384805392)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 0111ae2bc128c718ba0469aa41d435ee 1/1 column families, dataSize=333 B heapSize=976 B 2023-10-04 02:01:16,430 DEBUG [member: 'jenkins-hbase9.apache.org,44303,1696384805319' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-10-04 02:01:16,430 DEBUG [member: 'jenkins-hbase9.apache.org,44303,1696384805319' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-04 02:01:16,430 DEBUG [member: 'jenkins-hbase9.apache.org,44303,1696384805319' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-10-04 02:01:16,448 INFO [rs(jenkins-hbase9.apache.org,39045,1696384805392)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231004c12c37a2b1414509894b2e78e4ce385b to hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e20231004c12c37a2b1414509894b2e78e4ce385b 2023-10-04 02:01:16,448 INFO [rs(jenkins-hbase9.apache.org,35175,1696384805436)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023100470f29098471247d78a9bc3e449d4eb19 to hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b2023100470f29098471247d78a9bc3e449d4eb19 2023-10-04 02:01:16,458 INFO [rs(jenkins-hbase9.apache.org,35175,1696384805436)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=2.9 K, hasBloomFilter=true, into tmp file hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/data/default/testtb-testExportFileSystemStateWithMergeRegion/a9dfc2e86ffa31dcf326539b4c556dd1/.tmp/cf/f8609d2231c94172b0b8e2e2c6e9c54e 2023-10-04 02:01:16,458 INFO [rs(jenkins-hbase9.apache.org,39045,1696384805392)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=333, hasBloomFilter=true, into tmp file hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/data/default/testtb-testExportFileSystemStateWithMergeRegion/0111ae2bc128c718ba0469aa41d435ee/.tmp/cf/57434000b3ca483fae3c1c7f64fda6a3 2023-10-04 02:01:16,464 DEBUG [rs(jenkins-hbase9.apache.org,39045,1696384805392)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/data/default/testtb-testExportFileSystemStateWithMergeRegion/0111ae2bc128c718ba0469aa41d435ee/.tmp/cf/57434000b3ca483fae3c1c7f64fda6a3 as hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/data/default/testtb-testExportFileSystemStateWithMergeRegion/0111ae2bc128c718ba0469aa41d435ee/cf/57434000b3ca483fae3c1c7f64fda6a3 2023-10-04 02:01:16,464 DEBUG [rs(jenkins-hbase9.apache.org,35175,1696384805436)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/data/default/testtb-testExportFileSystemStateWithMergeRegion/a9dfc2e86ffa31dcf326539b4c556dd1/.tmp/cf/f8609d2231c94172b0b8e2e2c6e9c54e as hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/data/default/testtb-testExportFileSystemStateWithMergeRegion/a9dfc2e86ffa31dcf326539b4c556dd1/cf/f8609d2231c94172b0b8e2e2c6e9c54e 2023-10-04 02:01:16,468 INFO [rs(jenkins-hbase9.apache.org,35175,1696384805436)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/data/default/testtb-testExportFileSystemStateWithMergeRegion/a9dfc2e86ffa31dcf326539b4c556dd1/cf/f8609d2231c94172b0b8e2e2c6e9c54e, entries=45, sequenceid=6, filesize=13.2 K 2023-10-04 02:01:16,469 INFO [rs(jenkins-hbase9.apache.org,39045,1696384805392)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/data/default/testtb-testExportFileSystemStateWithMergeRegion/0111ae2bc128c718ba0469aa41d435ee/cf/57434000b3ca483fae3c1c7f64fda6a3, entries=5, sequenceid=6, filesize=5.8 K 2023-10-04 02:01:16,469 INFO [rs(jenkins-hbase9.apache.org,35175,1696384805436)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~2.93 KB/3003, heapSize ~6.56 KB/6720, currentSize=0 B/0 for a9dfc2e86ffa31dcf326539b4c556dd1 in 42ms, sequenceid=6, compaction requested=false 2023-10-04 02:01:16,469 DEBUG [rs(jenkins-hbase9.apache.org,35175,1696384805436)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithMergeRegion' 2023-10-04 02:01:16,470 DEBUG [rs(jenkins-hbase9.apache.org,35175,1696384805436)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for a9dfc2e86ffa31dcf326539b4c556dd1: 2023-10-04 02:01:16,470 DEBUG [rs(jenkins-hbase9.apache.org,35175,1696384805436)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,1,1696384875386.a9dfc2e86ffa31dcf326539b4c556dd1.' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 02:01:16,470 DEBUG [rs(jenkins-hbase9.apache.org,35175,1696384805436)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-04 02:01:16,470 DEBUG [rs(jenkins-hbase9.apache.org,35175,1696384805436)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/data/default/testtb-testExportFileSystemStateWithMergeRegion/a9dfc2e86ffa31dcf326539b4c556dd1/cf/f8609d2231c94172b0b8e2e2c6e9c54e] hfiles 2023-10-04 02:01:16,470 DEBUG [rs(jenkins-hbase9.apache.org,35175,1696384805436)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/data/default/testtb-testExportFileSystemStateWithMergeRegion/a9dfc2e86ffa31dcf326539b4c556dd1/cf/f8609d2231c94172b0b8e2e2c6e9c54e for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 02:01:16,471 INFO [rs(jenkins-hbase9.apache.org,39045,1696384805392)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~333 B/333, heapSize ~960 B/960, currentSize=0 B/0 for 0111ae2bc128c718ba0469aa41d435ee in 43ms, sequenceid=6, compaction requested=false 2023-10-04 02:01:16,472 DEBUG [rs(jenkins-hbase9.apache.org,39045,1696384805392)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 0111ae2bc128c718ba0469aa41d435ee: 2023-10-04 02:01:16,472 DEBUG [rs(jenkins-hbase9.apache.org,39045,1696384805392)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,,1696384875386.0111ae2bc128c718ba0469aa41d435ee.' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 02:01:16,472 DEBUG [rs(jenkins-hbase9.apache.org,39045,1696384805392)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-04 02:01:16,472 DEBUG [rs(jenkins-hbase9.apache.org,39045,1696384805392)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/data/default/testtb-testExportFileSystemStateWithMergeRegion/0111ae2bc128c718ba0469aa41d435ee/cf/57434000b3ca483fae3c1c7f64fda6a3] hfiles 2023-10-04 02:01:16,472 DEBUG [rs(jenkins-hbase9.apache.org,39045,1696384805392)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/data/default/testtb-testExportFileSystemStateWithMergeRegion/0111ae2bc128c718ba0469aa41d435ee/cf/57434000b3ca483fae3c1c7f64fda6a3 for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 02:01:16,484 DEBUG [rs(jenkins-hbase9.apache.org,35175,1696384805436)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1696384875386.a9dfc2e86ffa31dcf326539b4c556dd1. completed. 2023-10-04 02:01:16,484 DEBUG [rs(jenkins-hbase9.apache.org,35175,1696384805436)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1696384875386.a9dfc2e86ffa31dcf326539b4c556dd1. 2023-10-04 02:01:16,484 DEBUG [rs(jenkins-hbase9.apache.org,39045,1696384805392)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1696384875386.0111ae2bc128c718ba0469aa41d435ee. completed. 2023-10-04 02:01:16,484 DEBUG [member: 'jenkins-hbase9.apache.org,35175,1696384805436' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-04 02:01:16,484 DEBUG [member: 'jenkins-hbase9.apache.org,35175,1696384805436' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-04 02:01:16,484 DEBUG [rs(jenkins-hbase9.apache.org,39045,1696384805392)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1696384875386.0111ae2bc128c718ba0469aa41d435ee. 2023-10-04 02:01:16,484 DEBUG [member: 'jenkins-hbase9.apache.org,35175,1696384805436' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase9.apache.org,35175,1696384805436 2023-10-04 02:01:16,484 DEBUG [member: 'jenkins-hbase9.apache.org,39045,1696384805392' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-04 02:01:16,484 DEBUG [member: 'jenkins-hbase9.apache.org,39045,1696384805392' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-04 02:01:16,484 DEBUG [member: 'jenkins-hbase9.apache.org,35175,1696384805436' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-10-04 02:01:16,484 DEBUG [member: 'jenkins-hbase9.apache.org,35175,1696384805436' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase9.apache.org,35175,1696384805436' in zk 2023-10-04 02:01:16,484 DEBUG [member: 'jenkins-hbase9.apache.org,39045,1696384805392' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase9.apache.org,39045,1696384805392 2023-10-04 02:01:16,484 DEBUG [member: 'jenkins-hbase9.apache.org,39045,1696384805392' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-10-04 02:01:16,484 DEBUG [member: 'jenkins-hbase9.apache.org,39045,1696384805392' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase9.apache.org,39045,1696384805392' in zk 2023-10-04 02:01:16,486 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): master:39651-0x1010f1b55330000, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,35175,1696384805436 2023-10-04 02:01:16,486 DEBUG [member: 'jenkins-hbase9.apache.org,39045,1696384805392' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-10-04 02:01:16,486 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,35175,1696384805436 2023-10-04 02:01:16,486 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-04 02:01:16,486 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-04 02:01:16,486 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): master:39651-0x1010f1b55330000, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,39045,1696384805392 2023-10-04 02:01:16,486 DEBUG [member: 'jenkins-hbase9.apache.org,35175,1696384805436' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-10-04 02:01:16,486 DEBUG [member: 'jenkins-hbase9.apache.org,39045,1696384805392' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-04 02:01:16,486 DEBUG [member: 'jenkins-hbase9.apache.org,35175,1696384805436' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-04 02:01:16,486 DEBUG [member: 'jenkins-hbase9.apache.org,39045,1696384805392' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-10-04 02:01:16,488 DEBUG [member: 'jenkins-hbase9.apache.org,35175,1696384805436' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-10-04 02:01:16,488 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-04 02:01:16,489 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-04 02:01:16,489 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 02:01:16,489 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,39045,1696384805392 2023-10-04 02:01:16,490 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,35175,1696384805436 2023-10-04 02:01:16,490 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44303,1696384805319 2023-10-04 02:01:16,490 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-04 02:01:16,490 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 02:01:16,490 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,39045,1696384805392 2023-10-04 02:01:16,491 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,35175,1696384805436 2023-10-04 02:01:16,491 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44303,1696384805319 2023-10-04 02:01:16,491 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase9.apache.org,35175,1696384805436': 2023-10-04 02:01:16,491 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,35175,1696384805436' released barrier for procedure'snaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 1 more 2023-10-04 02:01:16,491 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,39045,1696384805392 2023-10-04 02:01:16,491 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-04 02:01:16,491 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-04 02:01:16,492 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-04 02:01:16,492 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-04 02:01:16,492 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 02:01:16,492 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,39045,1696384805392 2023-10-04 02:01:16,493 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,35175,1696384805436 2023-10-04 02:01:16,493 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44303,1696384805319 2023-10-04 02:01:16,493 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-04 02:01:16,493 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 02:01:16,493 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,39045,1696384805392 2023-10-04 02:01:16,494 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,35175,1696384805436 2023-10-04 02:01:16,494 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44303,1696384805319 2023-10-04 02:01:16,494 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase9.apache.org,39045,1696384805392': 2023-10-04 02:01:16,494 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,39045,1696384805392' released barrier for procedure'snaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 0 more 2023-10-04 02:01:16,494 INFO [(jenkins-hbase9.apache.org,39651,1696384803959)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' execution completed 2023-10-04 02:01:16,494 DEBUG [(jenkins-hbase9.apache.org,39651,1696384803959)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-04 02:01:16,494 DEBUG [(jenkins-hbase9.apache.org,39651,1696384803959)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-04 02:01:16,494 DEBUG [(jenkins-hbase9.apache.org,39651,1696384803959)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 02:01:16,494 INFO [(jenkins-hbase9.apache.org,39651,1696384803959)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateWithMergeRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-10-04 02:01:16,500 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): regionserver:39045-0x1010f1b55330002, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 02:01:16,500 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): regionserver:35175-0x1010f1b55330003, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 02:01:16,500 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 02:01:16,500 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 02:01:16,500 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 02:01:16,500 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): regionserver:35175-0x1010f1b55330003, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-04 02:01:16,500 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): regionserver:39045-0x1010f1b55330002, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-04 02:01:16,500 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): regionserver:44303-0x1010f1b55330001, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 02:01:16,500 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): master:39651-0x1010f1b55330000, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 02:01:16,500 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 02:01:16,500 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 02:01:16,500 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 02:01:16,500 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): regionserver:44303-0x1010f1b55330001, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-04 02:01:16,500 DEBUG [Listener at jenkins-hbase9.apache.org/33899] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-04 02:01:16,500 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 02:01:16,500 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-04 02:01:16,501 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-04 02:01:16,500 DEBUG [(jenkins-hbase9.apache.org,39651,1696384803959)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39651-0x1010f1b55330000, quorum=127.0.0.1:60027, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,39045,1696384805392 2023-10-04 02:01:16,500 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-04 02:01:16,501 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-04 02:01:16,501 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-04 02:01:16,501 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-04 02:01:16,501 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-04 02:01:16,501 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-04 02:01:16,501 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-04 02:01:16,501 DEBUG [(jenkins-hbase9.apache.org,39651,1696384803959)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39651-0x1010f1b55330000, quorum=127.0.0.1:60027, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,35175,1696384805436 2023-10-04 02:01:16,501 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 02:01:16,501 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 02:01:16,501 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39651] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-10-04 02:01:16,501 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 02:01:16,502 DEBUG [(jenkins-hbase9.apache.org,39651,1696384803959)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39651-0x1010f1b55330000, quorum=127.0.0.1:60027, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,44303,1696384805319 2023-10-04 02:01:16,502 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39651] snapshot.SnapshotManager(406): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-10-04 02:01:16,502 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 02:01:16,502 DEBUG [Listener at jenkins-hbase9.apache.org/33899] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-10-04 02:01:16,502 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-04 02:01:16,502 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 02:01:16,503 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,39045,1696384805392 2023-10-04 02:01:16,503 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,35175,1696384805436 2023-10-04 02:01:16,503 DEBUG [(jenkins-hbase9.apache.org,39651,1696384803959)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39651-0x1010f1b55330000, quorum=127.0.0.1:60027, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,39045,1696384805392 2023-10-04 02:01:16,503 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44303,1696384805319 2023-10-04 02:01:16,503 DEBUG [(jenkins-hbase9.apache.org,39651,1696384803959)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39651-0x1010f1b55330000, quorum=127.0.0.1:60027, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,35175,1696384805436 2023-10-04 02:01:16,503 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-04 02:01:16,504 DEBUG [(jenkins-hbase9.apache.org,39651,1696384803959)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39651-0x1010f1b55330000, quorum=127.0.0.1:60027, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,44303,1696384805319 2023-10-04 02:01:16,504 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 02:01:16,504 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,39045,1696384805392 2023-10-04 02:01:16,504 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,35175,1696384805436 2023-10-04 02:01:16,504 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44303,1696384805319 2023-10-04 02:01:16,506 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): master:39651-0x1010f1b55330000, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,44303,1696384805319 2023-10-04 02:01:16,506 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): master:39651-0x1010f1b55330000, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 02:01:16,506 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): regionserver:35175-0x1010f1b55330003, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-04 02:01:16,506 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): regionserver:39045-0x1010f1b55330002, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-04 02:01:16,506 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-04 02:01:16,507 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): regionserver:39045-0x1010f1b55330002, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-04 02:01:16,507 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-04 02:01:16,507 DEBUG [(jenkins-hbase9.apache.org,39651,1696384803959)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-04 02:01:16,506 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-04 02:01:16,507 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-04 02:01:16,506 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): regionserver:35175-0x1010f1b55330003, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-04 02:01:16,506 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): regionserver:44303-0x1010f1b55330001, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-04 02:01:16,506 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): master:39651-0x1010f1b55330000, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,35175,1696384805436 2023-10-04 02:01:16,508 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-04 02:01:16,508 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): master:39651-0x1010f1b55330000, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,39045,1696384805392 2023-10-04 02:01:16,508 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-04 02:01:16,508 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-04 02:01:16,508 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): master:39651-0x1010f1b55330000, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 02:01:16,508 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-04 02:01:16,508 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): regionserver:44303-0x1010f1b55330001, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-04 02:01:16,508 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-04 02:01:16,507 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 02:01:16,508 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): master:39651-0x1010f1b55330000, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,44303,1696384805319 2023-10-04 02:01:16,508 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-04 02:01:16,509 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): master:39651-0x1010f1b55330000, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 02:01:16,509 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemStateWithMergeRegion 2023-10-04 02:01:16,509 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): master:39651-0x1010f1b55330000, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,35175,1696384805436 2023-10-04 02:01:16,509 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-04 02:01:16,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-04 02:01:16,509 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): master:39651-0x1010f1b55330000, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,39045,1696384805392 2023-10-04 02:01:16,509 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => aaca68e56e63a701f5c1ec9dc2f0511c, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,.mob,0.aaca68e56e63a701f5c1ec9dc2f0511c.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 02:01:16,509 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): master:39651-0x1010f1b55330000, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 02:01:16,509 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-10-04 02:01:16,509 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): master:39651-0x1010f1b55330000, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 02:01:16,510 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b2023100470f29098471247d78a9bc3e449d4eb19, hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e20231004c12c37a2b1414509894b2e78e4ce385b] mob files 2023-10-04 02:01:16,510 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b2023100470f29098471247d78a9bc3e449d4eb19 2023-10-04 02:01:16,510 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e20231004c12c37a2b1414509894b2e78e4ce385b 2023-10-04 02:01:16,517 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 02:01:16,517 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 02:01:16,534 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion to hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 02:01:16,535 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed 2023-10-04 02:01:16,535 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 02:01:16,535 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 02:01:16,536 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion at 1696384876398Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemStateWithMergeRegion at 1696384876517 (+119 ms)Consolidate snapshot: snaptb0-testExportFileSystemStateWithMergeRegion at 1696384876517Loading Region manifests for snaptb0-testExportFileSystemStateWithMergeRegion at 1696384876517Writing data manifest for snaptb0-testExportFileSystemStateWithMergeRegion at 1696384876520 (+3 ms)Verifying snapshot: snaptb0-testExportFileSystemStateWithMergeRegion at 1696384876527 (+7 ms)Snapshot snaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed at 1696384876535 (+8 ms) 2023-10-04 02:01:16,538 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=65, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-10-04 02:01:16,540 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=65, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED in 139 msec 2023-10-04 02:01:16,702 DEBUG [Listener at jenkins-hbase9.apache.org/33899] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-04 02:01:16,703 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39651] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-10-04 02:01:16,703 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39651] snapshot.SnapshotManager(403): Snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' has completed, notifying client. 2023-10-04 02:01:16,732 DEBUG [Listener at jenkins-hbase9.apache.org/33899] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-10-04 02:01:16,737 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:44328, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-10-04 02:01:16,739 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35175] regionserver.CompactSplit(310): Interrupting running compactions because user switched off compactions 2023-10-04 02:01:16,740 DEBUG [Listener at jenkins-hbase9.apache.org/33899] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-10-04 02:01:16,742 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:60416, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-10-04 02:01:16,742 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39045] regionserver.CompactSplit(310): Interrupting running compactions because user switched off compactions 2023-10-04 02:01:16,743 DEBUG [Listener at jenkins-hbase9.apache.org/33899] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-10-04 02:01:16,746 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:35104, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-10-04 02:01:16,746 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44303] regionserver.CompactSplit(310): Interrupting running compactions because user switched off compactions 2023-10-04 02:01:16,749 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39651] master.HMaster$4(2112): Client=jenkins//172.31.2.10 create 'testtb-testExportFileSystemStateWithMergeRegion-1', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-10-04 02:01:16,750 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39651] procedure2.ProcedureExecutor(1028): Stored pid=66, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-10-04 02:01:16,751 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_PRE_OPERATION 2023-10-04 02:01:16,752 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39651] master.MasterRpcServices(700): Client=jenkins//172.31.2.10 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemStateWithMergeRegion-1" procId is: 66 2023-10-04 02:01:16,752 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-10-04 02:01:16,752 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39651] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-10-04 02:01:16,754 DEBUG [HFileArchiver-17] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ee251983e839ee6dbc40cc61c0a6f617 2023-10-04 02:01:16,755 DEBUG [HFileArchiver-18] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/fe1b2bafcd3a41814c7a1d6faf1927b8 2023-10-04 02:01:16,755 DEBUG [HFileArchiver-17] backup.HFileArchiver(153): Directory hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ee251983e839ee6dbc40cc61c0a6f617 empty. 2023-10-04 02:01:16,755 DEBUG [HFileArchiver-18] backup.HFileArchiver(153): Directory hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/fe1b2bafcd3a41814c7a1d6faf1927b8 empty. 2023-10-04 02:01:16,755 DEBUG [HFileArchiver-17] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ee251983e839ee6dbc40cc61c0a6f617 2023-10-04 02:01:16,755 DEBUG [HFileArchiver-18] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/fe1b2bafcd3a41814c7a1d6faf1927b8 2023-10-04 02:01:16,756 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion-1 regions 2023-10-04 02:01:16,767 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/.tabledesc/.tableinfo.0000000001 2023-10-04 02:01:16,768 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(7675): creating {ENCODED => ee251983e839ee6dbc40cc61c0a6f617, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1696384876748.ee251983e839ee6dbc40cc61c0a6f617.', STARTKEY => '', ENDKEY => '2'}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion-1', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/.tmp 2023-10-04 02:01:16,769 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(7675): creating {ENCODED => fe1b2bafcd3a41814c7a1d6faf1927b8, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,2,1696384876748.fe1b2bafcd3a41814c7a1d6faf1927b8.', STARTKEY => '2', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion-1', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/.tmp 2023-10-04 02:01:16,785 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,2,1696384876748.fe1b2bafcd3a41814c7a1d6faf1927b8.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-04 02:01:16,785 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1604): Closing fe1b2bafcd3a41814c7a1d6faf1927b8, disabling compactions & flushes 2023-10-04 02:01:16,785 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,2,1696384876748.fe1b2bafcd3a41814c7a1d6faf1927b8. 2023-10-04 02:01:16,785 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1696384876748.fe1b2bafcd3a41814c7a1d6faf1927b8. 2023-10-04 02:01:16,785 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1696384876748.fe1b2bafcd3a41814c7a1d6faf1927b8. after waiting 0 ms 2023-10-04 02:01:16,785 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,2,1696384876748.fe1b2bafcd3a41814c7a1d6faf1927b8. 2023-10-04 02:01:16,785 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,2,1696384876748.fe1b2bafcd3a41814c7a1d6faf1927b8. 2023-10-04 02:01:16,785 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1558): Region close journal for fe1b2bafcd3a41814c7a1d6faf1927b8: 2023-10-04 02:01:16,787 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,,1696384876748.ee251983e839ee6dbc40cc61c0a6f617.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-04 02:01:16,787 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1604): Closing ee251983e839ee6dbc40cc61c0a6f617, disabling compactions & flushes 2023-10-04 02:01:16,787 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,,1696384876748.ee251983e839ee6dbc40cc61c0a6f617. 2023-10-04 02:01:16,787 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1696384876748.ee251983e839ee6dbc40cc61c0a6f617. 2023-10-04 02:01:16,787 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1696384876748.ee251983e839ee6dbc40cc61c0a6f617. after waiting 0 ms 2023-10-04 02:01:16,787 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,,1696384876748.ee251983e839ee6dbc40cc61c0a6f617. 2023-10-04 02:01:16,787 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,,1696384876748.ee251983e839ee6dbc40cc61c0a6f617. 2023-10-04 02:01:16,787 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1558): Region close journal for ee251983e839ee6dbc40cc61c0a6f617: 2023-10-04 02:01:16,790 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_ADD_TO_META 2023-10-04 02:01:16,791 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1696384876748.fe1b2bafcd3a41814c7a1d6faf1927b8.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1696384876790"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696384876790"}]},"ts":"1696384876790"} 2023-10-04 02:01:16,791 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1696384876748.ee251983e839ee6dbc40cc61c0a6f617.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1696384876790"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696384876790"}]},"ts":"1696384876790"} 2023-10-04 02:01:16,793 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-10-04 02:01:16,794 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-10-04 02:01:16,794 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696384876794"}]},"ts":"1696384876794"} 2023-10-04 02:01:16,795 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=ENABLING in hbase:meta 2023-10-04 02:01:16,799 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase9.apache.org=0} racks are {/default-rack=0} 2023-10-04 02:01:16,800 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-10-04 02:01:16,800 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-10-04 02:01:16,800 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-10-04 02:01:16,800 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-10-04 02:01:16,800 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=ee251983e839ee6dbc40cc61c0a6f617, ASSIGN}, {pid=68, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=fe1b2bafcd3a41814c7a1d6faf1927b8, ASSIGN}] 2023-10-04 02:01:16,803 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=ee251983e839ee6dbc40cc61c0a6f617, ASSIGN 2023-10-04 02:01:16,803 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=68, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=fe1b2bafcd3a41814c7a1d6faf1927b8, ASSIGN 2023-10-04 02:01:16,804 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=ee251983e839ee6dbc40cc61c0a6f617, ASSIGN; state=OFFLINE, location=jenkins-hbase9.apache.org,39045,1696384805392; forceNewPlan=false, retain=false 2023-10-04 02:01:16,804 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=68, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=fe1b2bafcd3a41814c7a1d6faf1927b8, ASSIGN; state=OFFLINE, location=jenkins-hbase9.apache.org,35175,1696384805436; forceNewPlan=false, retain=false 2023-10-04 02:01:16,853 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39651] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-10-04 02:01:16,954 INFO [jenkins-hbase9:39651] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-10-04 02:01:16,957 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=ee251983e839ee6dbc40cc61c0a6f617, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,39045,1696384805392 2023-10-04 02:01:16,957 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=68 updating hbase:meta row=fe1b2bafcd3a41814c7a1d6faf1927b8, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,35175,1696384805436 2023-10-04 02:01:16,957 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1696384876748.ee251983e839ee6dbc40cc61c0a6f617.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1696384876957"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696384876957"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696384876957"}]},"ts":"1696384876957"} 2023-10-04 02:01:16,957 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1696384876748.fe1b2bafcd3a41814c7a1d6faf1927b8.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1696384876957"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696384876957"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696384876957"}]},"ts":"1696384876957"} 2023-10-04 02:01:16,959 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=69, ppid=67, state=RUNNABLE; OpenRegionProcedure ee251983e839ee6dbc40cc61c0a6f617, server=jenkins-hbase9.apache.org,39045,1696384805392}] 2023-10-04 02:01:16,960 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=70, ppid=68, state=RUNNABLE; OpenRegionProcedure fe1b2bafcd3a41814c7a1d6faf1927b8, server=jenkins-hbase9.apache.org,35175,1696384805436}] 2023-10-04 02:01:17,055 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39651] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-10-04 02:01:17,114 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion-1,,1696384876748.ee251983e839ee6dbc40cc61c0a6f617. 2023-10-04 02:01:17,114 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion-1,2,1696384876748.fe1b2bafcd3a41814c7a1d6faf1927b8. 2023-10-04 02:01:17,114 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => ee251983e839ee6dbc40cc61c0a6f617, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1696384876748.ee251983e839ee6dbc40cc61c0a6f617.', STARTKEY => '', ENDKEY => '2'} 2023-10-04 02:01:17,114 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => fe1b2bafcd3a41814c7a1d6faf1927b8, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,2,1696384876748.fe1b2bafcd3a41814c7a1d6faf1927b8.', STARTKEY => '2', ENDKEY => ''} 2023-10-04 02:01:17,115 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion-1,2,1696384876748.fe1b2bafcd3a41814c7a1d6faf1927b8. service=AccessControlService 2023-10-04 02:01:17,115 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion-1,,1696384876748.ee251983e839ee6dbc40cc61c0a6f617. service=AccessControlService 2023-10-04 02:01:17,115 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-10-04 02:01:17,115 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-10-04 02:01:17,115 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion-1 fe1b2bafcd3a41814c7a1d6faf1927b8 2023-10-04 02:01:17,116 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion-1 ee251983e839ee6dbc40cc61c0a6f617 2023-10-04 02:01:17,116 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,2,1696384876748.fe1b2bafcd3a41814c7a1d6faf1927b8.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-04 02:01:17,116 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,,1696384876748.ee251983e839ee6dbc40cc61c0a6f617.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-04 02:01:17,116 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7894): checking encryption for fe1b2bafcd3a41814c7a1d6faf1927b8 2023-10-04 02:01:17,116 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7894): checking encryption for ee251983e839ee6dbc40cc61c0a6f617 2023-10-04 02:01:17,116 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7897): checking classloading for fe1b2bafcd3a41814c7a1d6faf1927b8 2023-10-04 02:01:17,116 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7897): checking classloading for ee251983e839ee6dbc40cc61c0a6f617 2023-10-04 02:01:17,117 INFO [StoreOpener-fe1b2bafcd3a41814c7a1d6faf1927b8-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region fe1b2bafcd3a41814c7a1d6faf1927b8 2023-10-04 02:01:17,117 INFO [StoreOpener-ee251983e839ee6dbc40cc61c0a6f617-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region ee251983e839ee6dbc40cc61c0a6f617 2023-10-04 02:01:17,118 DEBUG [StoreOpener-fe1b2bafcd3a41814c7a1d6faf1927b8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/fe1b2bafcd3a41814c7a1d6faf1927b8/cf 2023-10-04 02:01:17,118 DEBUG [StoreOpener-ee251983e839ee6dbc40cc61c0a6f617-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ee251983e839ee6dbc40cc61c0a6f617/cf 2023-10-04 02:01:17,118 DEBUG [StoreOpener-ee251983e839ee6dbc40cc61c0a6f617-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ee251983e839ee6dbc40cc61c0a6f617/cf 2023-10-04 02:01:17,118 DEBUG [StoreOpener-fe1b2bafcd3a41814c7a1d6faf1927b8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/fe1b2bafcd3a41814c7a1d6faf1927b8/cf 2023-10-04 02:01:17,119 INFO [StoreOpener-ee251983e839ee6dbc40cc61c0a6f617-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region ee251983e839ee6dbc40cc61c0a6f617 columnFamilyName cf 2023-10-04 02:01:17,119 INFO [StoreOpener-fe1b2bafcd3a41814c7a1d6faf1927b8-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region fe1b2bafcd3a41814c7a1d6faf1927b8 columnFamilyName cf 2023-10-04 02:01:17,119 INFO [StoreOpener-ee251983e839ee6dbc40cc61c0a6f617-1] regionserver.HStore(310): Store=ee251983e839ee6dbc40cc61c0a6f617/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-04 02:01:17,119 INFO [StoreOpener-fe1b2bafcd3a41814c7a1d6faf1927b8-1] regionserver.HStore(310): Store=fe1b2bafcd3a41814c7a1d6faf1927b8/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-04 02:01:17,120 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/fe1b2bafcd3a41814c7a1d6faf1927b8 2023-10-04 02:01:17,120 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ee251983e839ee6dbc40cc61c0a6f617 2023-10-04 02:01:17,120 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/fe1b2bafcd3a41814c7a1d6faf1927b8 2023-10-04 02:01:17,121 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ee251983e839ee6dbc40cc61c0a6f617 2023-10-04 02:01:17,123 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1055): writing seq id for ee251983e839ee6dbc40cc61c0a6f617 2023-10-04 02:01:17,123 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1055): writing seq id for fe1b2bafcd3a41814c7a1d6faf1927b8 2023-10-04 02:01:17,125 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ee251983e839ee6dbc40cc61c0a6f617/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-04 02:01:17,125 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/fe1b2bafcd3a41814c7a1d6faf1927b8/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-04 02:01:17,126 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1072): Opened ee251983e839ee6dbc40cc61c0a6f617; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67775251, jitterRate=0.009929940104484558}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-10-04 02:01:17,126 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1072): Opened fe1b2bafcd3a41814c7a1d6faf1927b8; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59992214, jitterRate=-0.10604634881019592}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-10-04 02:01:17,126 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(965): Region open journal for ee251983e839ee6dbc40cc61c0a6f617: 2023-10-04 02:01:17,126 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(965): Region open journal for fe1b2bafcd3a41814c7a1d6faf1927b8: 2023-10-04 02:01:17,127 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion-1,2,1696384876748.fe1b2bafcd3a41814c7a1d6faf1927b8., pid=70, masterSystemTime=1696384877111 2023-10-04 02:01:17,127 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion-1,,1696384876748.ee251983e839ee6dbc40cc61c0a6f617., pid=69, masterSystemTime=1696384877111 2023-10-04 02:01:17,128 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion-1,2,1696384876748.fe1b2bafcd3a41814c7a1d6faf1927b8. 2023-10-04 02:01:17,128 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion-1,2,1696384876748.fe1b2bafcd3a41814c7a1d6faf1927b8. 2023-10-04 02:01:17,129 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=68 updating hbase:meta row=fe1b2bafcd3a41814c7a1d6faf1927b8, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase9.apache.org,35175,1696384805436 2023-10-04 02:01:17,129 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion-1,,1696384876748.ee251983e839ee6dbc40cc61c0a6f617. 2023-10-04 02:01:17,129 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1696384876748.fe1b2bafcd3a41814c7a1d6faf1927b8.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1696384877129"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1696384877129"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1696384877129"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1696384877129"}]},"ts":"1696384877129"} 2023-10-04 02:01:17,129 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion-1,,1696384876748.ee251983e839ee6dbc40cc61c0a6f617. 2023-10-04 02:01:17,129 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=ee251983e839ee6dbc40cc61c0a6f617, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase9.apache.org,39045,1696384805392 2023-10-04 02:01:17,130 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1696384876748.ee251983e839ee6dbc40cc61c0a6f617.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1696384877129"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1696384877129"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1696384877129"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1696384877129"}]},"ts":"1696384877129"} 2023-10-04 02:01:17,132 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=70, resume processing ppid=68 2023-10-04 02:01:17,133 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=70, ppid=68, state=SUCCESS; OpenRegionProcedure fe1b2bafcd3a41814c7a1d6faf1927b8, server=jenkins-hbase9.apache.org,35175,1696384805436 in 171 msec 2023-10-04 02:01:17,133 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=69, resume processing ppid=67 2023-10-04 02:01:17,133 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=69, ppid=67, state=SUCCESS; OpenRegionProcedure ee251983e839ee6dbc40cc61c0a6f617, server=jenkins-hbase9.apache.org,39045,1696384805392 in 172 msec 2023-10-04 02:01:17,134 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=68, ppid=66, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=fe1b2bafcd3a41814c7a1d6faf1927b8, ASSIGN in 333 msec 2023-10-04 02:01:17,135 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=67, resume processing ppid=66 2023-10-04 02:01:17,135 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=67, ppid=66, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=ee251983e839ee6dbc40cc61c0a6f617, ASSIGN in 333 msec 2023-10-04 02:01:17,136 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-10-04 02:01:17,136 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696384877136"}]},"ts":"1696384877136"} 2023-10-04 02:01:17,137 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=ENABLED in hbase:meta 2023-10-04 02:01:17,139 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_POST_OPERATION 2023-10-04 02:01:17,140 DEBUG [PEWorker-4] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemStateWithMergeRegion-1 jenkins: RWXCA 2023-10-04 02:01:17,141 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=44303] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion-1], kv [jenkins: RWXCA] 2023-10-04 02:01:17,144 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): regionserver:39045-0x1010f1b55330002, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-04 02:01:17,144 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): regionserver:35175-0x1010f1b55330003, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-04 02:01:17,144 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): master:39651-0x1010f1b55330000, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-04 02:01:17,144 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): regionserver:44303-0x1010f1b55330001, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-04 02:01:17,146 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-10-04 02:01:17,146 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-10-04 02:01:17,146 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-10-04 02:01:17,146 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-10-04 02:01:17,146 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-10-04 02:01:17,146 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-10-04 02:01:17,147 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-10-04 02:01:17,147 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-10-04 02:01:17,147 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=66, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 in 397 msec 2023-10-04 02:01:17,356 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39651] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-10-04 02:01:17,356 INFO [Listener at jenkins-hbase9.apache.org/33899] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 66 completed 2023-10-04 02:01:17,376 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39651] master.HMaster$2(1952): Client=jenkins//172.31.2.10 merge regions ee251983e839ee6dbc40cc61c0a6f617, fe1b2bafcd3a41814c7a1d6faf1927b8 2023-10-04 02:01:17,385 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39651] procedure2.ProcedureExecutor(1028): Stored pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[ee251983e839ee6dbc40cc61c0a6f617, fe1b2bafcd3a41814c7a1d6faf1927b8], force=true 2023-10-04 02:01:17,387 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[ee251983e839ee6dbc40cc61c0a6f617, fe1b2bafcd3a41814c7a1d6faf1927b8], force=true 2023-10-04 02:01:17,387 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[ee251983e839ee6dbc40cc61c0a6f617, fe1b2bafcd3a41814c7a1d6faf1927b8], force=true 2023-10-04 02:01:17,387 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[ee251983e839ee6dbc40cc61c0a6f617, fe1b2bafcd3a41814c7a1d6faf1927b8], force=true 2023-10-04 02:01:17,389 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39651] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-10-04 02:01:17,409 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=72, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=ee251983e839ee6dbc40cc61c0a6f617, UNASSIGN}, {pid=73, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=fe1b2bafcd3a41814c7a1d6faf1927b8, UNASSIGN}] 2023-10-04 02:01:17,411 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=72, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=ee251983e839ee6dbc40cc61c0a6f617, UNASSIGN 2023-10-04 02:01:17,411 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=73, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=fe1b2bafcd3a41814c7a1d6faf1927b8, UNASSIGN 2023-10-04 02:01:17,412 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=73 updating hbase:meta row=fe1b2bafcd3a41814c7a1d6faf1927b8, regionState=CLOSING, regionLocation=jenkins-hbase9.apache.org,35175,1696384805436 2023-10-04 02:01:17,412 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=72 updating hbase:meta row=ee251983e839ee6dbc40cc61c0a6f617, regionState=CLOSING, regionLocation=jenkins-hbase9.apache.org,39045,1696384805392 2023-10-04 02:01:17,412 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1696384876748.fe1b2bafcd3a41814c7a1d6faf1927b8.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1696384877412"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696384877412"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696384877412"}]},"ts":"1696384877412"} 2023-10-04 02:01:17,412 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1696384876748.ee251983e839ee6dbc40cc61c0a6f617.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1696384877412"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696384877412"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696384877412"}]},"ts":"1696384877412"} 2023-10-04 02:01:17,413 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=74, ppid=73, state=RUNNABLE; CloseRegionProcedure fe1b2bafcd3a41814c7a1d6faf1927b8, server=jenkins-hbase9.apache.org,35175,1696384805436}] 2023-10-04 02:01:17,414 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=75, ppid=72, state=RUNNABLE; CloseRegionProcedure ee251983e839ee6dbc40cc61c0a6f617, server=jenkins-hbase9.apache.org,39045,1696384805392}] 2023-10-04 02:01:17,490 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39651] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-10-04 02:01:17,566 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(111): Close fe1b2bafcd3a41814c7a1d6faf1927b8 2023-10-04 02:01:17,568 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1604): Closing fe1b2bafcd3a41814c7a1d6faf1927b8, disabling compactions & flushes 2023-10-04 02:01:17,568 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,2,1696384876748.fe1b2bafcd3a41814c7a1d6faf1927b8. 2023-10-04 02:01:17,568 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1696384876748.fe1b2bafcd3a41814c7a1d6faf1927b8. 2023-10-04 02:01:17,568 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1696384876748.fe1b2bafcd3a41814c7a1d6faf1927b8. after waiting 0 ms 2023-10-04 02:01:17,568 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,2,1696384876748.fe1b2bafcd3a41814c7a1d6faf1927b8. 2023-10-04 02:01:17,568 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(2745): Flushing fe1b2bafcd3a41814c7a1d6faf1927b8 1/1 column families, dataSize=24 B heapSize=352 B 2023-10-04 02:01:17,568 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(111): Close ee251983e839ee6dbc40cc61c0a6f617 2023-10-04 02:01:17,569 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1604): Closing ee251983e839ee6dbc40cc61c0a6f617, disabling compactions & flushes 2023-10-04 02:01:17,569 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,,1696384876748.ee251983e839ee6dbc40cc61c0a6f617. 2023-10-04 02:01:17,569 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1696384876748.ee251983e839ee6dbc40cc61c0a6f617. 2023-10-04 02:01:17,569 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1696384876748.ee251983e839ee6dbc40cc61c0a6f617. after waiting 0 ms 2023-10-04 02:01:17,569 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,,1696384876748.ee251983e839ee6dbc40cc61c0a6f617. 2023-10-04 02:01:17,570 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(2745): Flushing ee251983e839ee6dbc40cc61c0a6f617 1/1 column families, dataSize=24 B heapSize=352 B 2023-10-04 02:01:17,580 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=24 B at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/fe1b2bafcd3a41814c7a1d6faf1927b8/.tmp/cf/cf56ae802a7f4549bbc53942f93d978b 2023-10-04 02:01:17,580 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=24 B at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ee251983e839ee6dbc40cc61c0a6f617/.tmp/cf/9cb2ec6af8544e5291e3c5824957e5da 2023-10-04 02:01:17,586 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ee251983e839ee6dbc40cc61c0a6f617/.tmp/cf/9cb2ec6af8544e5291e3c5824957e5da as hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ee251983e839ee6dbc40cc61c0a6f617/cf/9cb2ec6af8544e5291e3c5824957e5da 2023-10-04 02:01:17,586 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/fe1b2bafcd3a41814c7a1d6faf1927b8/.tmp/cf/cf56ae802a7f4549bbc53942f93d978b as hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/fe1b2bafcd3a41814c7a1d6faf1927b8/cf/cf56ae802a7f4549bbc53942f93d978b 2023-10-04 02:01:17,590 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HStore(1080): Added hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ee251983e839ee6dbc40cc61c0a6f617/cf/9cb2ec6af8544e5291e3c5824957e5da, entries=1, sequenceid=5, filesize=4.7 K 2023-10-04 02:01:17,590 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HStore(1080): Added hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/fe1b2bafcd3a41814c7a1d6faf1927b8/cf/cf56ae802a7f4549bbc53942f93d978b, entries=1, sequenceid=5, filesize=4.7 K 2023-10-04 02:01:17,591 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~24 B/24, heapSize ~336 B/336, currentSize=0 B/0 for ee251983e839ee6dbc40cc61c0a6f617 in 21ms, sequenceid=5, compaction requested=false 2023-10-04 02:01:17,591 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~24 B/24, heapSize ~336 B/336, currentSize=0 B/0 for fe1b2bafcd3a41814c7a1d6faf1927b8 in 23ms, sequenceid=5, compaction requested=false 2023-10-04 02:01:17,591 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithMergeRegion-1' 2023-10-04 02:01:17,591 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithMergeRegion-1' 2023-10-04 02:01:17,600 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ee251983e839ee6dbc40cc61c0a6f617/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=1 2023-10-04 02:01:17,600 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/fe1b2bafcd3a41814c7a1d6faf1927b8/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=1 2023-10-04 02:01:17,601 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-10-04 02:01:17,601 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-10-04 02:01:17,601 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,,1696384876748.ee251983e839ee6dbc40cc61c0a6f617. 2023-10-04 02:01:17,601 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,2,1696384876748.fe1b2bafcd3a41814c7a1d6faf1927b8. 2023-10-04 02:01:17,601 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1558): Region close journal for fe1b2bafcd3a41814c7a1d6faf1927b8: 2023-10-04 02:01:17,601 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1558): Region close journal for ee251983e839ee6dbc40cc61c0a6f617: 2023-10-04 02:01:17,603 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(149): Closed fe1b2bafcd3a41814c7a1d6faf1927b8 2023-10-04 02:01:17,603 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=73 updating hbase:meta row=fe1b2bafcd3a41814c7a1d6faf1927b8, regionState=CLOSED 2023-10-04 02:01:17,603 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1696384876748.fe1b2bafcd3a41814c7a1d6faf1927b8.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1696384877603"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696384877603"}]},"ts":"1696384877603"} 2023-10-04 02:01:17,603 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(149): Closed ee251983e839ee6dbc40cc61c0a6f617 2023-10-04 02:01:17,604 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=72 updating hbase:meta row=ee251983e839ee6dbc40cc61c0a6f617, regionState=CLOSED 2023-10-04 02:01:17,604 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1696384876748.ee251983e839ee6dbc40cc61c0a6f617.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1696384877604"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696384877604"}]},"ts":"1696384877604"} 2023-10-04 02:01:17,606 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=74, resume processing ppid=73 2023-10-04 02:01:17,606 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=74, ppid=73, state=SUCCESS; CloseRegionProcedure fe1b2bafcd3a41814c7a1d6faf1927b8, server=jenkins-hbase9.apache.org,35175,1696384805436 in 192 msec 2023-10-04 02:01:17,607 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=75, resume processing ppid=72 2023-10-04 02:01:17,607 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=75, ppid=72, state=SUCCESS; CloseRegionProcedure ee251983e839ee6dbc40cc61c0a6f617, server=jenkins-hbase9.apache.org,39045,1696384805392 in 191 msec 2023-10-04 02:01:17,607 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=73, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=fe1b2bafcd3a41814c7a1d6faf1927b8, UNASSIGN in 197 msec 2023-10-04 02:01:17,609 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=72, resume processing ppid=71 2023-10-04 02:01:17,609 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=72, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=ee251983e839ee6dbc40cc61c0a6f617, UNASSIGN in 201 msec 2023-10-04 02:01:17,654 DEBUG [PEWorker-4] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/018d949fe4d33c96a4133913167ebfdb/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=-1 2023-10-04 02:01:17,656 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1696384876748.ee251983e839ee6dbc40cc61c0a6f617.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"9223372036854775807"}]},"ts":"9223372036854775807"} 2023-10-04 02:01:17,656 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1696384876748.fe1b2bafcd3a41814c7a1d6faf1927b8.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"9223372036854775807"}]},"ts":"9223372036854775807"} 2023-10-04 02:01:17,657 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":7,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1696384876749.018d949fe4d33c96a4133913167ebfdb.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"9223372036854775807"},{"qualifier":"merge0000","vlen":84,"tag":[],"timestamp":"9223372036854775807"},{"qualifier":"merge0001","vlen":84,"tag":[],"timestamp":"9223372036854775807"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"9223372036854775807"}]},"ts":"9223372036854775807"} 2023-10-04 02:01:17,692 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39651] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-10-04 02:01:17,706 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=76, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=018d949fe4d33c96a4133913167ebfdb, ASSIGN}] 2023-10-04 02:01:17,707 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=76, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=018d949fe4d33c96a4133913167ebfdb, ASSIGN 2023-10-04 02:01:17,708 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=76, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=018d949fe4d33c96a4133913167ebfdb, ASSIGN; state=MERGED, location=jenkins-hbase9.apache.org,39045,1696384805392; forceNewPlan=false, retain=false 2023-10-04 02:01:17,858 INFO [jenkins-hbase9:39651] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-10-04 02:01:17,860 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=76 updating hbase:meta row=018d949fe4d33c96a4133913167ebfdb, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,39045,1696384805392 2023-10-04 02:01:17,860 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1696384876749.018d949fe4d33c96a4133913167ebfdb.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1696384877860"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696384877860"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696384877860"}]},"ts":"1696384877860"} 2023-10-04 02:01:17,862 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=77, ppid=76, state=RUNNABLE; OpenRegionProcedure 018d949fe4d33c96a4133913167ebfdb, server=jenkins-hbase9.apache.org,39045,1696384805392}] 2023-10-04 02:01:17,993 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39651] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-10-04 02:01:18,016 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion-1,,1696384876749.018d949fe4d33c96a4133913167ebfdb. 2023-10-04 02:01:18,016 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 018d949fe4d33c96a4133913167ebfdb, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1696384876749.018d949fe4d33c96a4133913167ebfdb.', STARTKEY => '', ENDKEY => ''} 2023-10-04 02:01:18,016 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion-1,,1696384876749.018d949fe4d33c96a4133913167ebfdb. service=AccessControlService 2023-10-04 02:01:18,017 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-10-04 02:01:18,017 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion-1 018d949fe4d33c96a4133913167ebfdb 2023-10-04 02:01:18,017 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,,1696384876749.018d949fe4d33c96a4133913167ebfdb.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-04 02:01:18,017 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7894): checking encryption for 018d949fe4d33c96a4133913167ebfdb 2023-10-04 02:01:18,017 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7897): checking classloading for 018d949fe4d33c96a4133913167ebfdb 2023-10-04 02:01:18,018 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionFileSystem(950): Rewriting .regioninfo file at: hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/018d949fe4d33c96a4133913167ebfdb/.regioninfo 2023-10-04 02:01:18,026 INFO [StoreOpener-018d949fe4d33c96a4133913167ebfdb-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 018d949fe4d33c96a4133913167ebfdb 2023-10-04 02:01:18,027 DEBUG [StoreOpener-018d949fe4d33c96a4133913167ebfdb-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/018d949fe4d33c96a4133913167ebfdb/cf 2023-10-04 02:01:18,027 DEBUG [StoreOpener-018d949fe4d33c96a4133913167ebfdb-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/018d949fe4d33c96a4133913167ebfdb/cf 2023-10-04 02:01:18,027 INFO [StoreOpener-018d949fe4d33c96a4133913167ebfdb-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 018d949fe4d33c96a4133913167ebfdb columnFamilyName cf 2023-10-04 02:01:18,055 DEBUG [StoreOpener-018d949fe4d33c96a4133913167ebfdb-1] regionserver.HStore(539): loaded hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/018d949fe4d33c96a4133913167ebfdb/cf/9cb2ec6af8544e5291e3c5824957e5da.ee251983e839ee6dbc40cc61c0a6f617->hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ee251983e839ee6dbc40cc61c0a6f617/cf/9cb2ec6af8544e5291e3c5824957e5da-top 2023-10-04 02:01:18,060 DEBUG [StoreOpener-018d949fe4d33c96a4133913167ebfdb-1] regionserver.HStore(539): loaded hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/018d949fe4d33c96a4133913167ebfdb/cf/cf56ae802a7f4549bbc53942f93d978b.fe1b2bafcd3a41814c7a1d6faf1927b8->hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/fe1b2bafcd3a41814c7a1d6faf1927b8/cf/cf56ae802a7f4549bbc53942f93d978b-top 2023-10-04 02:01:18,060 INFO [StoreOpener-018d949fe4d33c96a4133913167ebfdb-1] regionserver.HStore(310): Store=018d949fe4d33c96a4133913167ebfdb/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-04 02:01:18,061 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/018d949fe4d33c96a4133913167ebfdb 2023-10-04 02:01:18,062 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/018d949fe4d33c96a4133913167ebfdb 2023-10-04 02:01:18,065 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1055): writing seq id for 018d949fe4d33c96a4133913167ebfdb 2023-10-04 02:01:18,066 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1072): Opened 018d949fe4d33c96a4133913167ebfdb; next sequenceid=9; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71696582, jitterRate=0.06836232542991638}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-10-04 02:01:18,066 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(965): Region open journal for 018d949fe4d33c96a4133913167ebfdb: 2023-10-04 02:01:18,067 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion-1,,1696384876749.018d949fe4d33c96a4133913167ebfdb., pid=77, masterSystemTime=1696384878013 2023-10-04 02:01:18,067 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.CompactSplit(328): Ignoring compaction request for testtb-testExportFileSystemStateWithMergeRegion-1,,1696384876749.018d949fe4d33c96a4133913167ebfdb.,because compaction is disabled. 2023-10-04 02:01:18,068 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion-1,,1696384876749.018d949fe4d33c96a4133913167ebfdb. 2023-10-04 02:01:18,068 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion-1,,1696384876749.018d949fe4d33c96a4133913167ebfdb. 2023-10-04 02:01:18,069 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=76 updating hbase:meta row=018d949fe4d33c96a4133913167ebfdb, regionState=OPEN, openSeqNum=9, regionLocation=jenkins-hbase9.apache.org,39045,1696384805392 2023-10-04 02:01:18,069 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1696384876749.018d949fe4d33c96a4133913167ebfdb.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1696384878069"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1696384878069"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1696384878069"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1696384878069"}]},"ts":"1696384878069"} 2023-10-04 02:01:18,072 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=77, resume processing ppid=76 2023-10-04 02:01:18,072 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=77, ppid=76, state=SUCCESS; OpenRegionProcedure 018d949fe4d33c96a4133913167ebfdb, server=jenkins-hbase9.apache.org,39045,1696384805392 in 208 msec 2023-10-04 02:01:18,073 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=76, resume processing ppid=71 2023-10-04 02:01:18,073 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=76, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=018d949fe4d33c96a4133913167ebfdb, ASSIGN in 366 msec 2023-10-04 02:01:18,074 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=71, state=SUCCESS; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[ee251983e839ee6dbc40cc61c0a6f617, fe1b2bafcd3a41814c7a1d6faf1927b8], force=true in 693 msec 2023-10-04 02:01:18,494 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39651] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-10-04 02:01:18,495 INFO [Listener at jenkins-hbase9.apache.org/33899] client.HBaseAdmin$TableFuture(3541): Operation: MERGE_REGIONS, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 71 completed 2023-10-04 02:01:18,496 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39651] master.MasterRpcServices(1583): Client=jenkins//172.31.2.10 snapshot request for:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } 2023-10-04 02:01:18,496 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39651] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1696384878496 (current time:1696384878496). 2023-10-04 02:01:18,496 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39651] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-10-04 02:01:18,497 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39651] zookeeper.ReadOnlyZKClient(139): Connect 0x0b47070b to 127.0.0.1:60027 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-04 02:01:18,503 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39651] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@23226838, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-04 02:01:18,504 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39651] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-04 02:01:18,505 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:45506, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-04 02:01:18,506 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39651] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x0b47070b to 127.0.0.1:60027 2023-10-04 02:01:18,506 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39651] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-04 02:01:18,507 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39651] zookeeper.ReadOnlyZKClient(139): Connect 0x66a758ab to 127.0.0.1:60027 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-04 02:01:18,513 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39651] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@55eb742b, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-04 02:01:18,515 DEBUG [hconnection-0x6538b506-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-04 02:01:18,517 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:45510, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-04 02:01:18,521 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39651] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x66a758ab to 127.0.0.1:60027 2023-10-04 02:01:18,521 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39651] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-04 02:01:18,521 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39651] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion-1], kv [jenkins: RWXCA] 2023-10-04 02:01:18,522 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39651] snapshot.SnapshotManager(637): No existing snapshot, attempting snapshot... 2023-10-04 02:01:18,522 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39651] snapshot.SnapshotManager(684): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } 2023-10-04 02:01:18,524 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39651] snapshot.SnapshotManager(519): Unable to retrieve ACL status for path: hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/.hbase-snapshot, current working dir path: hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 org.apache.hadoop.hdfs.protocol.AclException: The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.ipc.RemoteException.instantiateException(RemoteException.java:121) at org.apache.hadoop.ipc.RemoteException.unwrapRemoteException(RemoteException.java:88) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2736) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2294) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2291) at org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81) at org.apache.hadoop.hdfs.DistributedFileSystem.getAclStatus(DistributedFileSystem.java:2291) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.updateWorkingDirAclsIfRequired(SnapshotManager.java:517) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.prepareToTakeSnapshot(SnapshotManager.java:490) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.snapshotEnabledTable(SnapshotManager.java:559) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshotInternal(SnapshotManager.java:687) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshot(SnapshotManager.java:623) at org.apache.hadoop.hbase.master.MasterRpcServices.snapshot(MasterRpcServices.java:1588) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) Caused by: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.hdfs.protocol.AclException): The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at org.apache.hadoop.ipc.Client.getRpcResponse(Client.java:1540) at org.apache.hadoop.ipc.Client.call(Client.java:1486) at org.apache.hadoop.ipc.Client.call(Client.java:1385) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:232) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:118) at com.sun.proxy.$Proxy32.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.getAclStatus(ClientNamenodeProtocolTranslatorPB.java:1385) at sun.reflect.GeneratedMethodAccessor61.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:422) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeMethod(RetryInvocationHandler.java:165) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invoke(RetryInvocationHandler.java:157) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeOnce(RetryInvocationHandler.java:95) at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:359) at com.sun.proxy.$Proxy35.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor61.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor61.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor61.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor61.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor61.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2734) ... 15 more 2023-10-04 02:01:18,526 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39651] procedure2.ProcedureExecutor(1028): Stored pid=78, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE 2023-10-04 02:01:18,527 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=78, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE 2023-10-04 02:01:18,527 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=78, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE; timeout=600000, timestamp=1696385478527 2023-10-04 02:01:18,527 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion-1 2023-10-04 02:01:18,527 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39651] snapshot.SnapshotManager(689): Started snapshot: { ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } 2023-10-04 02:01:18,531 DEBUG [Listener at jenkins-hbase9.apache.org/33899] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-10-04 02:01:18,532 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=78, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE 2023-10-04 02:01:18,532 DEBUG [Listener at jenkins-hbase9.apache.org/33899] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-10-04 02:01:18,532 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] procedure2.ProcedureExecutor(1028): Stored pid=79, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED 2023-10-04 02:01:18,533 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=78, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE in 7 msec 2023-10-04 02:01:18,534 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=79, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED 2023-10-04 02:01:18,534 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=79, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED; timeout=600000, timestamp=1696385478534 2023-10-04 02:01:18,543 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-04 02:01:18,543 INFO [(jenkins-hbase9.apache.org,39651,1696384803959)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' 2023-10-04 02:01:18,543 DEBUG [(jenkins-hbase9.apache.org,39651,1696384803959)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-04 02:01:18,544 DEBUG [(jenkins-hbase9.apache.org,39651,1696384803959)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' 2023-10-04 02:01:18,544 DEBUG [(jenkins-hbase9.apache.org,39651,1696384803959)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1', kicking off acquire phase on members. 2023-10-04 02:01:18,545 DEBUG [(jenkins-hbase9.apache.org,39651,1696384803959)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39651-0x1010f1b55330000, quorum=127.0.0.1:60027, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-04 02:01:18,545 DEBUG [(jenkins-hbase9.apache.org,39651,1696384803959)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-04 02:01:18,546 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): regionserver:44303-0x1010f1b55330001, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-04 02:01:18,546 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): regionserver:39045-0x1010f1b55330002, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-04 02:01:18,546 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-04 02:01:18,546 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-04 02:01:18,546 DEBUG [(jenkins-hbase9.apache.org,39651,1696384803959)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase9.apache.org,39045,1696384805392 2023-10-04 02:01:18,546 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): regionserver:35175-0x1010f1b55330003, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-04 02:01:18,546 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-04 02:01:18,546 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-04 02:01:18,547 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-04 02:01:18,547 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-04 02:01:18,547 DEBUG [(jenkins-hbase9.apache.org,39651,1696384803959)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39651-0x1010f1b55330000, quorum=127.0.0.1:60027, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase9.apache.org,39045,1696384805392 2023-10-04 02:01:18,547 DEBUG [(jenkins-hbase9.apache.org,39651,1696384803959)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-04 02:01:18,547 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-04 02:01:18,547 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-04 02:01:18,547 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39045-0x1010f1b55330002, quorum=127.0.0.1:60027, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-04 02:01:18,548 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44303-0x1010f1b55330001, quorum=127.0.0.1:60027, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-04 02:01:18,548 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 220 2023-10-04 02:01:18,548 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-04 02:01:18,548 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 220 2023-10-04 02:01:18,548 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-04 02:01:18,548 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 from table testtb-testExportFileSystemStateWithMergeRegion-1 type FLUSH 2023-10-04 02:01:18,548 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-04 02:01:18,548 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 from table testtb-testExportFileSystemStateWithMergeRegion-1 type FLUSH 2023-10-04 02:01:18,548 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-04 02:01:18,548 DEBUG [member: 'jenkins-hbase9.apache.org,39045,1696384805392' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' with timeout 300000ms 2023-10-04 02:01:18,548 DEBUG [member: 'jenkins-hbase9.apache.org,39045,1696384805392' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-04 02:01:18,548 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-04 02:01:18,550 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35175-0x1010f1b55330003, quorum=127.0.0.1:60027, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-04 02:01:18,550 DEBUG [member: 'jenkins-hbase9.apache.org,44303,1696384805319' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' with timeout 300000ms 2023-10-04 02:01:18,550 DEBUG [member: 'jenkins-hbase9.apache.org,44303,1696384805319' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-04 02:01:18,550 DEBUG [member: 'jenkins-hbase9.apache.org,39045,1696384805392' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' stage 2023-10-04 02:01:18,551 DEBUG [member: 'jenkins-hbase9.apache.org,44303,1696384805319' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' stage 2023-10-04 02:01:18,551 DEBUG [member: 'jenkins-hbase9.apache.org,44303,1696384805319' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally acquired 2023-10-04 02:01:18,551 DEBUG [member: 'jenkins-hbase9.apache.org,39045,1696384805392' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally acquired 2023-10-04 02:01:18,551 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 220 2023-10-04 02:01:18,552 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-04 02:01:18,551 DEBUG [member: 'jenkins-hbase9.apache.org,44303,1696384805319' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,44303,1696384805319' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion-1) in zk 2023-10-04 02:01:18,551 DEBUG [member: 'jenkins-hbase9.apache.org,39045,1696384805392' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,39045,1696384805392' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion-1) in zk 2023-10-04 02:01:18,552 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 from table testtb-testExportFileSystemStateWithMergeRegion-1 type FLUSH 2023-10-04 02:01:18,552 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-04 02:01:18,552 DEBUG [member: 'jenkins-hbase9.apache.org,35175,1696384805436' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' with timeout 300000ms 2023-10-04 02:01:18,552 DEBUG [member: 'jenkins-hbase9.apache.org,35175,1696384805436' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-04 02:01:18,554 DEBUG [member: 'jenkins-hbase9.apache.org,35175,1696384805436' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' stage 2023-10-04 02:01:18,554 DEBUG [member: 'jenkins-hbase9.apache.org,35175,1696384805436' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally acquired 2023-10-04 02:01:18,554 DEBUG [member: 'jenkins-hbase9.apache.org,35175,1696384805436' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,35175,1696384805436' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion-1) in zk 2023-10-04 02:01:18,554 DEBUG [member: 'jenkins-hbase9.apache.org,44303,1696384805319' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-04 02:01:18,554 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): master:39651-0x1010f1b55330000, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase9.apache.org,39045,1696384805392 2023-10-04 02:01:18,554 DEBUG [member: 'jenkins-hbase9.apache.org,39045,1696384805392' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-04 02:01:18,554 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase9.apache.org,39045,1696384805392 2023-10-04 02:01:18,554 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-04 02:01:18,554 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-04 02:01:18,554 DEBUG [member: 'jenkins-hbase9.apache.org,44303,1696384805319' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44303-0x1010f1b55330001, quorum=127.0.0.1:60027, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-04 02:01:18,555 DEBUG [member: 'jenkins-hbase9.apache.org,44303,1696384805319' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-04 02:01:18,555 DEBUG [member: 'jenkins-hbase9.apache.org,39045,1696384805392' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39045-0x1010f1b55330002, quorum=127.0.0.1:60027, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-04 02:01:18,555 DEBUG [member: 'jenkins-hbase9.apache.org,39045,1696384805392' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-04 02:01:18,555 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-04 02:01:18,557 DEBUG [member: 'jenkins-hbase9.apache.org,35175,1696384805436' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-04 02:01:18,557 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-04 02:01:18,557 DEBUG [member: 'jenkins-hbase9.apache.org,35175,1696384805436' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35175-0x1010f1b55330003, quorum=127.0.0.1:60027, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-04 02:01:18,557 DEBUG [member: 'jenkins-hbase9.apache.org,35175,1696384805436' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-04 02:01:18,557 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-04 02:01:18,557 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,39045,1696384805392 2023-10-04 02:01:18,558 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,35175,1696384805436 2023-10-04 02:01:18,558 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44303,1696384805319 2023-10-04 02:01:18,558 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-04 02:01:18,559 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,39045,1696384805392' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' on coordinator 2023-10-04 02:01:18,559 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6cd8bfb5[Count = 0] remaining members to acquire global barrier 2023-10-04 02:01:18,559 DEBUG [(jenkins-hbase9.apache.org,39651,1696384803959)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'in-barrier' execution. 2023-10-04 02:01:18,559 DEBUG [(jenkins-hbase9.apache.org,39651,1696384803959)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-04 02:01:18,560 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): regionserver:44303-0x1010f1b55330001, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-04 02:01:18,560 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-04 02:01:18,560 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): regionserver:35175-0x1010f1b55330003, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-04 02:01:18,560 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): regionserver:39045-0x1010f1b55330002, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-04 02:01:18,561 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-04 02:01:18,560 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-04 02:01:18,561 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-04 02:01:18,561 DEBUG [member: 'jenkins-hbase9.apache.org,44303,1696384805319' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' received 'reached' from coordinator. 2023-10-04 02:01:18,561 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-04 02:01:18,561 DEBUG [(jenkins-hbase9.apache.org,39651,1696384803959)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39651-0x1010f1b55330000, quorum=127.0.0.1:60027, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase9.apache.org,39045,1696384805392 2023-10-04 02:01:18,561 DEBUG [member: 'jenkins-hbase9.apache.org,39045,1696384805392' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' received 'reached' from coordinator. 2023-10-04 02:01:18,561 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-04 02:01:18,561 DEBUG [(jenkins-hbase9.apache.org,39651,1696384803959)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-04 02:01:18,561 DEBUG [member: 'jenkins-hbase9.apache.org,35175,1696384805436' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' received 'reached' from coordinator. 2023-10-04 02:01:18,561 DEBUG [member: 'jenkins-hbase9.apache.org,44303,1696384805319' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally completed 2023-10-04 02:01:18,561 DEBUG [member: 'jenkins-hbase9.apache.org,35175,1696384805436' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally completed 2023-10-04 02:01:18,561 DEBUG [member: 'jenkins-hbase9.apache.org,35175,1696384805436' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed for member 'jenkins-hbase9.apache.org,35175,1696384805436' in zk 2023-10-04 02:01:18,561 DEBUG [member: 'jenkins-hbase9.apache.org,39045,1696384805392' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-04 02:01:18,561 DEBUG [member: 'jenkins-hbase9.apache.org,39045,1696384805392' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-04 02:01:18,561 DEBUG [rs(jenkins-hbase9.apache.org,39045,1696384805392)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion-1,,1696384876749.018d949fe4d33c96a4133913167ebfdb. 2023-10-04 02:01:18,561 DEBUG [member: 'jenkins-hbase9.apache.org,44303,1696384805319' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed for member 'jenkins-hbase9.apache.org,44303,1696384805319' in zk 2023-10-04 02:01:18,561 DEBUG [rs(jenkins-hbase9.apache.org,39045,1696384805392)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion-1,,1696384876749.018d949fe4d33c96a4133913167ebfdb. started... 2023-10-04 02:01:18,563 DEBUG [rs(jenkins-hbase9.apache.org,39045,1696384805392)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 018d949fe4d33c96a4133913167ebfdb: 2023-10-04 02:01:18,563 DEBUG [rs(jenkins-hbase9.apache.org,39045,1696384805392)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion-1,,1696384876749.018d949fe4d33c96a4133913167ebfdb.' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-04 02:01:18,563 DEBUG [rs(jenkins-hbase9.apache.org,39045,1696384805392)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-04 02:01:18,563 DEBUG [rs(jenkins-hbase9.apache.org,39045,1696384805392)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/018d949fe4d33c96a4133913167ebfdb/cf/9cb2ec6af8544e5291e3c5824957e5da.ee251983e839ee6dbc40cc61c0a6f617->hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ee251983e839ee6dbc40cc61c0a6f617/cf/9cb2ec6af8544e5291e3c5824957e5da-top, hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/018d949fe4d33c96a4133913167ebfdb/cf/cf56ae802a7f4549bbc53942f93d978b.fe1b2bafcd3a41814c7a1d6faf1927b8->hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/fe1b2bafcd3a41814c7a1d6faf1927b8/cf/cf56ae802a7f4549bbc53942f93d978b-top] hfiles 2023-10-04 02:01:18,563 DEBUG [rs(jenkins-hbase9.apache.org,39045,1696384805392)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/2): hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/018d949fe4d33c96a4133913167ebfdb/cf/9cb2ec6af8544e5291e3c5824957e5da.ee251983e839ee6dbc40cc61c0a6f617 for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-04 02:01:18,564 DEBUG [member: 'jenkins-hbase9.apache.org,35175,1696384805436' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' has notified controller of completion 2023-10-04 02:01:18,564 DEBUG [member: 'jenkins-hbase9.apache.org,35175,1696384805436' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-04 02:01:18,564 DEBUG [member: 'jenkins-hbase9.apache.org,35175,1696384805436' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed. 2023-10-04 02:01:18,565 DEBUG [member: 'jenkins-hbase9.apache.org,44303,1696384805319' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' has notified controller of completion 2023-10-04 02:01:18,565 DEBUG [rs(jenkins-hbase9.apache.org,39045,1696384805392)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (2/2): hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/018d949fe4d33c96a4133913167ebfdb/cf/cf56ae802a7f4549bbc53942f93d978b.fe1b2bafcd3a41814c7a1d6faf1927b8 for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-04 02:01:18,565 DEBUG [member: 'jenkins-hbase9.apache.org,44303,1696384805319' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-04 02:01:18,565 DEBUG [member: 'jenkins-hbase9.apache.org,44303,1696384805319' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed. 2023-10-04 02:01:18,580 DEBUG [rs(jenkins-hbase9.apache.org,39045,1696384805392)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion-1,,1696384876749.018d949fe4d33c96a4133913167ebfdb. completed. 2023-10-04 02:01:18,580 DEBUG [rs(jenkins-hbase9.apache.org,39045,1696384805392)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion-1,,1696384876749.018d949fe4d33c96a4133913167ebfdb. 2023-10-04 02:01:18,580 DEBUG [member: 'jenkins-hbase9.apache.org,39045,1696384805392' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-04 02:01:18,580 DEBUG [member: 'jenkins-hbase9.apache.org,39045,1696384805392' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-04 02:01:18,580 DEBUG [member: 'jenkins-hbase9.apache.org,39045,1696384805392' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase9.apache.org,39045,1696384805392 2023-10-04 02:01:18,580 DEBUG [member: 'jenkins-hbase9.apache.org,39045,1696384805392' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally completed 2023-10-04 02:01:18,580 DEBUG [member: 'jenkins-hbase9.apache.org,39045,1696384805392' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed for member 'jenkins-hbase9.apache.org,39045,1696384805392' in zk 2023-10-04 02:01:18,586 DEBUG [member: 'jenkins-hbase9.apache.org,39045,1696384805392' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' has notified controller of completion 2023-10-04 02:01:18,586 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): master:39651-0x1010f1b55330000, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase9.apache.org,39045,1696384805392 2023-10-04 02:01:18,586 DEBUG [member: 'jenkins-hbase9.apache.org,39045,1696384805392' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-04 02:01:18,586 DEBUG [member: 'jenkins-hbase9.apache.org,39045,1696384805392' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed. 2023-10-04 02:01:18,586 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase9.apache.org,39045,1696384805392 2023-10-04 02:01:18,586 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-04 02:01:18,586 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-04 02:01:18,587 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-04 02:01:18,587 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-04 02:01:18,587 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-04 02:01:18,587 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,39045,1696384805392 2023-10-04 02:01:18,588 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,35175,1696384805436 2023-10-04 02:01:18,588 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44303,1696384805319 2023-10-04 02:01:18,588 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-04 02:01:18,588 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-04 02:01:18,589 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,39045,1696384805392 2023-10-04 02:01:18,589 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,35175,1696384805436 2023-10-04 02:01:18,589 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44303,1696384805319 2023-10-04 02:01:18,589 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' member 'jenkins-hbase9.apache.org,39045,1696384805392': 2023-10-04 02:01:18,589 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,39045,1696384805392' released barrier for procedure'snaptb0-testExportFileSystemStateWithMergeRegion-1', counting down latch. Waiting for 0 more 2023-10-04 02:01:18,589 INFO [(jenkins-hbase9.apache.org,39651,1696384803959)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' execution completed 2023-10-04 02:01:18,590 DEBUG [(jenkins-hbase9.apache.org,39651,1696384803959)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-04 02:01:18,590 DEBUG [(jenkins-hbase9.apache.org,39651,1696384803959)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-04 02:01:18,590 DEBUG [(jenkins-hbase9.apache.org,39651,1696384803959)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-04 02:01:18,590 INFO [(jenkins-hbase9.apache.org,39651,1696384803959)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateWithMergeRegion-1including nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-10-04 02:01:18,593 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): master:39651-0x1010f1b55330000, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-04 02:01:18,593 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): regionserver:39045-0x1010f1b55330002, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-04 02:01:18,593 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-04 02:01:18,593 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-04 02:01:18,593 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): regionserver:44303-0x1010f1b55330001, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-04 02:01:18,593 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-04 02:01:18,593 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-04 02:01:18,593 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-04 02:01:18,593 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-04 02:01:18,593 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-04 02:01:18,593 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): regionserver:39045-0x1010f1b55330002, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-04 02:01:18,593 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): regionserver:35175-0x1010f1b55330003, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-04 02:01:18,593 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-04 02:01:18,593 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): regionserver:44303-0x1010f1b55330001, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-04 02:01:18,593 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-04 02:01:18,593 DEBUG [(jenkins-hbase9.apache.org,39651,1696384803959)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39651-0x1010f1b55330000, quorum=127.0.0.1:60027, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase9.apache.org,39045,1696384805392 2023-10-04 02:01:18,593 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-04 02:01:18,593 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): regionserver:35175-0x1010f1b55330003, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-04 02:01:18,594 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-04 02:01:18,594 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-04 02:01:18,594 DEBUG [(jenkins-hbase9.apache.org,39651,1696384803959)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39651-0x1010f1b55330000, quorum=127.0.0.1:60027, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase9.apache.org,35175,1696384805436 2023-10-04 02:01:18,593 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-04 02:01:18,593 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-04 02:01:18,594 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-04 02:01:18,594 DEBUG [(jenkins-hbase9.apache.org,39651,1696384803959)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39651-0x1010f1b55330000, quorum=127.0.0.1:60027, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase9.apache.org,44303,1696384805319 2023-10-04 02:01:18,594 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-04 02:01:18,594 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-04 02:01:18,594 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-04 02:01:18,595 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-04 02:01:18,595 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-04 02:01:18,595 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-04 02:01:18,595 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-04 02:01:18,595 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,39045,1696384805392 2023-10-04 02:01:18,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,35175,1696384805436 2023-10-04 02:01:18,596 DEBUG [(jenkins-hbase9.apache.org,39651,1696384803959)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39651-0x1010f1b55330000, quorum=127.0.0.1:60027, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase9.apache.org,39045,1696384805392 2023-10-04 02:01:18,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44303,1696384805319 2023-10-04 02:01:18,596 DEBUG [(jenkins-hbase9.apache.org,39651,1696384803959)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39651-0x1010f1b55330000, quorum=127.0.0.1:60027, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase9.apache.org,35175,1696384805436 2023-10-04 02:01:18,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-04 02:01:18,597 DEBUG [(jenkins-hbase9.apache.org,39651,1696384803959)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39651-0x1010f1b55330000, quorum=127.0.0.1:60027, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase9.apache.org,44303,1696384805319 2023-10-04 02:01:18,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-04 02:01:18,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,39045,1696384805392 2023-10-04 02:01:18,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,35175,1696384805436 2023-10-04 02:01:18,598 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44303,1696384805319 2023-10-04 02:01:18,599 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): master:39651-0x1010f1b55330000, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase9.apache.org,44303,1696384805319 2023-10-04 02:01:18,599 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): master:39651-0x1010f1b55330000, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-04 02:01:18,599 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): regionserver:44303-0x1010f1b55330001, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-04 02:01:18,600 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): regionserver:39045-0x1010f1b55330002, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-04 02:01:18,600 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-04 02:01:18,600 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-04 02:01:18,600 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-04 02:01:18,600 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): regionserver:44303-0x1010f1b55330001, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-04 02:01:18,599 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): master:39651-0x1010f1b55330000, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase9.apache.org,35175,1696384805436 2023-10-04 02:01:18,599 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): regionserver:35175-0x1010f1b55330003, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-04 02:01:18,600 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): master:39651-0x1010f1b55330000, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase9.apache.org,39045,1696384805392 2023-10-04 02:01:18,600 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-04 02:01:18,600 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-04 02:01:18,600 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-04 02:01:18,600 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): master:39651-0x1010f1b55330000, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-04 02:01:18,600 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): regionserver:35175-0x1010f1b55330003, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-04 02:01:18,600 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): master:39651-0x1010f1b55330000, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase9.apache.org,44303,1696384805319 2023-10-04 02:01:18,600 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): master:39651-0x1010f1b55330000, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-04 02:01:18,600 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): master:39651-0x1010f1b55330000, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase9.apache.org,35175,1696384805436 2023-10-04 02:01:18,600 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): master:39651-0x1010f1b55330000, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase9.apache.org,39045,1696384805392 2023-10-04 02:01:18,600 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): master:39651-0x1010f1b55330000, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-04 02:01:18,604 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): regionserver:39045-0x1010f1b55330002, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-04 02:01:18,604 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): master:39651-0x1010f1b55330000, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-04 02:01:18,604 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-04 02:01:18,604 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-04 02:01:18,604 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-04 02:01:18,604 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-04 02:01:18,604 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-04 02:01:18,605 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-04 02:01:18,604 DEBUG [(jenkins-hbase9.apache.org,39651,1696384803959)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-04 02:01:18,604 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-04 02:01:18,604 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-04 02:01:18,606 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-04 02:01:18,625 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 to hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-04 02:01:18,625 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 of table testtb-testExportFileSystemStateWithMergeRegion-1 completed 2023-10-04 02:01:18,625 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-04 02:01:18,626 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-04 02:01:18,626 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion-1 at 1696384878527Consolidate snapshot: snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1696384878604 (+77 ms)Loading Region manifests for snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1696384878605 (+1 ms)Writing data manifest for snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1696384878610 (+5 ms)Verifying snapshot: snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1696384878617 (+7 ms)Snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 of table testtb-testExportFileSystemStateWithMergeRegion-1 completed at 1696384878625 (+8 ms) 2023-10-04 02:01:18,629 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=79, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED 2023-10-04 02:01:18,630 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=79, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED in 99 msec 2023-10-04 02:01:18,632 DEBUG [Listener at jenkins-hbase9.apache.org/33899] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-04 02:01:18,633 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39651] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } is done 2023-10-04 02:01:18,633 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39651] snapshot.SnapshotManager(403): Snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }' has completed, notifying client. 2023-10-04 02:01:18,633 INFO [Listener at jenkins-hbase9.apache.org/33899] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/export-test/export-1696384878633 2023-10-04 02:01:18,633 INFO [Listener at jenkins-hbase9.apache.org/33899] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:38449, tgtDir=hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/export-test/export-1696384878633, rawTgtDir=hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/export-test/export-1696384878633, srcFsUri=hdfs://localhost:38449, srcDir=hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51 2023-10-04 02:01:18,655 DEBUG [Listener at jenkins-hbase9.apache.org/33899] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:38449, inputRoot=hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51 2023-10-04 02:01:18,655 DEBUG [Listener at jenkins-hbase9.apache.org/33899] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_397166598_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/export-test/export-1696384878633, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/export-test/export-1696384878633/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-04 02:01:18,655 INFO [Listener at jenkins-hbase9.apache.org/33899] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:38449, inputRoot=hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51, snapshotDir=hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1. 2023-10-04 02:01:18,664 INFO [Listener at jenkins-hbase9.apache.org/33899] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 to hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/export-test/export-1696384878633/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-04 02:01:18,678 DEBUG [Listener at jenkins-hbase9.apache.org/33899] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-10-04 02:01:18,679 DEBUG [Listener at jenkins-hbase9.apache.org/33899] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-10-04 02:01:18,679 DEBUG [Listener at jenkins-hbase9.apache.org/33899] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-10-04 02:01:18,680 DEBUG [Listener at jenkins-hbase9.apache.org/33899] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-10-04 02:01:18,680 DEBUG [Listener at jenkins-hbase9.apache.org/33899] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar 2023-10-04 02:01:18,680 DEBUG [Listener at jenkins-hbase9.apache.org/33899] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-10-04 02:01:18,680 DEBUG [Listener at jenkins-hbase9.apache.org/33899] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-10-04 02:01:18,750 DEBUG [Listener at jenkins-hbase9.apache.org/33899] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/757a468a-9656-cc80-ec19-d6f68f36be5a/hadoop-7616810823853036950.jar 2023-10-04 02:01:18,750 DEBUG [Listener at jenkins-hbase9.apache.org/33899] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-10-04 02:01:18,751 DEBUG [Listener at jenkins-hbase9.apache.org/33899] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-10-04 02:01:18,751 DEBUG [Listener at jenkins-hbase9.apache.org/33899] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-10-04 02:01:18,751 DEBUG [Listener at jenkins-hbase9.apache.org/33899] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-10-04 02:01:18,752 DEBUG [Listener at jenkins-hbase9.apache.org/33899] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-10-04 02:01:18,752 DEBUG [Listener at jenkins-hbase9.apache.org/33899] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-10-04 02:01:18,752 DEBUG [Listener at jenkins-hbase9.apache.org/33899] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-10-04 02:01:18,753 DEBUG [Listener at jenkins-hbase9.apache.org/33899] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-10-04 02:01:18,753 DEBUG [Listener at jenkins-hbase9.apache.org/33899] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-10-04 02:01:18,753 DEBUG [Listener at jenkins-hbase9.apache.org/33899] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-10-04 02:01:18,754 DEBUG [Listener at jenkins-hbase9.apache.org/33899] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-10-04 02:01:18,754 DEBUG [Listener at jenkins-hbase9.apache.org/33899] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-10-04 02:01:18,755 DEBUG [Listener at jenkins-hbase9.apache.org/33899] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-10-04 02:01:18,755 DEBUG [Listener at jenkins-hbase9.apache.org/33899] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-10-04 02:01:18,755 DEBUG [Listener at jenkins-hbase9.apache.org/33899] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-10-04 02:01:18,756 DEBUG [Listener at jenkins-hbase9.apache.org/33899] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-10-04 02:01:18,756 DEBUG [Listener at jenkins-hbase9.apache.org/33899] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-04 02:01:18,757 DEBUG [Listener at jenkins-hbase9.apache.org/33899] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-04 02:01:18,757 DEBUG [Listener at jenkins-hbase9.apache.org/33899] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-10-04 02:01:18,757 DEBUG [Listener at jenkins-hbase9.apache.org/33899] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-04 02:01:18,757 DEBUG [Listener at jenkins-hbase9.apache.org/33899] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-04 02:01:18,758 DEBUG [Listener at jenkins-hbase9.apache.org/33899] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-10-04 02:01:18,758 DEBUG [Listener at jenkins-hbase9.apache.org/33899] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-10-04 02:01:19,095 WARN [Listener at jenkins-hbase9.apache.org/33899] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-10-04 02:01:19,097 INFO [Listener at jenkins-hbase9.apache.org/33899] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportFileSystemStateWithMergeRegion-1' hfile list 2023-10-04 02:01:19,099 DEBUG [Listener at jenkins-hbase9.apache.org/33899] snapshot.ExportSnapshot(671): export split=0 size=9.5 K 2023-10-04 02:01:19,957 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-10-04 02:01:19,957 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-10-04 02:01:19,959 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696384811997_0004_000001 (auth:SIMPLE) 2023-10-04 02:01:20,229 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696384811997_0005_000001 (auth:SIMPLE) 2023-10-04 02:01:20,650 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-10-04 02:01:23,961 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696384811997_0005_000001 (auth:SIMPLE) 2023-10-04 02:01:26,165 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696384811997_0005_000001 (auth:SIMPLE) 2023-10-04 02:01:28,497 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696384811997_0005_000001 (auth:SIMPLE) 2023-10-04 02:01:30,279 INFO [Listener at jenkins-hbase9.apache.org/33899] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-10-04 02:01:30,282 INFO [Listener at jenkins-hbase9.apache.org/33899] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-10-04 02:01:30,292 INFO [Listener at jenkins-hbase9.apache.org/33899] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-04 02:01:30,292 INFO [Listener at jenkins-hbase9.apache.org/33899] snapshot.TestExportSnapshot(279): Exported snapshot 2023-10-04 02:01:30,293 INFO [Listener at jenkins-hbase9.apache.org/33899] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-10-04 02:01:30,293 DEBUG [Listener at jenkins-hbase9.apache.org/33899] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-737588810_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 at hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-04 02:01:30,293 DEBUG [Listener at jenkins-hbase9.apache.org/33899] snapshot.TestExportSnapshot(367): hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/.snapshotinfo 2023-10-04 02:01:30,294 DEBUG [Listener at jenkins-hbase9.apache.org/33899] snapshot.TestExportSnapshot(367): hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/data.manifest 2023-10-04 02:01:30,294 DEBUG [Listener at jenkins-hbase9.apache.org/33899] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-737588810_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/export-test/export-1696384878633/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 at hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/export-test/export-1696384878633/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-04 02:01:30,294 DEBUG [Listener at jenkins-hbase9.apache.org/33899] snapshot.TestExportSnapshot(367): hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/export-test/export-1696384878633/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/.snapshotinfo 2023-10-04 02:01:30,294 DEBUG [Listener at jenkins-hbase9.apache.org/33899] snapshot.TestExportSnapshot(367): hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/export-test/export-1696384878633/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/data.manifest 2023-10-04 02:01:30,301 INFO [Listener at jenkins-hbase9.apache.org/33899] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemStateWithMergeRegion-1 2023-10-04 02:01:30,301 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39651] master.HMaster$11(2418): Client=jenkins//172.31.2.10 disable testtb-testExportFileSystemStateWithMergeRegion-1 2023-10-04 02:01:30,302 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39651] procedure2.ProcedureExecutor(1028): Stored pid=80, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-10-04 02:01:30,305 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39651] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-10-04 02:01:30,305 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696384890305"}]},"ts":"1696384890305"} 2023-10-04 02:01:30,306 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=DISABLING in hbase:meta 2023-10-04 02:01:30,308 INFO [PEWorker-1] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemStateWithMergeRegion-1 to state=DISABLING 2023-10-04 02:01:30,309 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=81, ppid=80, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=018d949fe4d33c96a4133913167ebfdb, UNASSIGN}] 2023-10-04 02:01:30,310 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=81, ppid=80, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=018d949fe4d33c96a4133913167ebfdb, UNASSIGN 2023-10-04 02:01:30,311 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=81 updating hbase:meta row=018d949fe4d33c96a4133913167ebfdb, regionState=CLOSING, regionLocation=jenkins-hbase9.apache.org,39045,1696384805392 2023-10-04 02:01:30,311 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1696384876749.018d949fe4d33c96a4133913167ebfdb.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1696384890311"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696384890311"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696384890311"}]},"ts":"1696384890311"} 2023-10-04 02:01:30,312 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=82, ppid=81, state=RUNNABLE; CloseRegionProcedure 018d949fe4d33c96a4133913167ebfdb, server=jenkins-hbase9.apache.org,39045,1696384805392}] 2023-10-04 02:01:30,406 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39651] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-10-04 02:01:30,464 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(111): Close 018d949fe4d33c96a4133913167ebfdb 2023-10-04 02:01:30,464 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1604): Closing 018d949fe4d33c96a4133913167ebfdb, disabling compactions & flushes 2023-10-04 02:01:30,464 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,,1696384876749.018d949fe4d33c96a4133913167ebfdb. 2023-10-04 02:01:30,464 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1696384876749.018d949fe4d33c96a4133913167ebfdb. 2023-10-04 02:01:30,465 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1696384876749.018d949fe4d33c96a4133913167ebfdb. after waiting 0 ms 2023-10-04 02:01:30,465 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,,1696384876749.018d949fe4d33c96a4133913167ebfdb. 2023-10-04 02:01:30,475 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/018d949fe4d33c96a4133913167ebfdb/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=8 2023-10-04 02:01:30,475 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-10-04 02:01:30,476 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,,1696384876749.018d949fe4d33c96a4133913167ebfdb. 2023-10-04 02:01:30,476 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1558): Region close journal for 018d949fe4d33c96a4133913167ebfdb: 2023-10-04 02:01:30,478 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(149): Closed 018d949fe4d33c96a4133913167ebfdb 2023-10-04 02:01:30,478 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=81 updating hbase:meta row=018d949fe4d33c96a4133913167ebfdb, regionState=CLOSED 2023-10-04 02:01:30,478 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1696384876749.018d949fe4d33c96a4133913167ebfdb.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1696384890478"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696384890478"}]},"ts":"1696384890478"} 2023-10-04 02:01:30,481 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=82, resume processing ppid=81 2023-10-04 02:01:30,481 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=82, ppid=81, state=SUCCESS; CloseRegionProcedure 018d949fe4d33c96a4133913167ebfdb, server=jenkins-hbase9.apache.org,39045,1696384805392 in 167 msec 2023-10-04 02:01:30,482 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=81, resume processing ppid=80 2023-10-04 02:01:30,482 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=81, ppid=80, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=018d949fe4d33c96a4133913167ebfdb, UNASSIGN in 172 msec 2023-10-04 02:01:30,483 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696384890483"}]},"ts":"1696384890483"} 2023-10-04 02:01:30,484 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=DISABLED in hbase:meta 2023-10-04 02:01:30,486 INFO [PEWorker-1] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemStateWithMergeRegion-1 to state=DISABLED 2023-10-04 02:01:30,487 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=80, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 in 185 msec 2023-10-04 02:01:30,607 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39651] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-10-04 02:01:30,607 INFO [Listener at jenkins-hbase9.apache.org/33899] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 80 completed 2023-10-04 02:01:30,608 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39651] master.HMaster$5(2228): Client=jenkins//172.31.2.10 delete testtb-testExportFileSystemStateWithMergeRegion-1 2023-10-04 02:01:30,609 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39651] procedure2.ProcedureExecutor(1028): Stored pid=83, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-10-04 02:01:30,611 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=83, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-10-04 02:01:30,611 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39651] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemStateWithMergeRegion-1 2023-10-04 02:01:30,612 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=83, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-10-04 02:01:30,613 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=44303] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemStateWithMergeRegion-1 2023-10-04 02:01:30,616 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/fe1b2bafcd3a41814c7a1d6faf1927b8 2023-10-04 02:01:30,616 DEBUG [HFileArchiver-20] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ee251983e839ee6dbc40cc61c0a6f617 2023-10-04 02:01:30,616 DEBUG [HFileArchiver-19] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/018d949fe4d33c96a4133913167ebfdb 2023-10-04 02:01:30,617 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): regionserver:39045-0x1010f1b55330002, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-10-04 02:01:30,617 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): master:39651-0x1010f1b55330000, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-10-04 02:01:30,617 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): regionserver:35175-0x1010f1b55330003, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-10-04 02:01:30,617 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): regionserver:44303-0x1010f1b55330001, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-10-04 02:01:30,618 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-10-04 02:01:30,618 DEBUG [HFileArchiver-13] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/fe1b2bafcd3a41814c7a1d6faf1927b8/cf, FileablePath, hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/fe1b2bafcd3a41814c7a1d6faf1927b8/recovered.edits] 2023-10-04 02:01:30,618 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-10-04 02:01:30,618 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-10-04 02:01:30,618 DEBUG [HFileArchiver-19] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/018d949fe4d33c96a4133913167ebfdb/cf, FileablePath, hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/018d949fe4d33c96a4133913167ebfdb/recovered.edits] 2023-10-04 02:01:30,619 DEBUG [HFileArchiver-20] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ee251983e839ee6dbc40cc61c0a6f617/cf, FileablePath, hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ee251983e839ee6dbc40cc61c0a6f617/recovered.edits] 2023-10-04 02:01:30,619 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): regionserver:35175-0x1010f1b55330003, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-10-04 02:01:30,619 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): regionserver:39045-0x1010f1b55330002, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-10-04 02:01:30,619 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): master:39651-0x1010f1b55330000, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-10-04 02:01:30,619 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data null 2023-10-04 02:01:30,619 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): regionserver:44303-0x1010f1b55330001, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-04 02:01:30,619 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): regionserver:39045-0x1010f1b55330002, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-04 02:01:30,619 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): regionserver:35175-0x1010f1b55330003, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-04 02:01:30,619 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-10-04 02:01:30,619 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): master:39651-0x1010f1b55330000, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-04 02:01:30,621 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39651] master.MasterRpcServices(1230): Checking to see if procedure is done pid=83 2023-10-04 02:01:30,621 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-10-04 02:01:30,621 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-10-04 02:01:30,621 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-10-04 02:01:30,621 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-10-04 02:01:30,623 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/018d949fe4d33c96a4133913167ebfdb/cf/9cb2ec6af8544e5291e3c5824957e5da.ee251983e839ee6dbc40cc61c0a6f617 to hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/018d949fe4d33c96a4133913167ebfdb/cf/9cb2ec6af8544e5291e3c5824957e5da.ee251983e839ee6dbc40cc61c0a6f617 2023-10-04 02:01:30,624 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/fe1b2bafcd3a41814c7a1d6faf1927b8/cf/cf56ae802a7f4549bbc53942f93d978b to hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/fe1b2bafcd3a41814c7a1d6faf1927b8/cf/cf56ae802a7f4549bbc53942f93d978b 2023-10-04 02:01:30,625 DEBUG [HFileArchiver-20] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ee251983e839ee6dbc40cc61c0a6f617/cf/9cb2ec6af8544e5291e3c5824957e5da to hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ee251983e839ee6dbc40cc61c0a6f617/cf/9cb2ec6af8544e5291e3c5824957e5da 2023-10-04 02:01:30,625 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/018d949fe4d33c96a4133913167ebfdb/cf/cf56ae802a7f4549bbc53942f93d978b.fe1b2bafcd3a41814c7a1d6faf1927b8 to hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/018d949fe4d33c96a4133913167ebfdb/cf/cf56ae802a7f4549bbc53942f93d978b.fe1b2bafcd3a41814c7a1d6faf1927b8 2023-10-04 02:01:30,629 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/fe1b2bafcd3a41814c7a1d6faf1927b8/recovered.edits/8.seqid to hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/fe1b2bafcd3a41814c7a1d6faf1927b8/recovered.edits/8.seqid 2023-10-04 02:01:30,629 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/018d949fe4d33c96a4133913167ebfdb/recovered.edits/12.seqid to hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/018d949fe4d33c96a4133913167ebfdb/recovered.edits/12.seqid 2023-10-04 02:01:30,630 DEBUG [HFileArchiver-20] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ee251983e839ee6dbc40cc61c0a6f617/recovered.edits/8.seqid to hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ee251983e839ee6dbc40cc61c0a6f617/recovered.edits/8.seqid 2023-10-04 02:01:30,630 DEBUG [HFileArchiver-13] backup.HFileArchiver(596): Deleted hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/fe1b2bafcd3a41814c7a1d6faf1927b8 2023-10-04 02:01:30,630 DEBUG [HFileArchiver-19] backup.HFileArchiver(596): Deleted hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/018d949fe4d33c96a4133913167ebfdb 2023-10-04 02:01:30,630 DEBUG [HFileArchiver-20] backup.HFileArchiver(596): Deleted hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ee251983e839ee6dbc40cc61c0a6f617 2023-10-04 02:01:30,630 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion-1 regions 2023-10-04 02:01:30,632 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=83, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-10-04 02:01:30,635 WARN [PEWorker-5] procedure.DeleteTableProcedure(384): Deleting some vestigial 1 rows of testtb-testExportFileSystemStateWithMergeRegion-1 from hbase:meta 2023-10-04 02:01:30,636 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemStateWithMergeRegion-1' descriptor. 2023-10-04 02:01:30,637 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=83, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-10-04 02:01:30,637 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemStateWithMergeRegion-1' from region states. 2023-10-04 02:01:30,638 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1696384876749.018d949fe4d33c96a4133913167ebfdb.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1696384890637"}]},"ts":"9223372036854775807"} 2023-10-04 02:01:30,639 INFO [PEWorker-5] hbase.MetaTableAccessor(1788): Deleted 1 regions from META 2023-10-04 02:01:30,639 DEBUG [PEWorker-5] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 018d949fe4d33c96a4133913167ebfdb, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1696384876749.018d949fe4d33c96a4133913167ebfdb.', STARTKEY => '', ENDKEY => ''}] 2023-10-04 02:01:30,639 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemStateWithMergeRegion-1' as deleted. 2023-10-04 02:01:30,639 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1696384890639"}]},"ts":"9223372036854775807"} 2023-10-04 02:01:30,640 INFO [PEWorker-5] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemStateWithMergeRegion-1 state from META 2023-10-04 02:01:30,642 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(130): Finished pid=83, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-10-04 02:01:30,643 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=83, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 in 34 msec 2023-10-04 02:01:30,722 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39651] master.MasterRpcServices(1230): Checking to see if procedure is done pid=83 2023-10-04 02:01:30,722 INFO [Listener at jenkins-hbase9.apache.org/33899] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 83 completed 2023-10-04 02:01:30,723 INFO [Listener at jenkins-hbase9.apache.org/33899] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemStateWithMergeRegion 2023-10-04 02:01:30,723 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39651] master.HMaster$11(2418): Client=jenkins//172.31.2.10 disable testtb-testExportFileSystemStateWithMergeRegion 2023-10-04 02:01:30,724 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39651] procedure2.ProcedureExecutor(1028): Stored pid=84, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-10-04 02:01:30,727 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39651] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-10-04 02:01:30,727 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696384890727"}]},"ts":"1696384890727"} 2023-10-04 02:01:30,728 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=DISABLING in hbase:meta 2023-10-04 02:01:30,730 INFO [PEWorker-2] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemStateWithMergeRegion to state=DISABLING 2023-10-04 02:01:30,731 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=85, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=0111ae2bc128c718ba0469aa41d435ee, UNASSIGN}, {pid=86, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=a9dfc2e86ffa31dcf326539b4c556dd1, UNASSIGN}] 2023-10-04 02:01:30,732 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=85, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=0111ae2bc128c718ba0469aa41d435ee, UNASSIGN 2023-10-04 02:01:30,733 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=86, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=a9dfc2e86ffa31dcf326539b4c556dd1, UNASSIGN 2023-10-04 02:01:30,733 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=85 updating hbase:meta row=0111ae2bc128c718ba0469aa41d435ee, regionState=CLOSING, regionLocation=jenkins-hbase9.apache.org,39045,1696384805392 2023-10-04 02:01:30,733 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=86 updating hbase:meta row=a9dfc2e86ffa31dcf326539b4c556dd1, regionState=CLOSING, regionLocation=jenkins-hbase9.apache.org,35175,1696384805436 2023-10-04 02:01:30,733 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1696384875386.0111ae2bc128c718ba0469aa41d435ee.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1696384890733"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696384890733"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696384890733"}]},"ts":"1696384890733"} 2023-10-04 02:01:30,733 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1696384875386.a9dfc2e86ffa31dcf326539b4c556dd1.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1696384890733"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696384890733"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696384890733"}]},"ts":"1696384890733"} 2023-10-04 02:01:30,734 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=87, ppid=85, state=RUNNABLE; CloseRegionProcedure 0111ae2bc128c718ba0469aa41d435ee, server=jenkins-hbase9.apache.org,39045,1696384805392}] 2023-10-04 02:01:30,735 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=88, ppid=86, state=RUNNABLE; CloseRegionProcedure a9dfc2e86ffa31dcf326539b4c556dd1, server=jenkins-hbase9.apache.org,35175,1696384805436}] 2023-10-04 02:01:30,828 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39651] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-10-04 02:01:30,886 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(111): Close a9dfc2e86ffa31dcf326539b4c556dd1 2023-10-04 02:01:30,886 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(111): Close 0111ae2bc128c718ba0469aa41d435ee 2023-10-04 02:01:30,886 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1604): Closing a9dfc2e86ffa31dcf326539b4c556dd1, disabling compactions & flushes 2023-10-04 02:01:30,887 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1604): Closing 0111ae2bc128c718ba0469aa41d435ee, disabling compactions & flushes 2023-10-04 02:01:30,887 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,1,1696384875386.a9dfc2e86ffa31dcf326539b4c556dd1. 2023-10-04 02:01:30,887 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,,1696384875386.0111ae2bc128c718ba0469aa41d435ee. 2023-10-04 02:01:30,887 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1696384875386.a9dfc2e86ffa31dcf326539b4c556dd1. 2023-10-04 02:01:30,887 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,,1696384875386.0111ae2bc128c718ba0469aa41d435ee. 2023-10-04 02:01:30,887 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1696384875386.a9dfc2e86ffa31dcf326539b4c556dd1. after waiting 0 ms 2023-10-04 02:01:30,887 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,1,1696384875386.a9dfc2e86ffa31dcf326539b4c556dd1. 2023-10-04 02:01:30,887 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,,1696384875386.0111ae2bc128c718ba0469aa41d435ee. after waiting 0 ms 2023-10-04 02:01:30,887 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,,1696384875386.0111ae2bc128c718ba0469aa41d435ee. 2023-10-04 02:01:30,896 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/data/default/testtb-testExportFileSystemStateWithMergeRegion/0111ae2bc128c718ba0469aa41d435ee/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-10-04 02:01:30,897 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/data/default/testtb-testExportFileSystemStateWithMergeRegion/a9dfc2e86ffa31dcf326539b4c556dd1/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-10-04 02:01:30,897 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-10-04 02:01:30,898 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,,1696384875386.0111ae2bc128c718ba0469aa41d435ee. 2023-10-04 02:01:30,898 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-10-04 02:01:30,898 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1558): Region close journal for 0111ae2bc128c718ba0469aa41d435ee: 2023-10-04 02:01:30,899 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,1,1696384875386.a9dfc2e86ffa31dcf326539b4c556dd1. 2023-10-04 02:01:30,899 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1558): Region close journal for a9dfc2e86ffa31dcf326539b4c556dd1: 2023-10-04 02:01:30,900 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(149): Closed 0111ae2bc128c718ba0469aa41d435ee 2023-10-04 02:01:30,900 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=85 updating hbase:meta row=0111ae2bc128c718ba0469aa41d435ee, regionState=CLOSED 2023-10-04 02:01:30,900 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1696384875386.0111ae2bc128c718ba0469aa41d435ee.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1696384890900"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696384890900"}]},"ts":"1696384890900"} 2023-10-04 02:01:30,901 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(149): Closed a9dfc2e86ffa31dcf326539b4c556dd1 2023-10-04 02:01:30,901 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=86 updating hbase:meta row=a9dfc2e86ffa31dcf326539b4c556dd1, regionState=CLOSED 2023-10-04 02:01:30,901 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1696384875386.a9dfc2e86ffa31dcf326539b4c556dd1.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1696384890901"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696384890901"}]},"ts":"1696384890901"} 2023-10-04 02:01:30,903 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=87, resume processing ppid=85 2023-10-04 02:01:30,903 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=87, ppid=85, state=SUCCESS; CloseRegionProcedure 0111ae2bc128c718ba0469aa41d435ee, server=jenkins-hbase9.apache.org,39045,1696384805392 in 168 msec 2023-10-04 02:01:30,904 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=88, resume processing ppid=86 2023-10-04 02:01:30,904 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=88, ppid=86, state=SUCCESS; CloseRegionProcedure a9dfc2e86ffa31dcf326539b4c556dd1, server=jenkins-hbase9.apache.org,35175,1696384805436 in 167 msec 2023-10-04 02:01:30,904 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=85, ppid=84, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=0111ae2bc128c718ba0469aa41d435ee, UNASSIGN in 173 msec 2023-10-04 02:01:30,905 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=86, resume processing ppid=84 2023-10-04 02:01:30,905 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=86, ppid=84, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=a9dfc2e86ffa31dcf326539b4c556dd1, UNASSIGN in 173 msec 2023-10-04 02:01:30,906 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696384890906"}]},"ts":"1696384890906"} 2023-10-04 02:01:30,907 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=DISABLED in hbase:meta 2023-10-04 02:01:30,909 INFO [PEWorker-5] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemStateWithMergeRegion to state=DISABLED 2023-10-04 02:01:30,910 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=84, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion in 186 msec 2023-10-04 02:01:31,029 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39651] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-10-04 02:01:31,029 INFO [Listener at jenkins-hbase9.apache.org/33899] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion, procId: 84 completed 2023-10-04 02:01:31,030 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39651] master.HMaster$5(2228): Client=jenkins//172.31.2.10 delete testtb-testExportFileSystemStateWithMergeRegion 2023-10-04 02:01:31,031 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39651] procedure2.ProcedureExecutor(1028): Stored pid=89, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-10-04 02:01:31,033 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=89, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-10-04 02:01:31,034 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39651] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemStateWithMergeRegion 2023-10-04 02:01:31,034 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=89, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-10-04 02:01:31,035 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=44303] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemStateWithMergeRegion 2023-10-04 02:01:31,038 DEBUG [HFileArchiver-14] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/0111ae2bc128c718ba0469aa41d435ee 2023-10-04 02:01:31,038 DEBUG [HFileArchiver-15] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/a9dfc2e86ffa31dcf326539b4c556dd1 2023-10-04 02:01:31,038 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): regionserver:39045-0x1010f1b55330002, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-10-04 02:01:31,038 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): regionserver:35175-0x1010f1b55330003, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-10-04 02:01:31,038 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): regionserver:44303-0x1010f1b55330001, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-10-04 02:01:31,038 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): master:39651-0x1010f1b55330000, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-10-04 02:01:31,039 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-10-04 02:01:31,039 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-10-04 02:01:31,039 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-10-04 02:01:31,039 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-10-04 02:01:31,042 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): regionserver:44303-0x1010f1b55330001, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-10-04 02:01:31,042 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): regionserver:35175-0x1010f1b55330003, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-10-04 02:01:31,042 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): regionserver:39045-0x1010f1b55330002, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-10-04 02:01:31,042 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): regionserver:35175-0x1010f1b55330003, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-04 02:01:31,042 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): regionserver:39045-0x1010f1b55330002, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-04 02:01:31,042 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): master:39651-0x1010f1b55330000, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-10-04 02:01:31,042 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): master:39651-0x1010f1b55330000, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-04 02:01:31,042 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): regionserver:44303-0x1010f1b55330001, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-04 02:01:31,043 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39651] master.MasterRpcServices(1230): Checking to see if procedure is done pid=89 2023-10-04 02:01:31,044 DEBUG [HFileArchiver-15] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/a9dfc2e86ffa31dcf326539b4c556dd1/cf, FileablePath, hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/a9dfc2e86ffa31dcf326539b4c556dd1/recovered.edits] 2023-10-04 02:01:31,044 DEBUG [HFileArchiver-14] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/0111ae2bc128c718ba0469aa41d435ee/cf, FileablePath, hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/0111ae2bc128c718ba0469aa41d435ee/recovered.edits] 2023-10-04 02:01:31,047 DEBUG [HFileArchiver-15] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/a9dfc2e86ffa31dcf326539b4c556dd1/cf/f8609d2231c94172b0b8e2e2c6e9c54e to hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/a9dfc2e86ffa31dcf326539b4c556dd1/cf/f8609d2231c94172b0b8e2e2c6e9c54e 2023-10-04 02:01:31,047 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/0111ae2bc128c718ba0469aa41d435ee/cf/57434000b3ca483fae3c1c7f64fda6a3 to hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/0111ae2bc128c718ba0469aa41d435ee/cf/57434000b3ca483fae3c1c7f64fda6a3 2023-10-04 02:01:31,050 DEBUG [HFileArchiver-15] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/a9dfc2e86ffa31dcf326539b4c556dd1/recovered.edits/9.seqid to hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/a9dfc2e86ffa31dcf326539b4c556dd1/recovered.edits/9.seqid 2023-10-04 02:01:31,050 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/0111ae2bc128c718ba0469aa41d435ee/recovered.edits/9.seqid to hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/0111ae2bc128c718ba0469aa41d435ee/recovered.edits/9.seqid 2023-10-04 02:01:31,050 DEBUG [HFileArchiver-15] backup.HFileArchiver(596): Deleted hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/a9dfc2e86ffa31dcf326539b4c556dd1 2023-10-04 02:01:31,050 DEBUG [HFileArchiver-14] backup.HFileArchiver(596): Deleted hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/0111ae2bc128c718ba0469aa41d435ee 2023-10-04 02:01:31,051 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion regions 2023-10-04 02:01:31,051 DEBUG [PEWorker-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c 2023-10-04 02:01:31,052 DEBUG [PEWorker-4] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf] 2023-10-04 02:01:31,054 DEBUG [PEWorker-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b2023100470f29098471247d78a9bc3e449d4eb19 to hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b2023100470f29098471247d78a9bc3e449d4eb19 2023-10-04 02:01:31,055 DEBUG [PEWorker-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e20231004c12c37a2b1414509894b2e78e4ce385b to hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e20231004c12c37a2b1414509894b2e78e4ce385b 2023-10-04 02:01:31,056 DEBUG [PEWorker-4] backup.HFileArchiver(596): Deleted hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c 2023-10-04 02:01:31,057 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=89, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-10-04 02:01:31,059 WARN [PEWorker-4] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportFileSystemStateWithMergeRegion from hbase:meta 2023-10-04 02:01:31,061 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemStateWithMergeRegion' descriptor. 2023-10-04 02:01:31,062 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=89, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-10-04 02:01:31,062 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemStateWithMergeRegion' from region states. 2023-10-04 02:01:31,062 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1696384875386.0111ae2bc128c718ba0469aa41d435ee.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1696384891062"}]},"ts":"9223372036854775807"} 2023-10-04 02:01:31,062 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1696384875386.a9dfc2e86ffa31dcf326539b4c556dd1.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1696384891062"}]},"ts":"9223372036854775807"} 2023-10-04 02:01:31,064 INFO [PEWorker-4] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-10-04 02:01:31,064 DEBUG [PEWorker-4] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 0111ae2bc128c718ba0469aa41d435ee, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,,1696384875386.0111ae2bc128c718ba0469aa41d435ee.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => a9dfc2e86ffa31dcf326539b4c556dd1, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,1,1696384875386.a9dfc2e86ffa31dcf326539b4c556dd1.', STARTKEY => '1', ENDKEY => ''}] 2023-10-04 02:01:31,064 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemStateWithMergeRegion' as deleted. 2023-10-04 02:01:31,064 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1696384891064"}]},"ts":"9223372036854775807"} 2023-10-04 02:01:31,065 INFO [PEWorker-4] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemStateWithMergeRegion state from META 2023-10-04 02:01:31,069 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(130): Finished pid=89, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-10-04 02:01:31,070 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=89, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion in 39 msec 2023-10-04 02:01:31,144 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39651] master.MasterRpcServices(1230): Checking to see if procedure is done pid=89 2023-10-04 02:01:31,145 INFO [Listener at jenkins-hbase9.apache.org/33899] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion, procId: 89 completed 2023-10-04 02:01:31,153 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39651] master.MasterRpcServices(751): Client=jenkins//172.31.2.10 delete name: "emptySnaptb0-testExportFileSystemStateWithMergeRegion" 2023-10-04 02:01:31,155 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39651] snapshot.SnapshotManager(335): Deleting snapshot: emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 02:01:31,157 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39651] master.MasterRpcServices(751): Client=jenkins//172.31.2.10 delete name: "snaptb0-testExportFileSystemStateWithMergeRegion" 2023-10-04 02:01:31,158 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39651] snapshot.SnapshotManager(335): Deleting snapshot: snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-04 02:01:31,159 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39651] master.MasterRpcServices(751): Client=jenkins//172.31.2.10 delete name: "snaptb0-testExportFileSystemStateWithMergeRegion-1" 2023-10-04 02:01:31,161 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39651] snapshot.SnapshotManager(335): Deleting snapshot: snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-04 02:01:31,185 INFO [Listener at jenkins-hbase9.apache.org/33899] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testExportFileSystemStateWithMergeRegion Thread=758 (was 751) Potentially hanging thread: hconnection-0x20d1013d-shared-pool-31 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-737588810_17 at /127.0.0.1:39730 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-19 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-18 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-3952 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: ApplicationMasterLauncher #7 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x20d1013d-shared-pool-29 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1657009344_1 at /127.0.0.1:52340 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-737588810_17 at /127.0.0.1:57132 [Waiting for operation #6] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-6 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #8 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (905985230) connection to jenkins-hbase9.apache.org/172.31.2.10:33961 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-737588810_17 at /127.0.0.1:52358 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x20d1013d-shared-pool-28 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-20 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-7 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-16 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x20d1013d-shared-pool-30 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x20d1013d-shared-pool-32 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-5 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-17 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-15 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x20d1013d-shared-pool-27 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=909 (was 907) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=267 (was 257) - SystemLoadAverage LEAK? -, ProcessCount=168 (was 168), AvailableMemoryMB=10778 (was 10822) 2023-10-04 02:01:31,185 WARN [Listener at jenkins-hbase9.apache.org/33899] hbase.ResourceChecker(130): Thread=758 is superior to 500 2023-10-04 02:01:31,204 INFO [Listener at jenkins-hbase9.apache.org/33899] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testEmptyExportFileSystemState Thread=758, OpenFileDescriptor=909, MaxFileDescriptor=60000, SystemLoadAverage=267, ProcessCount=168, AvailableMemoryMB=10777 2023-10-04 02:01:31,204 WARN [Listener at jenkins-hbase9.apache.org/33899] hbase.ResourceChecker(130): Thread=758 is superior to 500 2023-10-04 02:01:31,206 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39651] master.HMaster$4(2112): Client=jenkins//172.31.2.10 create 'testtb-testEmptyExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-10-04 02:01:31,207 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39651] procedure2.ProcedureExecutor(1028): Stored pid=90, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testEmptyExportFileSystemState 2023-10-04 02:01:31,209 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_PRE_OPERATION 2023-10-04 02:01:31,209 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39651] master.MasterRpcServices(700): Client=jenkins//172.31.2.10 procedure request for creating table: namespace: "default" qualifier: "testtb-testEmptyExportFileSystemState" procId is: 90 2023-10-04 02:01:31,210 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-10-04 02:01:31,210 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39651] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-10-04 02:01:31,212 DEBUG [HFileArchiver-16] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/.tmp/data/default/testtb-testEmptyExportFileSystemState/79af1642442547a31fa72109cfa3197d 2023-10-04 02:01:31,212 DEBUG [HFileArchiver-17] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/.tmp/data/default/testtb-testEmptyExportFileSystemState/33a13e738f38cdb034f48e7dc8ab0b9b 2023-10-04 02:01:31,212 DEBUG [HFileArchiver-16] backup.HFileArchiver(153): Directory hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/.tmp/data/default/testtb-testEmptyExportFileSystemState/79af1642442547a31fa72109cfa3197d empty. 2023-10-04 02:01:31,212 DEBUG [HFileArchiver-17] backup.HFileArchiver(153): Directory hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/.tmp/data/default/testtb-testEmptyExportFileSystemState/33a13e738f38cdb034f48e7dc8ab0b9b empty. 2023-10-04 02:01:31,213 DEBUG [HFileArchiver-16] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/.tmp/data/default/testtb-testEmptyExportFileSystemState/79af1642442547a31fa72109cfa3197d 2023-10-04 02:01:31,213 DEBUG [HFileArchiver-17] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/.tmp/data/default/testtb-testEmptyExportFileSystemState/33a13e738f38cdb034f48e7dc8ab0b9b 2023-10-04 02:01:31,213 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testtb-testEmptyExportFileSystemState regions 2023-10-04 02:01:31,221 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/.tmp/data/default/testtb-testEmptyExportFileSystemState/.tabledesc/.tableinfo.0000000001 2023-10-04 02:01:31,223 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(7675): creating {ENCODED => 79af1642442547a31fa72109cfa3197d, NAME => 'testtb-testEmptyExportFileSystemState,,1696384891206.79af1642442547a31fa72109cfa3197d.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testEmptyExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/.tmp 2023-10-04 02:01:31,224 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(7675): creating {ENCODED => 33a13e738f38cdb034f48e7dc8ab0b9b, NAME => 'testtb-testEmptyExportFileSystemState,1,1696384891206.33a13e738f38cdb034f48e7dc8ab0b9b.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testEmptyExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/.tmp 2023-10-04 02:01:31,234 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,,1696384891206.79af1642442547a31fa72109cfa3197d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-04 02:01:31,234 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,1,1696384891206.33a13e738f38cdb034f48e7dc8ab0b9b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-04 02:01:31,234 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1604): Closing 79af1642442547a31fa72109cfa3197d, disabling compactions & flushes 2023-10-04 02:01:31,234 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1604): Closing 33a13e738f38cdb034f48e7dc8ab0b9b, disabling compactions & flushes 2023-10-04 02:01:31,234 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,,1696384891206.79af1642442547a31fa72109cfa3197d. 2023-10-04 02:01:31,234 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,1,1696384891206.33a13e738f38cdb034f48e7dc8ab0b9b. 2023-10-04 02:01:31,234 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,1,1696384891206.33a13e738f38cdb034f48e7dc8ab0b9b. 2023-10-04 02:01:31,234 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,,1696384891206.79af1642442547a31fa72109cfa3197d. 2023-10-04 02:01:31,234 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,1,1696384891206.33a13e738f38cdb034f48e7dc8ab0b9b. after waiting 0 ms 2023-10-04 02:01:31,234 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,1,1696384891206.33a13e738f38cdb034f48e7dc8ab0b9b. 2023-10-04 02:01:31,234 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,1,1696384891206.33a13e738f38cdb034f48e7dc8ab0b9b. 2023-10-04 02:01:31,234 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1558): Region close journal for 33a13e738f38cdb034f48e7dc8ab0b9b: 2023-10-04 02:01:31,234 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,,1696384891206.79af1642442547a31fa72109cfa3197d. after waiting 0 ms 2023-10-04 02:01:31,234 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,,1696384891206.79af1642442547a31fa72109cfa3197d. 2023-10-04 02:01:31,234 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,,1696384891206.79af1642442547a31fa72109cfa3197d. 2023-10-04 02:01:31,234 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1558): Region close journal for 79af1642442547a31fa72109cfa3197d: 2023-10-04 02:01:31,236 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_ADD_TO_META 2023-10-04 02:01:31,237 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,1,1696384891206.33a13e738f38cdb034f48e7dc8ab0b9b.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1696384891237"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696384891237"}]},"ts":"1696384891237"} 2023-10-04 02:01:31,237 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,,1696384891206.79af1642442547a31fa72109cfa3197d.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1696384891237"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696384891237"}]},"ts":"1696384891237"} 2023-10-04 02:01:31,239 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-10-04 02:01:31,240 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-10-04 02:01:31,240 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696384891240"}]},"ts":"1696384891240"} 2023-10-04 02:01:31,241 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=ENABLING in hbase:meta 2023-10-04 02:01:31,244 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase9.apache.org=0} racks are {/default-rack=0} 2023-10-04 02:01:31,245 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-10-04 02:01:31,245 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-10-04 02:01:31,245 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-10-04 02:01:31,245 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-10-04 02:01:31,246 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=91, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=79af1642442547a31fa72109cfa3197d, ASSIGN}, {pid=92, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=33a13e738f38cdb034f48e7dc8ab0b9b, ASSIGN}] 2023-10-04 02:01:31,248 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=91, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=79af1642442547a31fa72109cfa3197d, ASSIGN 2023-10-04 02:01:31,248 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=92, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=33a13e738f38cdb034f48e7dc8ab0b9b, ASSIGN 2023-10-04 02:01:31,251 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=91, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=79af1642442547a31fa72109cfa3197d, ASSIGN; state=OFFLINE, location=jenkins-hbase9.apache.org,44303,1696384805319; forceNewPlan=false, retain=false 2023-10-04 02:01:31,251 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=92, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=33a13e738f38cdb034f48e7dc8ab0b9b, ASSIGN; state=OFFLINE, location=jenkins-hbase9.apache.org,39045,1696384805392; forceNewPlan=false, retain=false 2023-10-04 02:01:31,311 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39651] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-10-04 02:01:31,401 INFO [jenkins-hbase9:39651] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-10-04 02:01:31,404 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=91 updating hbase:meta row=79af1642442547a31fa72109cfa3197d, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,44303,1696384805319 2023-10-04 02:01:31,404 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=92 updating hbase:meta row=33a13e738f38cdb034f48e7dc8ab0b9b, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,39045,1696384805392 2023-10-04 02:01:31,404 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,,1696384891206.79af1642442547a31fa72109cfa3197d.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1696384891404"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696384891404"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696384891404"}]},"ts":"1696384891404"} 2023-10-04 02:01:31,404 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,1,1696384891206.33a13e738f38cdb034f48e7dc8ab0b9b.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1696384891404"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696384891404"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696384891404"}]},"ts":"1696384891404"} 2023-10-04 02:01:31,406 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=93, ppid=91, state=RUNNABLE; OpenRegionProcedure 79af1642442547a31fa72109cfa3197d, server=jenkins-hbase9.apache.org,44303,1696384805319}] 2023-10-04 02:01:31,406 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=94, ppid=92, state=RUNNABLE; OpenRegionProcedure 33a13e738f38cdb034f48e7dc8ab0b9b, server=jenkins-hbase9.apache.org,39045,1696384805392}] 2023-10-04 02:01:31,512 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39651] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-10-04 02:01:31,563 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(130): Open testtb-testEmptyExportFileSystemState,1,1696384891206.33a13e738f38cdb034f48e7dc8ab0b9b. 2023-10-04 02:01:31,563 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 33a13e738f38cdb034f48e7dc8ab0b9b, NAME => 'testtb-testEmptyExportFileSystemState,1,1696384891206.33a13e738f38cdb034f48e7dc8ab0b9b.', STARTKEY => '1', ENDKEY => ''} 2023-10-04 02:01:31,563 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(130): Open testtb-testEmptyExportFileSystemState,,1696384891206.79af1642442547a31fa72109cfa3197d. 2023-10-04 02:01:31,564 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 79af1642442547a31fa72109cfa3197d, NAME => 'testtb-testEmptyExportFileSystemState,,1696384891206.79af1642442547a31fa72109cfa3197d.', STARTKEY => '', ENDKEY => '1'} 2023-10-04 02:01:31,564 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testEmptyExportFileSystemState,1,1696384891206.33a13e738f38cdb034f48e7dc8ab0b9b. service=AccessControlService 2023-10-04 02:01:31,564 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testEmptyExportFileSystemState,,1696384891206.79af1642442547a31fa72109cfa3197d. service=AccessControlService 2023-10-04 02:01:31,564 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-10-04 02:01:31,564 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testEmptyExportFileSystemState 33a13e738f38cdb034f48e7dc8ab0b9b 2023-10-04 02:01:31,564 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-10-04 02:01:31,564 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,1,1696384891206.33a13e738f38cdb034f48e7dc8ab0b9b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-04 02:01:31,564 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7894): checking encryption for 33a13e738f38cdb034f48e7dc8ab0b9b 2023-10-04 02:01:31,564 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7897): checking classloading for 33a13e738f38cdb034f48e7dc8ab0b9b 2023-10-04 02:01:31,564 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testEmptyExportFileSystemState 79af1642442547a31fa72109cfa3197d 2023-10-04 02:01:31,564 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,,1696384891206.79af1642442547a31fa72109cfa3197d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-04 02:01:31,565 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7894): checking encryption for 79af1642442547a31fa72109cfa3197d 2023-10-04 02:01:31,565 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7897): checking classloading for 79af1642442547a31fa72109cfa3197d 2023-10-04 02:01:31,565 INFO [StoreOpener-33a13e738f38cdb034f48e7dc8ab0b9b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 33a13e738f38cdb034f48e7dc8ab0b9b 2023-10-04 02:01:31,566 INFO [StoreOpener-79af1642442547a31fa72109cfa3197d-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 79af1642442547a31fa72109cfa3197d 2023-10-04 02:01:31,567 DEBUG [StoreOpener-33a13e738f38cdb034f48e7dc8ab0b9b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/data/default/testtb-testEmptyExportFileSystemState/33a13e738f38cdb034f48e7dc8ab0b9b/cf 2023-10-04 02:01:31,567 DEBUG [StoreOpener-79af1642442547a31fa72109cfa3197d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/data/default/testtb-testEmptyExportFileSystemState/79af1642442547a31fa72109cfa3197d/cf 2023-10-04 02:01:31,567 DEBUG [StoreOpener-79af1642442547a31fa72109cfa3197d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/data/default/testtb-testEmptyExportFileSystemState/79af1642442547a31fa72109cfa3197d/cf 2023-10-04 02:01:31,567 DEBUG [StoreOpener-33a13e738f38cdb034f48e7dc8ab0b9b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/data/default/testtb-testEmptyExportFileSystemState/33a13e738f38cdb034f48e7dc8ab0b9b/cf 2023-10-04 02:01:31,567 INFO [StoreOpener-79af1642442547a31fa72109cfa3197d-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 79af1642442547a31fa72109cfa3197d columnFamilyName cf 2023-10-04 02:01:31,567 INFO [StoreOpener-33a13e738f38cdb034f48e7dc8ab0b9b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 33a13e738f38cdb034f48e7dc8ab0b9b columnFamilyName cf 2023-10-04 02:01:31,569 INFO [StoreOpener-79af1642442547a31fa72109cfa3197d-1] regionserver.HStore(310): Store=79af1642442547a31fa72109cfa3197d/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-04 02:01:31,569 INFO [StoreOpener-33a13e738f38cdb034f48e7dc8ab0b9b-1] regionserver.HStore(310): Store=33a13e738f38cdb034f48e7dc8ab0b9b/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-04 02:01:31,570 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/data/default/testtb-testEmptyExportFileSystemState/79af1642442547a31fa72109cfa3197d 2023-10-04 02:01:31,570 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/data/default/testtb-testEmptyExportFileSystemState/33a13e738f38cdb034f48e7dc8ab0b9b 2023-10-04 02:01:31,570 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/data/default/testtb-testEmptyExportFileSystemState/79af1642442547a31fa72109cfa3197d 2023-10-04 02:01:31,570 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/data/default/testtb-testEmptyExportFileSystemState/33a13e738f38cdb034f48e7dc8ab0b9b 2023-10-04 02:01:31,573 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1055): writing seq id for 33a13e738f38cdb034f48e7dc8ab0b9b 2023-10-04 02:01:31,575 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/data/default/testtb-testEmptyExportFileSystemState/33a13e738f38cdb034f48e7dc8ab0b9b/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-04 02:01:31,575 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1072): Opened 33a13e738f38cdb034f48e7dc8ab0b9b; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68314509, jitterRate=0.017965510487556458}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-10-04 02:01:31,575 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(965): Region open journal for 33a13e738f38cdb034f48e7dc8ab0b9b: 2023-10-04 02:01:31,575 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1055): writing seq id for 79af1642442547a31fa72109cfa3197d 2023-10-04 02:01:31,576 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testEmptyExportFileSystemState,1,1696384891206.33a13e738f38cdb034f48e7dc8ab0b9b., pid=94, masterSystemTime=1696384891558 2023-10-04 02:01:31,577 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testEmptyExportFileSystemState,1,1696384891206.33a13e738f38cdb034f48e7dc8ab0b9b. 2023-10-04 02:01:31,577 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/data/default/testtb-testEmptyExportFileSystemState/79af1642442547a31fa72109cfa3197d/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-04 02:01:31,577 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(158): Opened testtb-testEmptyExportFileSystemState,1,1696384891206.33a13e738f38cdb034f48e7dc8ab0b9b. 2023-10-04 02:01:31,578 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=92 updating hbase:meta row=33a13e738f38cdb034f48e7dc8ab0b9b, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase9.apache.org,39045,1696384805392 2023-10-04 02:01:31,578 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1072): Opened 79af1642442547a31fa72109cfa3197d; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62926398, jitterRate=-0.06232360005378723}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-10-04 02:01:31,578 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(965): Region open journal for 79af1642442547a31fa72109cfa3197d: 2023-10-04 02:01:31,578 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testEmptyExportFileSystemState,1,1696384891206.33a13e738f38cdb034f48e7dc8ab0b9b.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1696384891578"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1696384891578"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1696384891578"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1696384891578"}]},"ts":"1696384891578"} 2023-10-04 02:01:31,578 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testEmptyExportFileSystemState,,1696384891206.79af1642442547a31fa72109cfa3197d., pid=93, masterSystemTime=1696384891558 2023-10-04 02:01:31,579 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testEmptyExportFileSystemState,,1696384891206.79af1642442547a31fa72109cfa3197d. 2023-10-04 02:01:31,580 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(158): Opened testtb-testEmptyExportFileSystemState,,1696384891206.79af1642442547a31fa72109cfa3197d. 2023-10-04 02:01:31,580 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=91 updating hbase:meta row=79af1642442547a31fa72109cfa3197d, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase9.apache.org,44303,1696384805319 2023-10-04 02:01:31,580 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testEmptyExportFileSystemState,,1696384891206.79af1642442547a31fa72109cfa3197d.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1696384891580"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1696384891580"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1696384891580"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1696384891580"}]},"ts":"1696384891580"} 2023-10-04 02:01:31,581 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=94, resume processing ppid=92 2023-10-04 02:01:31,581 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=94, ppid=92, state=SUCCESS; OpenRegionProcedure 33a13e738f38cdb034f48e7dc8ab0b9b, server=jenkins-hbase9.apache.org,39045,1696384805392 in 174 msec 2023-10-04 02:01:31,582 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=92, ppid=90, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=33a13e738f38cdb034f48e7dc8ab0b9b, ASSIGN in 335 msec 2023-10-04 02:01:31,583 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=93, resume processing ppid=91 2023-10-04 02:01:31,583 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=93, ppid=91, state=SUCCESS; OpenRegionProcedure 79af1642442547a31fa72109cfa3197d, server=jenkins-hbase9.apache.org,44303,1696384805319 in 175 msec 2023-10-04 02:01:31,584 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=91, resume processing ppid=90 2023-10-04 02:01:31,584 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=91, ppid=90, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=79af1642442547a31fa72109cfa3197d, ASSIGN in 337 msec 2023-10-04 02:01:31,585 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-10-04 02:01:31,585 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696384891585"}]},"ts":"1696384891585"} 2023-10-04 02:01:31,586 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=ENABLED in hbase:meta 2023-10-04 02:01:31,588 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_POST_OPERATION 2023-10-04 02:01:31,588 DEBUG [PEWorker-1] access.PermissionStorage(175): Writing permission with rowKey testtb-testEmptyExportFileSystemState jenkins: RWXCA 2023-10-04 02:01:31,590 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=44303] access.PermissionStorage(611): Read acl: entry[testtb-testEmptyExportFileSystemState], kv [jenkins: RWXCA] 2023-10-04 02:01:31,592 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): regionserver:39045-0x1010f1b55330002, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-04 02:01:31,592 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): regionserver:35175-0x1010f1b55330003, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-04 02:01:31,592 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): regionserver:44303-0x1010f1b55330001, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-04 02:01:31,592 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): master:39651-0x1010f1b55330000, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-04 02:01:31,594 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-10-04 02:01:31,594 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-10-04 02:01:31,594 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-10-04 02:01:31,594 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-10-04 02:01:31,595 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=90, state=SUCCESS; CreateTableProcedure table=testtb-testEmptyExportFileSystemState in 388 msec 2023-10-04 02:01:31,813 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39651] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-10-04 02:01:31,814 INFO [Listener at jenkins-hbase9.apache.org/33899] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testEmptyExportFileSystemState, procId: 90 completed 2023-10-04 02:01:31,816 DEBUG [Listener at jenkins-hbase9.apache.org/33899] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testEmptyExportFileSystemState 2023-10-04 02:01:31,816 DEBUG [Listener at jenkins-hbase9.apache.org/33899] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testEmptyExportFileSystemState,,1696384891206.79af1642442547a31fa72109cfa3197d. 2023-10-04 02:01:31,818 INFO [Listener at jenkins-hbase9.apache.org/33899] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-10-04 02:01:31,828 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39651] master.MasterRpcServices(1583): Client=jenkins//172.31.2.10 snapshot request for:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-10-04 02:01:31,828 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39651] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1696384891828 (current time:1696384891828). 2023-10-04 02:01:31,828 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39651] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-10-04 02:01:31,828 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39651] zookeeper.ReadOnlyZKClient(139): Connect 0x3762c5ca to 127.0.0.1:60027 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-04 02:01:31,834 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39651] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@bae4f3a, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-04 02:01:31,838 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39651] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-04 02:01:31,840 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:56702, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-04 02:01:31,841 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39651] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x3762c5ca to 127.0.0.1:60027 2023-10-04 02:01:31,841 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39651] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-04 02:01:31,842 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39651] zookeeper.ReadOnlyZKClient(139): Connect 0x3b0a9387 to 127.0.0.1:60027 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-04 02:01:31,848 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39651] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1a675db9, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-04 02:01:31,849 DEBUG [hconnection-0x63c90650-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-04 02:01:31,850 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:56708, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-04 02:01:31,854 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39651] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x3b0a9387 to 127.0.0.1:60027 2023-10-04 02:01:31,855 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39651] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-04 02:01:31,855 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39651] access.PermissionStorage(611): Read acl: entry[testtb-testEmptyExportFileSystemState], kv [jenkins: RWXCA] 2023-10-04 02:01:31,855 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39651] snapshot.SnapshotManager(637): No existing snapshot, attempting snapshot... 2023-10-04 02:01:31,855 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39651] snapshot.SnapshotManager(684): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-10-04 02:01:31,858 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39651] snapshot.SnapshotManager(519): Unable to retrieve ACL status for path: hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/.hbase-snapshot, current working dir path: hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState org.apache.hadoop.hdfs.protocol.AclException: The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.ipc.RemoteException.instantiateException(RemoteException.java:121) at org.apache.hadoop.ipc.RemoteException.unwrapRemoteException(RemoteException.java:88) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2736) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2294) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2291) at org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81) at org.apache.hadoop.hdfs.DistributedFileSystem.getAclStatus(DistributedFileSystem.java:2291) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.updateWorkingDirAclsIfRequired(SnapshotManager.java:517) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.prepareToTakeSnapshot(SnapshotManager.java:490) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.snapshotEnabledTable(SnapshotManager.java:559) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshotInternal(SnapshotManager.java:687) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshot(SnapshotManager.java:623) at org.apache.hadoop.hbase.master.MasterRpcServices.snapshot(MasterRpcServices.java:1588) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) Caused by: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.hdfs.protocol.AclException): The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at org.apache.hadoop.ipc.Client.getRpcResponse(Client.java:1540) at org.apache.hadoop.ipc.Client.call(Client.java:1486) at org.apache.hadoop.ipc.Client.call(Client.java:1385) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:232) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:118) at com.sun.proxy.$Proxy32.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.getAclStatus(ClientNamenodeProtocolTranslatorPB.java:1385) at sun.reflect.GeneratedMethodAccessor61.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:422) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeMethod(RetryInvocationHandler.java:165) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invoke(RetryInvocationHandler.java:157) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeOnce(RetryInvocationHandler.java:95) at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:359) at com.sun.proxy.$Proxy35.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor61.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor61.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor61.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor61.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor61.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2734) ... 15 more 2023-10-04 02:01:31,862 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39651] procedure2.ProcedureExecutor(1028): Stored pid=95, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-10-04 02:01:31,862 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=95, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-10-04 02:01:31,863 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=95, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1696385491863 2023-10-04 02:01:31,863 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState 2023-10-04 02:01:31,863 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39651] snapshot.SnapshotManager(689): Started snapshot: { ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-10-04 02:01:31,864 DEBUG [Listener at jenkins-hbase9.apache.org/33899] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-10-04 02:01:31,864 DEBUG [Listener at jenkins-hbase9.apache.org/33899] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-10-04 02:01:31,865 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=95, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-10-04 02:01:31,865 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] procedure2.ProcedureExecutor(1028): Stored pid=96, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-10-04 02:01:31,866 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=95, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE in 4 msec 2023-10-04 02:01:31,869 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=96, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-10-04 02:01:31,869 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=96, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED; timeout=600000, timestamp=1696385491869 2023-10-04 02:01:31,879 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testEmptyExportFileSystemState 2023-10-04 02:01:31,879 INFO [(jenkins-hbase9.apache.org,39651,1696384803959)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testEmptyExportFileSystemState' 2023-10-04 02:01:31,879 DEBUG [(jenkins-hbase9.apache.org,39651,1696384803959)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-04 02:01:31,880 DEBUG [(jenkins-hbase9.apache.org,39651,1696384803959)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' 2023-10-04 02:01:31,880 DEBUG [(jenkins-hbase9.apache.org,39651,1696384803959)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testEmptyExportFileSystemState', kicking off acquire phase on members. 2023-10-04 02:01:31,880 DEBUG [(jenkins-hbase9.apache.org,39651,1696384803959)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39651-0x1010f1b55330000, quorum=127.0.0.1:60027, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-10-04 02:01:31,880 DEBUG [(jenkins-hbase9.apache.org,39651,1696384803959)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-10-04 02:01:31,887 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): regionserver:44303-0x1010f1b55330001, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-04 02:01:31,887 DEBUG [(jenkins-hbase9.apache.org,39651,1696384803959)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,39045,1696384805392 2023-10-04 02:01:31,887 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-04 02:01:31,887 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-04 02:01:31,887 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): regionserver:35175-0x1010f1b55330003, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-04 02:01:31,887 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): regionserver:39045-0x1010f1b55330002, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-04 02:01:31,887 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-04 02:01:31,887 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-04 02:01:31,887 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-04 02:01:31,887 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-04 02:01:31,887 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-10-04 02:01:31,887 DEBUG [(jenkins-hbase9.apache.org,39651,1696384803959)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39651-0x1010f1b55330000, quorum=127.0.0.1:60027, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,39045,1696384805392 2023-10-04 02:01:31,887 DEBUG [(jenkins-hbase9.apache.org,39651,1696384803959)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,44303,1696384805319 2023-10-04 02:01:31,887 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-10-04 02:01:31,887 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-10-04 02:01:31,887 DEBUG [(jenkins-hbase9.apache.org,39651,1696384803959)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39651-0x1010f1b55330000, quorum=127.0.0.1:60027, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,44303,1696384805319 2023-10-04 02:01:31,888 DEBUG [(jenkins-hbase9.apache.org,39651,1696384803959)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-04 02:01:31,887 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44303-0x1010f1b55330001, quorum=127.0.0.1:60027, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-10-04 02:01:31,888 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39045-0x1010f1b55330002, quorum=127.0.0.1:60027, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-10-04 02:01:31,888 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35175-0x1010f1b55330003, quorum=127.0.0.1:60027, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-10-04 02:01:31,888 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 189 2023-10-04 02:01:31,888 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-10-04 02:01:31,888 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 189 2023-10-04 02:01:31,888 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-10-04 02:01:31,888 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-10-04 02:01:31,888 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 189 2023-10-04 02:01:31,888 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-10-04 02:01:31,888 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-10-04 02:01:31,888 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testEmptyExportFileSystemState 2023-10-04 02:01:31,889 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-10-04 02:01:31,889 DEBUG [member: 'jenkins-hbase9.apache.org,44303,1696384805319' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-10-04 02:01:31,889 DEBUG [member: 'jenkins-hbase9.apache.org,44303,1696384805319' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-04 02:01:31,889 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testEmptyExportFileSystemState 2023-10-04 02:01:31,890 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testEmptyExportFileSystemState 2023-10-04 02:01:31,890 DEBUG [member: 'jenkins-hbase9.apache.org,44303,1696384805319' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-10-04 02:01:31,890 DEBUG [member: 'jenkins-hbase9.apache.org,35175,1696384805436' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-10-04 02:01:31,890 DEBUG [member: 'jenkins-hbase9.apache.org,39045,1696384805392' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-10-04 02:01:31,890 DEBUG [member: 'jenkins-hbase9.apache.org,35175,1696384805436' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-04 02:01:31,890 DEBUG [member: 'jenkins-hbase9.apache.org,44303,1696384805319' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally acquired 2023-10-04 02:01:31,891 DEBUG [member: 'jenkins-hbase9.apache.org,35175,1696384805436' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-10-04 02:01:31,891 DEBUG [member: 'jenkins-hbase9.apache.org,35175,1696384805436' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally acquired 2023-10-04 02:01:31,890 DEBUG [member: 'jenkins-hbase9.apache.org,39045,1696384805392' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-04 02:01:31,891 DEBUG [member: 'jenkins-hbase9.apache.org,35175,1696384805436' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,35175,1696384805436' joining acquired barrier for procedure (emptySnaptb0-testEmptyExportFileSystemState) in zk 2023-10-04 02:01:31,891 DEBUG [member: 'jenkins-hbase9.apache.org,44303,1696384805319' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,44303,1696384805319' joining acquired barrier for procedure (emptySnaptb0-testEmptyExportFileSystemState) in zk 2023-10-04 02:01:31,892 DEBUG [member: 'jenkins-hbase9.apache.org,39045,1696384805392' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-10-04 02:01:31,892 DEBUG [member: 'jenkins-hbase9.apache.org,39045,1696384805392' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally acquired 2023-10-04 02:01:31,892 DEBUG [member: 'jenkins-hbase9.apache.org,39045,1696384805392' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,39045,1696384805392' joining acquired barrier for procedure (emptySnaptb0-testEmptyExportFileSystemState) in zk 2023-10-04 02:01:31,893 DEBUG [member: 'jenkins-hbase9.apache.org,35175,1696384805436' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-10-04 02:01:31,894 DEBUG [member: 'jenkins-hbase9.apache.org,44303,1696384805319' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-10-04 02:01:31,894 DEBUG [member: 'jenkins-hbase9.apache.org,39045,1696384805392' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-10-04 02:01:31,894 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): master:39651-0x1010f1b55330000, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,44303,1696384805319 2023-10-04 02:01:31,894 DEBUG [member: 'jenkins-hbase9.apache.org,35175,1696384805436' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35175-0x1010f1b55330003, quorum=127.0.0.1:60027, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-10-04 02:01:31,895 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,44303,1696384805319 2023-10-04 02:01:31,895 DEBUG [member: 'jenkins-hbase9.apache.org,44303,1696384805319' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44303-0x1010f1b55330001, quorum=127.0.0.1:60027, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-10-04 02:01:31,895 DEBUG [member: 'jenkins-hbase9.apache.org,44303,1696384805319' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-04 02:01:31,895 DEBUG [member: 'jenkins-hbase9.apache.org,39045,1696384805392' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39045-0x1010f1b55330002, quorum=127.0.0.1:60027, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-10-04 02:01:31,895 DEBUG [member: 'jenkins-hbase9.apache.org,39045,1696384805392' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-04 02:01:31,895 DEBUG [member: 'jenkins-hbase9.apache.org,35175,1696384805436' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-04 02:01:31,894 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): master:39651-0x1010f1b55330000, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,39045,1696384805392 2023-10-04 02:01:31,895 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-04 02:01:31,895 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-04 02:01:31,895 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-04 02:01:31,896 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-04 02:01:31,896 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-10-04 02:01:31,897 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,39045,1696384805392 2023-10-04 02:01:31,897 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,35175,1696384805436 2023-10-04 02:01:31,897 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44303,1696384805319 2023-10-04 02:01:31,898 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-04 02:01:31,898 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,44303,1696384805319' joining acquired barrier for procedure 'emptySnaptb0-testEmptyExportFileSystemState' on coordinator 2023-10-04 02:01:31,898 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@72e5e9ee[Count = 1] remaining members to acquire global barrier 2023-10-04 02:01:31,898 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,39045,1696384805392 2023-10-04 02:01:31,898 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-04 02:01:31,898 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-04 02:01:31,898 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-04 02:01:31,899 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-04 02:01:31,899 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-10-04 02:01:31,899 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,39045,1696384805392 2023-10-04 02:01:31,899 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,35175,1696384805436 2023-10-04 02:01:31,900 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44303,1696384805319 2023-10-04 02:01:31,900 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-04 02:01:31,900 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,39045,1696384805392' joining acquired barrier for procedure 'emptySnaptb0-testEmptyExportFileSystemState' on coordinator 2023-10-04 02:01:31,900 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@72e5e9ee[Count = 0] remaining members to acquire global barrier 2023-10-04 02:01:31,900 DEBUG [(jenkins-hbase9.apache.org,39651,1696384803959)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'in-barrier' execution. 2023-10-04 02:01:31,900 DEBUG [(jenkins-hbase9.apache.org,39651,1696384803959)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-10-04 02:01:31,902 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): regionserver:39045-0x1010f1b55330002, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-10-04 02:01:31,902 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): regionserver:35175-0x1010f1b55330003, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-10-04 02:01:31,902 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): regionserver:44303-0x1010f1b55330001, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-10-04 02:01:31,902 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-10-04 02:01:31,902 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-10-04 02:01:31,902 DEBUG [(jenkins-hbase9.apache.org,39651,1696384803959)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39651-0x1010f1b55330000, quorum=127.0.0.1:60027, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,44303,1696384805319 2023-10-04 02:01:31,902 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-10-04 02:01:31,902 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-10-04 02:01:31,902 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-10-04 02:01:31,902 DEBUG [member: 'jenkins-hbase9.apache.org,35175,1696384805436' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-10-04 02:01:31,902 DEBUG [member: 'jenkins-hbase9.apache.org,35175,1696384805436' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally completed 2023-10-04 02:01:31,902 DEBUG [member: 'jenkins-hbase9.apache.org,35175,1696384805436' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase9.apache.org,35175,1696384805436' in zk 2023-10-04 02:01:31,902 DEBUG [member: 'jenkins-hbase9.apache.org,39045,1696384805392' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-10-04 02:01:31,902 DEBUG [(jenkins-hbase9.apache.org,39651,1696384803959)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39651-0x1010f1b55330000, quorum=127.0.0.1:60027, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,39045,1696384805392 2023-10-04 02:01:31,903 DEBUG [(jenkins-hbase9.apache.org,39651,1696384803959)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-04 02:01:31,902 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-10-04 02:01:31,903 DEBUG [member: 'jenkins-hbase9.apache.org,39045,1696384805392' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-04 02:01:31,903 DEBUG [member: 'jenkins-hbase9.apache.org,39045,1696384805392' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-04 02:01:31,903 DEBUG [member: 'jenkins-hbase9.apache.org,44303,1696384805319' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-10-04 02:01:31,903 DEBUG [rs(jenkins-hbase9.apache.org,39045,1696384805392)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,1,1696384891206.33a13e738f38cdb034f48e7dc8ab0b9b. 2023-10-04 02:01:31,903 DEBUG [rs(jenkins-hbase9.apache.org,39045,1696384805392)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1696384891206.33a13e738f38cdb034f48e7dc8ab0b9b. started... 2023-10-04 02:01:31,904 DEBUG [member: 'jenkins-hbase9.apache.org,44303,1696384805319' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-04 02:01:31,905 DEBUG [rs(jenkins-hbase9.apache.org,44303,1696384805319)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,,1696384891206.79af1642442547a31fa72109cfa3197d. 2023-10-04 02:01:31,905 DEBUG [member: 'jenkins-hbase9.apache.org,44303,1696384805319' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-04 02:01:31,905 DEBUG [member: 'jenkins-hbase9.apache.org,35175,1696384805436' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-10-04 02:01:31,905 DEBUG [rs(jenkins-hbase9.apache.org,39045,1696384805392)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 33a13e738f38cdb034f48e7dc8ab0b9b: 2023-10-04 02:01:31,905 DEBUG [member: 'jenkins-hbase9.apache.org,35175,1696384805436' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-04 02:01:31,905 DEBUG [rs(jenkins-hbase9.apache.org,44303,1696384805319)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1696384891206.79af1642442547a31fa72109cfa3197d. started... 2023-10-04 02:01:31,905 DEBUG [member: 'jenkins-hbase9.apache.org,35175,1696384805436' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' completed. 2023-10-04 02:01:31,907 DEBUG [rs(jenkins-hbase9.apache.org,44303,1696384805319)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 79af1642442547a31fa72109cfa3197d: 2023-10-04 02:01:31,907 DEBUG [rs(jenkins-hbase9.apache.org,39045,1696384805392)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,1,1696384891206.33a13e738f38cdb034f48e7dc8ab0b9b.' region-info for snapshot=emptySnaptb0-testEmptyExportFileSystemState 2023-10-04 02:01:31,907 DEBUG [rs(jenkins-hbase9.apache.org,39045,1696384805392)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-04 02:01:31,907 DEBUG [rs(jenkins-hbase9.apache.org,44303,1696384805319)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,,1696384891206.79af1642442547a31fa72109cfa3197d.' region-info for snapshot=emptySnaptb0-testEmptyExportFileSystemState 2023-10-04 02:01:31,907 DEBUG [rs(jenkins-hbase9.apache.org,39045,1696384805392)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-10-04 02:01:31,907 DEBUG [rs(jenkins-hbase9.apache.org,44303,1696384805319)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-04 02:01:31,907 DEBUG [rs(jenkins-hbase9.apache.org,44303,1696384805319)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-10-04 02:01:31,924 DEBUG [rs(jenkins-hbase9.apache.org,39045,1696384805392)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1696384891206.33a13e738f38cdb034f48e7dc8ab0b9b. completed. 2023-10-04 02:01:31,924 DEBUG [rs(jenkins-hbase9.apache.org,39045,1696384805392)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,1,1696384891206.33a13e738f38cdb034f48e7dc8ab0b9b. 2023-10-04 02:01:31,924 DEBUG [member: 'jenkins-hbase9.apache.org,39045,1696384805392' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-04 02:01:31,924 DEBUG [member: 'jenkins-hbase9.apache.org,39045,1696384805392' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-04 02:01:31,924 DEBUG [member: 'jenkins-hbase9.apache.org,39045,1696384805392' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase9.apache.org,39045,1696384805392 2023-10-04 02:01:31,924 DEBUG [member: 'jenkins-hbase9.apache.org,39045,1696384805392' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally completed 2023-10-04 02:01:31,924 DEBUG [member: 'jenkins-hbase9.apache.org,39045,1696384805392' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase9.apache.org,39045,1696384805392' in zk 2023-10-04 02:01:31,925 DEBUG [rs(jenkins-hbase9.apache.org,44303,1696384805319)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1696384891206.79af1642442547a31fa72109cfa3197d. completed. 2023-10-04 02:01:31,925 DEBUG [rs(jenkins-hbase9.apache.org,44303,1696384805319)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,,1696384891206.79af1642442547a31fa72109cfa3197d. 2023-10-04 02:01:31,925 DEBUG [member: 'jenkins-hbase9.apache.org,44303,1696384805319' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-04 02:01:31,925 DEBUG [member: 'jenkins-hbase9.apache.org,44303,1696384805319' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-04 02:01:31,925 DEBUG [member: 'jenkins-hbase9.apache.org,44303,1696384805319' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase9.apache.org,44303,1696384805319 2023-10-04 02:01:31,926 DEBUG [member: 'jenkins-hbase9.apache.org,44303,1696384805319' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally completed 2023-10-04 02:01:31,926 DEBUG [member: 'jenkins-hbase9.apache.org,44303,1696384805319' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase9.apache.org,44303,1696384805319' in zk 2023-10-04 02:01:31,926 DEBUG [member: 'jenkins-hbase9.apache.org,39045,1696384805392' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-10-04 02:01:31,926 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): master:39651-0x1010f1b55330000, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,39045,1696384805392 2023-10-04 02:01:31,926 DEBUG [member: 'jenkins-hbase9.apache.org,39045,1696384805392' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-04 02:01:31,927 DEBUG [member: 'jenkins-hbase9.apache.org,39045,1696384805392' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' completed. 2023-10-04 02:01:31,927 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,39045,1696384805392 2023-10-04 02:01:31,927 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-04 02:01:31,928 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-04 02:01:31,929 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): master:39651-0x1010f1b55330000, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,44303,1696384805319 2023-10-04 02:01:31,929 DEBUG [member: 'jenkins-hbase9.apache.org,44303,1696384805319' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-10-04 02:01:31,929 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-04 02:01:31,929 DEBUG [member: 'jenkins-hbase9.apache.org,44303,1696384805319' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-04 02:01:31,929 DEBUG [member: 'jenkins-hbase9.apache.org,44303,1696384805319' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' completed. 2023-10-04 02:01:31,930 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-04 02:01:31,930 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-10-04 02:01:31,930 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,39045,1696384805392 2023-10-04 02:01:31,931 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,35175,1696384805436 2023-10-04 02:01:31,931 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44303,1696384805319 2023-10-04 02:01:31,931 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-04 02:01:31,931 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-10-04 02:01:31,931 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,39045,1696384805392 2023-10-04 02:01:31,932 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,35175,1696384805436 2023-10-04 02:01:31,932 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44303,1696384805319 2023-10-04 02:01:31,932 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase9.apache.org,39045,1696384805392': 2023-10-04 02:01:31,932 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,39045,1696384805392' released barrier for procedure'emptySnaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 1 more 2023-10-04 02:01:31,932 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,44303,1696384805319 2023-10-04 02:01:31,932 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-04 02:01:31,932 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-04 02:01:31,933 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-04 02:01:31,933 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-04 02:01:31,933 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-10-04 02:01:31,933 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,39045,1696384805392 2023-10-04 02:01:31,934 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,35175,1696384805436 2023-10-04 02:01:31,934 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44303,1696384805319 2023-10-04 02:01:31,934 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-04 02:01:31,934 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-10-04 02:01:31,934 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,39045,1696384805392 2023-10-04 02:01:31,935 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,35175,1696384805436 2023-10-04 02:01:31,935 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44303,1696384805319 2023-10-04 02:01:31,935 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase9.apache.org,44303,1696384805319': 2023-10-04 02:01:31,935 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,44303,1696384805319' released barrier for procedure'emptySnaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 0 more 2023-10-04 02:01:31,935 INFO [(jenkins-hbase9.apache.org,39651,1696384803959)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testEmptyExportFileSystemState' execution completed 2023-10-04 02:01:31,935 DEBUG [(jenkins-hbase9.apache.org,39651,1696384803959)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-04 02:01:31,935 DEBUG [(jenkins-hbase9.apache.org,39651,1696384803959)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-04 02:01:31,935 DEBUG [(jenkins-hbase9.apache.org,39651,1696384803959)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testEmptyExportFileSystemState 2023-10-04 02:01:31,935 INFO [(jenkins-hbase9.apache.org,39651,1696384803959)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testEmptyExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-10-04 02:01:31,937 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): master:39651-0x1010f1b55330000, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-10-04 02:01:31,937 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): regionserver:44303-0x1010f1b55330001, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-10-04 02:01:31,937 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-10-04 02:01:31,937 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-04 02:01:31,937 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-04 02:01:31,937 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-10-04 02:01:31,937 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-10-04 02:01:31,937 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): regionserver:44303-0x1010f1b55330001, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-04 02:01:31,937 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): regionserver:35175-0x1010f1b55330003, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-10-04 02:01:31,937 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): regionserver:39045-0x1010f1b55330002, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-10-04 02:01:31,937 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-10-04 02:01:31,937 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): regionserver:35175-0x1010f1b55330003, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-04 02:01:31,938 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-10-04 02:01:31,938 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-10-04 02:01:31,938 DEBUG [(jenkins-hbase9.apache.org,39651,1696384803959)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39651-0x1010f1b55330000, quorum=127.0.0.1:60027, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,39045,1696384805392 2023-10-04 02:01:31,937 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): regionserver:39045-0x1010f1b55330002, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-04 02:01:31,938 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-10-04 02:01:31,938 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-04 02:01:31,938 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-04 02:01:31,938 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-04 02:01:31,938 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-04 02:01:31,938 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-04 02:01:31,938 DEBUG [(jenkins-hbase9.apache.org,39651,1696384803959)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39651-0x1010f1b55330000, quorum=127.0.0.1:60027, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,35175,1696384805436 2023-10-04 02:01:31,938 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-04 02:01:31,938 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-04 02:01:31,938 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-10-04 02:01:31,938 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-10-04 02:01:31,938 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-10-04 02:01:31,938 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-10-04 02:01:31,938 DEBUG [(jenkins-hbase9.apache.org,39651,1696384803959)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39651-0x1010f1b55330000, quorum=127.0.0.1:60027, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,44303,1696384805319 2023-10-04 02:01:31,939 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-04 02:01:31,939 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-10-04 02:01:31,939 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,39045,1696384805392 2023-10-04 02:01:31,939 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,35175,1696384805436 2023-10-04 02:01:31,940 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44303,1696384805319 2023-10-04 02:01:31,940 DEBUG [(jenkins-hbase9.apache.org,39651,1696384803959)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39651-0x1010f1b55330000, quorum=127.0.0.1:60027, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,39045,1696384805392 2023-10-04 02:01:31,940 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-04 02:01:31,940 DEBUG [(jenkins-hbase9.apache.org,39651,1696384803959)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39651-0x1010f1b55330000, quorum=127.0.0.1:60027, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,35175,1696384805436 2023-10-04 02:01:31,940 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-10-04 02:01:31,940 DEBUG [(jenkins-hbase9.apache.org,39651,1696384803959)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39651-0x1010f1b55330000, quorum=127.0.0.1:60027, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,44303,1696384805319 2023-10-04 02:01:31,940 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,39045,1696384805392 2023-10-04 02:01:31,941 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,35175,1696384805436 2023-10-04 02:01:31,941 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44303,1696384805319 2023-10-04 02:01:31,944 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): master:39651-0x1010f1b55330000, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,44303,1696384805319 2023-10-04 02:01:31,944 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): master:39651-0x1010f1b55330000, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-10-04 02:01:31,944 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): regionserver:35175-0x1010f1b55330003, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-04 02:01:31,944 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): regionserver:39045-0x1010f1b55330002, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-04 02:01:31,944 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): master:39651-0x1010f1b55330000, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,35175,1696384805436 2023-10-04 02:01:31,944 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): regionserver:44303-0x1010f1b55330001, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-04 02:01:31,945 DEBUG [(jenkins-hbase9.apache.org,39651,1696384803959)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-04 02:01:31,945 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): regionserver:39045-0x1010f1b55330002, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-04 02:01:31,945 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): master:39651-0x1010f1b55330000, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,39045,1696384805392 2023-10-04 02:01:31,945 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-04 02:01:31,946 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-04 02:01:31,945 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): regionserver:35175-0x1010f1b55330003, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-04 02:01:31,944 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-04 02:01:31,946 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): master:39651-0x1010f1b55330000, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-10-04 02:01:31,945 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-04 02:01:31,946 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-04 02:01:31,945 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testEmptyExportFileSystemState 2023-10-04 02:01:31,945 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): regionserver:44303-0x1010f1b55330001, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-04 02:01:31,946 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-04 02:01:31,946 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-04 02:01:31,946 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testEmptyExportFileSystemState 2023-10-04 02:01:31,946 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): master:39651-0x1010f1b55330000, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,44303,1696384805319 2023-10-04 02:01:31,946 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-04 02:01:31,946 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): master:39651-0x1010f1b55330000, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-10-04 02:01:31,946 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 37e3865d2ff7e5e2da33a03e3f723df0, NAME => 'testtb-testEmptyExportFileSystemState,.mob,0.37e3865d2ff7e5e2da33a03e3f723df0.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testEmptyExportFileSystemState 2023-10-04 02:01:31,946 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): master:39651-0x1010f1b55330000, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,35175,1696384805436 2023-10-04 02:01:31,946 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-10-04 02:01:31,946 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): master:39651-0x1010f1b55330000, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,39045,1696384805392 2023-10-04 02:01:31,946 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-04 02:01:31,947 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-04 02:01:31,947 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-04 02:01:31,946 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): master:39651-0x1010f1b55330000, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-10-04 02:01:31,947 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-04 02:01:31,947 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): master:39651-0x1010f1b55330000, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-10-04 02:01:31,947 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-10-04 02:01:31,954 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testEmptyExportFileSystemState 2023-10-04 02:01:31,954 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-10-04 02:01:31,964 DEBUG [Listener at jenkins-hbase9.apache.org/33899] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-04 02:01:31,965 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39651] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-10-04 02:01:31,965 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39651] snapshot.SnapshotManager(406): Snapshoting '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-10-04 02:01:31,966 DEBUG [Listener at jenkins-hbase9.apache.org/33899] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-10-04 02:01:31,972 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState to hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState 2023-10-04 02:01:31,972 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed 2023-10-04 02:01:31,972 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-10-04 02:01:31,973 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-10-04 02:01:31,973 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState at 1696384891863Completed referencing HFiles for the mob region of table: testtb-testEmptyExportFileSystemState at 1696384891954 (+91 ms)Consolidate snapshot: emptySnaptb0-testEmptyExportFileSystemState at 1696384891954Loading Region manifests for emptySnaptb0-testEmptyExportFileSystemState at 1696384891954Writing data manifest for emptySnaptb0-testEmptyExportFileSystemState at 1696384891959 (+5 ms)Verifying snapshot: emptySnaptb0-testEmptyExportFileSystemState at 1696384891967 (+8 ms)Snapshot emptySnaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed at 1696384891972 (+5 ms) 2023-10-04 02:01:31,976 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=96, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-10-04 02:01:31,977 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=96, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED in 112 msec 2023-10-04 02:01:32,166 DEBUG [Listener at jenkins-hbase9.apache.org/33899] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-04 02:01:32,167 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39651] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-10-04 02:01:32,167 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39651] snapshot.SnapshotManager(403): Snapshot '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-10-04 02:01:32,169 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44303] regionserver.HRegion(8805): writing data to region testtb-testEmptyExportFileSystemState,,1696384891206.79af1642442547a31fa72109cfa3197d. with WAL disabled. Data may be lost in the event of a crash. 2023-10-04 02:01:32,171 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39045] regionserver.HRegion(8805): writing data to region testtb-testEmptyExportFileSystemState,1,1696384891206.33a13e738f38cdb034f48e7dc8ab0b9b. with WAL disabled. Data may be lost in the event of a crash. 2023-10-04 02:01:32,173 DEBUG [Listener at jenkins-hbase9.apache.org/33899] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testEmptyExportFileSystemState 2023-10-04 02:01:32,173 DEBUG [Listener at jenkins-hbase9.apache.org/33899] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testEmptyExportFileSystemState,,1696384891206.79af1642442547a31fa72109cfa3197d. 2023-10-04 02:01:32,173 INFO [Listener at jenkins-hbase9.apache.org/33899] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-10-04 02:01:32,183 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39651] master.MasterRpcServices(1583): Client=jenkins//172.31.2.10 snapshot request for:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-10-04 02:01:32,183 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39651] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1696384892183 (current time:1696384892183). 2023-10-04 02:01:32,183 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39651] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-10-04 02:01:32,184 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39651] zookeeper.ReadOnlyZKClient(139): Connect 0x676e0900 to 127.0.0.1:60027 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-04 02:01:32,191 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39651] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@32356b69, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-04 02:01:32,192 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39651] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-04 02:01:32,195 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:56722, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-04 02:01:32,195 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39651] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x676e0900 to 127.0.0.1:60027 2023-10-04 02:01:32,195 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39651] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-04 02:01:32,196 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39651] zookeeper.ReadOnlyZKClient(139): Connect 0x1a1c840d to 127.0.0.1:60027 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-04 02:01:32,201 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39651] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@d2da847, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-04 02:01:32,202 DEBUG [hconnection-0x14dae4a8-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-04 02:01:32,205 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:56726, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-04 02:01:32,209 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39651] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1a1c840d to 127.0.0.1:60027 2023-10-04 02:01:32,209 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39651] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-04 02:01:32,209 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39651] access.PermissionStorage(611): Read acl: entry[testtb-testEmptyExportFileSystemState], kv [jenkins: RWXCA] 2023-10-04 02:01:32,209 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39651] snapshot.SnapshotManager(637): No existing snapshot, attempting snapshot... 2023-10-04 02:01:32,210 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39651] snapshot.SnapshotManager(684): Table enabled, starting distributed snapshots for { ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-10-04 02:01:32,212 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39651] snapshot.SnapshotManager(519): Unable to retrieve ACL status for path: hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/.hbase-snapshot, current working dir path: hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState org.apache.hadoop.hdfs.protocol.AclException: The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.ipc.RemoteException.instantiateException(RemoteException.java:121) at org.apache.hadoop.ipc.RemoteException.unwrapRemoteException(RemoteException.java:88) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2736) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2294) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2291) at org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81) at org.apache.hadoop.hdfs.DistributedFileSystem.getAclStatus(DistributedFileSystem.java:2291) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.updateWorkingDirAclsIfRequired(SnapshotManager.java:517) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.prepareToTakeSnapshot(SnapshotManager.java:490) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.snapshotEnabledTable(SnapshotManager.java:559) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshotInternal(SnapshotManager.java:687) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshot(SnapshotManager.java:623) at org.apache.hadoop.hbase.master.MasterRpcServices.snapshot(MasterRpcServices.java:1588) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) Caused by: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.hdfs.protocol.AclException): The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at org.apache.hadoop.ipc.Client.getRpcResponse(Client.java:1540) at org.apache.hadoop.ipc.Client.call(Client.java:1486) at org.apache.hadoop.ipc.Client.call(Client.java:1385) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:232) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:118) at com.sun.proxy.$Proxy32.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.getAclStatus(ClientNamenodeProtocolTranslatorPB.java:1385) at sun.reflect.GeneratedMethodAccessor61.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:422) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeMethod(RetryInvocationHandler.java:165) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invoke(RetryInvocationHandler.java:157) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeOnce(RetryInvocationHandler.java:95) at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:359) at com.sun.proxy.$Proxy35.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor61.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor61.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor61.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor61.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor61.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2734) ... 15 more 2023-10-04 02:01:32,213 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39651] procedure2.ProcedureExecutor(1028): Stored pid=97, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-10-04 02:01:32,214 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=97, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-10-04 02:01:32,214 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=97, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1696385492214 2023-10-04 02:01:32,214 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39651] snapshot.SnapshotManager(689): Started snapshot: { ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-10-04 02:01:32,214 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState 2023-10-04 02:01:32,215 DEBUG [Listener at jenkins-hbase9.apache.org/33899] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-10-04 02:01:32,216 DEBUG [Listener at jenkins-hbase9.apache.org/33899] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-10-04 02:01:32,216 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=97, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-10-04 02:01:32,217 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] procedure2.ProcedureExecutor(1028): Stored pid=98, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-10-04 02:01:32,217 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=97, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE in 4 msec 2023-10-04 02:01:32,218 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=98, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-10-04 02:01:32,218 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=98, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED; timeout=600000, timestamp=1696385492218 2023-10-04 02:01:32,228 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testEmptyExportFileSystemState 2023-10-04 02:01:32,228 INFO [(jenkins-hbase9.apache.org,39651,1696384803959)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testEmptyExportFileSystemState' 2023-10-04 02:01:32,228 DEBUG [(jenkins-hbase9.apache.org,39651,1696384803959)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-04 02:01:32,230 DEBUG [(jenkins-hbase9.apache.org,39651,1696384803959)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' 2023-10-04 02:01:32,230 DEBUG [(jenkins-hbase9.apache.org,39651,1696384803959)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testEmptyExportFileSystemState', kicking off acquire phase on members. 2023-10-04 02:01:32,230 DEBUG [(jenkins-hbase9.apache.org,39651,1696384803959)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39651-0x1010f1b55330000, quorum=127.0.0.1:60027, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-10-04 02:01:32,230 DEBUG [(jenkins-hbase9.apache.org,39651,1696384803959)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-10-04 02:01:32,231 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): regionserver:39045-0x1010f1b55330002, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-04 02:01:32,231 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): regionserver:44303-0x1010f1b55330001, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-04 02:01:32,231 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-04 02:01:32,231 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-04 02:01:32,231 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-04 02:01:32,231 DEBUG [(jenkins-hbase9.apache.org,39651,1696384803959)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,39045,1696384805392 2023-10-04 02:01:32,231 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): regionserver:35175-0x1010f1b55330003, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-04 02:01:32,231 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-04 02:01:32,232 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-04 02:01:32,232 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-04 02:01:32,232 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-10-04 02:01:32,232 DEBUG [(jenkins-hbase9.apache.org,39651,1696384803959)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39651-0x1010f1b55330000, quorum=127.0.0.1:60027, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,39045,1696384805392 2023-10-04 02:01:32,232 DEBUG [(jenkins-hbase9.apache.org,39651,1696384803959)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,44303,1696384805319 2023-10-04 02:01:32,232 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-10-04 02:01:32,232 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-10-04 02:01:32,232 DEBUG [(jenkins-hbase9.apache.org,39651,1696384803959)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39651-0x1010f1b55330000, quorum=127.0.0.1:60027, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,44303,1696384805319 2023-10-04 02:01:32,232 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35175-0x1010f1b55330003, quorum=127.0.0.1:60027, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-10-04 02:01:32,232 DEBUG [(jenkins-hbase9.apache.org,39651,1696384803959)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-04 02:01:32,232 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44303-0x1010f1b55330001, quorum=127.0.0.1:60027, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-10-04 02:01:32,232 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39045-0x1010f1b55330002, quorum=127.0.0.1:60027, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-10-04 02:01:32,233 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 184 2023-10-04 02:01:32,233 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 184 2023-10-04 02:01:32,233 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-10-04 02:01:32,233 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-10-04 02:01:32,233 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-10-04 02:01:32,233 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-10-04 02:01:32,233 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testEmptyExportFileSystemState 2023-10-04 02:01:32,233 DEBUG [member: 'jenkins-hbase9.apache.org,44303,1696384805319' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-10-04 02:01:32,233 DEBUG [member: 'jenkins-hbase9.apache.org,44303,1696384805319' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-04 02:01:32,234 DEBUG [member: 'jenkins-hbase9.apache.org,44303,1696384805319' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-10-04 02:01:32,234 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testEmptyExportFileSystemState 2023-10-04 02:01:32,235 DEBUG [member: 'jenkins-hbase9.apache.org,44303,1696384805319' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally acquired 2023-10-04 02:01:32,235 DEBUG [member: 'jenkins-hbase9.apache.org,44303,1696384805319' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,44303,1696384805319' joining acquired barrier for procedure (snaptb0-testEmptyExportFileSystemState) in zk 2023-10-04 02:01:32,235 DEBUG [member: 'jenkins-hbase9.apache.org,35175,1696384805436' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-10-04 02:01:32,235 DEBUG [member: 'jenkins-hbase9.apache.org,35175,1696384805436' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-04 02:01:32,236 DEBUG [member: 'jenkins-hbase9.apache.org,35175,1696384805436' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-10-04 02:01:32,236 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 184 2023-10-04 02:01:32,236 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-10-04 02:01:32,236 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-10-04 02:01:32,236 DEBUG [member: 'jenkins-hbase9.apache.org,35175,1696384805436' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally acquired 2023-10-04 02:01:32,236 DEBUG [member: 'jenkins-hbase9.apache.org,35175,1696384805436' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,35175,1696384805436' joining acquired barrier for procedure (snaptb0-testEmptyExportFileSystemState) in zk 2023-10-04 02:01:32,236 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testEmptyExportFileSystemState 2023-10-04 02:01:32,236 DEBUG [member: 'jenkins-hbase9.apache.org,39045,1696384805392' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-10-04 02:01:32,237 DEBUG [member: 'jenkins-hbase9.apache.org,39045,1696384805392' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-04 02:01:32,241 DEBUG [member: 'jenkins-hbase9.apache.org,39045,1696384805392' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-10-04 02:01:32,241 DEBUG [member: 'jenkins-hbase9.apache.org,39045,1696384805392' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally acquired 2023-10-04 02:01:32,241 DEBUG [member: 'jenkins-hbase9.apache.org,39045,1696384805392' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,39045,1696384805392' joining acquired barrier for procedure (snaptb0-testEmptyExportFileSystemState) in zk 2023-10-04 02:01:32,241 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): master:39651-0x1010f1b55330000, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,44303,1696384805319 2023-10-04 02:01:32,241 DEBUG [member: 'jenkins-hbase9.apache.org,44303,1696384805319' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-10-04 02:01:32,241 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,44303,1696384805319 2023-10-04 02:01:32,241 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-04 02:01:32,241 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-04 02:01:32,242 DEBUG [member: 'jenkins-hbase9.apache.org,44303,1696384805319' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44303-0x1010f1b55330001, quorum=127.0.0.1:60027, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-10-04 02:01:32,242 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-04 02:01:32,242 DEBUG [member: 'jenkins-hbase9.apache.org,44303,1696384805319' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-04 02:01:32,242 DEBUG [member: 'jenkins-hbase9.apache.org,35175,1696384805436' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-10-04 02:01:32,244 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): master:39651-0x1010f1b55330000, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,39045,1696384805392 2023-10-04 02:01:32,245 DEBUG [member: 'jenkins-hbase9.apache.org,35175,1696384805436' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35175-0x1010f1b55330003, quorum=127.0.0.1:60027, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-10-04 02:01:32,245 DEBUG [member: 'jenkins-hbase9.apache.org,35175,1696384805436' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-04 02:01:32,245 DEBUG [member: 'jenkins-hbase9.apache.org,39045,1696384805392' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-10-04 02:01:32,245 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-04 02:01:32,245 DEBUG [member: 'jenkins-hbase9.apache.org,39045,1696384805392' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39045-0x1010f1b55330002, quorum=127.0.0.1:60027, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-10-04 02:01:32,245 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-10-04 02:01:32,245 DEBUG [member: 'jenkins-hbase9.apache.org,39045,1696384805392' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-04 02:01:32,245 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,39045,1696384805392 2023-10-04 02:01:32,246 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,35175,1696384805436 2023-10-04 02:01:32,246 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44303,1696384805319 2023-10-04 02:01:32,246 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-04 02:01:32,246 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,44303,1696384805319' joining acquired barrier for procedure 'snaptb0-testEmptyExportFileSystemState' on coordinator 2023-10-04 02:01:32,246 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@502eb543[Count = 1] remaining members to acquire global barrier 2023-10-04 02:01:32,247 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,39045,1696384805392 2023-10-04 02:01:32,247 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-04 02:01:32,247 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-04 02:01:32,247 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-04 02:01:32,247 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-04 02:01:32,247 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-10-04 02:01:32,248 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,39045,1696384805392 2023-10-04 02:01:32,248 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,35175,1696384805436 2023-10-04 02:01:32,248 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44303,1696384805319 2023-10-04 02:01:32,248 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-04 02:01:32,249 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,39045,1696384805392' joining acquired barrier for procedure 'snaptb0-testEmptyExportFileSystemState' on coordinator 2023-10-04 02:01:32,249 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@502eb543[Count = 0] remaining members to acquire global barrier 2023-10-04 02:01:32,249 DEBUG [(jenkins-hbase9.apache.org,39651,1696384803959)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testEmptyExportFileSystemState' starting 'in-barrier' execution. 2023-10-04 02:01:32,249 DEBUG [(jenkins-hbase9.apache.org,39651,1696384803959)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-10-04 02:01:32,254 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): regionserver:44303-0x1010f1b55330001, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-10-04 02:01:32,254 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): regionserver:39045-0x1010f1b55330002, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-10-04 02:01:32,254 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-10-04 02:01:32,254 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-10-04 02:01:32,254 DEBUG [member: 'jenkins-hbase9.apache.org,44303,1696384805319' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-10-04 02:01:32,254 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): regionserver:35175-0x1010f1b55330003, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-10-04 02:01:32,254 DEBUG [(jenkins-hbase9.apache.org,39651,1696384803959)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39651-0x1010f1b55330000, quorum=127.0.0.1:60027, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,44303,1696384805319 2023-10-04 02:01:32,254 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-10-04 02:01:32,254 DEBUG [member: 'jenkins-hbase9.apache.org,44303,1696384805319' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-04 02:01:32,254 DEBUG [member: 'jenkins-hbase9.apache.org,44303,1696384805319' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-04 02:01:32,254 DEBUG [rs(jenkins-hbase9.apache.org,44303,1696384805319)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,,1696384891206.79af1642442547a31fa72109cfa3197d. 2023-10-04 02:01:32,254 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-10-04 02:01:32,254 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-10-04 02:01:32,255 DEBUG [member: 'jenkins-hbase9.apache.org,35175,1696384805436' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-10-04 02:01:32,255 DEBUG [(jenkins-hbase9.apache.org,39651,1696384803959)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39651-0x1010f1b55330000, quorum=127.0.0.1:60027, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,39045,1696384805392 2023-10-04 02:01:32,255 DEBUG [(jenkins-hbase9.apache.org,39651,1696384803959)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-04 02:01:32,255 DEBUG [rs(jenkins-hbase9.apache.org,44303,1696384805319)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1696384891206.79af1642442547a31fa72109cfa3197d. started... 2023-10-04 02:01:32,255 DEBUG [member: 'jenkins-hbase9.apache.org,35175,1696384805436' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally completed 2023-10-04 02:01:32,255 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-10-04 02:01:32,255 DEBUG [member: 'jenkins-hbase9.apache.org,35175,1696384805436' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase9.apache.org,35175,1696384805436' in zk 2023-10-04 02:01:32,255 DEBUG [member: 'jenkins-hbase9.apache.org,39045,1696384805392' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-10-04 02:01:32,255 INFO [rs(jenkins-hbase9.apache.org,44303,1696384805319)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 79af1642442547a31fa72109cfa3197d 1/1 column families, dataSize=400 B heapSize=1.09 KB 2023-10-04 02:01:32,255 DEBUG [member: 'jenkins-hbase9.apache.org,39045,1696384805392' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-04 02:01:32,255 DEBUG [member: 'jenkins-hbase9.apache.org,39045,1696384805392' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-04 02:01:32,255 DEBUG [rs(jenkins-hbase9.apache.org,39045,1696384805392)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,1,1696384891206.33a13e738f38cdb034f48e7dc8ab0b9b. 2023-10-04 02:01:32,255 DEBUG [rs(jenkins-hbase9.apache.org,39045,1696384805392)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1696384891206.33a13e738f38cdb034f48e7dc8ab0b9b. started... 2023-10-04 02:01:32,256 INFO [rs(jenkins-hbase9.apache.org,39045,1696384805392)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 33a13e738f38cdb034f48e7dc8ab0b9b 1/1 column families, dataSize=2.87 KB heapSize=6.44 KB 2023-10-04 02:01:32,257 DEBUG [member: 'jenkins-hbase9.apache.org,35175,1696384805436' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-10-04 02:01:32,257 DEBUG [member: 'jenkins-hbase9.apache.org,35175,1696384805436' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-04 02:01:32,257 DEBUG [member: 'jenkins-hbase9.apache.org,35175,1696384805436' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testEmptyExportFileSystemState' completed. 2023-10-04 02:01:32,284 INFO [rs(jenkins-hbase9.apache.org,44303,1696384805319)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231004a3d2743bb104466094a7fc731d9de7c5 to hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e20231004a3d2743bb104466094a7fc731d9de7c5 2023-10-04 02:01:32,284 INFO [rs(jenkins-hbase9.apache.org,39045,1696384805392)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20231004ac6393bf73174c94a25db76c1073d385 to hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b20231004ac6393bf73174c94a25db76c1073d385 2023-10-04 02:01:32,301 INFO [rs(jenkins-hbase9.apache.org,39045,1696384805392)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=2.9 K, hasBloomFilter=true, into tmp file hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/data/default/testtb-testEmptyExportFileSystemState/33a13e738f38cdb034f48e7dc8ab0b9b/.tmp/cf/efc8191c8ab749999157e78829ed1139 2023-10-04 02:01:32,301 INFO [rs(jenkins-hbase9.apache.org,44303,1696384805319)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=400, hasBloomFilter=true, into tmp file hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/data/default/testtb-testEmptyExportFileSystemState/79af1642442547a31fa72109cfa3197d/.tmp/cf/0b8908e80acc4f68963d9df7ce494198 2023-10-04 02:01:32,307 DEBUG [rs(jenkins-hbase9.apache.org,39045,1696384805392)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/data/default/testtb-testEmptyExportFileSystemState/33a13e738f38cdb034f48e7dc8ab0b9b/.tmp/cf/efc8191c8ab749999157e78829ed1139 as hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/data/default/testtb-testEmptyExportFileSystemState/33a13e738f38cdb034f48e7dc8ab0b9b/cf/efc8191c8ab749999157e78829ed1139 2023-10-04 02:01:32,308 DEBUG [rs(jenkins-hbase9.apache.org,44303,1696384805319)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/data/default/testtb-testEmptyExportFileSystemState/79af1642442547a31fa72109cfa3197d/.tmp/cf/0b8908e80acc4f68963d9df7ce494198 as hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/data/default/testtb-testEmptyExportFileSystemState/79af1642442547a31fa72109cfa3197d/cf/0b8908e80acc4f68963d9df7ce494198 2023-10-04 02:01:32,311 INFO [rs(jenkins-hbase9.apache.org,39045,1696384805392)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/data/default/testtb-testEmptyExportFileSystemState/33a13e738f38cdb034f48e7dc8ab0b9b/cf/efc8191c8ab749999157e78829ed1139, entries=44, sequenceid=6, filesize=12.6 K 2023-10-04 02:01:32,312 INFO [rs(jenkins-hbase9.apache.org,39045,1696384805392)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~2.87 KB/2936, heapSize ~6.42 KB/6576, currentSize=0 B/0 for 33a13e738f38cdb034f48e7dc8ab0b9b in 57ms, sequenceid=6, compaction requested=false 2023-10-04 02:01:32,313 DEBUG [rs(jenkins-hbase9.apache.org,39045,1696384805392)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testEmptyExportFileSystemState' 2023-10-04 02:01:32,313 DEBUG [rs(jenkins-hbase9.apache.org,39045,1696384805392)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 33a13e738f38cdb034f48e7dc8ab0b9b: 2023-10-04 02:01:32,313 DEBUG [rs(jenkins-hbase9.apache.org,39045,1696384805392)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,1,1696384891206.33a13e738f38cdb034f48e7dc8ab0b9b.' region-info for snapshot=snaptb0-testEmptyExportFileSystemState 2023-10-04 02:01:32,315 DEBUG [rs(jenkins-hbase9.apache.org,39045,1696384805392)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-04 02:01:32,315 INFO [rs(jenkins-hbase9.apache.org,44303,1696384805319)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/data/default/testtb-testEmptyExportFileSystemState/79af1642442547a31fa72109cfa3197d/cf/0b8908e80acc4f68963d9df7ce494198, entries=6, sequenceid=6, filesize=5.9 K 2023-10-04 02:01:32,315 DEBUG [rs(jenkins-hbase9.apache.org,39045,1696384805392)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/data/default/testtb-testEmptyExportFileSystemState/33a13e738f38cdb034f48e7dc8ab0b9b/cf/efc8191c8ab749999157e78829ed1139] hfiles 2023-10-04 02:01:32,315 DEBUG [rs(jenkins-hbase9.apache.org,39045,1696384805392)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/data/default/testtb-testEmptyExportFileSystemState/33a13e738f38cdb034f48e7dc8ab0b9b/cf/efc8191c8ab749999157e78829ed1139 for snapshot=snaptb0-testEmptyExportFileSystemState 2023-10-04 02:01:32,316 DEBUG [Listener at jenkins-hbase9.apache.org/33899] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-04 02:01:32,316 INFO [rs(jenkins-hbase9.apache.org,44303,1696384805319)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~400 B/400, heapSize ~1.08 KB/1104, currentSize=0 B/0 for 79af1642442547a31fa72109cfa3197d in 61ms, sequenceid=6, compaction requested=false 2023-10-04 02:01:32,317 DEBUG [rs(jenkins-hbase9.apache.org,44303,1696384805319)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 79af1642442547a31fa72109cfa3197d: 2023-10-04 02:01:32,317 DEBUG [rs(jenkins-hbase9.apache.org,44303,1696384805319)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,,1696384891206.79af1642442547a31fa72109cfa3197d.' region-info for snapshot=snaptb0-testEmptyExportFileSystemState 2023-10-04 02:01:32,317 DEBUG [rs(jenkins-hbase9.apache.org,44303,1696384805319)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-04 02:01:32,317 DEBUG [rs(jenkins-hbase9.apache.org,44303,1696384805319)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/data/default/testtb-testEmptyExportFileSystemState/79af1642442547a31fa72109cfa3197d/cf/0b8908e80acc4f68963d9df7ce494198] hfiles 2023-10-04 02:01:32,318 DEBUG [rs(jenkins-hbase9.apache.org,44303,1696384805319)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/data/default/testtb-testEmptyExportFileSystemState/79af1642442547a31fa72109cfa3197d/cf/0b8908e80acc4f68963d9df7ce494198 for snapshot=snaptb0-testEmptyExportFileSystemState 2023-10-04 02:01:32,318 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39651] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-10-04 02:01:32,318 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39651] snapshot.SnapshotManager(406): Snapshoting '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-10-04 02:01:32,318 DEBUG [Listener at jenkins-hbase9.apache.org/33899] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-10-04 02:01:32,336 DEBUG [rs(jenkins-hbase9.apache.org,39045,1696384805392)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1696384891206.33a13e738f38cdb034f48e7dc8ab0b9b. completed. 2023-10-04 02:01:32,336 DEBUG [rs(jenkins-hbase9.apache.org,39045,1696384805392)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,1,1696384891206.33a13e738f38cdb034f48e7dc8ab0b9b. 2023-10-04 02:01:32,336 DEBUG [member: 'jenkins-hbase9.apache.org,39045,1696384805392' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-04 02:01:32,336 DEBUG [member: 'jenkins-hbase9.apache.org,39045,1696384805392' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-04 02:01:32,336 DEBUG [member: 'jenkins-hbase9.apache.org,39045,1696384805392' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase9.apache.org,39045,1696384805392 2023-10-04 02:01:32,337 DEBUG [member: 'jenkins-hbase9.apache.org,39045,1696384805392' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally completed 2023-10-04 02:01:32,337 DEBUG [member: 'jenkins-hbase9.apache.org,39045,1696384805392' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase9.apache.org,39045,1696384805392' in zk 2023-10-04 02:01:32,339 DEBUG [rs(jenkins-hbase9.apache.org,44303,1696384805319)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1696384891206.79af1642442547a31fa72109cfa3197d. completed. 2023-10-04 02:01:32,339 DEBUG [rs(jenkins-hbase9.apache.org,44303,1696384805319)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,,1696384891206.79af1642442547a31fa72109cfa3197d. 2023-10-04 02:01:32,339 DEBUG [member: 'jenkins-hbase9.apache.org,44303,1696384805319' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-04 02:01:32,339 DEBUG [member: 'jenkins-hbase9.apache.org,44303,1696384805319' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-04 02:01:32,339 DEBUG [member: 'jenkins-hbase9.apache.org,44303,1696384805319' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase9.apache.org,44303,1696384805319 2023-10-04 02:01:32,339 DEBUG [member: 'jenkins-hbase9.apache.org,44303,1696384805319' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally completed 2023-10-04 02:01:32,339 DEBUG [member: 'jenkins-hbase9.apache.org,44303,1696384805319' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase9.apache.org,44303,1696384805319' in zk 2023-10-04 02:01:32,340 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): master:39651-0x1010f1b55330000, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,39045,1696384805392 2023-10-04 02:01:32,340 DEBUG [member: 'jenkins-hbase9.apache.org,39045,1696384805392' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-10-04 02:01:32,340 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,39045,1696384805392 2023-10-04 02:01:32,340 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-04 02:01:32,340 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-04 02:01:32,340 DEBUG [member: 'jenkins-hbase9.apache.org,39045,1696384805392' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-04 02:01:32,340 DEBUG [member: 'jenkins-hbase9.apache.org,39045,1696384805392' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testEmptyExportFileSystemState' completed. 2023-10-04 02:01:32,342 DEBUG [member: 'jenkins-hbase9.apache.org,44303,1696384805319' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-10-04 02:01:32,342 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): master:39651-0x1010f1b55330000, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,44303,1696384805319 2023-10-04 02:01:32,342 DEBUG [member: 'jenkins-hbase9.apache.org,44303,1696384805319' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-04 02:01:32,343 DEBUG [member: 'jenkins-hbase9.apache.org,44303,1696384805319' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testEmptyExportFileSystemState' completed. 2023-10-04 02:01:32,344 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-04 02:01:32,344 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-04 02:01:32,345 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-10-04 02:01:32,345 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,39045,1696384805392 2023-10-04 02:01:32,345 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,35175,1696384805436 2023-10-04 02:01:32,346 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44303,1696384805319 2023-10-04 02:01:32,346 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-04 02:01:32,346 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-10-04 02:01:32,347 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,39045,1696384805392 2023-10-04 02:01:32,347 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,35175,1696384805436 2023-10-04 02:01:32,347 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44303,1696384805319 2023-10-04 02:01:32,348 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase9.apache.org,39045,1696384805392': 2023-10-04 02:01:32,348 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,39045,1696384805392' released barrier for procedure'snaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 1 more 2023-10-04 02:01:32,348 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,44303,1696384805319 2023-10-04 02:01:32,348 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-04 02:01:32,348 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-04 02:01:32,348 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-04 02:01:32,349 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-04 02:01:32,349 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-10-04 02:01:32,349 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,39045,1696384805392 2023-10-04 02:01:32,350 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,35175,1696384805436 2023-10-04 02:01:32,350 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44303,1696384805319 2023-10-04 02:01:32,350 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-04 02:01:32,350 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-10-04 02:01:32,351 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,39045,1696384805392 2023-10-04 02:01:32,351 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,35175,1696384805436 2023-10-04 02:01:32,351 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44303,1696384805319 2023-10-04 02:01:32,352 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase9.apache.org,44303,1696384805319': 2023-10-04 02:01:32,352 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,44303,1696384805319' released barrier for procedure'snaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 0 more 2023-10-04 02:01:32,352 INFO [(jenkins-hbase9.apache.org,39651,1696384803959)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testEmptyExportFileSystemState' execution completed 2023-10-04 02:01:32,352 DEBUG [(jenkins-hbase9.apache.org,39651,1696384803959)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-04 02:01:32,352 DEBUG [(jenkins-hbase9.apache.org,39651,1696384803959)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-04 02:01:32,352 DEBUG [(jenkins-hbase9.apache.org,39651,1696384803959)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testEmptyExportFileSystemState 2023-10-04 02:01:32,352 INFO [(jenkins-hbase9.apache.org,39651,1696384803959)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testEmptyExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-10-04 02:01:32,354 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): regionserver:39045-0x1010f1b55330002, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-10-04 02:01:32,354 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): master:39651-0x1010f1b55330000, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-10-04 02:01:32,354 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): regionserver:35175-0x1010f1b55330003, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-10-04 02:01:32,354 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): regionserver:35175-0x1010f1b55330003, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-04 02:01:32,354 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-10-04 02:01:32,354 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-04 02:01:32,354 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-04 02:01:32,354 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-10-04 02:01:32,354 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): regionserver:39045-0x1010f1b55330002, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-04 02:01:32,354 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-10-04 02:01:32,354 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): regionserver:44303-0x1010f1b55330001, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-10-04 02:01:32,354 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-10-04 02:01:32,354 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-10-04 02:01:32,354 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-04 02:01:32,354 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): regionserver:44303-0x1010f1b55330001, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-04 02:01:32,355 DEBUG [(jenkins-hbase9.apache.org,39651,1696384803959)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39651-0x1010f1b55330000, quorum=127.0.0.1:60027, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,39045,1696384805392 2023-10-04 02:01:32,355 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-04 02:01:32,355 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-04 02:01:32,354 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-10-04 02:01:32,354 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-10-04 02:01:32,355 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-10-04 02:01:32,355 DEBUG [(jenkins-hbase9.apache.org,39651,1696384803959)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39651-0x1010f1b55330000, quorum=127.0.0.1:60027, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,35175,1696384805436 2023-10-04 02:01:32,355 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-04 02:01:32,355 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-10-04 02:01:32,355 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-04 02:01:32,355 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-04 02:01:32,355 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-04 02:01:32,355 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-04 02:01:32,355 DEBUG [(jenkins-hbase9.apache.org,39651,1696384803959)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39651-0x1010f1b55330000, quorum=127.0.0.1:60027, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,44303,1696384805319 2023-10-04 02:01:32,356 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-10-04 02:01:32,356 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-10-04 02:01:32,356 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-10-04 02:01:32,356 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,39045,1696384805392 2023-10-04 02:01:32,357 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,35175,1696384805436 2023-10-04 02:01:32,357 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44303,1696384805319 2023-10-04 02:01:32,357 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-04 02:01:32,357 DEBUG [(jenkins-hbase9.apache.org,39651,1696384803959)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39651-0x1010f1b55330000, quorum=127.0.0.1:60027, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,39045,1696384805392 2023-10-04 02:01:32,357 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-10-04 02:01:32,358 DEBUG [(jenkins-hbase9.apache.org,39651,1696384803959)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39651-0x1010f1b55330000, quorum=127.0.0.1:60027, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,35175,1696384805436 2023-10-04 02:01:32,358 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,39045,1696384805392 2023-10-04 02:01:32,358 DEBUG [(jenkins-hbase9.apache.org,39651,1696384803959)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39651-0x1010f1b55330000, quorum=127.0.0.1:60027, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,44303,1696384805319 2023-10-04 02:01:32,358 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,35175,1696384805436 2023-10-04 02:01:32,358 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44303,1696384805319 2023-10-04 02:01:32,361 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): master:39651-0x1010f1b55330000, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,44303,1696384805319 2023-10-04 02:01:32,361 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): regionserver:35175-0x1010f1b55330003, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-04 02:01:32,361 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): master:39651-0x1010f1b55330000, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-10-04 02:01:32,361 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): regionserver:39045-0x1010f1b55330002, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-04 02:01:32,361 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): regionserver:35175-0x1010f1b55330003, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-04 02:01:32,361 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-04 02:01:32,361 DEBUG [(jenkins-hbase9.apache.org,39651,1696384803959)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-04 02:01:32,361 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): master:39651-0x1010f1b55330000, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,35175,1696384805436 2023-10-04 02:01:32,361 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): regionserver:44303-0x1010f1b55330001, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-04 02:01:32,361 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-04 02:01:32,363 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-04 02:01:32,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-04 02:01:32,363 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): regionserver:44303-0x1010f1b55330001, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-04 02:01:32,363 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): master:39651-0x1010f1b55330000, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,39045,1696384805392 2023-10-04 02:01:32,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-04 02:01:32,361 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testEmptyExportFileSystemState 2023-10-04 02:01:32,361 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): regionserver:39045-0x1010f1b55330002, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-04 02:01:32,363 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testEmptyExportFileSystemState 2023-10-04 02:01:32,363 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): master:39651-0x1010f1b55330000, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-10-04 02:01:32,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-04 02:01:32,363 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): master:39651-0x1010f1b55330000, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,44303,1696384805319 2023-10-04 02:01:32,363 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-04 02:01:32,363 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): master:39651-0x1010f1b55330000, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-10-04 02:01:32,363 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 37e3865d2ff7e5e2da33a03e3f723df0, NAME => 'testtb-testEmptyExportFileSystemState,.mob,0.37e3865d2ff7e5e2da33a03e3f723df0.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testEmptyExportFileSystemState 2023-10-04 02:01:32,363 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-04 02:01:32,363 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-10-04 02:01:32,363 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-04 02:01:32,364 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-04 02:01:32,363 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): master:39651-0x1010f1b55330000, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,35175,1696384805436 2023-10-04 02:01:32,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-04 02:01:32,364 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): master:39651-0x1010f1b55330000, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,39045,1696384805392 2023-10-04 02:01:32,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-04 02:01:32,364 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): master:39651-0x1010f1b55330000, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-10-04 02:01:32,364 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): master:39651-0x1010f1b55330000, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-10-04 02:01:32,364 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b20231004ac6393bf73174c94a25db76c1073d385, hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e20231004a3d2743bb104466094a7fc731d9de7c5] mob files 2023-10-04 02:01:32,364 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b20231004ac6393bf73174c94a25db76c1073d385 2023-10-04 02:01:32,364 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e20231004a3d2743bb104466094a7fc731d9de7c5 2023-10-04 02:01:32,372 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testEmptyExportFileSystemState 2023-10-04 02:01:32,372 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState 2023-10-04 02:01:32,391 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState to hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/.hbase-snapshot/snaptb0-testEmptyExportFileSystemState 2023-10-04 02:01:32,391 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed 2023-10-04 02:01:32,391 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState 2023-10-04 02:01:32,392 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState 2023-10-04 02:01:32,392 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState at 1696384892214Completed referencing HFiles for the mob region of table: testtb-testEmptyExportFileSystemState at 1696384892372 (+158 ms)Consolidate snapshot: snaptb0-testEmptyExportFileSystemState at 1696384892372Loading Region manifests for snaptb0-testEmptyExportFileSystemState at 1696384892372Writing data manifest for snaptb0-testEmptyExportFileSystemState at 1696384892376 (+4 ms)Verifying snapshot: snaptb0-testEmptyExportFileSystemState at 1696384892385 (+9 ms)Snapshot snaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed at 1696384892391 (+6 ms) 2023-10-04 02:01:32,397 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=98, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-10-04 02:01:32,398 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=98, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED in 182 msec 2023-10-04 02:01:32,519 DEBUG [Listener at jenkins-hbase9.apache.org/33899] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-04 02:01:32,519 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39651] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-10-04 02:01:32,520 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39651] snapshot.SnapshotManager(403): Snapshot '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-10-04 02:01:32,520 INFO [Listener at jenkins-hbase9.apache.org/33899] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/export-test/export-1696384892520 2023-10-04 02:01:32,520 INFO [Listener at jenkins-hbase9.apache.org/33899] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:38449, tgtDir=hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/export-test/export-1696384892520, rawTgtDir=hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/export-test/export-1696384892520, srcFsUri=hdfs://localhost:38449, srcDir=hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51 2023-10-04 02:01:32,541 DEBUG [Listener at jenkins-hbase9.apache.org/33899] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:38449, inputRoot=hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51 2023-10-04 02:01:32,542 DEBUG [Listener at jenkins-hbase9.apache.org/33899] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-179758472_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/export-test/export-1696384892520, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/export-test/export-1696384892520/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-10-04 02:01:32,542 INFO [Listener at jenkins-hbase9.apache.org/33899] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:38449, inputRoot=hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51, snapshotDir=hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState. 2023-10-04 02:01:32,547 INFO [Listener at jenkins-hbase9.apache.org/33899] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState to hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/export-test/export-1696384892520/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-10-04 02:01:32,563 DEBUG [Listener at jenkins-hbase9.apache.org/33899] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-10-04 02:01:32,563 DEBUG [Listener at jenkins-hbase9.apache.org/33899] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-10-04 02:01:32,563 DEBUG [Listener at jenkins-hbase9.apache.org/33899] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-10-04 02:01:32,564 DEBUG [Listener at jenkins-hbase9.apache.org/33899] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-10-04 02:01:32,564 DEBUG [Listener at jenkins-hbase9.apache.org/33899] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar 2023-10-04 02:01:32,564 DEBUG [Listener at jenkins-hbase9.apache.org/33899] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-10-04 02:01:32,564 DEBUG [Listener at jenkins-hbase9.apache.org/33899] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-10-04 02:01:32,632 DEBUG [Listener at jenkins-hbase9.apache.org/33899] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/757a468a-9656-cc80-ec19-d6f68f36be5a/hadoop-5723857734460043034.jar 2023-10-04 02:01:32,633 DEBUG [Listener at jenkins-hbase9.apache.org/33899] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-10-04 02:01:32,633 DEBUG [Listener at jenkins-hbase9.apache.org/33899] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-10-04 02:01:32,633 DEBUG [Listener at jenkins-hbase9.apache.org/33899] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-10-04 02:01:32,633 DEBUG [Listener at jenkins-hbase9.apache.org/33899] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-10-04 02:01:32,634 DEBUG [Listener at jenkins-hbase9.apache.org/33899] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-10-04 02:01:32,634 DEBUG [Listener at jenkins-hbase9.apache.org/33899] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-10-04 02:01:32,634 DEBUG [Listener at jenkins-hbase9.apache.org/33899] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-10-04 02:01:32,635 DEBUG [Listener at jenkins-hbase9.apache.org/33899] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-10-04 02:01:32,635 DEBUG [Listener at jenkins-hbase9.apache.org/33899] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-10-04 02:01:32,635 DEBUG [Listener at jenkins-hbase9.apache.org/33899] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-10-04 02:01:32,636 DEBUG [Listener at jenkins-hbase9.apache.org/33899] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-10-04 02:01:32,636 DEBUG [Listener at jenkins-hbase9.apache.org/33899] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-10-04 02:01:32,636 DEBUG [Listener at jenkins-hbase9.apache.org/33899] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-10-04 02:01:32,637 DEBUG [Listener at jenkins-hbase9.apache.org/33899] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-10-04 02:01:32,637 DEBUG [Listener at jenkins-hbase9.apache.org/33899] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-10-04 02:01:32,637 DEBUG [Listener at jenkins-hbase9.apache.org/33899] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-10-04 02:01:32,638 DEBUG [Listener at jenkins-hbase9.apache.org/33899] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-04 02:01:32,638 DEBUG [Listener at jenkins-hbase9.apache.org/33899] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-04 02:01:32,638 DEBUG [Listener at jenkins-hbase9.apache.org/33899] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-10-04 02:01:32,639 DEBUG [Listener at jenkins-hbase9.apache.org/33899] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-04 02:01:32,639 DEBUG [Listener at jenkins-hbase9.apache.org/33899] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-04 02:01:32,639 DEBUG [Listener at jenkins-hbase9.apache.org/33899] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-10-04 02:01:32,639 DEBUG [Listener at jenkins-hbase9.apache.org/33899] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-10-04 02:01:33,018 WARN [Listener at jenkins-hbase9.apache.org/33899] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-10-04 02:01:33,021 INFO [Listener at jenkins-hbase9.apache.org/33899] snapshot.ExportSnapshot(578): Loading Snapshot 'emptySnaptb0-testEmptyExportFileSystemState' hfile list 2023-10-04 02:01:34,671 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-10-04 02:01:34,671 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-10-04 02:01:34,673 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696384811997_0005_000001 (auth:SIMPLE) 2023-10-04 02:01:34,968 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696384811997_0006_000001 (auth:SIMPLE) 2023-10-04 02:01:36,066 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-10-04 02:01:38,767 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696384811997_0006_000001 (auth:SIMPLE) 2023-10-04 02:01:41,356 INFO [Listener at jenkins-hbase9.apache.org/33899] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-10-04 02:01:41,357 INFO [Listener at jenkins-hbase9.apache.org/33899] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-10-04 02:01:41,364 INFO [Listener at jenkins-hbase9.apache.org/33899] snapshot.ExportSnapshot(1127): Export Completed: emptySnaptb0-testEmptyExportFileSystemState 2023-10-04 02:01:41,364 INFO [Listener at jenkins-hbase9.apache.org/33899] snapshot.TestExportSnapshot(279): Exported snapshot 2023-10-04 02:01:41,364 INFO [Listener at jenkins-hbase9.apache.org/33899] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-10-04 02:01:41,364 DEBUG [Listener at jenkins-hbase9.apache.org/33899] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-737588810_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState at hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState 2023-10-04 02:01:41,365 DEBUG [Listener at jenkins-hbase9.apache.org/33899] snapshot.TestExportSnapshot(367): hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/.snapshotinfo 2023-10-04 02:01:41,365 DEBUG [Listener at jenkins-hbase9.apache.org/33899] snapshot.TestExportSnapshot(367): hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/data.manifest 2023-10-04 02:01:41,365 DEBUG [Listener at jenkins-hbase9.apache.org/33899] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-737588810_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/export-test/export-1696384892520/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState at hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/export-test/export-1696384892520/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState 2023-10-04 02:01:41,366 DEBUG [Listener at jenkins-hbase9.apache.org/33899] snapshot.TestExportSnapshot(367): hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/export-test/export-1696384892520/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/.snapshotinfo 2023-10-04 02:01:41,366 DEBUG [Listener at jenkins-hbase9.apache.org/33899] snapshot.TestExportSnapshot(367): hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/export-test/export-1696384892520/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/data.manifest 2023-10-04 02:01:41,371 INFO [Listener at jenkins-hbase9.apache.org/33899] client.HBaseAdmin$15(890): Started disable of testtb-testEmptyExportFileSystemState 2023-10-04 02:01:41,371 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39651] master.HMaster$11(2418): Client=jenkins//172.31.2.10 disable testtb-testEmptyExportFileSystemState 2023-10-04 02:01:41,372 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39651] procedure2.ProcedureExecutor(1028): Stored pid=99, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testEmptyExportFileSystemState 2023-10-04 02:01:41,376 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696384901376"}]},"ts":"1696384901376"} 2023-10-04 02:01:41,376 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39651] master.MasterRpcServices(1230): Checking to see if procedure is done pid=99 2023-10-04 02:01:41,377 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=DISABLING in hbase:meta 2023-10-04 02:01:41,379 INFO [PEWorker-2] procedure.DisableTableProcedure(293): Set testtb-testEmptyExportFileSystemState to state=DISABLING 2023-10-04 02:01:41,380 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=100, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=79af1642442547a31fa72109cfa3197d, UNASSIGN}, {pid=101, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=33a13e738f38cdb034f48e7dc8ab0b9b, UNASSIGN}] 2023-10-04 02:01:41,382 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=100, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=79af1642442547a31fa72109cfa3197d, UNASSIGN 2023-10-04 02:01:41,382 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=101, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=33a13e738f38cdb034f48e7dc8ab0b9b, UNASSIGN 2023-10-04 02:01:41,382 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=100 updating hbase:meta row=79af1642442547a31fa72109cfa3197d, regionState=CLOSING, regionLocation=jenkins-hbase9.apache.org,44303,1696384805319 2023-10-04 02:01:41,382 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=101 updating hbase:meta row=33a13e738f38cdb034f48e7dc8ab0b9b, regionState=CLOSING, regionLocation=jenkins-hbase9.apache.org,39045,1696384805392 2023-10-04 02:01:41,382 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,,1696384891206.79af1642442547a31fa72109cfa3197d.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1696384901382"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696384901382"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696384901382"}]},"ts":"1696384901382"} 2023-10-04 02:01:41,383 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,1,1696384891206.33a13e738f38cdb034f48e7dc8ab0b9b.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1696384901382"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696384901382"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696384901382"}]},"ts":"1696384901382"} 2023-10-04 02:01:41,384 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=102, ppid=100, state=RUNNABLE; CloseRegionProcedure 79af1642442547a31fa72109cfa3197d, server=jenkins-hbase9.apache.org,44303,1696384805319}] 2023-10-04 02:01:41,385 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=103, ppid=101, state=RUNNABLE; CloseRegionProcedure 33a13e738f38cdb034f48e7dc8ab0b9b, server=jenkins-hbase9.apache.org,39045,1696384805392}] 2023-10-04 02:01:41,477 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39651] master.MasterRpcServices(1230): Checking to see if procedure is done pid=99 2023-10-04 02:01:41,536 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(111): Close 79af1642442547a31fa72109cfa3197d 2023-10-04 02:01:41,537 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(111): Close 33a13e738f38cdb034f48e7dc8ab0b9b 2023-10-04 02:01:41,537 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1604): Closing 79af1642442547a31fa72109cfa3197d, disabling compactions & flushes 2023-10-04 02:01:41,537 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1604): Closing 33a13e738f38cdb034f48e7dc8ab0b9b, disabling compactions & flushes 2023-10-04 02:01:41,537 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,,1696384891206.79af1642442547a31fa72109cfa3197d. 2023-10-04 02:01:41,537 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,1,1696384891206.33a13e738f38cdb034f48e7dc8ab0b9b. 2023-10-04 02:01:41,537 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,1,1696384891206.33a13e738f38cdb034f48e7dc8ab0b9b. 2023-10-04 02:01:41,537 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,,1696384891206.79af1642442547a31fa72109cfa3197d. 2023-10-04 02:01:41,537 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,,1696384891206.79af1642442547a31fa72109cfa3197d. after waiting 0 ms 2023-10-04 02:01:41,537 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,1,1696384891206.33a13e738f38cdb034f48e7dc8ab0b9b. after waiting 0 ms 2023-10-04 02:01:41,537 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,1,1696384891206.33a13e738f38cdb034f48e7dc8ab0b9b. 2023-10-04 02:01:41,537 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,,1696384891206.79af1642442547a31fa72109cfa3197d. 2023-10-04 02:01:41,546 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/data/default/testtb-testEmptyExportFileSystemState/33a13e738f38cdb034f48e7dc8ab0b9b/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-10-04 02:01:41,546 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/data/default/testtb-testEmptyExportFileSystemState/79af1642442547a31fa72109cfa3197d/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-10-04 02:01:41,546 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-10-04 02:01:41,546 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-10-04 02:01:41,548 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,,1696384891206.79af1642442547a31fa72109cfa3197d. 2023-10-04 02:01:41,548 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,1,1696384891206.33a13e738f38cdb034f48e7dc8ab0b9b. 2023-10-04 02:01:41,548 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1558): Region close journal for 79af1642442547a31fa72109cfa3197d: 2023-10-04 02:01:41,548 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1558): Region close journal for 33a13e738f38cdb034f48e7dc8ab0b9b: 2023-10-04 02:01:41,549 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(149): Closed 33a13e738f38cdb034f48e7dc8ab0b9b 2023-10-04 02:01:41,550 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=101 updating hbase:meta row=33a13e738f38cdb034f48e7dc8ab0b9b, regionState=CLOSED 2023-10-04 02:01:41,550 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,1,1696384891206.33a13e738f38cdb034f48e7dc8ab0b9b.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1696384901550"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696384901550"}]},"ts":"1696384901550"} 2023-10-04 02:01:41,550 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(149): Closed 79af1642442547a31fa72109cfa3197d 2023-10-04 02:01:41,550 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=100 updating hbase:meta row=79af1642442547a31fa72109cfa3197d, regionState=CLOSED 2023-10-04 02:01:41,550 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,,1696384891206.79af1642442547a31fa72109cfa3197d.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1696384901550"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696384901550"}]},"ts":"1696384901550"} 2023-10-04 02:01:41,553 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=103, resume processing ppid=101 2023-10-04 02:01:41,553 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=103, ppid=101, state=SUCCESS; CloseRegionProcedure 33a13e738f38cdb034f48e7dc8ab0b9b, server=jenkins-hbase9.apache.org,39045,1696384805392 in 166 msec 2023-10-04 02:01:41,554 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=102, resume processing ppid=100 2023-10-04 02:01:41,554 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=102, ppid=100, state=SUCCESS; CloseRegionProcedure 79af1642442547a31fa72109cfa3197d, server=jenkins-hbase9.apache.org,44303,1696384805319 in 168 msec 2023-10-04 02:01:41,554 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=101, ppid=99, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=33a13e738f38cdb034f48e7dc8ab0b9b, UNASSIGN in 173 msec 2023-10-04 02:01:41,555 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=100, resume processing ppid=99 2023-10-04 02:01:41,556 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=100, ppid=99, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=79af1642442547a31fa72109cfa3197d, UNASSIGN in 174 msec 2023-10-04 02:01:41,556 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696384901556"}]},"ts":"1696384901556"} 2023-10-04 02:01:41,557 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=DISABLED in hbase:meta 2023-10-04 02:01:41,559 INFO [PEWorker-4] procedure.DisableTableProcedure(305): Set testtb-testEmptyExportFileSystemState to state=DISABLED 2023-10-04 02:01:41,560 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=99, state=SUCCESS; DisableTableProcedure table=testtb-testEmptyExportFileSystemState in 188 msec 2023-10-04 02:01:41,678 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39651] master.MasterRpcServices(1230): Checking to see if procedure is done pid=99 2023-10-04 02:01:41,678 INFO [Listener at jenkins-hbase9.apache.org/33899] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testEmptyExportFileSystemState, procId: 99 completed 2023-10-04 02:01:41,679 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39651] master.HMaster$5(2228): Client=jenkins//172.31.2.10 delete testtb-testEmptyExportFileSystemState 2023-10-04 02:01:41,680 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39651] procedure2.ProcedureExecutor(1028): Stored pid=104, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-10-04 02:01:41,682 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=104, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-10-04 02:01:41,682 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39651] access.PermissionStorage(259): Removing permissions of removed table testtb-testEmptyExportFileSystemState 2023-10-04 02:01:41,682 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=104, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-10-04 02:01:41,684 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=44303] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testEmptyExportFileSystemState 2023-10-04 02:01:41,687 DEBUG [HFileArchiver-18] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/.tmp/data/default/testtb-testEmptyExportFileSystemState/79af1642442547a31fa72109cfa3197d 2023-10-04 02:01:41,687 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/.tmp/data/default/testtb-testEmptyExportFileSystemState/33a13e738f38cdb034f48e7dc8ab0b9b 2023-10-04 02:01:41,688 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): regionserver:39045-0x1010f1b55330002, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-10-04 02:01:41,688 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): master:39651-0x1010f1b55330000, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-10-04 02:01:41,688 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): regionserver:35175-0x1010f1b55330003, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-10-04 02:01:41,688 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): regionserver:44303-0x1010f1b55330001, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-10-04 02:01:41,688 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-10-04 02:01:41,688 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-10-04 02:01:41,689 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-10-04 02:01:41,688 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-10-04 02:01:41,689 DEBUG [HFileArchiver-18] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/.tmp/data/default/testtb-testEmptyExportFileSystemState/79af1642442547a31fa72109cfa3197d/cf, FileablePath, hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/.tmp/data/default/testtb-testEmptyExportFileSystemState/79af1642442547a31fa72109cfa3197d/recovered.edits] 2023-10-04 02:01:41,689 DEBUG [HFileArchiver-13] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/.tmp/data/default/testtb-testEmptyExportFileSystemState/33a13e738f38cdb034f48e7dc8ab0b9b/cf, FileablePath, hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/.tmp/data/default/testtb-testEmptyExportFileSystemState/33a13e738f38cdb034f48e7dc8ab0b9b/recovered.edits] 2023-10-04 02:01:41,689 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): regionserver:39045-0x1010f1b55330002, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-10-04 02:01:41,689 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): regionserver:39045-0x1010f1b55330002, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-04 02:01:41,689 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): master:39651-0x1010f1b55330000, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-10-04 02:01:41,689 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): regionserver:35175-0x1010f1b55330003, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-10-04 02:01:41,689 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): regionserver:35175-0x1010f1b55330003, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-04 02:01:41,689 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): regionserver:44303-0x1010f1b55330001, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-10-04 02:01:41,689 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): regionserver:44303-0x1010f1b55330001, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-04 02:01:41,689 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): master:39651-0x1010f1b55330000, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-04 02:01:41,690 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39651] master.MasterRpcServices(1230): Checking to see if procedure is done pid=104 2023-10-04 02:01:41,693 DEBUG [HFileArchiver-18] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/.tmp/data/default/testtb-testEmptyExportFileSystemState/79af1642442547a31fa72109cfa3197d/cf/0b8908e80acc4f68963d9df7ce494198 to hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/archive/data/default/testtb-testEmptyExportFileSystemState/79af1642442547a31fa72109cfa3197d/cf/0b8908e80acc4f68963d9df7ce494198 2023-10-04 02:01:41,693 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/.tmp/data/default/testtb-testEmptyExportFileSystemState/33a13e738f38cdb034f48e7dc8ab0b9b/cf/efc8191c8ab749999157e78829ed1139 to hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/archive/data/default/testtb-testEmptyExportFileSystemState/33a13e738f38cdb034f48e7dc8ab0b9b/cf/efc8191c8ab749999157e78829ed1139 2023-10-04 02:01:41,695 DEBUG [HFileArchiver-18] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/.tmp/data/default/testtb-testEmptyExportFileSystemState/79af1642442547a31fa72109cfa3197d/recovered.edits/9.seqid to hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/archive/data/default/testtb-testEmptyExportFileSystemState/79af1642442547a31fa72109cfa3197d/recovered.edits/9.seqid 2023-10-04 02:01:41,696 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/.tmp/data/default/testtb-testEmptyExportFileSystemState/33a13e738f38cdb034f48e7dc8ab0b9b/recovered.edits/9.seqid to hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/archive/data/default/testtb-testEmptyExportFileSystemState/33a13e738f38cdb034f48e7dc8ab0b9b/recovered.edits/9.seqid 2023-10-04 02:01:41,696 DEBUG [HFileArchiver-18] backup.HFileArchiver(596): Deleted hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/.tmp/data/default/testtb-testEmptyExportFileSystemState/79af1642442547a31fa72109cfa3197d 2023-10-04 02:01:41,696 DEBUG [HFileArchiver-13] backup.HFileArchiver(596): Deleted hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/.tmp/data/default/testtb-testEmptyExportFileSystemState/33a13e738f38cdb034f48e7dc8ab0b9b 2023-10-04 02:01:41,696 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testtb-testEmptyExportFileSystemState regions 2023-10-04 02:01:41,697 DEBUG [PEWorker-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0 2023-10-04 02:01:41,697 DEBUG [PEWorker-5] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf] 2023-10-04 02:01:41,701 DEBUG [PEWorker-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b20231004ac6393bf73174c94a25db76c1073d385 to hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/archive/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b20231004ac6393bf73174c94a25db76c1073d385 2023-10-04 02:01:41,702 DEBUG [PEWorker-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e20231004a3d2743bb104466094a7fc731d9de7c5 to hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/archive/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e20231004a3d2743bb104466094a7fc731d9de7c5 2023-10-04 02:01:41,702 DEBUG [PEWorker-5] backup.HFileArchiver(596): Deleted hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0 2023-10-04 02:01:41,704 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=104, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-10-04 02:01:41,706 WARN [PEWorker-5] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testEmptyExportFileSystemState from hbase:meta 2023-10-04 02:01:41,708 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(421): Removing 'testtb-testEmptyExportFileSystemState' descriptor. 2023-10-04 02:01:41,709 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=104, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-10-04 02:01:41,709 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(411): Removing 'testtb-testEmptyExportFileSystemState' from region states. 2023-10-04 02:01:41,709 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState,,1696384891206.79af1642442547a31fa72109cfa3197d.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1696384901709"}]},"ts":"9223372036854775807"} 2023-10-04 02:01:41,709 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState,1,1696384891206.33a13e738f38cdb034f48e7dc8ab0b9b.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1696384901709"}]},"ts":"9223372036854775807"} 2023-10-04 02:01:41,710 INFO [PEWorker-5] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-10-04 02:01:41,710 DEBUG [PEWorker-5] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 79af1642442547a31fa72109cfa3197d, NAME => 'testtb-testEmptyExportFileSystemState,,1696384891206.79af1642442547a31fa72109cfa3197d.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 33a13e738f38cdb034f48e7dc8ab0b9b, NAME => 'testtb-testEmptyExportFileSystemState,1,1696384891206.33a13e738f38cdb034f48e7dc8ab0b9b.', STARTKEY => '1', ENDKEY => ''}] 2023-10-04 02:01:41,710 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(415): Marking 'testtb-testEmptyExportFileSystemState' as deleted. 2023-10-04 02:01:41,711 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1696384901710"}]},"ts":"9223372036854775807"} 2023-10-04 02:01:41,712 INFO [PEWorker-5] hbase.MetaTableAccessor(1658): Deleted table testtb-testEmptyExportFileSystemState state from META 2023-10-04 02:01:41,713 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(130): Finished pid=104, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-10-04 02:01:41,714 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=104, state=SUCCESS; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState in 34 msec 2023-10-04 02:01:41,791 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39651] master.MasterRpcServices(1230): Checking to see if procedure is done pid=104 2023-10-04 02:01:41,792 INFO [Listener at jenkins-hbase9.apache.org/33899] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testEmptyExportFileSystemState, procId: 104 completed 2023-10-04 02:01:41,798 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39651] master.MasterRpcServices(751): Client=jenkins//172.31.2.10 delete name: "emptySnaptb0-testEmptyExportFileSystemState" 2023-10-04 02:01:41,800 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39651] snapshot.SnapshotManager(335): Deleting snapshot: emptySnaptb0-testEmptyExportFileSystemState 2023-10-04 02:01:41,802 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39651] master.MasterRpcServices(751): Client=jenkins//172.31.2.10 delete name: "snaptb0-testEmptyExportFileSystemState" 2023-10-04 02:01:41,803 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39651] snapshot.SnapshotManager(335): Deleting snapshot: snaptb0-testEmptyExportFileSystemState 2023-10-04 02:01:41,827 INFO [Listener at jenkins-hbase9.apache.org/33899] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testEmptyExportFileSystemState Thread=766 (was 758) Potentially hanging thread: hconnection-0x20d1013d-shared-pool-36 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LogDeleter #3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1088) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #10 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-737588810_17 at /127.0.0.1:34394 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (905985230) connection to jenkins-hbase9.apache.org/172.31.2.10:45271 from appattempt_1696384811997_0006_000001 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: ApplicationMasterLauncher #9 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x20d1013d-shared-pool-33 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_15072119_1 at /127.0.0.1:40212 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x20d1013d-shared-pool-34 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-737588810_17 at /127.0.0.1:54298 [Waiting for operation #6] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (905985230) connection to jenkins-hbase9.apache.org/172.31.2.10:38113 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: hconnection-0x20d1013d-shared-pool-35 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_15072119_1 at /127.0.0.1:54274 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-4604 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-737588810_17 at /127.0.0.1:40266 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (905985230) connection to jenkins-hbase9.apache.org/172.31.2.10:37003 from appattempt_1696384811997_0005_000001 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) - Thread LEAK? -, OpenFileDescriptor=939 (was 909) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=295 (was 267) - SystemLoadAverage LEAK? -, ProcessCount=168 (was 168), AvailableMemoryMB=10750 (was 10777) 2023-10-04 02:01:41,827 WARN [Listener at jenkins-hbase9.apache.org/33899] hbase.ResourceChecker(130): Thread=766 is superior to 500 2023-10-04 02:01:41,846 INFO [Listener at jenkins-hbase9.apache.org/33899] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testExportFileSystemStateWithSkipTmp Thread=766, OpenFileDescriptor=939, MaxFileDescriptor=60000, SystemLoadAverage=295, ProcessCount=168, AvailableMemoryMB=10750 2023-10-04 02:01:41,846 WARN [Listener at jenkins-hbase9.apache.org/33899] hbase.ResourceChecker(130): Thread=766 is superior to 500 2023-10-04 02:01:41,848 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39651] master.HMaster$4(2112): Client=jenkins//172.31.2.10 create 'testtb-testExportFileSystemStateWithSkipTmp', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-10-04 02:01:41,849 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39651] procedure2.ProcedureExecutor(1028): Stored pid=105, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-10-04 02:01:41,850 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_PRE_OPERATION 2023-10-04 02:01:41,851 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39651] master.MasterRpcServices(700): Client=jenkins//172.31.2.10 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemStateWithSkipTmp" procId is: 105 2023-10-04 02:01:41,851 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-10-04 02:01:41,851 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39651] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-10-04 02:01:41,853 DEBUG [HFileArchiver-19] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/ca38ebb41287c3efeac984dfbc22db48 2023-10-04 02:01:41,853 DEBUG [HFileArchiver-20] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/91d2010452fbe492aaa759851ab6b3c7 2023-10-04 02:01:41,854 DEBUG [HFileArchiver-19] backup.HFileArchiver(153): Directory hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/ca38ebb41287c3efeac984dfbc22db48 empty. 2023-10-04 02:01:41,854 DEBUG [HFileArchiver-20] backup.HFileArchiver(153): Directory hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/91d2010452fbe492aaa759851ab6b3c7 empty. 2023-10-04 02:01:41,854 DEBUG [HFileArchiver-19] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/ca38ebb41287c3efeac984dfbc22db48 2023-10-04 02:01:41,854 DEBUG [HFileArchiver-20] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/91d2010452fbe492aaa759851ab6b3c7 2023-10-04 02:01:41,854 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithSkipTmp regions 2023-10-04 02:01:41,863 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/.tabledesc/.tableinfo.0000000001 2023-10-04 02:01:41,864 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(7675): creating {ENCODED => ca38ebb41287c3efeac984dfbc22db48, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,,1696384901847.ca38ebb41287c3efeac984dfbc22db48.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportFileSystemStateWithSkipTmp', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/.tmp 2023-10-04 02:01:41,864 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(7675): creating {ENCODED => 91d2010452fbe492aaa759851ab6b3c7, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,1,1696384901847.91d2010452fbe492aaa759851ab6b3c7.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemStateWithSkipTmp', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/.tmp 2023-10-04 02:01:41,878 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,,1696384901847.ca38ebb41287c3efeac984dfbc22db48.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-04 02:01:41,878 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1604): Closing ca38ebb41287c3efeac984dfbc22db48, disabling compactions & flushes 2023-10-04 02:01:41,878 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,,1696384901847.ca38ebb41287c3efeac984dfbc22db48. 2023-10-04 02:01:41,879 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,,1696384901847.ca38ebb41287c3efeac984dfbc22db48. 2023-10-04 02:01:41,879 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,,1696384901847.ca38ebb41287c3efeac984dfbc22db48. after waiting 0 ms 2023-10-04 02:01:41,879 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,,1696384901847.ca38ebb41287c3efeac984dfbc22db48. 2023-10-04 02:01:41,879 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,,1696384901847.ca38ebb41287c3efeac984dfbc22db48. 2023-10-04 02:01:41,879 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1558): Region close journal for ca38ebb41287c3efeac984dfbc22db48: 2023-10-04 02:01:41,879 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,1,1696384901847.91d2010452fbe492aaa759851ab6b3c7.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-04 02:01:41,879 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1604): Closing 91d2010452fbe492aaa759851ab6b3c7, disabling compactions & flushes 2023-10-04 02:01:41,879 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,1,1696384901847.91d2010452fbe492aaa759851ab6b3c7. 2023-10-04 02:01:41,879 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1696384901847.91d2010452fbe492aaa759851ab6b3c7. 2023-10-04 02:01:41,879 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1696384901847.91d2010452fbe492aaa759851ab6b3c7. after waiting 0 ms 2023-10-04 02:01:41,879 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,1,1696384901847.91d2010452fbe492aaa759851ab6b3c7. 2023-10-04 02:01:41,879 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,1,1696384901847.91d2010452fbe492aaa759851ab6b3c7. 2023-10-04 02:01:41,879 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1558): Region close journal for 91d2010452fbe492aaa759851ab6b3c7: 2023-10-04 02:01:41,881 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_ADD_TO_META 2023-10-04 02:01:41,882 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1696384901847.ca38ebb41287c3efeac984dfbc22db48.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1696384901882"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696384901882"}]},"ts":"1696384901882"} 2023-10-04 02:01:41,882 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1696384901847.91d2010452fbe492aaa759851ab6b3c7.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1696384901882"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696384901882"}]},"ts":"1696384901882"} 2023-10-04 02:01:41,884 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-10-04 02:01:41,885 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-10-04 02:01:41,885 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696384901885"}]},"ts":"1696384901885"} 2023-10-04 02:01:41,886 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=ENABLING in hbase:meta 2023-10-04 02:01:41,889 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase9.apache.org=0} racks are {/default-rack=0} 2023-10-04 02:01:41,890 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-10-04 02:01:41,890 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-10-04 02:01:41,890 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-10-04 02:01:41,890 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-10-04 02:01:41,891 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=ca38ebb41287c3efeac984dfbc22db48, ASSIGN}, {pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=91d2010452fbe492aaa759851ab6b3c7, ASSIGN}] 2023-10-04 02:01:41,893 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=91d2010452fbe492aaa759851ab6b3c7, ASSIGN 2023-10-04 02:01:41,893 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=ca38ebb41287c3efeac984dfbc22db48, ASSIGN 2023-10-04 02:01:41,893 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=91d2010452fbe492aaa759851ab6b3c7, ASSIGN; state=OFFLINE, location=jenkins-hbase9.apache.org,35175,1696384805436; forceNewPlan=false, retain=false 2023-10-04 02:01:41,893 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=ca38ebb41287c3efeac984dfbc22db48, ASSIGN; state=OFFLINE, location=jenkins-hbase9.apache.org,44303,1696384805319; forceNewPlan=false, retain=false 2023-10-04 02:01:41,952 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39651] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-10-04 02:01:42,044 INFO [jenkins-hbase9:39651] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-10-04 02:01:42,046 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=107 updating hbase:meta row=91d2010452fbe492aaa759851ab6b3c7, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,35175,1696384805436 2023-10-04 02:01:42,046 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=106 updating hbase:meta row=ca38ebb41287c3efeac984dfbc22db48, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,44303,1696384805319 2023-10-04 02:01:42,047 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1696384901847.91d2010452fbe492aaa759851ab6b3c7.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1696384902046"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696384902046"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696384902046"}]},"ts":"1696384902046"} 2023-10-04 02:01:42,047 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1696384901847.ca38ebb41287c3efeac984dfbc22db48.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1696384902046"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696384902046"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696384902046"}]},"ts":"1696384902046"} 2023-10-04 02:01:42,048 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=108, ppid=107, state=RUNNABLE; OpenRegionProcedure 91d2010452fbe492aaa759851ab6b3c7, server=jenkins-hbase9.apache.org,35175,1696384805436}] 2023-10-04 02:01:42,049 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=109, ppid=106, state=RUNNABLE; OpenRegionProcedure ca38ebb41287c3efeac984dfbc22db48, server=jenkins-hbase9.apache.org,44303,1696384805319}] 2023-10-04 02:01:42,153 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39651] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-10-04 02:01:42,203 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithSkipTmp,,1696384901847.ca38ebb41287c3efeac984dfbc22db48. 2023-10-04 02:01:42,203 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithSkipTmp,1,1696384901847.91d2010452fbe492aaa759851ab6b3c7. 2023-10-04 02:01:42,203 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => ca38ebb41287c3efeac984dfbc22db48, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,,1696384901847.ca38ebb41287c3efeac984dfbc22db48.', STARTKEY => '', ENDKEY => '1'} 2023-10-04 02:01:42,203 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 91d2010452fbe492aaa759851ab6b3c7, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,1,1696384901847.91d2010452fbe492aaa759851ab6b3c7.', STARTKEY => '1', ENDKEY => ''} 2023-10-04 02:01:42,203 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithSkipTmp,,1696384901847.ca38ebb41287c3efeac984dfbc22db48. service=AccessControlService 2023-10-04 02:01:42,203 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithSkipTmp,1,1696384901847.91d2010452fbe492aaa759851ab6b3c7. service=AccessControlService 2023-10-04 02:01:42,203 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-10-04 02:01:42,203 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithSkipTmp ca38ebb41287c3efeac984dfbc22db48 2023-10-04 02:01:42,203 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-10-04 02:01:42,203 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,,1696384901847.ca38ebb41287c3efeac984dfbc22db48.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-04 02:01:42,203 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7894): checking encryption for ca38ebb41287c3efeac984dfbc22db48 2023-10-04 02:01:42,204 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7897): checking classloading for ca38ebb41287c3efeac984dfbc22db48 2023-10-04 02:01:42,204 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithSkipTmp 91d2010452fbe492aaa759851ab6b3c7 2023-10-04 02:01:42,204 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,1,1696384901847.91d2010452fbe492aaa759851ab6b3c7.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-04 02:01:42,204 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7894): checking encryption for 91d2010452fbe492aaa759851ab6b3c7 2023-10-04 02:01:42,204 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7897): checking classloading for 91d2010452fbe492aaa759851ab6b3c7 2023-10-04 02:01:42,205 INFO [StoreOpener-ca38ebb41287c3efeac984dfbc22db48-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region ca38ebb41287c3efeac984dfbc22db48 2023-10-04 02:01:42,205 INFO [StoreOpener-91d2010452fbe492aaa759851ab6b3c7-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 91d2010452fbe492aaa759851ab6b3c7 2023-10-04 02:01:42,206 DEBUG [StoreOpener-ca38ebb41287c3efeac984dfbc22db48-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/data/default/testtb-testExportFileSystemStateWithSkipTmp/ca38ebb41287c3efeac984dfbc22db48/cf 2023-10-04 02:01:42,206 DEBUG [StoreOpener-ca38ebb41287c3efeac984dfbc22db48-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/data/default/testtb-testExportFileSystemStateWithSkipTmp/ca38ebb41287c3efeac984dfbc22db48/cf 2023-10-04 02:01:42,206 DEBUG [StoreOpener-91d2010452fbe492aaa759851ab6b3c7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/data/default/testtb-testExportFileSystemStateWithSkipTmp/91d2010452fbe492aaa759851ab6b3c7/cf 2023-10-04 02:01:42,206 DEBUG [StoreOpener-91d2010452fbe492aaa759851ab6b3c7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/data/default/testtb-testExportFileSystemStateWithSkipTmp/91d2010452fbe492aaa759851ab6b3c7/cf 2023-10-04 02:01:42,207 INFO [StoreOpener-91d2010452fbe492aaa759851ab6b3c7-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 91d2010452fbe492aaa759851ab6b3c7 columnFamilyName cf 2023-10-04 02:01:42,207 INFO [StoreOpener-ca38ebb41287c3efeac984dfbc22db48-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region ca38ebb41287c3efeac984dfbc22db48 columnFamilyName cf 2023-10-04 02:01:42,208 INFO [StoreOpener-91d2010452fbe492aaa759851ab6b3c7-1] regionserver.HStore(310): Store=91d2010452fbe492aaa759851ab6b3c7/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-04 02:01:42,208 INFO [StoreOpener-ca38ebb41287c3efeac984dfbc22db48-1] regionserver.HStore(310): Store=ca38ebb41287c3efeac984dfbc22db48/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-04 02:01:42,209 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/data/default/testtb-testExportFileSystemStateWithSkipTmp/ca38ebb41287c3efeac984dfbc22db48 2023-10-04 02:01:42,209 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/data/default/testtb-testExportFileSystemStateWithSkipTmp/91d2010452fbe492aaa759851ab6b3c7 2023-10-04 02:01:42,209 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/data/default/testtb-testExportFileSystemStateWithSkipTmp/ca38ebb41287c3efeac984dfbc22db48 2023-10-04 02:01:42,209 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/data/default/testtb-testExportFileSystemStateWithSkipTmp/91d2010452fbe492aaa759851ab6b3c7 2023-10-04 02:01:42,212 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1055): writing seq id for 91d2010452fbe492aaa759851ab6b3c7 2023-10-04 02:01:42,212 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1055): writing seq id for ca38ebb41287c3efeac984dfbc22db48 2023-10-04 02:01:42,214 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/data/default/testtb-testExportFileSystemStateWithSkipTmp/91d2010452fbe492aaa759851ab6b3c7/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-04 02:01:42,214 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/data/default/testtb-testExportFileSystemStateWithSkipTmp/ca38ebb41287c3efeac984dfbc22db48/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-04 02:01:42,214 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1072): Opened 91d2010452fbe492aaa759851ab6b3c7; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74058224, jitterRate=0.10355353355407715}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-10-04 02:01:42,215 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1072): Opened ca38ebb41287c3efeac984dfbc22db48; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65222818, jitterRate=-0.028104275465011597}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-10-04 02:01:42,215 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(965): Region open journal for 91d2010452fbe492aaa759851ab6b3c7: 2023-10-04 02:01:42,215 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(965): Region open journal for ca38ebb41287c3efeac984dfbc22db48: 2023-10-04 02:01:42,215 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithSkipTmp,,1696384901847.ca38ebb41287c3efeac984dfbc22db48., pid=109, masterSystemTime=1696384902200 2023-10-04 02:01:42,215 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithSkipTmp,1,1696384901847.91d2010452fbe492aaa759851ab6b3c7., pid=108, masterSystemTime=1696384902200 2023-10-04 02:01:42,217 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithSkipTmp,,1696384901847.ca38ebb41287c3efeac984dfbc22db48. 2023-10-04 02:01:42,217 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithSkipTmp,,1696384901847.ca38ebb41287c3efeac984dfbc22db48. 2023-10-04 02:01:42,217 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=106 updating hbase:meta row=ca38ebb41287c3efeac984dfbc22db48, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase9.apache.org,44303,1696384805319 2023-10-04 02:01:42,217 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithSkipTmp,1,1696384901847.91d2010452fbe492aaa759851ab6b3c7. 2023-10-04 02:01:42,217 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithSkipTmp,1,1696384901847.91d2010452fbe492aaa759851ab6b3c7. 2023-10-04 02:01:42,217 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1696384901847.ca38ebb41287c3efeac984dfbc22db48.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1696384902217"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1696384902217"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1696384902217"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1696384902217"}]},"ts":"1696384902217"} 2023-10-04 02:01:42,218 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=107 updating hbase:meta row=91d2010452fbe492aaa759851ab6b3c7, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase9.apache.org,35175,1696384805436 2023-10-04 02:01:42,218 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1696384901847.91d2010452fbe492aaa759851ab6b3c7.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1696384902218"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1696384902218"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1696384902218"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1696384902218"}]},"ts":"1696384902218"} 2023-10-04 02:01:42,221 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=109, resume processing ppid=106 2023-10-04 02:01:42,221 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=109, ppid=106, state=SUCCESS; OpenRegionProcedure ca38ebb41287c3efeac984dfbc22db48, server=jenkins-hbase9.apache.org,44303,1696384805319 in 170 msec 2023-10-04 02:01:42,222 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=106, ppid=105, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=ca38ebb41287c3efeac984dfbc22db48, ASSIGN in 330 msec 2023-10-04 02:01:42,222 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=108, resume processing ppid=107 2023-10-04 02:01:42,222 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=108, ppid=107, state=SUCCESS; OpenRegionProcedure 91d2010452fbe492aaa759851ab6b3c7, server=jenkins-hbase9.apache.org,35175,1696384805436 in 172 msec 2023-10-04 02:01:42,223 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=107, resume processing ppid=105 2023-10-04 02:01:42,223 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=107, ppid=105, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=91d2010452fbe492aaa759851ab6b3c7, ASSIGN in 331 msec 2023-10-04 02:01:42,224 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-10-04 02:01:42,224 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696384902224"}]},"ts":"1696384902224"} 2023-10-04 02:01:42,225 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=ENABLED in hbase:meta 2023-10-04 02:01:42,228 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_POST_OPERATION 2023-10-04 02:01:42,228 DEBUG [PEWorker-1] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemStateWithSkipTmp jenkins: RWXCA 2023-10-04 02:01:42,229 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=44303] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithSkipTmp], kv [jenkins: RWXCA] 2023-10-04 02:01:42,231 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): master:39651-0x1010f1b55330000, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-04 02:01:42,231 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): regionserver:39045-0x1010f1b55330002, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-04 02:01:42,231 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): regionserver:44303-0x1010f1b55330001, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-04 02:01:42,231 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): regionserver:35175-0x1010f1b55330003, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-04 02:01:42,233 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-10-04 02:01:42,233 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-10-04 02:01:42,233 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-10-04 02:01:42,233 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-10-04 02:01:42,234 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=105, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp in 384 msec 2023-10-04 02:01:42,455 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39651] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-10-04 02:01:42,455 INFO [Listener at jenkins-hbase9.apache.org/33899] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemStateWithSkipTmp, procId: 105 completed 2023-10-04 02:01:42,457 DEBUG [Listener at jenkins-hbase9.apache.org/33899] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithSkipTmp 2023-10-04 02:01:42,457 DEBUG [Listener at jenkins-hbase9.apache.org/33899] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithSkipTmp,,1696384901847.ca38ebb41287c3efeac984dfbc22db48. 2023-10-04 02:01:42,459 INFO [Listener at jenkins-hbase9.apache.org/33899] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-10-04 02:01:42,469 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39651] master.MasterRpcServices(1583): Client=jenkins//172.31.2.10 snapshot request for:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-10-04 02:01:42,469 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39651] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1696384902469 (current time:1696384902469). 2023-10-04 02:01:42,469 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39651] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-10-04 02:01:42,470 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39651] zookeeper.ReadOnlyZKClient(139): Connect 0x55a33d12 to 127.0.0.1:60027 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-04 02:01:42,476 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39651] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7358e33f, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-04 02:01:42,477 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39651] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-04 02:01:42,478 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:48218, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-04 02:01:42,479 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39651] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x55a33d12 to 127.0.0.1:60027 2023-10-04 02:01:42,479 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39651] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-04 02:01:42,480 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39651] zookeeper.ReadOnlyZKClient(139): Connect 0x21235dbb to 127.0.0.1:60027 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-04 02:01:42,486 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39651] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6d24bf20, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-04 02:01:42,487 DEBUG [hconnection-0x5951e8a0-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-04 02:01:42,490 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:48226, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-04 02:01:42,494 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39651] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x21235dbb to 127.0.0.1:60027 2023-10-04 02:01:42,494 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39651] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-04 02:01:42,494 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39651] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithSkipTmp], kv [jenkins: RWXCA] 2023-10-04 02:01:42,494 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39651] snapshot.SnapshotManager(637): No existing snapshot, attempting snapshot... 2023-10-04 02:01:42,495 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39651] snapshot.SnapshotManager(684): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-10-04 02:01:42,497 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39651] snapshot.SnapshotManager(519): Unable to retrieve ACL status for path: hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/.hbase-snapshot, current working dir path: hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp org.apache.hadoop.hdfs.protocol.AclException: The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.ipc.RemoteException.instantiateException(RemoteException.java:121) at org.apache.hadoop.ipc.RemoteException.unwrapRemoteException(RemoteException.java:88) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2736) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2294) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2291) at org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81) at org.apache.hadoop.hdfs.DistributedFileSystem.getAclStatus(DistributedFileSystem.java:2291) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.updateWorkingDirAclsIfRequired(SnapshotManager.java:517) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.prepareToTakeSnapshot(SnapshotManager.java:490) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.snapshotEnabledTable(SnapshotManager.java:559) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshotInternal(SnapshotManager.java:687) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshot(SnapshotManager.java:623) at org.apache.hadoop.hbase.master.MasterRpcServices.snapshot(MasterRpcServices.java:1588) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) Caused by: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.hdfs.protocol.AclException): The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at org.apache.hadoop.ipc.Client.getRpcResponse(Client.java:1540) at org.apache.hadoop.ipc.Client.call(Client.java:1486) at org.apache.hadoop.ipc.Client.call(Client.java:1385) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:232) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:118) at com.sun.proxy.$Proxy32.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.getAclStatus(ClientNamenodeProtocolTranslatorPB.java:1385) at sun.reflect.GeneratedMethodAccessor61.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:422) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeMethod(RetryInvocationHandler.java:165) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invoke(RetryInvocationHandler.java:157) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeOnce(RetryInvocationHandler.java:95) at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:359) at com.sun.proxy.$Proxy35.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor61.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor61.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor61.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor61.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor61.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2734) ... 15 more 2023-10-04 02:01:42,498 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39651] procedure2.ProcedureExecutor(1028): Stored pid=110, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-10-04 02:01:42,499 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=110, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-10-04 02:01:42,500 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=110, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE; timeout=600000, timestamp=1696385502500 2023-10-04 02:01:42,500 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39651] snapshot.SnapshotManager(689): Started snapshot: { ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-10-04 02:01:42,500 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp 2023-10-04 02:01:42,501 DEBUG [Listener at jenkins-hbase9.apache.org/33899] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-10-04 02:01:42,501 DEBUG [Listener at jenkins-hbase9.apache.org/33899] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-10-04 02:01:42,502 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=110, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-10-04 02:01:42,502 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] procedure2.ProcedureExecutor(1028): Stored pid=111, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-10-04 02:01:42,502 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=110, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE in 5 msec 2023-10-04 02:01:42,503 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=111, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-10-04 02:01:42,504 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=111, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED; timeout=600000, timestamp=1696385502504 2023-10-04 02:01:42,518 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 02:01:42,518 INFO [(jenkins-hbase9.apache.org,39651,1696384803959)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' 2023-10-04 02:01:42,518 DEBUG [(jenkins-hbase9.apache.org,39651,1696384803959)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-04 02:01:42,519 DEBUG [(jenkins-hbase9.apache.org,39651,1696384803959)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' 2023-10-04 02:01:42,519 DEBUG [(jenkins-hbase9.apache.org,39651,1696384803959)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp', kicking off acquire phase on members. 2023-10-04 02:01:42,520 DEBUG [(jenkins-hbase9.apache.org,39651,1696384803959)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39651-0x1010f1b55330000, quorum=127.0.0.1:60027, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 02:01:42,520 DEBUG [(jenkins-hbase9.apache.org,39651,1696384803959)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 02:01:42,521 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): regionserver:39045-0x1010f1b55330002, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-04 02:01:42,521 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): regionserver:35175-0x1010f1b55330003, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-04 02:01:42,521 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-04 02:01:42,521 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-04 02:01:42,521 DEBUG [(jenkins-hbase9.apache.org,39651,1696384803959)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,35175,1696384805436 2023-10-04 02:01:42,521 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): regionserver:44303-0x1010f1b55330001, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-04 02:01:42,521 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-04 02:01:42,521 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-04 02:01:42,521 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-04 02:01:42,521 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-04 02:01:42,522 DEBUG [(jenkins-hbase9.apache.org,39651,1696384803959)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39651-0x1010f1b55330000, quorum=127.0.0.1:60027, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,35175,1696384805436 2023-10-04 02:01:42,522 DEBUG [(jenkins-hbase9.apache.org,39651,1696384803959)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,44303,1696384805319 2023-10-04 02:01:42,522 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 02:01:42,522 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 02:01:42,522 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 02:01:42,522 DEBUG [(jenkins-hbase9.apache.org,39651,1696384803959)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39651-0x1010f1b55330000, quorum=127.0.0.1:60027, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,44303,1696384805319 2023-10-04 02:01:42,522 DEBUG [(jenkins-hbase9.apache.org,39651,1696384803959)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-04 02:01:42,522 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44303-0x1010f1b55330001, quorum=127.0.0.1:60027, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 02:01:42,522 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35175-0x1010f1b55330003, quorum=127.0.0.1:60027, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 02:01:42,522 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39045-0x1010f1b55330002, quorum=127.0.0.1:60027, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 02:01:42,522 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 207 2023-10-04 02:01:42,522 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 02:01:42,523 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 207 2023-10-04 02:01:42,523 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 02:01:42,523 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 207 2023-10-04 02:01:42,523 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 02:01:42,523 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-10-04 02:01:42,523 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-10-04 02:01:42,523 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-10-04 02:01:42,523 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 02:01:42,523 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 02:01:42,523 DEBUG [member: 'jenkins-hbase9.apache.org,39045,1696384805392' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-10-04 02:01:42,523 DEBUG [member: 'jenkins-hbase9.apache.org,35175,1696384805436' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-10-04 02:01:42,523 DEBUG [member: 'jenkins-hbase9.apache.org,39045,1696384805392' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-04 02:01:42,523 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 02:01:42,524 DEBUG [member: 'jenkins-hbase9.apache.org,39045,1696384805392' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-10-04 02:01:42,524 DEBUG [member: 'jenkins-hbase9.apache.org,44303,1696384805319' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-10-04 02:01:42,524 DEBUG [member: 'jenkins-hbase9.apache.org,44303,1696384805319' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-04 02:01:42,523 DEBUG [member: 'jenkins-hbase9.apache.org,35175,1696384805436' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-04 02:01:42,525 DEBUG [member: 'jenkins-hbase9.apache.org,44303,1696384805319' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-10-04 02:01:42,525 DEBUG [member: 'jenkins-hbase9.apache.org,44303,1696384805319' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-10-04 02:01:42,524 DEBUG [member: 'jenkins-hbase9.apache.org,39045,1696384805392' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-10-04 02:01:42,526 DEBUG [member: 'jenkins-hbase9.apache.org,44303,1696384805319' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,44303,1696384805319' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-10-04 02:01:42,526 DEBUG [member: 'jenkins-hbase9.apache.org,35175,1696384805436' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-10-04 02:01:42,526 DEBUG [member: 'jenkins-hbase9.apache.org,35175,1696384805436' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-10-04 02:01:42,526 DEBUG [member: 'jenkins-hbase9.apache.org,39045,1696384805392' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,39045,1696384805392' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-10-04 02:01:42,526 DEBUG [member: 'jenkins-hbase9.apache.org,35175,1696384805436' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,35175,1696384805436' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-10-04 02:01:42,534 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): master:39651-0x1010f1b55330000, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,44303,1696384805319 2023-10-04 02:01:42,534 DEBUG [member: 'jenkins-hbase9.apache.org,39045,1696384805392' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 02:01:42,534 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,44303,1696384805319 2023-10-04 02:01:42,534 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-04 02:01:42,534 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-04 02:01:42,534 DEBUG [member: 'jenkins-hbase9.apache.org,44303,1696384805319' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 02:01:42,534 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): master:39651-0x1010f1b55330000, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,35175,1696384805436 2023-10-04 02:01:42,534 DEBUG [member: 'jenkins-hbase9.apache.org,35175,1696384805436' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 02:01:42,534 DEBUG [member: 'jenkins-hbase9.apache.org,44303,1696384805319' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44303-0x1010f1b55330001, quorum=127.0.0.1:60027, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 02:01:42,534 DEBUG [member: 'jenkins-hbase9.apache.org,44303,1696384805319' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-04 02:01:42,534 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-04 02:01:42,534 DEBUG [member: 'jenkins-hbase9.apache.org,39045,1696384805392' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39045-0x1010f1b55330002, quorum=127.0.0.1:60027, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 02:01:42,534 DEBUG [member: 'jenkins-hbase9.apache.org,39045,1696384805392' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-04 02:01:42,535 DEBUG [member: 'jenkins-hbase9.apache.org,35175,1696384805436' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35175-0x1010f1b55330003, quorum=127.0.0.1:60027, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 02:01:42,535 DEBUG [member: 'jenkins-hbase9.apache.org,35175,1696384805436' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-04 02:01:42,535 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-04 02:01:42,535 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 02:01:42,535 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,39045,1696384805392 2023-10-04 02:01:42,535 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,35175,1696384805436 2023-10-04 02:01:42,536 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44303,1696384805319 2023-10-04 02:01:42,536 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-04 02:01:42,536 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,44303,1696384805319' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-10-04 02:01:42,536 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@50e306e6[Count = 1] remaining members to acquire global barrier 2023-10-04 02:01:42,536 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,35175,1696384805436 2023-10-04 02:01:42,536 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-04 02:01:42,536 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-04 02:01:42,536 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-04 02:01:42,537 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-04 02:01:42,537 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 02:01:42,537 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,39045,1696384805392 2023-10-04 02:01:42,537 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,35175,1696384805436 2023-10-04 02:01:42,537 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44303,1696384805319 2023-10-04 02:01:42,538 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-04 02:01:42,538 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,35175,1696384805436' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-10-04 02:01:42,538 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@50e306e6[Count = 0] remaining members to acquire global barrier 2023-10-04 02:01:42,538 DEBUG [(jenkins-hbase9.apache.org,39651,1696384803959)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'in-barrier' execution. 2023-10-04 02:01:42,538 DEBUG [(jenkins-hbase9.apache.org,39651,1696384803959)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 02:01:42,539 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): regionserver:39045-0x1010f1b55330002, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 02:01:42,539 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): regionserver:35175-0x1010f1b55330003, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 02:01:42,539 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 02:01:42,539 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 02:01:42,539 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): regionserver:44303-0x1010f1b55330001, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 02:01:42,539 DEBUG [member: 'jenkins-hbase9.apache.org,39045,1696384805392' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-10-04 02:01:42,539 DEBUG [(jenkins-hbase9.apache.org,39651,1696384803959)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39651-0x1010f1b55330000, quorum=127.0.0.1:60027, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,44303,1696384805319 2023-10-04 02:01:42,539 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 02:01:42,539 DEBUG [member: 'jenkins-hbase9.apache.org,39045,1696384805392' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-10-04 02:01:42,539 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 02:01:42,539 DEBUG [member: 'jenkins-hbase9.apache.org,39045,1696384805392' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase9.apache.org,39045,1696384805392' in zk 2023-10-04 02:01:42,539 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 02:01:42,539 DEBUG [(jenkins-hbase9.apache.org,39651,1696384803959)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39651-0x1010f1b55330000, quorum=127.0.0.1:60027, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,35175,1696384805436 2023-10-04 02:01:42,540 DEBUG [member: 'jenkins-hbase9.apache.org,35175,1696384805436' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-10-04 02:01:42,539 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 02:01:42,540 DEBUG [(jenkins-hbase9.apache.org,39651,1696384803959)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-04 02:01:42,540 DEBUG [member: 'jenkins-hbase9.apache.org,44303,1696384805319' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-10-04 02:01:42,540 DEBUG [member: 'jenkins-hbase9.apache.org,35175,1696384805436' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-04 02:01:42,540 DEBUG [member: 'jenkins-hbase9.apache.org,35175,1696384805436' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-04 02:01:42,540 DEBUG [rs(jenkins-hbase9.apache.org,35175,1696384805436)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1696384901847.91d2010452fbe492aaa759851ab6b3c7. 2023-10-04 02:01:42,540 DEBUG [rs(jenkins-hbase9.apache.org,35175,1696384805436)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1696384901847.91d2010452fbe492aaa759851ab6b3c7. started... 2023-10-04 02:01:42,541 DEBUG [member: 'jenkins-hbase9.apache.org,39045,1696384805392' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-10-04 02:01:42,541 DEBUG [member: 'jenkins-hbase9.apache.org,39045,1696384805392' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-04 02:01:42,542 DEBUG [member: 'jenkins-hbase9.apache.org,39045,1696384805392' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-10-04 02:01:42,545 DEBUG [member: 'jenkins-hbase9.apache.org,44303,1696384805319' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-04 02:01:42,545 DEBUG [rs(jenkins-hbase9.apache.org,44303,1696384805319)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1696384901847.ca38ebb41287c3efeac984dfbc22db48. 2023-10-04 02:01:42,545 DEBUG [member: 'jenkins-hbase9.apache.org,44303,1696384805319' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-04 02:01:42,545 DEBUG [rs(jenkins-hbase9.apache.org,44303,1696384805319)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1696384901847.ca38ebb41287c3efeac984dfbc22db48. started... 2023-10-04 02:01:42,545 DEBUG [rs(jenkins-hbase9.apache.org,35175,1696384805436)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 91d2010452fbe492aaa759851ab6b3c7: 2023-10-04 02:01:42,545 DEBUG [rs(jenkins-hbase9.apache.org,35175,1696384805436)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,1,1696384901847.91d2010452fbe492aaa759851ab6b3c7.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 02:01:42,545 DEBUG [rs(jenkins-hbase9.apache.org,44303,1696384805319)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for ca38ebb41287c3efeac984dfbc22db48: 2023-10-04 02:01:42,545 DEBUG [rs(jenkins-hbase9.apache.org,35175,1696384805436)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-04 02:01:42,546 DEBUG [rs(jenkins-hbase9.apache.org,35175,1696384805436)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-10-04 02:01:42,546 DEBUG [rs(jenkins-hbase9.apache.org,44303,1696384805319)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,,1696384901847.ca38ebb41287c3efeac984dfbc22db48.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 02:01:42,546 DEBUG [rs(jenkins-hbase9.apache.org,44303,1696384805319)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-04 02:01:42,546 DEBUG [rs(jenkins-hbase9.apache.org,44303,1696384805319)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-10-04 02:01:42,553 DEBUG [rs(jenkins-hbase9.apache.org,44303,1696384805319)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1696384901847.ca38ebb41287c3efeac984dfbc22db48. completed. 2023-10-04 02:01:42,553 DEBUG [rs(jenkins-hbase9.apache.org,44303,1696384805319)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1696384901847.ca38ebb41287c3efeac984dfbc22db48. 2023-10-04 02:01:42,553 DEBUG [member: 'jenkins-hbase9.apache.org,44303,1696384805319' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-04 02:01:42,553 DEBUG [rs(jenkins-hbase9.apache.org,35175,1696384805436)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1696384901847.91d2010452fbe492aaa759851ab6b3c7. completed. 2023-10-04 02:01:42,553 DEBUG [rs(jenkins-hbase9.apache.org,35175,1696384805436)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1696384901847.91d2010452fbe492aaa759851ab6b3c7. 2023-10-04 02:01:42,553 DEBUG [member: 'jenkins-hbase9.apache.org,44303,1696384805319' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-04 02:01:42,553 DEBUG [member: 'jenkins-hbase9.apache.org,35175,1696384805436' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-04 02:01:42,553 DEBUG [member: 'jenkins-hbase9.apache.org,35175,1696384805436' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-04 02:01:42,554 DEBUG [member: 'jenkins-hbase9.apache.org,35175,1696384805436' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase9.apache.org,35175,1696384805436 2023-10-04 02:01:42,553 DEBUG [member: 'jenkins-hbase9.apache.org,44303,1696384805319' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase9.apache.org,44303,1696384805319 2023-10-04 02:01:42,554 DEBUG [member: 'jenkins-hbase9.apache.org,35175,1696384805436' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-10-04 02:01:42,554 DEBUG [member: 'jenkins-hbase9.apache.org,44303,1696384805319' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-10-04 02:01:42,554 DEBUG [member: 'jenkins-hbase9.apache.org,44303,1696384805319' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase9.apache.org,44303,1696384805319' in zk 2023-10-04 02:01:42,554 DEBUG [member: 'jenkins-hbase9.apache.org,35175,1696384805436' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase9.apache.org,35175,1696384805436' in zk 2023-10-04 02:01:42,555 DEBUG [member: 'jenkins-hbase9.apache.org,44303,1696384805319' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-10-04 02:01:42,555 DEBUG [member: 'jenkins-hbase9.apache.org,44303,1696384805319' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-04 02:01:42,555 DEBUG [member: 'jenkins-hbase9.apache.org,35175,1696384805436' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-10-04 02:01:42,555 DEBUG [member: 'jenkins-hbase9.apache.org,44303,1696384805319' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-10-04 02:01:42,555 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): master:39651-0x1010f1b55330000, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,44303,1696384805319 2023-10-04 02:01:42,557 DEBUG [member: 'jenkins-hbase9.apache.org,35175,1696384805436' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-04 02:01:42,557 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,44303,1696384805319 2023-10-04 02:01:42,557 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-04 02:01:42,558 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-04 02:01:42,557 DEBUG [member: 'jenkins-hbase9.apache.org,35175,1696384805436' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-10-04 02:01:42,557 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): master:39651-0x1010f1b55330000, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,35175,1696384805436 2023-10-04 02:01:42,559 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-04 02:01:42,559 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-04 02:01:42,559 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 02:01:42,559 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,39045,1696384805392 2023-10-04 02:01:42,560 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,35175,1696384805436 2023-10-04 02:01:42,560 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44303,1696384805319 2023-10-04 02:01:42,560 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-04 02:01:42,561 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 02:01:42,561 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,39045,1696384805392 2023-10-04 02:01:42,561 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,35175,1696384805436 2023-10-04 02:01:42,561 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44303,1696384805319 2023-10-04 02:01:42,562 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase9.apache.org,44303,1696384805319': 2023-10-04 02:01:42,562 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,44303,1696384805319' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 1 more 2023-10-04 02:01:42,562 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,35175,1696384805436 2023-10-04 02:01:42,562 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-04 02:01:42,562 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-04 02:01:42,562 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-04 02:01:42,562 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-04 02:01:42,563 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 02:01:42,563 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,39045,1696384805392 2023-10-04 02:01:42,563 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,35175,1696384805436 2023-10-04 02:01:42,563 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44303,1696384805319 2023-10-04 02:01:42,563 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-04 02:01:42,564 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 02:01:42,564 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,39045,1696384805392 2023-10-04 02:01:42,564 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,35175,1696384805436 2023-10-04 02:01:42,564 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44303,1696384805319 2023-10-04 02:01:42,565 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase9.apache.org,35175,1696384805436': 2023-10-04 02:01:42,565 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,35175,1696384805436' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 0 more 2023-10-04 02:01:42,565 INFO [(jenkins-hbase9.apache.org,39651,1696384803959)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' execution completed 2023-10-04 02:01:42,565 DEBUG [(jenkins-hbase9.apache.org,39651,1696384803959)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-04 02:01:42,565 DEBUG [(jenkins-hbase9.apache.org,39651,1696384803959)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-04 02:01:42,565 DEBUG [(jenkins-hbase9.apache.org,39651,1696384803959)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 02:01:42,565 INFO [(jenkins-hbase9.apache.org,39651,1696384803959)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportFileSystemStateWithSkipTmpincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-10-04 02:01:42,567 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): regionserver:44303-0x1010f1b55330001, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 02:01:42,567 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): regionserver:35175-0x1010f1b55330003, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 02:01:42,567 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): regionserver:39045-0x1010f1b55330002, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 02:01:42,567 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): regionserver:35175-0x1010f1b55330003, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-04 02:01:42,567 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 02:01:42,567 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 02:01:42,567 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 02:01:42,567 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): master:39651-0x1010f1b55330000, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 02:01:42,567 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): regionserver:44303-0x1010f1b55330001, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-04 02:01:42,567 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 02:01:42,567 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-04 02:01:42,567 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-04 02:01:42,567 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 02:01:42,567 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 02:01:42,567 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 02:01:42,567 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): regionserver:39045-0x1010f1b55330002, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-04 02:01:42,567 DEBUG [(jenkins-hbase9.apache.org,39651,1696384803959)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39651-0x1010f1b55330000, quorum=127.0.0.1:60027, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,39045,1696384805392 2023-10-04 02:01:42,568 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-04 02:01:42,568 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-04 02:01:42,568 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-04 02:01:42,568 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 02:01:42,568 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-04 02:01:42,568 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-04 02:01:42,568 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 02:01:42,568 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-04 02:01:42,568 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-04 02:01:42,568 DEBUG [(jenkins-hbase9.apache.org,39651,1696384803959)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39651-0x1010f1b55330000, quorum=127.0.0.1:60027, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,35175,1696384805436 2023-10-04 02:01:42,568 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 02:01:42,569 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-04 02:01:42,569 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 02:01:42,569 DEBUG [(jenkins-hbase9.apache.org,39651,1696384803959)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39651-0x1010f1b55330000, quorum=127.0.0.1:60027, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,44303,1696384805319 2023-10-04 02:01:42,569 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 02:01:42,569 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,39045,1696384805392 2023-10-04 02:01:42,569 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,35175,1696384805436 2023-10-04 02:01:42,570 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44303,1696384805319 2023-10-04 02:01:42,570 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-04 02:01:42,570 DEBUG [(jenkins-hbase9.apache.org,39651,1696384803959)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39651-0x1010f1b55330000, quorum=127.0.0.1:60027, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,39045,1696384805392 2023-10-04 02:01:42,570 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 02:01:42,570 DEBUG [(jenkins-hbase9.apache.org,39651,1696384803959)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39651-0x1010f1b55330000, quorum=127.0.0.1:60027, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,35175,1696384805436 2023-10-04 02:01:42,571 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,39045,1696384805392 2023-10-04 02:01:42,571 DEBUG [(jenkins-hbase9.apache.org,39651,1696384803959)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39651-0x1010f1b55330000, quorum=127.0.0.1:60027, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,44303,1696384805319 2023-10-04 02:01:42,571 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,35175,1696384805436 2023-10-04 02:01:42,571 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44303,1696384805319 2023-10-04 02:01:42,573 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): master:39651-0x1010f1b55330000, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,44303,1696384805319 2023-10-04 02:01:42,573 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): master:39651-0x1010f1b55330000, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 02:01:42,573 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): regionserver:39045-0x1010f1b55330002, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-04 02:01:42,573 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): regionserver:44303-0x1010f1b55330001, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-04 02:01:42,574 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): regionserver:35175-0x1010f1b55330003, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-04 02:01:42,574 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-04 02:01:42,574 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-04 02:01:42,574 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): regionserver:39045-0x1010f1b55330002, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-04 02:01:42,573 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 02:01:42,573 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): master:39651-0x1010f1b55330000, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,35175,1696384805436 2023-10-04 02:01:42,573 DEBUG [(jenkins-hbase9.apache.org,39651,1696384803959)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-04 02:01:42,574 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): master:39651-0x1010f1b55330000, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,39045,1696384805392 2023-10-04 02:01:42,574 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemStateWithSkipTmp 2023-10-04 02:01:42,574 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-04 02:01:42,574 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => e9516f04c7d2974b21addb190acc6c0a, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,.mob,0.e9516f04c7d2974b21addb190acc6c0a.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 02:01:42,574 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-04 02:01:42,574 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): regionserver:35175-0x1010f1b55330003, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-04 02:01:42,574 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): regionserver:44303-0x1010f1b55330001, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-04 02:01:42,574 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-04 02:01:42,574 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-10-04 02:01:42,574 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): master:39651-0x1010f1b55330000, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 02:01:42,576 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-04 02:01:42,576 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-04 02:01:42,576 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-04 02:01:42,576 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-04 02:01:42,576 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-04 02:01:42,576 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): master:39651-0x1010f1b55330000, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,44303,1696384805319 2023-10-04 02:01:42,576 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): master:39651-0x1010f1b55330000, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 02:01:42,576 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): master:39651-0x1010f1b55330000, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,35175,1696384805436 2023-10-04 02:01:42,576 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): master:39651-0x1010f1b55330000, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,39045,1696384805392 2023-10-04 02:01:42,576 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-04 02:01:42,576 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-04 02:01:42,576 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): master:39651-0x1010f1b55330000, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 02:01:42,576 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): master:39651-0x1010f1b55330000, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 02:01:42,577 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-10-04 02:01:42,589 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 02:01:42,590 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 02:01:42,601 DEBUG [Listener at jenkins-hbase9.apache.org/33899] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-04 02:01:42,602 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39651] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-10-04 02:01:42,602 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39651] snapshot.SnapshotManager(406): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-10-04 02:01:42,602 DEBUG [Listener at jenkins-hbase9.apache.org/33899] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-10-04 02:01:42,616 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp to hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/.hbase-snapshot/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 02:01:42,617 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed 2023-10-04 02:01:42,617 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 02:01:42,617 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 02:01:42,617 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp at 1696384902500Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemStateWithSkipTmp at 1696384902589 (+89 ms)Consolidate snapshot: emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1696384902589Loading Region manifests for emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1696384902590 (+1 ms)Writing data manifest for emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1696384902594 (+4 ms)Verifying snapshot: emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1696384902611 (+17 ms)Snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed at 1696384902617 (+6 ms) 2023-10-04 02:01:42,620 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=111, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-10-04 02:01:42,621 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=111, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED in 119 msec 2023-10-04 02:01:42,802 DEBUG [Listener at jenkins-hbase9.apache.org/33899] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-04 02:01:42,803 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39651] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-10-04 02:01:42,803 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39651] snapshot.SnapshotManager(403): Snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' has completed, notifying client. 2023-10-04 02:01:42,805 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44303] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithSkipTmp,,1696384901847.ca38ebb41287c3efeac984dfbc22db48. with WAL disabled. Data may be lost in the event of a crash. 2023-10-04 02:01:42,806 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35175] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithSkipTmp,1,1696384901847.91d2010452fbe492aaa759851ab6b3c7. with WAL disabled. Data may be lost in the event of a crash. 2023-10-04 02:01:42,808 DEBUG [Listener at jenkins-hbase9.apache.org/33899] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithSkipTmp 2023-10-04 02:01:42,809 DEBUG [Listener at jenkins-hbase9.apache.org/33899] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithSkipTmp,,1696384901847.ca38ebb41287c3efeac984dfbc22db48. 2023-10-04 02:01:42,809 INFO [Listener at jenkins-hbase9.apache.org/33899] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-10-04 02:01:42,817 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39651] master.MasterRpcServices(1583): Client=jenkins//172.31.2.10 snapshot request for:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-10-04 02:01:42,817 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39651] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1696384902817 (current time:1696384902817). 2023-10-04 02:01:42,817 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39651] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-10-04 02:01:42,818 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39651] zookeeper.ReadOnlyZKClient(139): Connect 0x17493eca to 127.0.0.1:60027 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-04 02:01:42,825 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39651] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5f8f746, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-04 02:01:42,826 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39651] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-04 02:01:42,829 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:48234, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-04 02:01:42,830 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39651] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x17493eca to 127.0.0.1:60027 2023-10-04 02:01:42,830 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39651] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-04 02:01:42,831 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39651] zookeeper.ReadOnlyZKClient(139): Connect 0x445b0ff7 to 127.0.0.1:60027 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-04 02:01:42,835 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39651] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1abac6d8, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-04 02:01:42,837 DEBUG [hconnection-0x583a500e-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-04 02:01:42,838 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:48242, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-04 02:01:42,842 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39651] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x445b0ff7 to 127.0.0.1:60027 2023-10-04 02:01:42,842 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39651] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-04 02:01:42,842 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39651] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithSkipTmp], kv [jenkins: RWXCA] 2023-10-04 02:01:42,843 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39651] snapshot.SnapshotManager(637): No existing snapshot, attempting snapshot... 2023-10-04 02:01:42,843 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39651] snapshot.SnapshotManager(684): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-10-04 02:01:42,846 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39651] snapshot.SnapshotManager(519): Unable to retrieve ACL status for path: hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/.hbase-snapshot, current working dir path: hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp org.apache.hadoop.hdfs.protocol.AclException: The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.ipc.RemoteException.instantiateException(RemoteException.java:121) at org.apache.hadoop.ipc.RemoteException.unwrapRemoteException(RemoteException.java:88) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2736) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2294) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2291) at org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81) at org.apache.hadoop.hdfs.DistributedFileSystem.getAclStatus(DistributedFileSystem.java:2291) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.updateWorkingDirAclsIfRequired(SnapshotManager.java:517) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.prepareToTakeSnapshot(SnapshotManager.java:490) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.snapshotEnabledTable(SnapshotManager.java:559) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshotInternal(SnapshotManager.java:687) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshot(SnapshotManager.java:623) at org.apache.hadoop.hbase.master.MasterRpcServices.snapshot(MasterRpcServices.java:1588) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) Caused by: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.hdfs.protocol.AclException): The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at org.apache.hadoop.ipc.Client.getRpcResponse(Client.java:1540) at org.apache.hadoop.ipc.Client.call(Client.java:1486) at org.apache.hadoop.ipc.Client.call(Client.java:1385) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:232) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:118) at com.sun.proxy.$Proxy32.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.getAclStatus(ClientNamenodeProtocolTranslatorPB.java:1385) at sun.reflect.GeneratedMethodAccessor61.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:422) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeMethod(RetryInvocationHandler.java:165) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invoke(RetryInvocationHandler.java:157) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeOnce(RetryInvocationHandler.java:95) at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:359) at com.sun.proxy.$Proxy35.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor61.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor61.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor61.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor61.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor61.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2734) ... 15 more 2023-10-04 02:01:42,847 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39651] procedure2.ProcedureExecutor(1028): Stored pid=112, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-10-04 02:01:42,848 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=112, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-10-04 02:01:42,849 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=112, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE; timeout=600000, timestamp=1696385502849 2023-10-04 02:01:42,849 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp 2023-10-04 02:01:42,849 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39651] snapshot.SnapshotManager(689): Started snapshot: { ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-10-04 02:01:42,850 DEBUG [Listener at jenkins-hbase9.apache.org/33899] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-10-04 02:01:42,850 DEBUG [Listener at jenkins-hbase9.apache.org/33899] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-10-04 02:01:42,850 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] procedure2.ProcedureExecutor(1028): Stored pid=113, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-10-04 02:01:42,851 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=112, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-10-04 02:01:42,852 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=112, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE in 5 msec 2023-10-04 02:01:42,853 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=113, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-10-04 02:01:42,853 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=113, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED; timeout=600000, timestamp=1696385502853 2023-10-04 02:01:42,864 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 02:01:42,865 INFO [(jenkins-hbase9.apache.org,39651,1696384803959)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' 2023-10-04 02:01:42,865 DEBUG [(jenkins-hbase9.apache.org,39651,1696384803959)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-04 02:01:42,866 DEBUG [(jenkins-hbase9.apache.org,39651,1696384803959)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' 2023-10-04 02:01:42,866 DEBUG [(jenkins-hbase9.apache.org,39651,1696384803959)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemStateWithSkipTmp', kicking off acquire phase on members. 2023-10-04 02:01:42,866 DEBUG [(jenkins-hbase9.apache.org,39651,1696384803959)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39651-0x1010f1b55330000, quorum=127.0.0.1:60027, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 02:01:42,866 DEBUG [(jenkins-hbase9.apache.org,39651,1696384803959)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 02:01:42,869 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): regionserver:35175-0x1010f1b55330003, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-04 02:01:42,869 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): regionserver:44303-0x1010f1b55330001, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-04 02:01:42,869 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-04 02:01:42,869 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): regionserver:39045-0x1010f1b55330002, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-04 02:01:42,869 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-04 02:01:42,869 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-04 02:01:42,869 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-04 02:01:42,869 DEBUG [(jenkins-hbase9.apache.org,39651,1696384803959)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,35175,1696384805436 2023-10-04 02:01:42,869 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-04 02:01:42,869 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-04 02:01:42,869 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 02:01:42,869 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 02:01:42,869 DEBUG [(jenkins-hbase9.apache.org,39651,1696384803959)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39651-0x1010f1b55330000, quorum=127.0.0.1:60027, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,35175,1696384805436 2023-10-04 02:01:42,869 DEBUG [(jenkins-hbase9.apache.org,39651,1696384803959)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,44303,1696384805319 2023-10-04 02:01:42,869 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 02:01:42,869 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35175-0x1010f1b55330003, quorum=127.0.0.1:60027, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 02:01:42,869 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44303-0x1010f1b55330001, quorum=127.0.0.1:60027, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 02:01:42,870 DEBUG [(jenkins-hbase9.apache.org,39651,1696384803959)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39651-0x1010f1b55330000, quorum=127.0.0.1:60027, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,44303,1696384805319 2023-10-04 02:01:42,870 DEBUG [(jenkins-hbase9.apache.org,39651,1696384803959)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-04 02:01:42,870 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39045-0x1010f1b55330002, quorum=127.0.0.1:60027, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 02:01:42,870 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 202 2023-10-04 02:01:42,870 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 02:01:42,870 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-10-04 02:01:42,870 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 202 2023-10-04 02:01:42,870 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 02:01:42,870 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 202 2023-10-04 02:01:42,870 DEBUG [member: 'jenkins-hbase9.apache.org,35175,1696384805436' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-10-04 02:01:42,871 DEBUG [member: 'jenkins-hbase9.apache.org,35175,1696384805436' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-04 02:01:42,870 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 02:01:42,872 DEBUG [member: 'jenkins-hbase9.apache.org,35175,1696384805436' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-10-04 02:01:42,872 DEBUG [member: 'jenkins-hbase9.apache.org,35175,1696384805436' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-10-04 02:01:42,870 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 02:01:42,872 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-10-04 02:01:42,872 DEBUG [member: 'jenkins-hbase9.apache.org,35175,1696384805436' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,35175,1696384805436' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-10-04 02:01:42,872 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-10-04 02:01:42,872 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 02:01:42,872 DEBUG [member: 'jenkins-hbase9.apache.org,39045,1696384805392' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-10-04 02:01:42,872 DEBUG [member: 'jenkins-hbase9.apache.org,39045,1696384805392' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-04 02:01:42,872 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 02:01:42,873 DEBUG [member: 'jenkins-hbase9.apache.org,39045,1696384805392' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-10-04 02:01:42,874 DEBUG [member: 'jenkins-hbase9.apache.org,39045,1696384805392' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-10-04 02:01:42,874 DEBUG [member: 'jenkins-hbase9.apache.org,39045,1696384805392' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,39045,1696384805392' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-10-04 02:01:42,874 DEBUG [member: 'jenkins-hbase9.apache.org,44303,1696384805319' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-10-04 02:01:42,874 DEBUG [member: 'jenkins-hbase9.apache.org,44303,1696384805319' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-04 02:01:42,875 DEBUG [member: 'jenkins-hbase9.apache.org,44303,1696384805319' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-10-04 02:01:42,875 DEBUG [member: 'jenkins-hbase9.apache.org,44303,1696384805319' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-10-04 02:01:42,875 DEBUG [member: 'jenkins-hbase9.apache.org,44303,1696384805319' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,44303,1696384805319' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-10-04 02:01:42,875 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): master:39651-0x1010f1b55330000, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,35175,1696384805436 2023-10-04 02:01:42,875 DEBUG [member: 'jenkins-hbase9.apache.org,35175,1696384805436' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 02:01:42,875 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,35175,1696384805436 2023-10-04 02:01:42,875 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-04 02:01:42,875 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-04 02:01:42,876 DEBUG [member: 'jenkins-hbase9.apache.org,39045,1696384805392' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 02:01:42,876 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): master:39651-0x1010f1b55330000, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,44303,1696384805319 2023-10-04 02:01:42,876 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-04 02:01:42,876 DEBUG [member: 'jenkins-hbase9.apache.org,44303,1696384805319' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 02:01:42,876 DEBUG [member: 'jenkins-hbase9.apache.org,35175,1696384805436' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35175-0x1010f1b55330003, quorum=127.0.0.1:60027, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 02:01:42,876 DEBUG [member: 'jenkins-hbase9.apache.org,35175,1696384805436' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-04 02:01:42,876 DEBUG [member: 'jenkins-hbase9.apache.org,39045,1696384805392' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39045-0x1010f1b55330002, quorum=127.0.0.1:60027, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 02:01:42,876 DEBUG [member: 'jenkins-hbase9.apache.org,39045,1696384805392' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-04 02:01:42,876 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-04 02:01:42,876 DEBUG [member: 'jenkins-hbase9.apache.org,44303,1696384805319' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44303-0x1010f1b55330001, quorum=127.0.0.1:60027, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 02:01:42,876 DEBUG [member: 'jenkins-hbase9.apache.org,44303,1696384805319' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-04 02:01:42,877 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 02:01:42,877 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,39045,1696384805392 2023-10-04 02:01:42,877 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,35175,1696384805436 2023-10-04 02:01:42,877 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44303,1696384805319 2023-10-04 02:01:42,877 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-04 02:01:42,878 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,35175,1696384805436' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-10-04 02:01:42,878 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@796f2e58[Count = 1] remaining members to acquire global barrier 2023-10-04 02:01:42,878 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,44303,1696384805319 2023-10-04 02:01:42,878 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-04 02:01:42,878 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-04 02:01:42,878 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-04 02:01:42,878 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-04 02:01:42,878 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 02:01:42,879 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,39045,1696384805392 2023-10-04 02:01:42,879 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,35175,1696384805436 2023-10-04 02:01:42,879 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44303,1696384805319 2023-10-04 02:01:42,879 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-04 02:01:42,880 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,44303,1696384805319' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-10-04 02:01:42,880 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@796f2e58[Count = 0] remaining members to acquire global barrier 2023-10-04 02:01:42,880 DEBUG [(jenkins-hbase9.apache.org,39651,1696384803959)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'in-barrier' execution. 2023-10-04 02:01:42,880 DEBUG [(jenkins-hbase9.apache.org,39651,1696384803959)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 02:01:42,884 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): regionserver:39045-0x1010f1b55330002, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 02:01:42,884 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): regionserver:35175-0x1010f1b55330003, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 02:01:42,884 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): regionserver:44303-0x1010f1b55330001, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 02:01:42,884 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 02:01:42,884 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 02:01:42,884 DEBUG [(jenkins-hbase9.apache.org,39651,1696384803959)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39651-0x1010f1b55330000, quorum=127.0.0.1:60027, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,35175,1696384805436 2023-10-04 02:01:42,884 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 02:01:42,884 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 02:01:42,884 DEBUG [member: 'jenkins-hbase9.apache.org,44303,1696384805319' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-10-04 02:01:42,884 DEBUG [member: 'jenkins-hbase9.apache.org,35175,1696384805436' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-10-04 02:01:42,884 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 02:01:42,884 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 02:01:42,884 DEBUG [member: 'jenkins-hbase9.apache.org,39045,1696384805392' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-10-04 02:01:42,885 DEBUG [(jenkins-hbase9.apache.org,39651,1696384803959)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39651-0x1010f1b55330000, quorum=127.0.0.1:60027, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,44303,1696384805319 2023-10-04 02:01:42,885 DEBUG [(jenkins-hbase9.apache.org,39651,1696384803959)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-04 02:01:42,885 DEBUG [rs(jenkins-hbase9.apache.org,44303,1696384805319)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1696384901847.ca38ebb41287c3efeac984dfbc22db48. 2023-10-04 02:01:42,884 DEBUG [member: 'jenkins-hbase9.apache.org,44303,1696384805319' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-04 02:01:42,885 DEBUG [rs(jenkins-hbase9.apache.org,44303,1696384805319)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1696384901847.ca38ebb41287c3efeac984dfbc22db48. started... 2023-10-04 02:01:42,885 DEBUG [member: 'jenkins-hbase9.apache.org,44303,1696384805319' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-04 02:01:42,885 DEBUG [rs(jenkins-hbase9.apache.org,35175,1696384805436)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1696384901847.91d2010452fbe492aaa759851ab6b3c7. 2023-10-04 02:01:42,885 DEBUG [member: 'jenkins-hbase9.apache.org,35175,1696384805436' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-04 02:01:42,885 INFO [rs(jenkins-hbase9.apache.org,44303,1696384805319)-snapshot-pool-0] regionserver.HRegion(2745): Flushing ca38ebb41287c3efeac984dfbc22db48 1/1 column families, dataSize=199 B heapSize=688 B 2023-10-04 02:01:42,885 DEBUG [member: 'jenkins-hbase9.apache.org,39045,1696384805392' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-10-04 02:01:42,885 DEBUG [member: 'jenkins-hbase9.apache.org,35175,1696384805436' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-04 02:01:42,885 DEBUG [rs(jenkins-hbase9.apache.org,35175,1696384805436)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1696384901847.91d2010452fbe492aaa759851ab6b3c7. started... 2023-10-04 02:01:42,885 DEBUG [member: 'jenkins-hbase9.apache.org,39045,1696384805392' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase9.apache.org,39045,1696384805392' in zk 2023-10-04 02:01:42,885 INFO [rs(jenkins-hbase9.apache.org,35175,1696384805436)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 91d2010452fbe492aaa759851ab6b3c7 1/1 column families, dataSize=3.06 KB heapSize=6.86 KB 2023-10-04 02:01:42,887 DEBUG [member: 'jenkins-hbase9.apache.org,39045,1696384805392' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-10-04 02:01:42,887 DEBUG [member: 'jenkins-hbase9.apache.org,39045,1696384805392' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-04 02:01:42,887 DEBUG [member: 'jenkins-hbase9.apache.org,39045,1696384805392' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-10-04 02:01:42,901 INFO [rs(jenkins-hbase9.apache.org,35175,1696384805436)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023100496e0e18bdebe4989b8e7609bd8cbe030 to hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b2023100496e0e18bdebe4989b8e7609bd8cbe030 2023-10-04 02:01:42,901 INFO [rs(jenkins-hbase9.apache.org,44303,1696384805319)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231004b4e81a62381247dfad47988c6ddda641 to hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e20231004b4e81a62381247dfad47988c6ddda641 2023-10-04 02:01:42,908 INFO [rs(jenkins-hbase9.apache.org,44303,1696384805319)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=199, hasBloomFilter=true, into tmp file hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/data/default/testtb-testExportFileSystemStateWithSkipTmp/ca38ebb41287c3efeac984dfbc22db48/.tmp/cf/c0a1df4b05154eb280871cfff3aad3e3 2023-10-04 02:01:42,909 INFO [rs(jenkins-hbase9.apache.org,35175,1696384805436)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=3.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/data/default/testtb-testExportFileSystemStateWithSkipTmp/91d2010452fbe492aaa759851ab6b3c7/.tmp/cf/785b741806154436820478b2ed8d2aff 2023-10-04 02:01:42,913 DEBUG [rs(jenkins-hbase9.apache.org,44303,1696384805319)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/data/default/testtb-testExportFileSystemStateWithSkipTmp/ca38ebb41287c3efeac984dfbc22db48/.tmp/cf/c0a1df4b05154eb280871cfff3aad3e3 as hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/data/default/testtb-testExportFileSystemStateWithSkipTmp/ca38ebb41287c3efeac984dfbc22db48/cf/c0a1df4b05154eb280871cfff3aad3e3 2023-10-04 02:01:42,913 DEBUG [rs(jenkins-hbase9.apache.org,35175,1696384805436)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/data/default/testtb-testExportFileSystemStateWithSkipTmp/91d2010452fbe492aaa759851ab6b3c7/.tmp/cf/785b741806154436820478b2ed8d2aff as hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/data/default/testtb-testExportFileSystemStateWithSkipTmp/91d2010452fbe492aaa759851ab6b3c7/cf/785b741806154436820478b2ed8d2aff 2023-10-04 02:01:42,917 INFO [rs(jenkins-hbase9.apache.org,44303,1696384805319)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/data/default/testtb-testExportFileSystemStateWithSkipTmp/ca38ebb41287c3efeac984dfbc22db48/cf/c0a1df4b05154eb280871cfff3aad3e3, entries=3, sequenceid=6, filesize=5.4 K 2023-10-04 02:01:42,917 INFO [rs(jenkins-hbase9.apache.org,35175,1696384805436)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/data/default/testtb-testExportFileSystemStateWithSkipTmp/91d2010452fbe492aaa759851ab6b3c7/cf/785b741806154436820478b2ed8d2aff, entries=47, sequenceid=6, filesize=13.4 K 2023-10-04 02:01:42,918 INFO [rs(jenkins-hbase9.apache.org,44303,1696384805319)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~199 B/199, heapSize ~672 B/672, currentSize=0 B/0 for ca38ebb41287c3efeac984dfbc22db48 in 33ms, sequenceid=6, compaction requested=false 2023-10-04 02:01:42,918 INFO [rs(jenkins-hbase9.apache.org,35175,1696384805436)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.06 KB/3137, heapSize ~6.84 KB/7008, currentSize=0 B/0 for 91d2010452fbe492aaa759851ab6b3c7 in 33ms, sequenceid=6, compaction requested=false 2023-10-04 02:01:42,918 DEBUG [rs(jenkins-hbase9.apache.org,44303,1696384805319)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithSkipTmp' 2023-10-04 02:01:42,918 DEBUG [rs(jenkins-hbase9.apache.org,35175,1696384805436)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithSkipTmp' 2023-10-04 02:01:42,921 DEBUG [rs(jenkins-hbase9.apache.org,44303,1696384805319)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for ca38ebb41287c3efeac984dfbc22db48: 2023-10-04 02:01:42,921 DEBUG [rs(jenkins-hbase9.apache.org,35175,1696384805436)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 91d2010452fbe492aaa759851ab6b3c7: 2023-10-04 02:01:42,921 DEBUG [rs(jenkins-hbase9.apache.org,44303,1696384805319)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,,1696384901847.ca38ebb41287c3efeac984dfbc22db48.' region-info for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 02:01:42,921 DEBUG [rs(jenkins-hbase9.apache.org,35175,1696384805436)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,1,1696384901847.91d2010452fbe492aaa759851ab6b3c7.' region-info for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 02:01:42,921 DEBUG [rs(jenkins-hbase9.apache.org,44303,1696384805319)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-04 02:01:42,921 DEBUG [rs(jenkins-hbase9.apache.org,35175,1696384805436)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-04 02:01:42,921 DEBUG [rs(jenkins-hbase9.apache.org,44303,1696384805319)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/data/default/testtb-testExportFileSystemStateWithSkipTmp/ca38ebb41287c3efeac984dfbc22db48/cf/c0a1df4b05154eb280871cfff3aad3e3] hfiles 2023-10-04 02:01:42,921 DEBUG [rs(jenkins-hbase9.apache.org,35175,1696384805436)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/data/default/testtb-testExportFileSystemStateWithSkipTmp/91d2010452fbe492aaa759851ab6b3c7/cf/785b741806154436820478b2ed8d2aff] hfiles 2023-10-04 02:01:42,921 DEBUG [rs(jenkins-hbase9.apache.org,35175,1696384805436)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/data/default/testtb-testExportFileSystemStateWithSkipTmp/91d2010452fbe492aaa759851ab6b3c7/cf/785b741806154436820478b2ed8d2aff for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 02:01:42,921 DEBUG [rs(jenkins-hbase9.apache.org,44303,1696384805319)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/data/default/testtb-testExportFileSystemStateWithSkipTmp/ca38ebb41287c3efeac984dfbc22db48/cf/c0a1df4b05154eb280871cfff3aad3e3 for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 02:01:42,931 DEBUG [rs(jenkins-hbase9.apache.org,44303,1696384805319)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1696384901847.ca38ebb41287c3efeac984dfbc22db48. completed. 2023-10-04 02:01:42,931 DEBUG [rs(jenkins-hbase9.apache.org,44303,1696384805319)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1696384901847.ca38ebb41287c3efeac984dfbc22db48. 2023-10-04 02:01:42,931 DEBUG [member: 'jenkins-hbase9.apache.org,44303,1696384805319' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-04 02:01:42,931 DEBUG [member: 'jenkins-hbase9.apache.org,44303,1696384805319' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-04 02:01:42,931 DEBUG [member: 'jenkins-hbase9.apache.org,44303,1696384805319' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase9.apache.org,44303,1696384805319 2023-10-04 02:01:42,931 DEBUG [member: 'jenkins-hbase9.apache.org,44303,1696384805319' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-10-04 02:01:42,931 DEBUG [member: 'jenkins-hbase9.apache.org,44303,1696384805319' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase9.apache.org,44303,1696384805319' in zk 2023-10-04 02:01:42,933 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): master:39651-0x1010f1b55330000, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,44303,1696384805319 2023-10-04 02:01:42,933 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,44303,1696384805319 2023-10-04 02:01:42,933 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-04 02:01:42,933 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-04 02:01:42,933 DEBUG [member: 'jenkins-hbase9.apache.org,44303,1696384805319' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-10-04 02:01:42,934 DEBUG [member: 'jenkins-hbase9.apache.org,44303,1696384805319' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-04 02:01:42,934 DEBUG [member: 'jenkins-hbase9.apache.org,44303,1696384805319' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-10-04 02:01:42,934 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-04 02:01:42,935 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-04 02:01:42,935 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 02:01:42,935 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,39045,1696384805392 2023-10-04 02:01:42,935 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,35175,1696384805436 2023-10-04 02:01:42,936 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44303,1696384805319 2023-10-04 02:01:42,936 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-04 02:01:42,936 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 02:01:42,936 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,39045,1696384805392 2023-10-04 02:01:42,936 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44303,1696384805319 2023-10-04 02:01:42,937 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase9.apache.org,44303,1696384805319': 2023-10-04 02:01:42,937 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,44303,1696384805319' released barrier for procedure'snaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 1 more 2023-10-04 02:01:42,950 DEBUG [Listener at jenkins-hbase9.apache.org/33899] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-04 02:01:42,951 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39651] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-10-04 02:01:42,951 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39651] snapshot.SnapshotManager(406): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-10-04 02:01:42,951 DEBUG [Listener at jenkins-hbase9.apache.org/33899] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-10-04 02:01:43,152 DEBUG [Listener at jenkins-hbase9.apache.org/33899] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-04 02:01:43,153 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39651] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-10-04 02:01:43,153 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39651] snapshot.SnapshotManager(406): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-10-04 02:01:43,153 DEBUG [Listener at jenkins-hbase9.apache.org/33899] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-10-04 02:01:43,331 DEBUG [rs(jenkins-hbase9.apache.org,35175,1696384805436)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1696384901847.91d2010452fbe492aaa759851ab6b3c7. completed. 2023-10-04 02:01:43,331 DEBUG [rs(jenkins-hbase9.apache.org,35175,1696384805436)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1696384901847.91d2010452fbe492aaa759851ab6b3c7. 2023-10-04 02:01:43,331 DEBUG [member: 'jenkins-hbase9.apache.org,35175,1696384805436' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-04 02:01:43,332 DEBUG [member: 'jenkins-hbase9.apache.org,35175,1696384805436' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-04 02:01:43,332 DEBUG [member: 'jenkins-hbase9.apache.org,35175,1696384805436' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase9.apache.org,35175,1696384805436 2023-10-04 02:01:43,332 DEBUG [member: 'jenkins-hbase9.apache.org,35175,1696384805436' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-10-04 02:01:43,332 DEBUG [member: 'jenkins-hbase9.apache.org,35175,1696384805436' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase9.apache.org,35175,1696384805436' in zk 2023-10-04 02:01:43,334 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): master:39651-0x1010f1b55330000, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,35175,1696384805436 2023-10-04 02:01:43,334 DEBUG [member: 'jenkins-hbase9.apache.org,35175,1696384805436' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-10-04 02:01:43,334 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,35175,1696384805436 2023-10-04 02:01:43,335 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-04 02:01:43,335 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-04 02:01:43,335 DEBUG [member: 'jenkins-hbase9.apache.org,35175,1696384805436' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-04 02:01:43,335 DEBUG [member: 'jenkins-hbase9.apache.org,35175,1696384805436' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-10-04 02:01:43,336 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-04 02:01:43,337 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-04 02:01:43,337 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 02:01:43,337 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,39045,1696384805392 2023-10-04 02:01:43,338 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,35175,1696384805436 2023-10-04 02:01:43,338 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44303,1696384805319 2023-10-04 02:01:43,338 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-04 02:01:43,338 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 02:01:43,338 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,39045,1696384805392 2023-10-04 02:01:43,339 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,35175,1696384805436 2023-10-04 02:01:43,339 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44303,1696384805319 2023-10-04 02:01:43,339 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase9.apache.org,35175,1696384805436': 2023-10-04 02:01:43,339 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,35175,1696384805436' released barrier for procedure'snaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 0 more 2023-10-04 02:01:43,340 INFO [(jenkins-hbase9.apache.org,39651,1696384803959)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' execution completed 2023-10-04 02:01:43,340 DEBUG [(jenkins-hbase9.apache.org,39651,1696384803959)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-04 02:01:43,340 DEBUG [(jenkins-hbase9.apache.org,39651,1696384803959)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-04 02:01:43,340 DEBUG [(jenkins-hbase9.apache.org,39651,1696384803959)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 02:01:43,340 INFO [(jenkins-hbase9.apache.org,39651,1696384803959)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateWithSkipTmpincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-10-04 02:01:43,341 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): master:39651-0x1010f1b55330000, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 02:01:43,341 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): regionserver:35175-0x1010f1b55330003, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 02:01:43,341 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 02:01:43,341 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-04 02:01:43,341 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-04 02:01:43,341 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): regionserver:44303-0x1010f1b55330001, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 02:01:43,341 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): regionserver:39045-0x1010f1b55330002, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 02:01:43,342 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 02:01:43,342 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 02:01:43,342 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 02:01:43,342 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): regionserver:44303-0x1010f1b55330001, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-04 02:01:43,341 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 02:01:43,342 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 02:01:43,341 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): regionserver:35175-0x1010f1b55330003, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-04 02:01:43,342 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-04 02:01:43,342 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 02:01:43,342 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): regionserver:39045-0x1010f1b55330002, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-04 02:01:43,342 DEBUG [(jenkins-hbase9.apache.org,39651,1696384803959)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39651-0x1010f1b55330000, quorum=127.0.0.1:60027, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,39045,1696384805392 2023-10-04 02:01:43,342 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-04 02:01:43,342 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-04 02:01:43,342 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-04 02:01:43,342 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 02:01:43,342 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-04 02:01:43,342 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-04 02:01:43,342 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-04 02:01:43,342 DEBUG [(jenkins-hbase9.apache.org,39651,1696384803959)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39651-0x1010f1b55330000, quorum=127.0.0.1:60027, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,35175,1696384805436 2023-10-04 02:01:43,343 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 02:01:43,343 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-04 02:01:43,343 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 02:01:43,343 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 02:01:43,343 DEBUG [(jenkins-hbase9.apache.org,39651,1696384803959)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39651-0x1010f1b55330000, quorum=127.0.0.1:60027, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,44303,1696384805319 2023-10-04 02:01:43,343 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 02:01:43,343 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,39045,1696384805392 2023-10-04 02:01:43,344 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,35175,1696384805436 2023-10-04 02:01:43,344 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44303,1696384805319 2023-10-04 02:01:43,344 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-04 02:01:43,344 DEBUG [(jenkins-hbase9.apache.org,39651,1696384803959)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39651-0x1010f1b55330000, quorum=127.0.0.1:60027, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,39045,1696384805392 2023-10-04 02:01:43,344 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 02:01:43,345 DEBUG [(jenkins-hbase9.apache.org,39651,1696384803959)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39651-0x1010f1b55330000, quorum=127.0.0.1:60027, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,35175,1696384805436 2023-10-04 02:01:43,345 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,39045,1696384805392 2023-10-04 02:01:43,345 DEBUG [(jenkins-hbase9.apache.org,39651,1696384803959)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39651-0x1010f1b55330000, quorum=127.0.0.1:60027, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,44303,1696384805319 2023-10-04 02:01:43,345 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,35175,1696384805436 2023-10-04 02:01:43,345 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44303,1696384805319 2023-10-04 02:01:43,347 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): master:39651-0x1010f1b55330000, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,44303,1696384805319 2023-10-04 02:01:43,347 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): master:39651-0x1010f1b55330000, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 02:01:43,347 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): regionserver:44303-0x1010f1b55330001, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-04 02:01:43,347 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): regionserver:35175-0x1010f1b55330003, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-04 02:01:43,347 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): regionserver:39045-0x1010f1b55330002, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-04 02:01:43,347 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): regionserver:44303-0x1010f1b55330001, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-04 02:01:43,347 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-04 02:01:43,347 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): regionserver:35175-0x1010f1b55330003, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-04 02:01:43,347 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): master:39651-0x1010f1b55330000, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,35175,1696384805436 2023-10-04 02:01:43,347 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-04 02:01:43,347 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 02:01:43,347 DEBUG [(jenkins-hbase9.apache.org,39651,1696384803959)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-04 02:01:43,347 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): regionserver:39045-0x1010f1b55330002, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-04 02:01:43,347 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-04 02:01:43,348 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-04 02:01:43,347 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-04 02:01:43,349 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-04 02:01:43,348 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemStateWithSkipTmp 2023-10-04 02:01:43,348 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): master:39651-0x1010f1b55330000, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,39045,1696384805392 2023-10-04 02:01:43,349 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-04 02:01:43,349 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-04 02:01:43,349 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): master:39651-0x1010f1b55330000, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 02:01:43,349 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => e9516f04c7d2974b21addb190acc6c0a, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,.mob,0.e9516f04c7d2974b21addb190acc6c0a.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 02:01:43,350 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-04 02:01:43,350 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-10-04 02:01:43,350 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-04 02:01:43,350 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): master:39651-0x1010f1b55330000, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,44303,1696384805319 2023-10-04 02:01:43,349 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-04 02:01:43,350 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-04 02:01:43,350 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): master:39651-0x1010f1b55330000, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 02:01:43,350 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): master:39651-0x1010f1b55330000, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,35175,1696384805436 2023-10-04 02:01:43,350 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): master:39651-0x1010f1b55330000, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,39045,1696384805392 2023-10-04 02:01:43,350 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): master:39651-0x1010f1b55330000, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 02:01:43,350 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): master:39651-0x1010f1b55330000, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 02:01:43,350 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b2023100496e0e18bdebe4989b8e7609bd8cbe030, hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e20231004b4e81a62381247dfad47988c6ddda641] mob files 2023-10-04 02:01:43,351 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b2023100496e0e18bdebe4989b8e7609bd8cbe030 2023-10-04 02:01:43,351 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e20231004b4e81a62381247dfad47988c6ddda641 2023-10-04 02:01:43,358 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 02:01:43,359 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 02:01:43,389 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp to hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 02:01:43,389 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed 2023-10-04 02:01:43,390 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 02:01:43,390 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 02:01:43,390 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp at 1696384902849Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemStateWithSkipTmp at 1696384903358 (+509 ms)Consolidate snapshot: snaptb0-testExportFileSystemStateWithSkipTmp at 1696384903358Loading Region manifests for snaptb0-testExportFileSystemStateWithSkipTmp at 1696384903358Writing data manifest for snaptb0-testExportFileSystemStateWithSkipTmp at 1696384903366 (+8 ms)Verifying snapshot: snaptb0-testExportFileSystemStateWithSkipTmp at 1696384903383 (+17 ms)Snapshot snaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed at 1696384903389 (+6 ms) 2023-10-04 02:01:43,393 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=113, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-10-04 02:01:43,394 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=113, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED in 543 msec 2023-10-04 02:01:43,453 DEBUG [Listener at jenkins-hbase9.apache.org/33899] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-04 02:01:43,454 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39651] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-10-04 02:01:43,454 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39651] snapshot.SnapshotManager(403): Snapshot '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' has completed, notifying client. 2023-10-04 02:01:43,454 INFO [Listener at jenkins-hbase9.apache.org/33899] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/export-test/export-1696384903454 2023-10-04 02:01:43,455 INFO [Listener at jenkins-hbase9.apache.org/33899] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:38449, tgtDir=hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/export-test/export-1696384903454, rawTgtDir=hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/export-test/export-1696384903454, srcFsUri=hdfs://localhost:38449, srcDir=hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51 2023-10-04 02:01:43,477 DEBUG [Listener at jenkins-hbase9.apache.org/33899] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:38449, inputRoot=hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51 2023-10-04 02:01:43,477 DEBUG [Listener at jenkins-hbase9.apache.org/33899] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-338034484_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/export-test/export-1696384903454, skipTmp=true, initialOutputSnapshotDir=hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/export-test/export-1696384903454/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 02:01:43,477 INFO [Listener at jenkins-hbase9.apache.org/33899] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:38449, inputRoot=hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51, snapshotDir=hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp. 2023-10-04 02:01:43,486 INFO [Listener at jenkins-hbase9.apache.org/33899] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp to hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/export-test/export-1696384903454/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 02:01:43,519 DEBUG [Listener at jenkins-hbase9.apache.org/33899] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-10-04 02:01:43,520 DEBUG [Listener at jenkins-hbase9.apache.org/33899] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-10-04 02:01:43,520 DEBUG [Listener at jenkins-hbase9.apache.org/33899] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-10-04 02:01:43,520 DEBUG [Listener at jenkins-hbase9.apache.org/33899] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-10-04 02:01:43,521 DEBUG [Listener at jenkins-hbase9.apache.org/33899] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar 2023-10-04 02:01:43,521 DEBUG [Listener at jenkins-hbase9.apache.org/33899] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-10-04 02:01:43,521 DEBUG [Listener at jenkins-hbase9.apache.org/33899] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-10-04 02:01:43,588 DEBUG [Listener at jenkins-hbase9.apache.org/33899] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/757a468a-9656-cc80-ec19-d6f68f36be5a/hadoop-7952847047715991873.jar 2023-10-04 02:01:43,588 DEBUG [Listener at jenkins-hbase9.apache.org/33899] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-10-04 02:01:43,589 DEBUG [Listener at jenkins-hbase9.apache.org/33899] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-10-04 02:01:43,589 DEBUG [Listener at jenkins-hbase9.apache.org/33899] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-10-04 02:01:43,589 DEBUG [Listener at jenkins-hbase9.apache.org/33899] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-10-04 02:01:43,590 DEBUG [Listener at jenkins-hbase9.apache.org/33899] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-10-04 02:01:43,590 DEBUG [Listener at jenkins-hbase9.apache.org/33899] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-10-04 02:01:43,590 DEBUG [Listener at jenkins-hbase9.apache.org/33899] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-10-04 02:01:43,590 DEBUG [Listener at jenkins-hbase9.apache.org/33899] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-10-04 02:01:43,591 DEBUG [Listener at jenkins-hbase9.apache.org/33899] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-10-04 02:01:43,591 DEBUG [Listener at jenkins-hbase9.apache.org/33899] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-10-04 02:01:43,591 DEBUG [Listener at jenkins-hbase9.apache.org/33899] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-10-04 02:01:43,592 DEBUG [Listener at jenkins-hbase9.apache.org/33899] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-10-04 02:01:43,592 DEBUG [Listener at jenkins-hbase9.apache.org/33899] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-10-04 02:01:43,593 DEBUG [Listener at jenkins-hbase9.apache.org/33899] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-10-04 02:01:43,593 DEBUG [Listener at jenkins-hbase9.apache.org/33899] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-10-04 02:01:43,593 DEBUG [Listener at jenkins-hbase9.apache.org/33899] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-10-04 02:01:43,594 DEBUG [Listener at jenkins-hbase9.apache.org/33899] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-04 02:01:43,594 DEBUG [Listener at jenkins-hbase9.apache.org/33899] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-04 02:01:43,594 DEBUG [Listener at jenkins-hbase9.apache.org/33899] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-10-04 02:01:43,594 DEBUG [Listener at jenkins-hbase9.apache.org/33899] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-04 02:01:43,595 DEBUG [Listener at jenkins-hbase9.apache.org/33899] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-04 02:01:43,595 DEBUG [Listener at jenkins-hbase9.apache.org/33899] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-10-04 02:01:43,595 DEBUG [Listener at jenkins-hbase9.apache.org/33899] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-10-04 02:01:43,918 WARN [Listener at jenkins-hbase9.apache.org/33899] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-10-04 02:01:43,920 INFO [Listener at jenkins-hbase9.apache.org/33899] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportFileSystemStateWithSkipTmp' hfile list 2023-10-04 02:01:43,922 DEBUG [Listener at jenkins-hbase9.apache.org/33899] snapshot.ExportSnapshot(671): export split=0 size=31.5 K 2023-10-04 02:01:46,078 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-10-04 02:01:46,078 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-10-04 02:01:46,081 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696384811997_0006_000001 (auth:SIMPLE) 2023-10-04 02:01:46,684 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696384811997_0007_000001 (auth:SIMPLE) 2023-10-04 02:01:47,123 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-10-04 02:01:50,341 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696384811997_0007_000001 (auth:SIMPLE) 2023-10-04 02:01:52,551 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696384811997_0007_000001 (auth:SIMPLE) 2023-10-04 02:01:55,047 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696384811997_0007_000001 (auth:SIMPLE) 2023-10-04 02:01:56,095 INFO [Listener at jenkins-hbase9.apache.org/33899] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-10-04 02:01:56,095 INFO [Listener at jenkins-hbase9.apache.org/33899] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-10-04 02:01:56,105 INFO [Listener at jenkins-hbase9.apache.org/33899] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 02:01:56,105 INFO [Listener at jenkins-hbase9.apache.org/33899] snapshot.TestExportSnapshot(279): Exported snapshot 2023-10-04 02:01:56,106 INFO [Listener at jenkins-hbase9.apache.org/33899] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-10-04 02:01:56,106 DEBUG [Listener at jenkins-hbase9.apache.org/33899] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-737588810_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp at hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 02:01:56,106 DEBUG [Listener at jenkins-hbase9.apache.org/33899] snapshot.TestExportSnapshot(367): hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/.snapshotinfo 2023-10-04 02:01:56,106 DEBUG [Listener at jenkins-hbase9.apache.org/33899] snapshot.TestExportSnapshot(367): hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/data.manifest 2023-10-04 02:01:56,106 DEBUG [Listener at jenkins-hbase9.apache.org/33899] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-737588810_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/export-test/export-1696384903454/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp at hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/export-test/export-1696384903454/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 02:01:56,107 DEBUG [Listener at jenkins-hbase9.apache.org/33899] snapshot.TestExportSnapshot(367): hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/export-test/export-1696384903454/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/.snapshotinfo 2023-10-04 02:01:56,107 DEBUG [Listener at jenkins-hbase9.apache.org/33899] snapshot.TestExportSnapshot(367): hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/export-test/export-1696384903454/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/data.manifest 2023-10-04 02:01:56,112 INFO [Listener at jenkins-hbase9.apache.org/33899] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemStateWithSkipTmp 2023-10-04 02:01:56,112 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39651] master.HMaster$11(2418): Client=jenkins//172.31.2.10 disable testtb-testExportFileSystemStateWithSkipTmp 2023-10-04 02:01:56,113 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39651] procedure2.ProcedureExecutor(1028): Stored pid=114, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-10-04 02:01:56,115 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39651] master.MasterRpcServices(1230): Checking to see if procedure is done pid=114 2023-10-04 02:01:56,115 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696384916115"}]},"ts":"1696384916115"} 2023-10-04 02:01:56,117 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=DISABLING in hbase:meta 2023-10-04 02:01:56,118 INFO [PEWorker-3] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemStateWithSkipTmp to state=DISABLING 2023-10-04 02:01:56,119 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=115, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=ca38ebb41287c3efeac984dfbc22db48, UNASSIGN}, {pid=116, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=91d2010452fbe492aaa759851ab6b3c7, UNASSIGN}] 2023-10-04 02:01:56,120 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=115, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=ca38ebb41287c3efeac984dfbc22db48, UNASSIGN 2023-10-04 02:01:56,120 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=116, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=91d2010452fbe492aaa759851ab6b3c7, UNASSIGN 2023-10-04 02:01:56,121 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=115 updating hbase:meta row=ca38ebb41287c3efeac984dfbc22db48, regionState=CLOSING, regionLocation=jenkins-hbase9.apache.org,44303,1696384805319 2023-10-04 02:01:56,121 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=116 updating hbase:meta row=91d2010452fbe492aaa759851ab6b3c7, regionState=CLOSING, regionLocation=jenkins-hbase9.apache.org,35175,1696384805436 2023-10-04 02:01:56,121 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1696384901847.ca38ebb41287c3efeac984dfbc22db48.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1696384916121"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696384916121"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696384916121"}]},"ts":"1696384916121"} 2023-10-04 02:01:56,121 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1696384901847.91d2010452fbe492aaa759851ab6b3c7.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1696384916121"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696384916121"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696384916121"}]},"ts":"1696384916121"} 2023-10-04 02:01:56,122 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=117, ppid=115, state=RUNNABLE; CloseRegionProcedure ca38ebb41287c3efeac984dfbc22db48, server=jenkins-hbase9.apache.org,44303,1696384805319}] 2023-10-04 02:01:56,122 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=118, ppid=116, state=RUNNABLE; CloseRegionProcedure 91d2010452fbe492aaa759851ab6b3c7, server=jenkins-hbase9.apache.org,35175,1696384805436}] 2023-10-04 02:01:56,216 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39651] master.MasterRpcServices(1230): Checking to see if procedure is done pid=114 2023-10-04 02:01:56,274 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(111): Close ca38ebb41287c3efeac984dfbc22db48 2023-10-04 02:01:56,274 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(111): Close 91d2010452fbe492aaa759851ab6b3c7 2023-10-04 02:01:56,274 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1604): Closing ca38ebb41287c3efeac984dfbc22db48, disabling compactions & flushes 2023-10-04 02:01:56,274 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1604): Closing 91d2010452fbe492aaa759851ab6b3c7, disabling compactions & flushes 2023-10-04 02:01:56,274 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,,1696384901847.ca38ebb41287c3efeac984dfbc22db48. 2023-10-04 02:01:56,274 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,1,1696384901847.91d2010452fbe492aaa759851ab6b3c7. 2023-10-04 02:01:56,274 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,,1696384901847.ca38ebb41287c3efeac984dfbc22db48. 2023-10-04 02:01:56,274 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1696384901847.91d2010452fbe492aaa759851ab6b3c7. 2023-10-04 02:01:56,274 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,,1696384901847.ca38ebb41287c3efeac984dfbc22db48. after waiting 0 ms 2023-10-04 02:01:56,274 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1696384901847.91d2010452fbe492aaa759851ab6b3c7. after waiting 0 ms 2023-10-04 02:01:56,274 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,1,1696384901847.91d2010452fbe492aaa759851ab6b3c7. 2023-10-04 02:01:56,274 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,,1696384901847.ca38ebb41287c3efeac984dfbc22db48. 2023-10-04 02:01:56,285 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/data/default/testtb-testExportFileSystemStateWithSkipTmp/91d2010452fbe492aaa759851ab6b3c7/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-10-04 02:01:56,285 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/data/default/testtb-testExportFileSystemStateWithSkipTmp/ca38ebb41287c3efeac984dfbc22db48/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-10-04 02:01:56,285 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-10-04 02:01:56,285 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-10-04 02:01:56,286 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,1,1696384901847.91d2010452fbe492aaa759851ab6b3c7. 2023-10-04 02:01:56,287 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1558): Region close journal for 91d2010452fbe492aaa759851ab6b3c7: 2023-10-04 02:01:56,287 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,,1696384901847.ca38ebb41287c3efeac984dfbc22db48. 2023-10-04 02:01:56,287 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1558): Region close journal for ca38ebb41287c3efeac984dfbc22db48: 2023-10-04 02:01:56,288 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(149): Closed 91d2010452fbe492aaa759851ab6b3c7 2023-10-04 02:01:56,289 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=116 updating hbase:meta row=91d2010452fbe492aaa759851ab6b3c7, regionState=CLOSED 2023-10-04 02:01:56,289 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(149): Closed ca38ebb41287c3efeac984dfbc22db48 2023-10-04 02:01:56,289 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1696384901847.91d2010452fbe492aaa759851ab6b3c7.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1696384916289"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696384916289"}]},"ts":"1696384916289"} 2023-10-04 02:01:56,289 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=115 updating hbase:meta row=ca38ebb41287c3efeac984dfbc22db48, regionState=CLOSED 2023-10-04 02:01:56,289 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1696384901847.ca38ebb41287c3efeac984dfbc22db48.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1696384916289"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696384916289"}]},"ts":"1696384916289"} 2023-10-04 02:01:56,291 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=118, resume processing ppid=116 2023-10-04 02:01:56,292 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=118, ppid=116, state=SUCCESS; CloseRegionProcedure 91d2010452fbe492aaa759851ab6b3c7, server=jenkins-hbase9.apache.org,35175,1696384805436 in 168 msec 2023-10-04 02:01:56,293 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=117, resume processing ppid=115 2023-10-04 02:01:56,293 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=116, ppid=114, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=91d2010452fbe492aaa759851ab6b3c7, UNASSIGN in 172 msec 2023-10-04 02:01:56,293 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=117, ppid=115, state=SUCCESS; CloseRegionProcedure ca38ebb41287c3efeac984dfbc22db48, server=jenkins-hbase9.apache.org,44303,1696384805319 in 169 msec 2023-10-04 02:01:56,294 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=115, resume processing ppid=114 2023-10-04 02:01:56,294 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=115, ppid=114, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=ca38ebb41287c3efeac984dfbc22db48, UNASSIGN in 174 msec 2023-10-04 02:01:56,295 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696384916295"}]},"ts":"1696384916295"} 2023-10-04 02:01:56,296 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=DISABLED in hbase:meta 2023-10-04 02:01:56,297 INFO [PEWorker-4] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemStateWithSkipTmp to state=DISABLED 2023-10-04 02:01:56,299 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=114, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp in 186 msec 2023-10-04 02:01:56,417 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39651] master.MasterRpcServices(1230): Checking to see if procedure is done pid=114 2023-10-04 02:01:56,417 INFO [Listener at jenkins-hbase9.apache.org/33899] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemStateWithSkipTmp, procId: 114 completed 2023-10-04 02:01:56,418 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39651] master.HMaster$5(2228): Client=jenkins//172.31.2.10 delete testtb-testExportFileSystemStateWithSkipTmp 2023-10-04 02:01:56,418 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39651] procedure2.ProcedureExecutor(1028): Stored pid=119, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-10-04 02:01:56,420 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=119, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-10-04 02:01:56,420 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39651] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemStateWithSkipTmp 2023-10-04 02:01:56,421 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=119, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-10-04 02:01:56,422 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=44303] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemStateWithSkipTmp 2023-10-04 02:01:56,424 DEBUG [HFileArchiver-15] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/ca38ebb41287c3efeac984dfbc22db48 2023-10-04 02:01:56,424 DEBUG [HFileArchiver-14] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/91d2010452fbe492aaa759851ab6b3c7 2023-10-04 02:01:56,425 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): regionserver:39045-0x1010f1b55330002, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-10-04 02:01:56,425 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): regionserver:44303-0x1010f1b55330001, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-10-04 02:01:56,425 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): regionserver:35175-0x1010f1b55330003, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-10-04 02:01:56,425 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): master:39651-0x1010f1b55330000, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-10-04 02:01:56,426 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-10-04 02:01:56,426 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-10-04 02:01:56,426 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-10-04 02:01:56,426 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-10-04 02:01:56,426 DEBUG [HFileArchiver-15] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/ca38ebb41287c3efeac984dfbc22db48/cf, FileablePath, hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/ca38ebb41287c3efeac984dfbc22db48/recovered.edits] 2023-10-04 02:01:56,427 DEBUG [HFileArchiver-14] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/91d2010452fbe492aaa759851ab6b3c7/cf, FileablePath, hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/91d2010452fbe492aaa759851ab6b3c7/recovered.edits] 2023-10-04 02:01:56,427 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): regionserver:39045-0x1010f1b55330002, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-10-04 02:01:56,427 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): regionserver:39045-0x1010f1b55330002, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-04 02:01:56,427 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): regionserver:35175-0x1010f1b55330003, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-10-04 02:01:56,427 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): regionserver:35175-0x1010f1b55330003, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-04 02:01:56,427 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): master:39651-0x1010f1b55330000, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-10-04 02:01:56,427 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): master:39651-0x1010f1b55330000, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-04 02:01:56,427 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): regionserver:44303-0x1010f1b55330001, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-10-04 02:01:56,427 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): regionserver:44303-0x1010f1b55330001, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-04 02:01:56,428 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39651] master.MasterRpcServices(1230): Checking to see if procedure is done pid=119 2023-10-04 02:01:56,431 DEBUG [HFileArchiver-15] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/ca38ebb41287c3efeac984dfbc22db48/cf/c0a1df4b05154eb280871cfff3aad3e3 to hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/ca38ebb41287c3efeac984dfbc22db48/cf/c0a1df4b05154eb280871cfff3aad3e3 2023-10-04 02:01:56,431 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/91d2010452fbe492aaa759851ab6b3c7/cf/785b741806154436820478b2ed8d2aff to hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/91d2010452fbe492aaa759851ab6b3c7/cf/785b741806154436820478b2ed8d2aff 2023-10-04 02:01:56,434 DEBUG [HFileArchiver-15] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/ca38ebb41287c3efeac984dfbc22db48/recovered.edits/9.seqid to hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/ca38ebb41287c3efeac984dfbc22db48/recovered.edits/9.seqid 2023-10-04 02:01:56,434 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/91d2010452fbe492aaa759851ab6b3c7/recovered.edits/9.seqid to hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/91d2010452fbe492aaa759851ab6b3c7/recovered.edits/9.seqid 2023-10-04 02:01:56,434 DEBUG [HFileArchiver-15] backup.HFileArchiver(596): Deleted hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/ca38ebb41287c3efeac984dfbc22db48 2023-10-04 02:01:56,435 DEBUG [HFileArchiver-14] backup.HFileArchiver(596): Deleted hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/91d2010452fbe492aaa759851ab6b3c7 2023-10-04 02:01:56,435 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithSkipTmp regions 2023-10-04 02:01:56,435 DEBUG [PEWorker-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a 2023-10-04 02:01:56,436 DEBUG [PEWorker-5] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf] 2023-10-04 02:01:56,440 DEBUG [PEWorker-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b2023100496e0e18bdebe4989b8e7609bd8cbe030 to hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b2023100496e0e18bdebe4989b8e7609bd8cbe030 2023-10-04 02:01:56,442 DEBUG [PEWorker-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e20231004b4e81a62381247dfad47988c6ddda641 to hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e20231004b4e81a62381247dfad47988c6ddda641 2023-10-04 02:01:56,442 DEBUG [PEWorker-5] backup.HFileArchiver(596): Deleted hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a 2023-10-04 02:01:56,444 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=119, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-10-04 02:01:56,446 WARN [PEWorker-5] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportFileSystemStateWithSkipTmp from hbase:meta 2023-10-04 02:01:56,449 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemStateWithSkipTmp' descriptor. 2023-10-04 02:01:56,450 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=119, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-10-04 02:01:56,450 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemStateWithSkipTmp' from region states. 2023-10-04 02:01:56,450 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1696384901847.ca38ebb41287c3efeac984dfbc22db48.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1696384916450"}]},"ts":"9223372036854775807"} 2023-10-04 02:01:56,450 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1696384901847.91d2010452fbe492aaa759851ab6b3c7.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1696384916450"}]},"ts":"9223372036854775807"} 2023-10-04 02:01:56,451 INFO [PEWorker-5] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-10-04 02:01:56,452 DEBUG [PEWorker-5] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => ca38ebb41287c3efeac984dfbc22db48, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,,1696384901847.ca38ebb41287c3efeac984dfbc22db48.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 91d2010452fbe492aaa759851ab6b3c7, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,1,1696384901847.91d2010452fbe492aaa759851ab6b3c7.', STARTKEY => '1', ENDKEY => ''}] 2023-10-04 02:01:56,452 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemStateWithSkipTmp' as deleted. 2023-10-04 02:01:56,452 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1696384916452"}]},"ts":"9223372036854775807"} 2023-10-04 02:01:56,453 INFO [PEWorker-5] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemStateWithSkipTmp state from META 2023-10-04 02:01:56,455 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(130): Finished pid=119, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-10-04 02:01:56,456 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=119, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp in 37 msec 2023-10-04 02:01:56,529 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39651] master.MasterRpcServices(1230): Checking to see if procedure is done pid=119 2023-10-04 02:01:56,529 INFO [Listener at jenkins-hbase9.apache.org/33899] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemStateWithSkipTmp, procId: 119 completed 2023-10-04 02:01:56,536 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39651] master.MasterRpcServices(751): Client=jenkins//172.31.2.10 delete name: "emptySnaptb0-testExportFileSystemStateWithSkipTmp" 2023-10-04 02:01:56,538 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39651] snapshot.SnapshotManager(335): Deleting snapshot: emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 02:01:56,539 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39651] master.MasterRpcServices(751): Client=jenkins//172.31.2.10 delete name: "snaptb0-testExportFileSystemStateWithSkipTmp" 2023-10-04 02:01:56,540 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39651] snapshot.SnapshotManager(335): Deleting snapshot: snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-04 02:01:56,564 INFO [Listener at jenkins-hbase9.apache.org/33899] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testExportFileSystemStateWithSkipTmp Thread=765 (was 766), OpenFileDescriptor=911 (was 939), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=245 (was 295), ProcessCount=168 (was 168), AvailableMemoryMB=10684 (was 10750) 2023-10-04 02:01:56,564 WARN [Listener at jenkins-hbase9.apache.org/33899] hbase.ResourceChecker(130): Thread=765 is superior to 500 2023-10-04 02:01:56,564 INFO [Listener at jenkins-hbase9.apache.org/33899] hbase.HBaseTestingUtility(2762): Stopping mini mapreduce cluster... 2023-10-04 02:01:56,574 INFO [Listener at jenkins-hbase9.apache.org/33899] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase9.apache.org:0 2023-10-04 02:02:01,234 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696384811997_0007_000001 (auth:SIMPLE) 2023-10-04 02:02:01,854 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-10-04 02:02:10,698 INFO [Listener at jenkins-hbase9.apache.org/33899] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase9.apache.org:0 2023-10-04 02:02:24,811 ERROR [Thread[Thread-410,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager$ExpiredTokenRemover(696): ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted 2023-10-04 02:02:24,811 INFO [Listener at jenkins-hbase9.apache.org/33899] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase9.apache.org:0 2023-10-04 02:02:24,917 WARN [ApplicationMaster Launcher] amlauncher.ApplicationMasterLauncher$LauncherThread(122): org.apache.hadoop.yarn.server.resourcemanager.amlauncher.ApplicationMasterLauncher$LauncherThread interrupted. Returning. 2023-10-04 02:02:24,923 ERROR [SchedulerEventDispatcher:Event Processor] event.EventDispatcher$EventProcessor(61): Returning, interrupted : java.lang.InterruptedException 2023-10-04 02:02:24,924 ERROR [Thread[Thread-420,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager$ExpiredTokenRemover(696): ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted 2023-10-04 02:02:24,931 INFO [Listener at jenkins-hbase9.apache.org/33899] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase9.apache.org:0 2023-10-04 02:02:25,035 ERROR [Thread[Thread-385,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager$ExpiredTokenRemover(696): ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted 2023-10-04 02:02:25,035 INFO [Listener at jenkins-hbase9.apache.org/33899] hbase.HBaseTestingUtility(2765): Mini mapreduce cluster stopped 2023-10-04 02:02:25,035 INFO [Listener at jenkins-hbase9.apache.org/33899] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-10-04 02:02:25,035 INFO [Listener at jenkins-hbase9.apache.org/33899] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-10-04 02:02:25,035 DEBUG [Listener at jenkins-hbase9.apache.org/33899] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x322007f2 to 127.0.0.1:60027 2023-10-04 02:02:25,035 DEBUG [Listener at jenkins-hbase9.apache.org/33899] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-04 02:02:25,036 DEBUG [Listener at jenkins-hbase9.apache.org/33899] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-10-04 02:02:25,036 DEBUG [Listener at jenkins-hbase9.apache.org/33899] util.JVMClusterUtil(257): Found active master hash=425537222, stopped=false 2023-10-04 02:02:25,036 DEBUG [Listener at jenkins-hbase9.apache.org/33899] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-10-04 02:02:25,036 DEBUG [Listener at jenkins-hbase9.apache.org/33899] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver 2023-10-04 02:02:25,036 INFO [Listener at jenkins-hbase9.apache.org/33899] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase9.apache.org,39651,1696384803959 2023-10-04 02:02:25,038 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): regionserver:39045-0x1010f1b55330002, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-10-04 02:02:25,038 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): master:39651-0x1010f1b55330000, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-10-04 02:02:25,038 INFO [Listener at jenkins-hbase9.apache.org/33899] procedure2.ProcedureExecutor(628): Stopping 2023-10-04 02:02:25,038 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): master:39651-0x1010f1b55330000, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-10-04 02:02:25,038 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): regionserver:35175-0x1010f1b55330003, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-10-04 02:02:25,038 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): regionserver:44303-0x1010f1b55330001, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-10-04 02:02:25,038 DEBUG [Listener at jenkins-hbase9.apache.org/33899] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x0acbf86e to 127.0.0.1:60027 2023-10-04 02:02:25,038 DEBUG [Listener at jenkins-hbase9.apache.org/33899] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-04 02:02:25,038 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35175-0x1010f1b55330003, quorum=127.0.0.1:60027, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-10-04 02:02:25,038 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:39651-0x1010f1b55330000, quorum=127.0.0.1:60027, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-10-04 02:02:25,038 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39045-0x1010f1b55330002, quorum=127.0.0.1:60027, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-10-04 02:02:25,038 INFO [Listener at jenkins-hbase9.apache.org/33899] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase9.apache.org,44303,1696384805319' ***** 2023-10-04 02:02:25,039 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44303-0x1010f1b55330001, quorum=127.0.0.1:60027, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-10-04 02:02:25,039 DEBUG [Listener at jenkins-hbase9.apache.org/33899] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-10-04 02:02:25,039 INFO [Listener at jenkins-hbase9.apache.org/33899] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-10-04 02:02:25,039 INFO [Listener at jenkins-hbase9.apache.org/33899] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase9.apache.org,39045,1696384805392' ***** 2023-10-04 02:02:25,039 DEBUG [Listener at jenkins-hbase9.apache.org/33899] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-10-04 02:02:25,039 INFO [Listener at jenkins-hbase9.apache.org/33899] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-10-04 02:02:25,039 INFO [Listener at jenkins-hbase9.apache.org/33899] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase9.apache.org,35175,1696384805436' ***** 2023-10-04 02:02:25,039 INFO [RS:0;jenkins-hbase9:44303] regionserver.HeapMemoryManager(220): Stopping 2023-10-04 02:02:25,039 INFO [RS:1;jenkins-hbase9:39045] regionserver.HeapMemoryManager(220): Stopping 2023-10-04 02:02:25,039 DEBUG [Listener at jenkins-hbase9.apache.org/33899] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-10-04 02:02:25,040 INFO [RS:1;jenkins-hbase9:39045] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-10-04 02:02:25,040 INFO [Listener at jenkins-hbase9.apache.org/33899] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-10-04 02:02:25,040 INFO [RS:1;jenkins-hbase9:39045] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-10-04 02:02:25,040 INFO [RS:0;jenkins-hbase9:44303] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-10-04 02:02:25,040 INFO [RS:1;jenkins-hbase9:39045] regionserver.HRegionServer(1144): stopping server jenkins-hbase9.apache.org,39045,1696384805392 2023-10-04 02:02:25,040 INFO [RS:2;jenkins-hbase9:35175] regionserver.HeapMemoryManager(220): Stopping 2023-10-04 02:02:25,040 INFO [RS:0;jenkins-hbase9:44303] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-10-04 02:02:25,040 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-10-04 02:02:25,040 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-10-04 02:02:25,040 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-10-04 02:02:25,040 INFO [RS:0;jenkins-hbase9:44303] regionserver.HRegionServer(3305): Received CLOSE for efd2d5b3ef87d5ee769a207fc17e879a 2023-10-04 02:02:25,040 INFO [RS:2;jenkins-hbase9:35175] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-10-04 02:02:25,040 DEBUG [RS:1;jenkins-hbase9:39045] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x2c8779a5 to 127.0.0.1:60027 2023-10-04 02:02:25,040 INFO [RS:2;jenkins-hbase9:35175] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-10-04 02:02:25,040 DEBUG [RS:1;jenkins-hbase9:39045] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-04 02:02:25,042 INFO [RS:2;jenkins-hbase9:35175] regionserver.HRegionServer(3305): Received CLOSE for 2ec2ed12b72bd33dd2c8b72e8e42d407 2023-10-04 02:02:25,042 INFO [RS:0;jenkins-hbase9:44303] regionserver.HRegionServer(1144): stopping server jenkins-hbase9.apache.org,44303,1696384805319 2023-10-04 02:02:25,042 INFO [RS:2;jenkins-hbase9:35175] regionserver.HRegionServer(1144): stopping server jenkins-hbase9.apache.org,35175,1696384805436 2023-10-04 02:02:25,042 DEBUG [RS:0;jenkins-hbase9:44303] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x2ab078bf to 127.0.0.1:60027 2023-10-04 02:02:25,042 DEBUG [RS:2;jenkins-hbase9:35175] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x0e54d3ac to 127.0.0.1:60027 2023-10-04 02:02:25,042 INFO [RS:1;jenkins-hbase9:39045] regionserver.HRegionServer(1170): stopping server jenkins-hbase9.apache.org,39045,1696384805392; all regions closed. 2023-10-04 02:02:25,043 DEBUG [RS:2;jenkins-hbase9:35175] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-04 02:02:25,043 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1604): Closing 2ec2ed12b72bd33dd2c8b72e8e42d407, disabling compactions & flushes 2023-10-04 02:02:25,043 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1604): Closing efd2d5b3ef87d5ee769a207fc17e879a, disabling compactions & flushes 2023-10-04 02:02:25,042 DEBUG [RS:0;jenkins-hbase9:44303] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-04 02:02:25,045 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1626): Closing region hbase:acl,,1696384808452.efd2d5b3ef87d5ee769a207fc17e879a. 2023-10-04 02:02:25,045 INFO [RS:0;jenkins-hbase9:44303] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-10-04 02:02:25,045 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:acl,,1696384808452.efd2d5b3ef87d5ee769a207fc17e879a. 2023-10-04 02:02:25,045 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1696384807699.2ec2ed12b72bd33dd2c8b72e8e42d407. 2023-10-04 02:02:25,045 INFO [RS:2;jenkins-hbase9:35175] regionserver.HRegionServer(1474): Waiting on 1 regions to close 2023-10-04 02:02:25,046 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1696384807699.2ec2ed12b72bd33dd2c8b72e8e42d407. 2023-10-04 02:02:25,046 DEBUG [RS:2;jenkins-hbase9:35175] regionserver.HRegionServer(1478): Online Regions={2ec2ed12b72bd33dd2c8b72e8e42d407=hbase:namespace,,1696384807699.2ec2ed12b72bd33dd2c8b72e8e42d407.} 2023-10-04 02:02:25,046 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1696384807699.2ec2ed12b72bd33dd2c8b72e8e42d407. after waiting 0 ms 2023-10-04 02:02:25,045 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:acl,,1696384808452.efd2d5b3ef87d5ee769a207fc17e879a. after waiting 0 ms 2023-10-04 02:02:25,045 INFO [RS:0;jenkins-hbase9:44303] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-10-04 02:02:25,046 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:acl,,1696384808452.efd2d5b3ef87d5ee769a207fc17e879a. 2023-10-04 02:02:25,046 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1696384807699.2ec2ed12b72bd33dd2c8b72e8e42d407. 2023-10-04 02:02:25,046 INFO [RS:0;jenkins-hbase9:44303] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-10-04 02:02:25,046 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(2745): Flushing efd2d5b3ef87d5ee769a207fc17e879a 1/1 column families, dataSize=914 B heapSize=2.17 KB 2023-10-04 02:02:25,046 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(2745): Flushing 2ec2ed12b72bd33dd2c8b72e8e42d407 1/1 column families, dataSize=78 B heapSize=488 B 2023-10-04 02:02:25,046 INFO [RS:0;jenkins-hbase9:44303] regionserver.HRegionServer(3305): Received CLOSE for 1588230740 2023-10-04 02:02:25,046 INFO [RS:0;jenkins-hbase9:44303] regionserver.HRegionServer(1474): Waiting on 2 regions to close 2023-10-04 02:02:25,046 DEBUG [RS:0;jenkins-hbase9:44303] regionserver.HRegionServer(1478): Online Regions={1588230740=hbase:meta,,1.1588230740, efd2d5b3ef87d5ee769a207fc17e879a=hbase:acl,,1696384808452.efd2d5b3ef87d5ee769a207fc17e879a.} 2023-10-04 02:02:25,047 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-10-04 02:02:25,047 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-10-04 02:02:25,047 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-10-04 02:02:25,047 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-10-04 02:02:25,047 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-10-04 02:02:25,047 DEBUG [RS:2;jenkins-hbase9:35175] regionserver.HRegionServer(1504): Waiting on 2ec2ed12b72bd33dd2c8b72e8e42d407 2023-10-04 02:02:25,047 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(2745): Flushing 1588230740 3/3 column families, dataSize=45.93 KB heapSize=71.92 KB 2023-10-04 02:02:25,047 DEBUG [RS:0;jenkins-hbase9:44303] regionserver.HRegionServer(1504): Waiting on 1588230740, efd2d5b3ef87d5ee769a207fc17e879a 2023-10-04 02:02:25,052 INFO [regionserver/jenkins-hbase9:0.Chore.1] hbase.ScheduledChore(146): Chore: CompactionChecker was stopped 2023-10-04 02:02:25,052 INFO [regionserver/jenkins-hbase9:0.Chore.1] hbase.ScheduledChore(146): Chore: MemstoreFlusherChore was stopped 2023-10-04 02:02:25,053 INFO [regionserver/jenkins-hbase9:0.Chore.1] hbase.ScheduledChore(146): Chore: CompactionChecker was stopped 2023-10-04 02:02:25,055 INFO [regionserver/jenkins-hbase9:0.Chore.1] hbase.ScheduledChore(146): Chore: MemstoreFlusherChore was stopped 2023-10-04 02:02:25,064 DEBUG [RS:1;jenkins-hbase9:39045] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/oldWALs 2023-10-04 02:02:25,064 INFO [RS:1;jenkins-hbase9:39045] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase9.apache.org%2C39045%2C1696384805392:(num 1696384807229) 2023-10-04 02:02:25,064 DEBUG [RS:1;jenkins-hbase9:39045] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-04 02:02:25,064 INFO [RS:1;jenkins-hbase9:39045] regionserver.LeaseManager(133): Closed leases 2023-10-04 02:02:25,067 INFO [RS:1;jenkins-hbase9:39045] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase9:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-10-04 02:02:25,068 INFO [RS:1;jenkins-hbase9:39045] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-10-04 02:02:25,068 INFO [regionserver/jenkins-hbase9:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-10-04 02:02:25,068 INFO [RS:1;jenkins-hbase9:39045] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-10-04 02:02:25,068 INFO [RS:1;jenkins-hbase9:39045] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-10-04 02:02:25,072 INFO [RS:1;jenkins-hbase9:39045] ipc.NettyRpcServer(158): Stopping server on /172.31.2.10:39045 2023-10-04 02:02:25,081 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): regionserver:39045-0x1010f1b55330002, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase9.apache.org,39045,1696384805392 2023-10-04 02:02:25,081 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): master:39651-0x1010f1b55330000, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-10-04 02:02:25,081 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): regionserver:39045-0x1010f1b55330002, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-10-04 02:02:25,081 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): regionserver:44303-0x1010f1b55330001, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase9.apache.org,39045,1696384805392 2023-10-04 02:02:25,082 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): regionserver:44303-0x1010f1b55330001, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-10-04 02:02:25,081 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): regionserver:35175-0x1010f1b55330003, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase9.apache.org,39045,1696384805392 2023-10-04 02:02:25,082 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): regionserver:35175-0x1010f1b55330003, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-10-04 02:02:25,084 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=78 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/data/hbase/namespace/2ec2ed12b72bd33dd2c8b72e8e42d407/.tmp/info/9b93ca0c818343ac8af7c7659abb73be 2023-10-04 02:02:25,084 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase9.apache.org,39045,1696384805392] 2023-10-04 02:02:25,085 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase9.apache.org,39045,1696384805392; numProcessing=1 2023-10-04 02:02:25,085 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=914 B at sequenceid=18 (bloomFilter=false), to=hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/data/hbase/acl/efd2d5b3ef87d5ee769a207fc17e879a/.tmp/l/004a19f2992c416e8d3b6984153fc00b 2023-10-04 02:02:25,086 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=40.45 KB at sequenceid=131 (bloomFilter=false), to=hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/data/hbase/meta/1588230740/.tmp/info/f3f60c4aafb5449da29e0b8d31d2c4cf 2023-10-04 02:02:25,086 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase9.apache.org,39045,1696384805392 already deleted, retry=false 2023-10-04 02:02:25,087 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase9.apache.org,39045,1696384805392 expired; onlineServers=2 2023-10-04 02:02:25,091 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 004a19f2992c416e8d3b6984153fc00b 2023-10-04 02:02:25,092 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for f3f60c4aafb5449da29e0b8d31d2c4cf 2023-10-04 02:02:25,093 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/data/hbase/namespace/2ec2ed12b72bd33dd2c8b72e8e42d407/.tmp/info/9b93ca0c818343ac8af7c7659abb73be as hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/data/hbase/namespace/2ec2ed12b72bd33dd2c8b72e8e42d407/info/9b93ca0c818343ac8af7c7659abb73be 2023-10-04 02:02:25,096 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/data/hbase/acl/efd2d5b3ef87d5ee769a207fc17e879a/.tmp/l/004a19f2992c416e8d3b6984153fc00b as hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/data/hbase/acl/efd2d5b3ef87d5ee769a207fc17e879a/l/004a19f2992c416e8d3b6984153fc00b 2023-10-04 02:02:25,100 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 004a19f2992c416e8d3b6984153fc00b 2023-10-04 02:02:25,101 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HStore(1080): Added hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/data/hbase/acl/efd2d5b3ef87d5ee769a207fc17e879a/l/004a19f2992c416e8d3b6984153fc00b, entries=7, sequenceid=18, filesize=5.2 K 2023-10-04 02:02:25,101 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~914 B/914, heapSize ~2.16 KB/2208, currentSize=0 B/0 for efd2d5b3ef87d5ee769a207fc17e879a in 55ms, sequenceid=18, compaction requested=false 2023-10-04 02:02:25,111 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HStore(1080): Added hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/data/hbase/namespace/2ec2ed12b72bd33dd2c8b72e8e42d407/info/9b93ca0c818343ac8af7c7659abb73be, entries=2, sequenceid=6, filesize=4.8 K 2023-10-04 02:02:25,112 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for 2ec2ed12b72bd33dd2c8b72e8e42d407 in 65ms, sequenceid=6, compaction requested=false 2023-10-04 02:02:25,122 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/data/hbase/acl/efd2d5b3ef87d5ee769a207fc17e879a/recovered.edits/21.seqid, newMaxSeqId=21, maxSeqId=1 2023-10-04 02:02:25,122 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-10-04 02:02:25,123 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1838): Closed hbase:acl,,1696384808452.efd2d5b3ef87d5ee769a207fc17e879a. 2023-10-04 02:02:25,123 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1558): Region close journal for efd2d5b3ef87d5ee769a207fc17e879a: 2023-10-04 02:02:25,123 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.CloseRegionHandler(117): Closed hbase:acl,,1696384808452.efd2d5b3ef87d5ee769a207fc17e879a. 2023-10-04 02:02:25,126 INFO [regionserver/jenkins-hbase9:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-10-04 02:02:25,126 INFO [regionserver/jenkins-hbase9:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-10-04 02:02:25,126 INFO [regionserver/jenkins-hbase9:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-10-04 02:02:25,128 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=1.50 KB at sequenceid=131 (bloomFilter=false), to=hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/data/hbase/meta/1588230740/.tmp/rep_barrier/56f910c90ff748ce8810d7dfdf2b6094 2023-10-04 02:02:25,129 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/data/hbase/namespace/2ec2ed12b72bd33dd2c8b72e8e42d407/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-10-04 02:02:25,129 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-10-04 02:02:25,130 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1838): Closed hbase:namespace,,1696384807699.2ec2ed12b72bd33dd2c8b72e8e42d407. 2023-10-04 02:02:25,130 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1558): Region close journal for 2ec2ed12b72bd33dd2c8b72e8e42d407: 2023-10-04 02:02:25,131 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1696384807699.2ec2ed12b72bd33dd2c8b72e8e42d407. 2023-10-04 02:02:25,134 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 56f910c90ff748ce8810d7dfdf2b6094 2023-10-04 02:02:25,149 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.98 KB at sequenceid=131 (bloomFilter=false), to=hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/data/hbase/meta/1588230740/.tmp/table/b9118c1e7d1942d9bdb8ba0fec10bad6 2023-10-04 02:02:25,154 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for b9118c1e7d1942d9bdb8ba0fec10bad6 2023-10-04 02:02:25,154 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/data/hbase/meta/1588230740/.tmp/info/f3f60c4aafb5449da29e0b8d31d2c4cf as hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/data/hbase/meta/1588230740/info/f3f60c4aafb5449da29e0b8d31d2c4cf 2023-10-04 02:02:25,159 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for f3f60c4aafb5449da29e0b8d31d2c4cf 2023-10-04 02:02:25,159 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HStore(1080): Added hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/data/hbase/meta/1588230740/info/f3f60c4aafb5449da29e0b8d31d2c4cf, entries=48, sequenceid=131, filesize=10.3 K 2023-10-04 02:02:25,160 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/data/hbase/meta/1588230740/.tmp/rep_barrier/56f910c90ff748ce8810d7dfdf2b6094 as hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/data/hbase/meta/1588230740/rep_barrier/56f910c90ff748ce8810d7dfdf2b6094 2023-10-04 02:02:25,164 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 56f910c90ff748ce8810d7dfdf2b6094 2023-10-04 02:02:25,164 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HStore(1080): Added hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/data/hbase/meta/1588230740/rep_barrier/56f910c90ff748ce8810d7dfdf2b6094, entries=13, sequenceid=131, filesize=6.4 K 2023-10-04 02:02:25,165 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/data/hbase/meta/1588230740/.tmp/table/b9118c1e7d1942d9bdb8ba0fec10bad6 as hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/data/hbase/meta/1588230740/table/b9118c1e7d1942d9bdb8ba0fec10bad6 2023-10-04 02:02:25,169 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for b9118c1e7d1942d9bdb8ba0fec10bad6 2023-10-04 02:02:25,169 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HStore(1080): Added hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/data/hbase/meta/1588230740/table/b9118c1e7d1942d9bdb8ba0fec10bad6, entries=24, sequenceid=131, filesize=6.9 K 2023-10-04 02:02:25,170 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~45.93 KB/47028, heapSize ~71.88 KB/73600, currentSize=0 B/0 for 1588230740 in 123ms, sequenceid=131, compaction requested=false 2023-10-04 02:02:25,180 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/data/hbase/meta/1588230740/recovered.edits/134.seqid, newMaxSeqId=134, maxSeqId=1 2023-10-04 02:02:25,181 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-10-04 02:02:25,181 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-10-04 02:02:25,181 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-10-04 02:02:25,181 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-10-04 02:02:25,181 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-10-04 02:02:25,186 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): regionserver:39045-0x1010f1b55330002, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-10-04 02:02:25,186 INFO [RS:1;jenkins-hbase9:39045] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase9.apache.org,39045,1696384805392; zookeeper connection closed. 2023-10-04 02:02:25,186 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): regionserver:39045-0x1010f1b55330002, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-10-04 02:02:25,186 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@415d4e13] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@415d4e13 2023-10-04 02:02:25,247 INFO [RS:2;jenkins-hbase9:35175] regionserver.HRegionServer(1170): stopping server jenkins-hbase9.apache.org,35175,1696384805436; all regions closed. 2023-10-04 02:02:25,247 INFO [RS:0;jenkins-hbase9:44303] regionserver.HRegionServer(1170): stopping server jenkins-hbase9.apache.org,44303,1696384805319; all regions closed. 2023-10-04 02:02:25,259 DEBUG [RS:0;jenkins-hbase9:44303] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/oldWALs 2023-10-04 02:02:25,259 DEBUG [RS:2;jenkins-hbase9:35175] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/oldWALs 2023-10-04 02:02:25,259 INFO [RS:0;jenkins-hbase9:44303] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase9.apache.org%2C44303%2C1696384805319.meta:.meta(num 1696384807384) 2023-10-04 02:02:25,259 INFO [RS:2;jenkins-hbase9:35175] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase9.apache.org%2C35175%2C1696384805436:(num 1696384807229) 2023-10-04 02:02:25,259 DEBUG [RS:2;jenkins-hbase9:35175] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-04 02:02:25,259 INFO [RS:2;jenkins-hbase9:35175] regionserver.LeaseManager(133): Closed leases 2023-10-04 02:02:25,259 INFO [RS:2;jenkins-hbase9:35175] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase9:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-10-04 02:02:25,260 INFO [RS:2;jenkins-hbase9:35175] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-10-04 02:02:25,260 INFO [regionserver/jenkins-hbase9:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-10-04 02:02:25,260 INFO [RS:2;jenkins-hbase9:35175] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-10-04 02:02:25,260 INFO [RS:2;jenkins-hbase9:35175] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-10-04 02:02:25,261 INFO [RS:2;jenkins-hbase9:35175] ipc.NettyRpcServer(158): Stopping server on /172.31.2.10:35175 2023-10-04 02:02:25,263 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): master:39651-0x1010f1b55330000, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-10-04 02:02:25,263 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): regionserver:44303-0x1010f1b55330001, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase9.apache.org,35175,1696384805436 2023-10-04 02:02:25,263 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): regionserver:35175-0x1010f1b55330003, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase9.apache.org,35175,1696384805436 2023-10-04 02:02:25,264 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase9.apache.org,35175,1696384805436] 2023-10-04 02:02:25,264 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase9.apache.org,35175,1696384805436; numProcessing=2 2023-10-04 02:02:25,265 DEBUG [RS:0;jenkins-hbase9:44303] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/oldWALs 2023-10-04 02:02:25,265 INFO [RS:0;jenkins-hbase9:44303] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase9.apache.org%2C44303%2C1696384805319:(num 1696384807229) 2023-10-04 02:02:25,265 DEBUG [RS:0;jenkins-hbase9:44303] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-04 02:02:25,265 INFO [RS:0;jenkins-hbase9:44303] regionserver.LeaseManager(133): Closed leases 2023-10-04 02:02:25,265 INFO [RS:0;jenkins-hbase9:44303] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase9:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-10-04 02:02:25,266 INFO [regionserver/jenkins-hbase9:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-10-04 02:02:25,266 INFO [RS:0;jenkins-hbase9:44303] ipc.NettyRpcServer(158): Stopping server on /172.31.2.10:44303 2023-10-04 02:02:25,267 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase9.apache.org,35175,1696384805436 already deleted, retry=false 2023-10-04 02:02:25,267 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase9.apache.org,35175,1696384805436 expired; onlineServers=1 2023-10-04 02:02:25,268 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): regionserver:44303-0x1010f1b55330001, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase9.apache.org,44303,1696384805319 2023-10-04 02:02:25,268 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): master:39651-0x1010f1b55330000, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-10-04 02:02:25,269 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase9.apache.org,44303,1696384805319] 2023-10-04 02:02:25,269 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase9.apache.org,44303,1696384805319; numProcessing=3 2023-10-04 02:02:25,270 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase9.apache.org,44303,1696384805319 already deleted, retry=false 2023-10-04 02:02:25,270 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase9.apache.org,44303,1696384805319 expired; onlineServers=0 2023-10-04 02:02:25,270 INFO [RegionServerTracker-0] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase9.apache.org,39651,1696384803959' ***** 2023-10-04 02:02:25,270 INFO [RegionServerTracker-0] regionserver.HRegionServer(2311): STOPPED: Cluster shutdown set; onlineServer=0 2023-10-04 02:02:25,270 DEBUG [M:0;jenkins-hbase9:39651] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@586024fd, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase9.apache.org/172.31.2.10:0 2023-10-04 02:02:25,270 INFO [M:0;jenkins-hbase9:39651] regionserver.HRegionServer(1144): stopping server jenkins-hbase9.apache.org,39651,1696384803959 2023-10-04 02:02:25,270 INFO [M:0;jenkins-hbase9:39651] regionserver.HRegionServer(1170): stopping server jenkins-hbase9.apache.org,39651,1696384803959; all regions closed. 2023-10-04 02:02:25,270 DEBUG [M:0;jenkins-hbase9:39651] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-04 02:02:25,270 DEBUG [M:0;jenkins-hbase9:39651] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-10-04 02:02:25,270 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-10-04 02:02:25,270 DEBUG [M:0;jenkins-hbase9:39651] cleaner.HFileCleaner(317): Stopping file delete threads 2023-10-04 02:02:25,270 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster-HFileCleaner.large.0-1696384806831] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase9:0:becomeActiveMaster-HFileCleaner.large.0-1696384806831,5,FailOnTimeoutGroup] 2023-10-04 02:02:25,270 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster-HFileCleaner.small.0-1696384806832] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase9:0:becomeActiveMaster-HFileCleaner.small.0-1696384806832,5,FailOnTimeoutGroup] 2023-10-04 02:02:25,271 INFO [M:0;jenkins-hbase9:39651] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-10-04 02:02:25,271 INFO [M:0;jenkins-hbase9:39651] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-10-04 02:02:25,271 INFO [M:0;jenkins-hbase9:39651] hbase.ChoreService(369): Chore service for: master/jenkins-hbase9:0 had [] on shutdown 2023-10-04 02:02:25,271 DEBUG [M:0;jenkins-hbase9:39651] master.HMaster(1512): Stopping service threads 2023-10-04 02:02:25,271 INFO [M:0;jenkins-hbase9:39651] procedure2.RemoteProcedureDispatcher(119): Stopping procedure remote dispatcher 2023-10-04 02:02:25,271 ERROR [M:0;jenkins-hbase9:39651] procedure2.ProcedureExecutor(652): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] Thread[HFileArchiver-14,5,PEWorkerGroup] Thread[HFileArchiver-15,5,PEWorkerGroup] 2023-10-04 02:02:25,272 INFO [M:0;jenkins-hbase9:39651] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-10-04 02:02:25,272 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-10-04 02:02:25,272 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): master:39651-0x1010f1b55330000, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-10-04 02:02:25,272 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): master:39651-0x1010f1b55330000, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-10-04 02:02:25,272 DEBUG [M:0;jenkins-hbase9:39651] zookeeper.ZKUtil(398): master:39651-0x1010f1b55330000, quorum=127.0.0.1:60027, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-10-04 02:02:25,272 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:39651-0x1010f1b55330000, quorum=127.0.0.1:60027, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-10-04 02:02:25,272 WARN [M:0;jenkins-hbase9:39651] master.ActiveMasterManager(326): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-10-04 02:02:25,272 INFO [M:0;jenkins-hbase9:39651] assignment.AssignmentManager(315): Stopping assignment manager 2023-10-04 02:02:25,273 INFO [M:0;jenkins-hbase9:39651] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-10-04 02:02:25,273 DEBUG [M:0;jenkins-hbase9:39651] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-10-04 02:02:25,273 INFO [M:0;jenkins-hbase9:39651] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-10-04 02:02:25,273 DEBUG [M:0;jenkins-hbase9:39651] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-10-04 02:02:25,273 DEBUG [M:0;jenkins-hbase9:39651] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-10-04 02:02:25,273 DEBUG [M:0;jenkins-hbase9:39651] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-10-04 02:02:25,273 INFO [M:0;jenkins-hbase9:39651] regionserver.HRegion(2745): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=375.87 KB heapSize=452.10 KB 2023-10-04 02:02:25,290 INFO [M:0;jenkins-hbase9:39651] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=375.87 KB at sequenceid=899 (bloomFilter=true), to=hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/650d61a0a40e48cc87f7257b5b9c59a8 2023-10-04 02:02:25,294 INFO [M:0;jenkins-hbase9:39651] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 650d61a0a40e48cc87f7257b5b9c59a8 2023-10-04 02:02:25,294 DEBUG [M:0;jenkins-hbase9:39651] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/650d61a0a40e48cc87f7257b5b9c59a8 as hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/650d61a0a40e48cc87f7257b5b9c59a8 2023-10-04 02:02:25,298 INFO [M:0;jenkins-hbase9:39651] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 650d61a0a40e48cc87f7257b5b9c59a8 2023-10-04 02:02:25,298 INFO [M:0;jenkins-hbase9:39651] regionserver.HStore(1080): Added hdfs://localhost:38449/user/jenkins/test-data/8e401254-77d0-3dcf-cd27-725a3f212f51/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/650d61a0a40e48cc87f7257b5b9c59a8, entries=119, sequenceid=899, filesize=28.7 K 2023-10-04 02:02:25,299 INFO [M:0;jenkins-hbase9:39651] regionserver.HRegion(2948): Finished flush of dataSize ~375.87 KB/384889, heapSize ~452.09 KB/462936, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 26ms, sequenceid=899, compaction requested=false 2023-10-04 02:02:25,301 INFO [M:0;jenkins-hbase9:39651] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-10-04 02:02:25,301 DEBUG [M:0;jenkins-hbase9:39651] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-10-04 02:02:25,304 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-10-04 02:02:25,304 INFO [M:0;jenkins-hbase9:39651] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-10-04 02:02:25,305 INFO [M:0;jenkins-hbase9:39651] ipc.NettyRpcServer(158): Stopping server on /172.31.2.10:39651 2023-10-04 02:02:25,306 DEBUG [M:0;jenkins-hbase9:39651] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase9.apache.org,39651,1696384803959 already deleted, retry=false 2023-10-04 02:02:25,365 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): regionserver:35175-0x1010f1b55330003, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-10-04 02:02:25,365 INFO [RS:2;jenkins-hbase9:35175] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase9.apache.org,35175,1696384805436; zookeeper connection closed. 2023-10-04 02:02:25,365 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): regionserver:35175-0x1010f1b55330003, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-10-04 02:02:25,365 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@15986d48] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@15986d48 2023-10-04 02:02:25,465 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): master:39651-0x1010f1b55330000, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-10-04 02:02:25,465 INFO [M:0;jenkins-hbase9:39651] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase9.apache.org,39651,1696384803959; zookeeper connection closed. 2023-10-04 02:02:25,465 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): master:39651-0x1010f1b55330000, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-10-04 02:02:25,565 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): regionserver:44303-0x1010f1b55330001, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-10-04 02:02:25,565 INFO [RS:0;jenkins-hbase9:44303] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase9.apache.org,44303,1696384805319; zookeeper connection closed. 2023-10-04 02:02:25,565 DEBUG [Listener at localhost/41661-EventThread] zookeeper.ZKWatcher(600): regionserver:44303-0x1010f1b55330001, quorum=127.0.0.1:60027, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-10-04 02:02:25,565 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@c8d45cd] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@c8d45cd 2023-10-04 02:02:25,566 INFO [Listener at jenkins-hbase9.apache.org/33899] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 3 regionserver(s) complete 2023-10-04 02:02:25,566 WARN [Listener at jenkins-hbase9.apache.org/33899] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-10-04 02:02:25,568 INFO [Listener at jenkins-hbase9.apache.org/33899] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-10-04 02:02:25,671 WARN [BP-769032513-172.31.2.10-1696384800366 heartbeating to localhost/127.0.0.1:38449] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-10-04 02:02:25,671 WARN [BP-769032513-172.31.2.10-1696384800366 heartbeating to localhost/127.0.0.1:38449] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-769032513-172.31.2.10-1696384800366 (Datanode Uuid 34efd62f-e667-4310-8896-4088ac0f23f5) service to localhost/127.0.0.1:38449 2023-10-04 02:02:25,673 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/757a468a-9656-cc80-ec19-d6f68f36be5a/cluster_99689198-45bf-8fbc-bd30-def9ae3ef530/dfs/data/data5/current/BP-769032513-172.31.2.10-1696384800366] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-10-04 02:02:25,673 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/757a468a-9656-cc80-ec19-d6f68f36be5a/cluster_99689198-45bf-8fbc-bd30-def9ae3ef530/dfs/data/data6/current/BP-769032513-172.31.2.10-1696384800366] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-10-04 02:02:25,674 WARN [Listener at jenkins-hbase9.apache.org/33899] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-10-04 02:02:25,676 INFO [Listener at jenkins-hbase9.apache.org/33899] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-10-04 02:02:25,779 WARN [BP-769032513-172.31.2.10-1696384800366 heartbeating to localhost/127.0.0.1:38449] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-10-04 02:02:25,779 WARN [BP-769032513-172.31.2.10-1696384800366 heartbeating to localhost/127.0.0.1:38449] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-769032513-172.31.2.10-1696384800366 (Datanode Uuid 3d7b3d74-f4e4-4baa-b482-70929f3fcd65) service to localhost/127.0.0.1:38449 2023-10-04 02:02:25,780 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/757a468a-9656-cc80-ec19-d6f68f36be5a/cluster_99689198-45bf-8fbc-bd30-def9ae3ef530/dfs/data/data3/current/BP-769032513-172.31.2.10-1696384800366] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-10-04 02:02:25,780 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/757a468a-9656-cc80-ec19-d6f68f36be5a/cluster_99689198-45bf-8fbc-bd30-def9ae3ef530/dfs/data/data4/current/BP-769032513-172.31.2.10-1696384800366] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-10-04 02:02:25,780 WARN [Listener at jenkins-hbase9.apache.org/33899] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-10-04 02:02:25,784 INFO [Listener at jenkins-hbase9.apache.org/33899] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-10-04 02:02:25,886 WARN [BP-769032513-172.31.2.10-1696384800366 heartbeating to localhost/127.0.0.1:38449] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-10-04 02:02:25,886 WARN [BP-769032513-172.31.2.10-1696384800366 heartbeating to localhost/127.0.0.1:38449] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-769032513-172.31.2.10-1696384800366 (Datanode Uuid edb287ae-283f-4776-9175-a8f1c8f78f9e) service to localhost/127.0.0.1:38449 2023-10-04 02:02:25,887 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/757a468a-9656-cc80-ec19-d6f68f36be5a/cluster_99689198-45bf-8fbc-bd30-def9ae3ef530/dfs/data/data1/current/BP-769032513-172.31.2.10-1696384800366] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-10-04 02:02:25,887 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/757a468a-9656-cc80-ec19-d6f68f36be5a/cluster_99689198-45bf-8fbc-bd30-def9ae3ef530/dfs/data/data2/current/BP-769032513-172.31.2.10-1696384800366] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-10-04 02:02:25,907 INFO [Listener at jenkins-hbase9.apache.org/33899] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-10-04 02:02:26,032 INFO [Listener at jenkins-hbase9.apache.org/33899] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-10-04 02:02:26,108 INFO [Listener at jenkins-hbase9.apache.org/33899] hbase.HBaseTestingUtility(1293): Minicluster is down