2023-07-15 03:10:43,497 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.snapshot.TestExportSnapshot timeout: 13 mins 2023-07-15 03:10:43,739 DEBUG [main] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6bc8dbaf-aac0-03cf-90d4-be6af049f709 2023-07-15 03:10:43,739 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.snapshot.TestSecureExportSnapshot timeout: 13 mins 2023-07-15 03:10:43,794 WARN [Time-limited test] util.NativeCodeLoader(62): Unable to load native-hadoop library for your platform... using builtin-java classes where applicable 2023-07-15 03:10:44,126 INFO [Time-limited test] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=3, rsPorts=, rsClass=null, numDataNodes=3, dataNodeHosts=null, numZkServers=1, createRootDir=false, createWALDir=false} 2023-07-15 03:10:44,126 INFO [Time-limited test] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6bc8dbaf-aac0-03cf-90d4-be6af049f709/cluster_2988be05-db52-9f51-9e27-39bd2563d627, deleteOnExit=true 2023-07-15 03:10:44,127 INFO [Time-limited test] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-07-15 03:10:44,127 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6bc8dbaf-aac0-03cf-90d4-be6af049f709/test.cache.data in system properties and HBase conf 2023-07-15 03:10:44,128 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6bc8dbaf-aac0-03cf-90d4-be6af049f709/hadoop.tmp.dir in system properties and HBase conf 2023-07-15 03:10:44,129 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6bc8dbaf-aac0-03cf-90d4-be6af049f709/hadoop.log.dir in system properties and HBase conf 2023-07-15 03:10:44,129 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6bc8dbaf-aac0-03cf-90d4-be6af049f709/mapreduce.cluster.local.dir in system properties and HBase conf 2023-07-15 03:10:44,130 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6bc8dbaf-aac0-03cf-90d4-be6af049f709/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-07-15 03:10:44,130 INFO [Time-limited test] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-07-15 03:10:44,549 DEBUG [Time-limited test] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-07-15 03:10:44,556 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6bc8dbaf-aac0-03cf-90d4-be6af049f709/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-07-15 03:10:44,556 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6bc8dbaf-aac0-03cf-90d4-be6af049f709/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-07-15 03:10:44,557 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6bc8dbaf-aac0-03cf-90d4-be6af049f709/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-07-15 03:10:44,557 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6bc8dbaf-aac0-03cf-90d4-be6af049f709/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-07-15 03:10:44,557 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6bc8dbaf-aac0-03cf-90d4-be6af049f709/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-07-15 03:10:44,558 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6bc8dbaf-aac0-03cf-90d4-be6af049f709/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-07-15 03:10:44,558 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6bc8dbaf-aac0-03cf-90d4-be6af049f709/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-07-15 03:10:44,558 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6bc8dbaf-aac0-03cf-90d4-be6af049f709/dfs.journalnode.edits.dir in system properties and HBase conf 2023-07-15 03:10:44,558 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6bc8dbaf-aac0-03cf-90d4-be6af049f709/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-07-15 03:10:44,559 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6bc8dbaf-aac0-03cf-90d4-be6af049f709/nfs.dump.dir in system properties and HBase conf 2023-07-15 03:10:44,559 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6bc8dbaf-aac0-03cf-90d4-be6af049f709/java.io.tmpdir in system properties and HBase conf 2023-07-15 03:10:44,559 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6bc8dbaf-aac0-03cf-90d4-be6af049f709/dfs.journalnode.edits.dir in system properties and HBase conf 2023-07-15 03:10:44,559 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6bc8dbaf-aac0-03cf-90d4-be6af049f709/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-07-15 03:10:44,560 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6bc8dbaf-aac0-03cf-90d4-be6af049f709/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-07-15 03:10:45,209 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-07-15 03:10:45,215 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-07-15 03:10:45,584 WARN [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-namenode.properties,hadoop-metrics2.properties 2023-07-15 03:10:45,810 INFO [Time-limited test] log.Slf4jLog(67): Logging to org.slf4j.impl.Reload4jLoggerAdapter(org.mortbay.log) via org.mortbay.log.Slf4jLog 2023-07-15 03:10:45,837 WARN [Time-limited test] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-15 03:10:45,893 INFO [Time-limited test] log.Slf4jLog(67): jetty-6.1.26 2023-07-15 03:10:45,943 INFO [Time-limited test] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6bc8dbaf-aac0-03cf-90d4-be6af049f709/java.io.tmpdir/Jetty_localhost_37959_hdfs____8to50j/webapp 2023-07-15 03:10:46,143 INFO [Time-limited test] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:37959 2023-07-15 03:10:46,215 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-07-15 03:10:46,216 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-07-15 03:10:46,810 WARN [Listener at localhost/37513] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-15 03:10:46,916 WARN [Listener at localhost/37513] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-07-15 03:10:46,945 WARN [Listener at localhost/37513] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-15 03:10:46,954 INFO [Listener at localhost/37513] log.Slf4jLog(67): jetty-6.1.26 2023-07-15 03:10:46,963 INFO [Listener at localhost/37513] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6bc8dbaf-aac0-03cf-90d4-be6af049f709/java.io.tmpdir/Jetty_localhost_42607_datanode____.u6kavu/webapp 2023-07-15 03:10:47,077 INFO [Listener at localhost/37513] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:42607 2023-07-15 03:10:47,621 WARN [Listener at localhost/35477] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-15 03:10:47,669 WARN [Listener at localhost/35477] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-07-15 03:10:47,674 WARN [Listener at localhost/35477] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-15 03:10:47,677 INFO [Listener at localhost/35477] log.Slf4jLog(67): jetty-6.1.26 2023-07-15 03:10:47,692 INFO [Listener at localhost/35477] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6bc8dbaf-aac0-03cf-90d4-be6af049f709/java.io.tmpdir/Jetty_localhost_43377_datanode____.tvy1lx/webapp 2023-07-15 03:10:47,839 INFO [Listener at localhost/35477] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:43377 2023-07-15 03:10:47,866 WARN [Listener at localhost/33299] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-15 03:10:47,912 WARN [Listener at localhost/33299] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-07-15 03:10:47,918 WARN [Listener at localhost/33299] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-15 03:10:47,921 INFO [Listener at localhost/33299] log.Slf4jLog(67): jetty-6.1.26 2023-07-15 03:10:47,930 INFO [Listener at localhost/33299] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6bc8dbaf-aac0-03cf-90d4-be6af049f709/java.io.tmpdir/Jetty_localhost_39711_datanode____51s1y0/webapp 2023-07-15 03:10:48,091 INFO [Listener at localhost/33299] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:39711 2023-07-15 03:10:48,131 WARN [Listener at localhost/46707] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-15 03:10:48,431 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x50f548460a835d5f: Processing first storage report for DS-f6e80cc3-9793-4176-9663-be8015e10c8f from datanode 328e933e-deae-49cc-862f-2c4c9c703b43 2023-07-15 03:10:48,433 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x50f548460a835d5f: from storage DS-f6e80cc3-9793-4176-9663-be8015e10c8f node DatanodeRegistration(127.0.0.1:42765, datanodeUuid=328e933e-deae-49cc-862f-2c4c9c703b43, infoPort=36003, infoSecurePort=0, ipcPort=35477, storageInfo=lv=-57;cid=testClusterID;nsid=2028004654;c=1689390645349), blocks: 0, hasStaleStorage: true, processing time: 2 msecs, invalidatedBlocks: 0 2023-07-15 03:10:48,433 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x31175bcc874e0983: Processing first storage report for DS-e7e1fbba-a873-442a-85a1-984e8658a7e2 from datanode e90030db-cf7a-48c2-b7c2-61e8177567c9 2023-07-15 03:10:48,434 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x31175bcc874e0983: from storage DS-e7e1fbba-a873-442a-85a1-984e8658a7e2 node DatanodeRegistration(127.0.0.1:43577, datanodeUuid=e90030db-cf7a-48c2-b7c2-61e8177567c9, infoPort=34401, infoSecurePort=0, ipcPort=46707, storageInfo=lv=-57;cid=testClusterID;nsid=2028004654;c=1689390645349), blocks: 0, hasStaleStorage: true, processing time: 1 msecs, invalidatedBlocks: 0 2023-07-15 03:10:48,434 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xa74dfac1371588a1: Processing first storage report for DS-3de7949b-6285-495b-b53d-e7fd8450273b from datanode afacc892-def3-4fe1-9973-4ba044fc3825 2023-07-15 03:10:48,434 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xa74dfac1371588a1: from storage DS-3de7949b-6285-495b-b53d-e7fd8450273b node DatanodeRegistration(127.0.0.1:40343, datanodeUuid=afacc892-def3-4fe1-9973-4ba044fc3825, infoPort=34369, infoSecurePort=0, ipcPort=33299, storageInfo=lv=-57;cid=testClusterID;nsid=2028004654;c=1689390645349), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-15 03:10:48,434 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x50f548460a835d5f: Processing first storage report for DS-b33034a6-f54d-456e-b1f6-64019b47cc2e from datanode 328e933e-deae-49cc-862f-2c4c9c703b43 2023-07-15 03:10:48,434 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x50f548460a835d5f: from storage DS-b33034a6-f54d-456e-b1f6-64019b47cc2e node DatanodeRegistration(127.0.0.1:42765, datanodeUuid=328e933e-deae-49cc-862f-2c4c9c703b43, infoPort=36003, infoSecurePort=0, ipcPort=35477, storageInfo=lv=-57;cid=testClusterID;nsid=2028004654;c=1689390645349), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-15 03:10:48,434 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x31175bcc874e0983: Processing first storage report for DS-d2b910bf-8c01-4a27-83d7-a2c55ed82edf from datanode e90030db-cf7a-48c2-b7c2-61e8177567c9 2023-07-15 03:10:48,434 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x31175bcc874e0983: from storage DS-d2b910bf-8c01-4a27-83d7-a2c55ed82edf node DatanodeRegistration(127.0.0.1:43577, datanodeUuid=e90030db-cf7a-48c2-b7c2-61e8177567c9, infoPort=34401, infoSecurePort=0, ipcPort=46707, storageInfo=lv=-57;cid=testClusterID;nsid=2028004654;c=1689390645349), blocks: 0, hasStaleStorage: false, processing time: 1 msecs, invalidatedBlocks: 0 2023-07-15 03:10:48,435 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xa74dfac1371588a1: Processing first storage report for DS-9166b9bf-060a-4830-80af-f6ece648e007 from datanode afacc892-def3-4fe1-9973-4ba044fc3825 2023-07-15 03:10:48,435 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xa74dfac1371588a1: from storage DS-9166b9bf-060a-4830-80af-f6ece648e007 node DatanodeRegistration(127.0.0.1:40343, datanodeUuid=afacc892-def3-4fe1-9973-4ba044fc3825, infoPort=34369, infoSecurePort=0, ipcPort=33299, storageInfo=lv=-57;cid=testClusterID;nsid=2028004654;c=1689390645349), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-15 03:10:48,740 DEBUG [Listener at localhost/46707] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6bc8dbaf-aac0-03cf-90d4-be6af049f709 2023-07-15 03:10:48,825 INFO [Listener at localhost/46707] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6bc8dbaf-aac0-03cf-90d4-be6af049f709/cluster_2988be05-db52-9f51-9e27-39bd2563d627/zookeeper_0, clientPort=62663, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6bc8dbaf-aac0-03cf-90d4-be6af049f709/cluster_2988be05-db52-9f51-9e27-39bd2563d627/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6bc8dbaf-aac0-03cf-90d4-be6af049f709/cluster_2988be05-db52-9f51-9e27-39bd2563d627/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-07-15 03:10:48,846 INFO [Listener at localhost/46707] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=62663 2023-07-15 03:10:48,856 INFO [Listener at localhost/46707] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-15 03:10:48,859 INFO [Listener at localhost/46707] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-15 03:10:49,576 INFO [Listener at localhost/46707] util.FSUtils(471): Created version file at hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280 with version=8 2023-07-15 03:10:49,576 INFO [Listener at localhost/46707] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/hbase-staging 2023-07-15 03:10:49,967 INFO [Listener at localhost/46707] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl 2023-07-15 03:10:50,515 INFO [Listener at localhost/46707] client.ConnectionUtils(127): master/jenkins-hbase4:0 server-side Connection retries=45 2023-07-15 03:10:50,549 INFO [Listener at localhost/46707] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-15 03:10:50,549 INFO [Listener at localhost/46707] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-15 03:10:50,549 INFO [Listener at localhost/46707] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-15 03:10:50,549 INFO [Listener at localhost/46707] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-15 03:10:50,550 INFO [Listener at localhost/46707] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-15 03:10:50,711 INFO [Listener at localhost/46707] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-07-15 03:10:50,790 DEBUG [Listener at localhost/46707] util.ClassSize(228): Using Unsafe to estimate memory layout 2023-07-15 03:10:50,893 INFO [Listener at localhost/46707] ipc.NettyRpcServer(120): Bind to /172.31.14.131:41669 2023-07-15 03:10:50,910 INFO [Listener at localhost/46707] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-15 03:10:50,913 INFO [Listener at localhost/46707] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-15 03:10:50,938 INFO [Listener at localhost/46707] zookeeper.RecoverableZooKeeper(93): Process identifier=master:41669 connecting to ZooKeeper ensemble=127.0.0.1:62663 2023-07-15 03:10:51,019 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): master:416690x0, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-15 03:10:51,024 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): master:41669-0x10166f610e80000 connected 2023-07-15 03:10:51,092 DEBUG [Listener at localhost/46707] zookeeper.ZKUtil(164): master:41669-0x10166f610e80000, quorum=127.0.0.1:62663, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-15 03:10:51,093 DEBUG [Listener at localhost/46707] zookeeper.ZKUtil(164): master:41669-0x10166f610e80000, quorum=127.0.0.1:62663, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-15 03:10:51,109 DEBUG [Listener at localhost/46707] zookeeper.ZKUtil(164): master:41669-0x10166f610e80000, quorum=127.0.0.1:62663, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-07-15 03:10:51,130 DEBUG [Listener at localhost/46707] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=41669 2023-07-15 03:10:51,130 DEBUG [Listener at localhost/46707] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=41669 2023-07-15 03:10:51,134 DEBUG [Listener at localhost/46707] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=41669 2023-07-15 03:10:51,139 DEBUG [Listener at localhost/46707] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=41669 2023-07-15 03:10:51,142 DEBUG [Listener at localhost/46707] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=41669 2023-07-15 03:10:51,151 INFO [Listener at localhost/46707] master.HMaster(444): hbase.rootdir=hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280, hbase.cluster.distributed=false 2023-07-15 03:10:51,226 INFO [Listener at localhost/46707] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-07-15 03:10:51,227 INFO [Listener at localhost/46707] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-15 03:10:51,227 INFO [Listener at localhost/46707] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-15 03:10:51,227 INFO [Listener at localhost/46707] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-15 03:10:51,228 INFO [Listener at localhost/46707] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-15 03:10:51,228 INFO [Listener at localhost/46707] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-15 03:10:51,235 INFO [Listener at localhost/46707] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-07-15 03:10:51,240 INFO [Listener at localhost/46707] ipc.NettyRpcServer(120): Bind to /172.31.14.131:43199 2023-07-15 03:10:51,243 INFO [Listener at localhost/46707] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-07-15 03:10:51,250 DEBUG [Listener at localhost/46707] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-07-15 03:10:51,252 INFO [Listener at localhost/46707] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-15 03:10:51,254 INFO [Listener at localhost/46707] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-15 03:10:51,256 INFO [Listener at localhost/46707] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:43199 connecting to ZooKeeper ensemble=127.0.0.1:62663 2023-07-15 03:10:51,262 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): regionserver:431990x0, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-15 03:10:51,263 DEBUG [Listener at localhost/46707] zookeeper.ZKUtil(164): regionserver:431990x0, quorum=127.0.0.1:62663, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-15 03:10:51,267 DEBUG [Listener at localhost/46707] zookeeper.ZKUtil(164): regionserver:431990x0, quorum=127.0.0.1:62663, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-15 03:10:51,268 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:43199-0x10166f610e80001 connected 2023-07-15 03:10:51,269 DEBUG [Listener at localhost/46707] zookeeper.ZKUtil(164): regionserver:43199-0x10166f610e80001, quorum=127.0.0.1:62663, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-07-15 03:10:51,271 DEBUG [Listener at localhost/46707] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=43199 2023-07-15 03:10:51,271 DEBUG [Listener at localhost/46707] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=43199 2023-07-15 03:10:51,272 DEBUG [Listener at localhost/46707] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=43199 2023-07-15 03:10:51,280 DEBUG [Listener at localhost/46707] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=43199 2023-07-15 03:10:51,281 DEBUG [Listener at localhost/46707] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=43199 2023-07-15 03:10:51,300 INFO [Listener at localhost/46707] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-07-15 03:10:51,300 INFO [Listener at localhost/46707] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-15 03:10:51,300 INFO [Listener at localhost/46707] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-15 03:10:51,301 INFO [Listener at localhost/46707] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-15 03:10:51,315 INFO [Listener at localhost/46707] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-15 03:10:51,315 INFO [Listener at localhost/46707] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-15 03:10:51,315 INFO [Listener at localhost/46707] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-07-15 03:10:51,317 INFO [Listener at localhost/46707] ipc.NettyRpcServer(120): Bind to /172.31.14.131:39199 2023-07-15 03:10:51,318 INFO [Listener at localhost/46707] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-07-15 03:10:51,319 DEBUG [Listener at localhost/46707] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-07-15 03:10:51,320 INFO [Listener at localhost/46707] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-15 03:10:51,323 INFO [Listener at localhost/46707] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-15 03:10:51,326 INFO [Listener at localhost/46707] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:39199 connecting to ZooKeeper ensemble=127.0.0.1:62663 2023-07-15 03:10:51,333 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): regionserver:391990x0, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-15 03:10:51,335 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:39199-0x10166f610e80002 connected 2023-07-15 03:10:51,335 DEBUG [Listener at localhost/46707] zookeeper.ZKUtil(164): regionserver:39199-0x10166f610e80002, quorum=127.0.0.1:62663, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-15 03:10:51,336 DEBUG [Listener at localhost/46707] zookeeper.ZKUtil(164): regionserver:39199-0x10166f610e80002, quorum=127.0.0.1:62663, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-15 03:10:51,337 DEBUG [Listener at localhost/46707] zookeeper.ZKUtil(164): regionserver:39199-0x10166f610e80002, quorum=127.0.0.1:62663, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-07-15 03:10:51,337 DEBUG [Listener at localhost/46707] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=39199 2023-07-15 03:10:51,337 DEBUG [Listener at localhost/46707] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=39199 2023-07-15 03:10:51,338 DEBUG [Listener at localhost/46707] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=39199 2023-07-15 03:10:51,342 DEBUG [Listener at localhost/46707] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=39199 2023-07-15 03:10:51,343 DEBUG [Listener at localhost/46707] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=39199 2023-07-15 03:10:51,356 INFO [Listener at localhost/46707] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-07-15 03:10:51,356 INFO [Listener at localhost/46707] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-15 03:10:51,357 INFO [Listener at localhost/46707] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-15 03:10:51,357 INFO [Listener at localhost/46707] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-15 03:10:51,357 INFO [Listener at localhost/46707] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-15 03:10:51,357 INFO [Listener at localhost/46707] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-15 03:10:51,357 INFO [Listener at localhost/46707] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-07-15 03:10:51,359 INFO [Listener at localhost/46707] ipc.NettyRpcServer(120): Bind to /172.31.14.131:38367 2023-07-15 03:10:51,359 INFO [Listener at localhost/46707] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-07-15 03:10:51,362 DEBUG [Listener at localhost/46707] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-07-15 03:10:51,364 INFO [Listener at localhost/46707] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-15 03:10:51,366 INFO [Listener at localhost/46707] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-15 03:10:51,368 INFO [Listener at localhost/46707] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:38367 connecting to ZooKeeper ensemble=127.0.0.1:62663 2023-07-15 03:10:51,372 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): regionserver:383670x0, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-15 03:10:51,373 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:38367-0x10166f610e80003 connected 2023-07-15 03:10:51,374 DEBUG [Listener at localhost/46707] zookeeper.ZKUtil(164): regionserver:38367-0x10166f610e80003, quorum=127.0.0.1:62663, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-15 03:10:51,375 DEBUG [Listener at localhost/46707] zookeeper.ZKUtil(164): regionserver:38367-0x10166f610e80003, quorum=127.0.0.1:62663, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-15 03:10:51,376 DEBUG [Listener at localhost/46707] zookeeper.ZKUtil(164): regionserver:38367-0x10166f610e80003, quorum=127.0.0.1:62663, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-07-15 03:10:51,383 DEBUG [Listener at localhost/46707] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=38367 2023-07-15 03:10:51,383 DEBUG [Listener at localhost/46707] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=38367 2023-07-15 03:10:51,385 DEBUG [Listener at localhost/46707] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=38367 2023-07-15 03:10:51,386 DEBUG [Listener at localhost/46707] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=38367 2023-07-15 03:10:51,388 DEBUG [Listener at localhost/46707] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=38367 2023-07-15 03:10:51,391 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2168): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase4.apache.org,41669,1689390649760 2023-07-15 03:10:51,401 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): master:41669-0x10166f610e80000, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-07-15 03:10:51,403 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:41669-0x10166f610e80000, quorum=127.0.0.1:62663, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase4.apache.org,41669,1689390649760 2023-07-15 03:10:51,424 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): master:41669-0x10166f610e80000, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-07-15 03:10:51,424 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): regionserver:38367-0x10166f610e80003, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-07-15 03:10:51,424 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): regionserver:43199-0x10166f610e80001, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-07-15 03:10:51,424 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): regionserver:39199-0x10166f610e80002, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-07-15 03:10:51,424 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): master:41669-0x10166f610e80000, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-15 03:10:51,426 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:41669-0x10166f610e80000, quorum=127.0.0.1:62663, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-07-15 03:10:51,429 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:41669-0x10166f610e80000, quorum=127.0.0.1:62663, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-07-15 03:10:51,429 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(227): Deleting ZNode for /hbase/backup-masters/jenkins-hbase4.apache.org,41669,1689390649760 from backup master directory 2023-07-15 03:10:51,433 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): master:41669-0x10166f610e80000, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase4.apache.org,41669,1689390649760 2023-07-15 03:10:51,433 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): master:41669-0x10166f610e80000, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-07-15 03:10:51,434 WARN [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-15 03:10:51,434 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(237): Registered as active master=jenkins-hbase4.apache.org,41669,1689390649760 2023-07-15 03:10:51,438 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating data MemStoreChunkPool with chunk size 2 MB, max count 352, initial count 0 2023-07-15 03:10:51,440 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating index MemStoreChunkPool with chunk size 204.80 KB, max count 391, initial count 0 2023-07-15 03:10:51,574 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] util.FSUtils(620): Created cluster ID file at hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/hbase.id with ID: 4e5b418d-43d2-4db9-b6b5-05ca1eaedf93 2023-07-15 03:10:51,631 INFO [master/jenkins-hbase4:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-15 03:10:51,656 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): master:41669-0x10166f610e80000, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-15 03:10:51,739 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x5719d199 to 127.0.0.1:62663 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-15 03:10:51,791 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4ff0cfc0, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-15 03:10:51,823 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-15 03:10:51,825 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-07-15 03:10:51,844 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(264): ClientProtocol::create wrong number of arguments, should be hadoop 3.2 or below 2023-07-15 03:10:51,845 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(270): ClientProtocol::create wrong number of arguments, should be hadoop 2.x 2023-07-15 03:10:51,847 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(279): can not find SHOULD_REPLICATE flag, should be hadoop 2.x java.lang.IllegalArgumentException: No enum constant org.apache.hadoop.fs.CreateFlag.SHOULD_REPLICATE at java.lang.Enum.valueOf(Enum.java:238) at org.apache.hadoop.fs.CreateFlag.valueOf(CreateFlag.java:63) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.loadShouldReplicateFlag(FanOutOneBlockAsyncDFSOutputHelper.java:277) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.(FanOutOneBlockAsyncDFSOutputHelper.java:304) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:139) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:855) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2193) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:528) at java.lang.Thread.run(Thread.java:750) 2023-07-15 03:10:51,851 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(243): No decryptEncryptedDataEncryptionKey method in DFSClient, should be hadoop version with HDFS-12396 java.lang.NoSuchMethodException: org.apache.hadoop.hdfs.DFSClient.decryptEncryptedDataEncryptionKey(org.apache.hadoop.fs.FileEncryptionInfo) at java.lang.Class.getDeclaredMethod(Class.java:2130) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelperWithoutHDFS12396(FanOutOneBlockAsyncDFSOutputSaslHelper.java:182) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelper(FanOutOneBlockAsyncDFSOutputSaslHelper.java:241) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.(FanOutOneBlockAsyncDFSOutputSaslHelper.java:252) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:140) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:855) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2193) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:528) at java.lang.Thread.run(Thread.java:750) 2023-07-15 03:10:51,853 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-15 03:10:51,889 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7693): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/MasterData/data/master/store-tmp 2023-07-15 03:10:51,949 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-15 03:10:51,949 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-07-15 03:10:51,949 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-15 03:10:51,949 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-15 03:10:51,949 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-07-15 03:10:51,949 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-15 03:10:51,950 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-15 03:10:51,950 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-07-15 03:10:51,957 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/MasterData/WALs/jenkins-hbase4.apache.org,41669,1689390649760 2023-07-15 03:10:51,985 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C41669%2C1689390649760, suffix=, logDir=hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/MasterData/WALs/jenkins-hbase4.apache.org,41669,1689390649760, archiveDir=hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/MasterData/oldWALs, maxLogs=10 2023-07-15 03:10:52,077 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:42765,DS-f6e80cc3-9793-4176-9663-be8015e10c8f,DISK] 2023-07-15 03:10:52,077 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:43577,DS-e7e1fbba-a873-442a-85a1-984e8658a7e2,DISK] 2023-07-15 03:10:52,079 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:40343,DS-3de7949b-6285-495b-b53d-e7fd8450273b,DISK] 2023-07-15 03:10:52,088 DEBUG [RS-EventLoopGroup-5-2] asyncfs.ProtobufDecoder(123): Hadoop 3.2 and below use unshaded protobuf. java.lang.ClassNotFoundException: org.apache.hadoop.thirdparty.protobuf.MessageLite at java.net.URLClassLoader.findClass(URLClassLoader.java:387) at java.lang.ClassLoader.loadClass(ClassLoader.java:418) at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:352) at java.lang.ClassLoader.loadClass(ClassLoader.java:351) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.io.asyncfs.ProtobufDecoder.(ProtobufDecoder.java:118) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.processWriteBlockResponse(FanOutOneBlockAsyncDFSOutputHelper.java:340) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$100(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$4.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:424) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:557) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.addListener(DefaultPromise.java:185) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.initialize(FanOutOneBlockAsyncDFSOutputHelper.java:418) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$300(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:476) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:471) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:583) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:559) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:636) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setSuccess0(DefaultPromise.java:625) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.trySuccess(DefaultPromise.java:105) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPromise.trySuccess(DefaultChannelPromise.java:84) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.fulfillConnectPromise(AbstractEpollChannel.java:653) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:691) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-07-15 03:10:52,170 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/MasterData/WALs/jenkins-hbase4.apache.org,41669,1689390649760/jenkins-hbase4.apache.org%2C41669%2C1689390649760.1689390651999 2023-07-15 03:10:52,171 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:43577,DS-e7e1fbba-a873-442a-85a1-984e8658a7e2,DISK], DatanodeInfoWithStorage[127.0.0.1:40343,DS-3de7949b-6285-495b-b53d-e7fd8450273b,DISK], DatanodeInfoWithStorage[127.0.0.1:42765,DS-f6e80cc3-9793-4176-9663-be8015e10c8f,DISK]] 2023-07-15 03:10:52,172 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7854): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-07-15 03:10:52,172 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-15 03:10:52,176 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7894): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-07-15 03:10:52,177 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7897): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-07-15 03:10:52,259 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-07-15 03:10:52,268 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-07-15 03:10:52,301 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-07-15 03:10:52,333 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-15 03:10:52,341 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-07-15 03:10:52,343 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-07-15 03:10:52,359 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1055): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-07-15 03:10:52,363 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-15 03:10:52,364 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1072): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64764587, jitterRate=-0.0349324494600296}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-15 03:10:52,365 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(965): Region open journal for 1595e783b53d99cd5eef43b6debb2682: 2023-07-15 03:10:52,366 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-07-15 03:10:52,388 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-07-15 03:10:52,388 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(562): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-07-15 03:10:52,393 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-07-15 03:10:52,395 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 1 msec 2023-07-15 03:10:52,437 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 41 msec 2023-07-15 03:10:52,437 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(96): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-07-15 03:10:52,468 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-07-15 03:10:52,475 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-07-15 03:10:52,508 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-07-15 03:10:52,514 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-07-15 03:10:52,517 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:41669-0x10166f610e80000, quorum=127.0.0.1:62663, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-07-15 03:10:52,523 INFO [master/jenkins-hbase4:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-07-15 03:10:52,528 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:41669-0x10166f610e80000, quorum=127.0.0.1:62663, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-07-15 03:10:52,532 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): master:41669-0x10166f610e80000, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-15 03:10:52,536 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:41669-0x10166f610e80000, quorum=127.0.0.1:62663, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-07-15 03:10:52,537 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:41669-0x10166f610e80000, quorum=127.0.0.1:62663, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-07-15 03:10:52,554 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:41669-0x10166f610e80000, quorum=127.0.0.1:62663, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-07-15 03:10:52,559 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): regionserver:43199-0x10166f610e80001, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-07-15 03:10:52,559 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): regionserver:39199-0x10166f610e80002, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-07-15 03:10:52,560 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): regionserver:38367-0x10166f610e80003, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-07-15 03:10:52,559 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): master:41669-0x10166f610e80000, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-07-15 03:10:52,560 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): master:41669-0x10166f610e80000, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-15 03:10:52,564 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(744): Active/primary master=jenkins-hbase4.apache.org,41669,1689390649760, sessionid=0x10166f610e80000, setting cluster-up flag (Was=false) 2023-07-15 03:10:52,588 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): master:41669-0x10166f610e80000, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-15 03:10:52,599 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-07-15 03:10:52,601 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,41669,1689390649760 2023-07-15 03:10:52,608 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): master:41669-0x10166f610e80000, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-15 03:10:52,614 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-07-15 03:10:52,616 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,41669,1689390649760 2023-07-15 03:10:52,619 WARN [master/jenkins-hbase4:0:becomeActiveMaster] snapshot.SnapshotManager(302): Couldn't delete working snapshot directory: hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/.hbase-snapshot/.tmp 2023-07-15 03:10:52,697 INFO [RS:0;jenkins-hbase4:43199] regionserver.HRegionServer(951): ClusterId : 4e5b418d-43d2-4db9-b6b5-05ca1eaedf93 2023-07-15 03:10:52,712 DEBUG [RS:0;jenkins-hbase4:43199] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-07-15 03:10:52,719 INFO [RS:1;jenkins-hbase4:39199] regionserver.HRegionServer(951): ClusterId : 4e5b418d-43d2-4db9-b6b5-05ca1eaedf93 2023-07-15 03:10:52,720 DEBUG [RS:1;jenkins-hbase4:39199] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-07-15 03:10:52,721 INFO [RS:2;jenkins-hbase4:38367] regionserver.HRegionServer(951): ClusterId : 4e5b418d-43d2-4db9-b6b5-05ca1eaedf93 2023-07-15 03:10:52,722 DEBUG [RS:2;jenkins-hbase4:38367] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-07-15 03:10:52,727 DEBUG [RS:1;jenkins-hbase4:39199] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-07-15 03:10:52,727 DEBUG [RS:1;jenkins-hbase4:39199] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-07-15 03:10:52,728 DEBUG [RS:2;jenkins-hbase4:38367] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-07-15 03:10:52,728 DEBUG [RS:2;jenkins-hbase4:38367] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-07-15 03:10:52,734 DEBUG [RS:0;jenkins-hbase4:43199] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-07-15 03:10:52,735 DEBUG [RS:0;jenkins-hbase4:43199] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-07-15 03:10:52,739 DEBUG [RS:2;jenkins-hbase4:38367] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-07-15 03:10:52,739 DEBUG [RS:1;jenkins-hbase4:39199] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-07-15 03:10:52,742 DEBUG [RS:1;jenkins-hbase4:39199] zookeeper.ReadOnlyZKClient(139): Connect 0x75adc386 to 127.0.0.1:62663 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-15 03:10:52,742 DEBUG [RS:2;jenkins-hbase4:38367] zookeeper.ReadOnlyZKClient(139): Connect 0x4a554aa1 to 127.0.0.1:62663 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-15 03:10:52,752 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2930): Registered master coprocessor service: service=AccessControlService 2023-07-15 03:10:52,758 INFO [master/jenkins-hbase4:0:becomeActiveMaster] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-15 03:10:52,758 INFO [master/jenkins-hbase4:0:becomeActiveMaster] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver loaded, priority=536870912. 2023-07-15 03:10:52,766 DEBUG [RS:0;jenkins-hbase4:43199] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-07-15 03:10:52,776 DEBUG [RS:0;jenkins-hbase4:43199] zookeeper.ReadOnlyZKClient(139): Connect 0x09c10f09 to 127.0.0.1:62663 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-15 03:10:52,802 DEBUG [RS:1;jenkins-hbase4:39199] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7b6a2343, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-15 03:10:52,803 DEBUG [RS:1;jenkins-hbase4:39199] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7f55a8f6, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-07-15 03:10:52,807 DEBUG [RS:2;jenkins-hbase4:38367] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4492bd9b, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-15 03:10:52,807 DEBUG [RS:2;jenkins-hbase4:38367] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@40ad21d1, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-07-15 03:10:52,809 DEBUG [RS:0;jenkins-hbase4:43199] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@706f041, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-15 03:10:52,809 DEBUG [RS:0;jenkins-hbase4:43199] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@463bfa7a, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-07-15 03:10:52,829 DEBUG [RS:1;jenkins-hbase4:39199] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:1;jenkins-hbase4:39199 2023-07-15 03:10:52,830 DEBUG [RS:0;jenkins-hbase4:43199] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase4:43199 2023-07-15 03:10:52,833 DEBUG [RS:2;jenkins-hbase4:38367] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:2;jenkins-hbase4:38367 2023-07-15 03:10:52,838 INFO [RS:1;jenkins-hbase4:39199] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-07-15 03:10:52,838 INFO [RS:0;jenkins-hbase4:43199] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-07-15 03:10:52,850 INFO [RS:0;jenkins-hbase4:43199] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-07-15 03:10:52,850 DEBUG [RS:0;jenkins-hbase4:43199] regionserver.HRegionServer(839): Registered regionserver coprocessor executorService: executorService=AccessControlService 2023-07-15 03:10:52,838 INFO [RS:2;jenkins-hbase4:38367] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-07-15 03:10:52,851 INFO [RS:2;jenkins-hbase4:38367] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-07-15 03:10:52,851 DEBUG [RS:2;jenkins-hbase4:38367] regionserver.HRegionServer(839): Registered regionserver coprocessor executorService: executorService=AccessControlService 2023-07-15 03:10:52,849 INFO [RS:1;jenkins-hbase4:39199] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-07-15 03:10:52,855 INFO [RS:2;jenkins-hbase4:38367] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-15 03:10:52,856 DEBUG [RS:1;jenkins-hbase4:39199] regionserver.HRegionServer(839): Registered regionserver coprocessor executorService: executorService=AccessControlService 2023-07-15 03:10:52,855 INFO [RS:0;jenkins-hbase4:43199] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-15 03:10:52,856 INFO [RS:1;jenkins-hbase4:39199] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-15 03:10:52,856 DEBUG [RS:0;jenkins-hbase4:43199] regionserver.HRegionServer(1022): About to register with Master. 2023-07-15 03:10:52,856 DEBUG [RS:2;jenkins-hbase4:38367] regionserver.HRegionServer(1022): About to register with Master. 2023-07-15 03:10:52,856 DEBUG [RS:1;jenkins-hbase4:39199] regionserver.HRegionServer(1022): About to register with Master. 2023-07-15 03:10:52,860 INFO [RS:0;jenkins-hbase4:43199] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,41669,1689390649760 with isa=jenkins-hbase4.apache.org/172.31.14.131:43199, startcode=1689390651225 2023-07-15 03:10:52,860 INFO [RS:2;jenkins-hbase4:38367] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,41669,1689390649760 with isa=jenkins-hbase4.apache.org/172.31.14.131:38367, startcode=1689390651355 2023-07-15 03:10:52,860 INFO [RS:1;jenkins-hbase4:39199] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,41669,1689390649760 with isa=jenkins-hbase4.apache.org/172.31.14.131:39199, startcode=1689390651299 2023-07-15 03:10:52,894 DEBUG [RS:0;jenkins-hbase4:43199] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-07-15 03:10:52,895 DEBUG [RS:2;jenkins-hbase4:38367] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-07-15 03:10:52,894 DEBUG [RS:1;jenkins-hbase4:39199] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-07-15 03:10:52,900 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-07-15 03:10:52,914 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-07-15 03:10:52,915 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-07-15 03:10:52,915 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-07-15 03:10:52,915 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-07-15 03:10:52,915 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase4:0, corePoolSize=10, maxPoolSize=10 2023-07-15 03:10:52,915 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-15 03:10:52,915 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-07-15 03:10:52,916 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-15 03:10:52,927 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1689390682927 2023-07-15 03:10:52,961 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-07-15 03:10:52,980 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-07-15 03:10:52,981 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-07-15 03:10:52,987 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-07-15 03:10:52,988 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-07-15 03:10:52,996 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-07-15 03:10:52,997 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-07-15 03:10:52,997 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-07-15 03:10:52,998 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-07-15 03:10:53,006 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:53401, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.1 (auth:SIMPLE), service=RegionServerStatusService 2023-07-15 03:10:53,011 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-07-15 03:10:53,006 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:53277, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.0 (auth:SIMPLE), service=RegionServerStatusService 2023-07-15 03:10:53,006 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:53883, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.2 (auth:SIMPLE), service=RegionServerStatusService 2023-07-15 03:10:53,021 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-07-15 03:10:53,022 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=41669] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server is not running yet at org.apache.hadoop.hbase.master.HMaster.checkServiceStarted(HMaster.java:2832) at org.apache.hadoop.hbase.master.MasterRpcServices.regionServerStartup(MasterRpcServices.java:579) at org.apache.hadoop.hbase.shaded.protobuf.generated.RegionServerStatusProtos$RegionServerStatusService$2.callBlockingMethod(RegionServerStatusProtos.java:15952) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-07-15 03:10:53,024 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-07-15 03:10:53,024 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-07-15 03:10:53,033 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=41669] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server is not running yet at org.apache.hadoop.hbase.master.HMaster.checkServiceStarted(HMaster.java:2832) at org.apache.hadoop.hbase.master.MasterRpcServices.regionServerStartup(MasterRpcServices.java:579) at org.apache.hadoop.hbase.shaded.protobuf.generated.RegionServerStatusProtos$RegionServerStatusService$2.callBlockingMethod(RegionServerStatusProtos.java:15952) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-07-15 03:10:53,034 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=41669] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server is not running yet at org.apache.hadoop.hbase.master.HMaster.checkServiceStarted(HMaster.java:2832) at org.apache.hadoop.hbase.master.MasterRpcServices.regionServerStartup(MasterRpcServices.java:579) at org.apache.hadoop.hbase.shaded.protobuf.generated.RegionServerStatusProtos$RegionServerStatusService$2.callBlockingMethod(RegionServerStatusProtos.java:15952) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-07-15 03:10:53,038 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-07-15 03:10:53,039 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-07-15 03:10:53,043 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1689390653042,5,FailOnTimeoutGroup] 2023-07-15 03:10:53,044 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1689390653044,5,FailOnTimeoutGroup] 2023-07-15 03:10:53,044 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-07-15 03:10:53,044 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1461): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-07-15 03:10:53,046 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-07-15 03:10:53,046 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-07-15 03:10:53,061 DEBUG [RS:0;jenkins-hbase4:43199] regionserver.HRegionServer(2830): Master is not running yet 2023-07-15 03:10:53,061 WARN [RS:0;jenkins-hbase4:43199] regionserver.HRegionServer(1030): reportForDuty failed; sleeping 100 ms and then retrying. 2023-07-15 03:10:53,062 DEBUG [RS:1;jenkins-hbase4:39199] regionserver.HRegionServer(2830): Master is not running yet 2023-07-15 03:10:53,062 WARN [RS:1;jenkins-hbase4:39199] regionserver.HRegionServer(1030): reportForDuty failed; sleeping 100 ms and then retrying. 2023-07-15 03:10:53,062 DEBUG [RS:2;jenkins-hbase4:38367] regionserver.HRegionServer(2830): Master is not running yet 2023-07-15 03:10:53,062 WARN [RS:2;jenkins-hbase4:38367] regionserver.HRegionServer(1030): reportForDuty failed; sleeping 100 ms and then retrying. 2023-07-15 03:10:53,105 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-07-15 03:10:53,107 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-07-15 03:10:53,107 INFO [PEWorker-1] regionserver.HRegion(7675): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280 2023-07-15 03:10:53,165 INFO [RS:0;jenkins-hbase4:43199] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,41669,1689390649760 with isa=jenkins-hbase4.apache.org/172.31.14.131:43199, startcode=1689390651225 2023-07-15 03:10:53,166 INFO [RS:1;jenkins-hbase4:39199] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,41669,1689390649760 with isa=jenkins-hbase4.apache.org/172.31.14.131:39199, startcode=1689390651299 2023-07-15 03:10:53,166 INFO [RS:2;jenkins-hbase4:38367] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,41669,1689390649760 with isa=jenkins-hbase4.apache.org/172.31.14.131:38367, startcode=1689390651355 2023-07-15 03:10:53,176 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=41669] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,38367,1689390651355 2023-07-15 03:10:53,183 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=41669] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,43199,1689390651225 2023-07-15 03:10:53,184 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=41669] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,39199,1689390651299 2023-07-15 03:10:53,204 DEBUG [RS:0;jenkins-hbase4:43199] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280 2023-07-15 03:10:53,204 DEBUG [RS:2;jenkins-hbase4:38367] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280 2023-07-15 03:10:53,205 DEBUG [RS:2;jenkins-hbase4:38367] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:37513 2023-07-15 03:10:53,205 DEBUG [RS:2;jenkins-hbase4:38367] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-07-15 03:10:53,208 DEBUG [PEWorker-1] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-15 03:10:53,204 DEBUG [RS:1;jenkins-hbase4:39199] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280 2023-07-15 03:10:53,210 DEBUG [RS:1;jenkins-hbase4:39199] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:37513 2023-07-15 03:10:53,210 DEBUG [RS:1;jenkins-hbase4:39199] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-07-15 03:10:53,204 DEBUG [RS:0;jenkins-hbase4:43199] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:37513 2023-07-15 03:10:53,220 DEBUG [RS:0;jenkins-hbase4:43199] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-07-15 03:10:53,212 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): master:41669-0x10166f610e80000, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-15 03:10:53,225 DEBUG [RS:1;jenkins-hbase4:39199] zookeeper.ZKUtil(162): regionserver:39199-0x10166f610e80002, quorum=127.0.0.1:62663, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,39199,1689390651299 2023-07-15 03:10:53,225 WARN [RS:1;jenkins-hbase4:39199] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-15 03:10:53,225 INFO [RS:1;jenkins-hbase4:39199] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-15 03:10:53,225 DEBUG [RS:2;jenkins-hbase4:38367] zookeeper.ZKUtil(162): regionserver:38367-0x10166f610e80003, quorum=127.0.0.1:62663, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,38367,1689390651355 2023-07-15 03:10:53,225 DEBUG [RS:1;jenkins-hbase4:39199] regionserver.HRegionServer(1948): logDir=hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/WALs/jenkins-hbase4.apache.org,39199,1689390651299 2023-07-15 03:10:53,221 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-07-15 03:10:53,229 DEBUG [RS:0;jenkins-hbase4:43199] zookeeper.ZKUtil(162): regionserver:43199-0x10166f610e80001, quorum=127.0.0.1:62663, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,43199,1689390651225 2023-07-15 03:10:53,225 WARN [RS:2;jenkins-hbase4:38367] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-15 03:10:53,229 WARN [RS:0;jenkins-hbase4:43199] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-15 03:10:53,240 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,43199,1689390651225] 2023-07-15 03:10:53,241 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,39199,1689390651299] 2023-07-15 03:10:53,241 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,38367,1689390651355] 2023-07-15 03:10:53,239 INFO [RS:2;jenkins-hbase4:38367] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-15 03:10:53,239 INFO [RS:0;jenkins-hbase4:43199] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-15 03:10:53,248 DEBUG [RS:2;jenkins-hbase4:38367] regionserver.HRegionServer(1948): logDir=hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/WALs/jenkins-hbase4.apache.org,38367,1689390651355 2023-07-15 03:10:53,248 DEBUG [RS:0;jenkins-hbase4:43199] regionserver.HRegionServer(1948): logDir=hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/WALs/jenkins-hbase4.apache.org,43199,1689390651225 2023-07-15 03:10:53,252 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/data/hbase/meta/1588230740/info 2023-07-15 03:10:53,254 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-07-15 03:10:53,257 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-15 03:10:53,258 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-07-15 03:10:53,265 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/data/hbase/meta/1588230740/rep_barrier 2023-07-15 03:10:53,265 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-07-15 03:10:53,267 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-15 03:10:53,267 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-07-15 03:10:53,270 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/data/hbase/meta/1588230740/table 2023-07-15 03:10:53,271 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-07-15 03:10:53,272 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-15 03:10:53,279 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/data/hbase/meta/1588230740 2023-07-15 03:10:53,287 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/data/hbase/meta/1588230740 2023-07-15 03:10:53,293 DEBUG [RS:1;jenkins-hbase4:39199] zookeeper.ZKUtil(162): regionserver:39199-0x10166f610e80002, quorum=127.0.0.1:62663, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,43199,1689390651225 2023-07-15 03:10:53,293 DEBUG [RS:0;jenkins-hbase4:43199] zookeeper.ZKUtil(162): regionserver:43199-0x10166f610e80001, quorum=127.0.0.1:62663, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,43199,1689390651225 2023-07-15 03:10:53,293 DEBUG [RS:2;jenkins-hbase4:38367] zookeeper.ZKUtil(162): regionserver:38367-0x10166f610e80003, quorum=127.0.0.1:62663, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,43199,1689390651225 2023-07-15 03:10:53,294 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-07-15 03:10:53,294 DEBUG [RS:1;jenkins-hbase4:39199] zookeeper.ZKUtil(162): regionserver:39199-0x10166f610e80002, quorum=127.0.0.1:62663, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,39199,1689390651299 2023-07-15 03:10:53,295 DEBUG [RS:0;jenkins-hbase4:43199] zookeeper.ZKUtil(162): regionserver:43199-0x10166f610e80001, quorum=127.0.0.1:62663, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,39199,1689390651299 2023-07-15 03:10:53,295 DEBUG [RS:2;jenkins-hbase4:38367] zookeeper.ZKUtil(162): regionserver:38367-0x10166f610e80003, quorum=127.0.0.1:62663, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,39199,1689390651299 2023-07-15 03:10:53,295 DEBUG [RS:1;jenkins-hbase4:39199] zookeeper.ZKUtil(162): regionserver:39199-0x10166f610e80002, quorum=127.0.0.1:62663, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,38367,1689390651355 2023-07-15 03:10:53,295 DEBUG [RS:0;jenkins-hbase4:43199] zookeeper.ZKUtil(162): regionserver:43199-0x10166f610e80001, quorum=127.0.0.1:62663, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,38367,1689390651355 2023-07-15 03:10:53,296 DEBUG [RS:2;jenkins-hbase4:38367] zookeeper.ZKUtil(162): regionserver:38367-0x10166f610e80003, quorum=127.0.0.1:62663, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,38367,1689390651355 2023-07-15 03:10:53,297 DEBUG [PEWorker-1] regionserver.HRegion(1055): writing seq id for 1588230740 2023-07-15 03:10:53,301 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-15 03:10:53,302 INFO [PEWorker-1] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64420626, jitterRate=-0.040057867765426636}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-07-15 03:10:53,303 DEBUG [PEWorker-1] regionserver.HRegion(965): Region open journal for 1588230740: 2023-07-15 03:10:53,303 DEBUG [PEWorker-1] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-07-15 03:10:53,303 INFO [PEWorker-1] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-07-15 03:10:53,303 DEBUG [PEWorker-1] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-07-15 03:10:53,303 DEBUG [PEWorker-1] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-07-15 03:10:53,303 DEBUG [PEWorker-1] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-07-15 03:10:53,307 INFO [PEWorker-1] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-07-15 03:10:53,307 DEBUG [PEWorker-1] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-07-15 03:10:53,313 DEBUG [RS:0;jenkins-hbase4:43199] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-07-15 03:10:53,322 DEBUG [RS:1;jenkins-hbase4:39199] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-07-15 03:10:53,324 DEBUG [RS:2;jenkins-hbase4:38367] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-07-15 03:10:53,325 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-07-15 03:10:53,325 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-07-15 03:10:53,328 INFO [RS:2;jenkins-hbase4:38367] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-07-15 03:10:53,331 INFO [RS:1;jenkins-hbase4:39199] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-07-15 03:10:53,340 INFO [RS:0;jenkins-hbase4:43199] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-07-15 03:10:53,345 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-07-15 03:10:53,363 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-07-15 03:10:53,369 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-07-15 03:10:53,370 INFO [RS:2;jenkins-hbase4:38367] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-07-15 03:10:53,371 INFO [RS:1;jenkins-hbase4:39199] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-07-15 03:10:53,383 INFO [RS:0;jenkins-hbase4:43199] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-07-15 03:10:53,389 INFO [RS:2;jenkins-hbase4:38367] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-07-15 03:10:53,389 INFO [RS:1;jenkins-hbase4:39199] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-07-15 03:10:53,389 INFO [RS:0;jenkins-hbase4:43199] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-07-15 03:10:53,390 INFO [RS:1;jenkins-hbase4:39199] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-07-15 03:10:53,390 INFO [RS:2;jenkins-hbase4:38367] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-07-15 03:10:53,391 INFO [RS:0;jenkins-hbase4:43199] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-07-15 03:10:53,393 INFO [RS:0;jenkins-hbase4:43199] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-07-15 03:10:53,393 INFO [RS:2;jenkins-hbase4:38367] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-07-15 03:10:53,393 INFO [RS:1;jenkins-hbase4:39199] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-07-15 03:10:53,402 INFO [RS:0;jenkins-hbase4:43199] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-07-15 03:10:53,402 INFO [RS:2;jenkins-hbase4:38367] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-07-15 03:10:53,402 INFO [RS:1;jenkins-hbase4:39199] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-07-15 03:10:53,403 DEBUG [RS:0;jenkins-hbase4:43199] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-15 03:10:53,403 DEBUG [RS:2;jenkins-hbase4:38367] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-15 03:10:53,403 DEBUG [RS:1;jenkins-hbase4:39199] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-15 03:10:53,403 DEBUG [RS:2;jenkins-hbase4:38367] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-15 03:10:53,403 DEBUG [RS:1;jenkins-hbase4:39199] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-15 03:10:53,403 DEBUG [RS:0;jenkins-hbase4:43199] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-15 03:10:53,403 DEBUG [RS:1;jenkins-hbase4:39199] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-15 03:10:53,404 DEBUG [RS:0;jenkins-hbase4:43199] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-15 03:10:53,404 DEBUG [RS:1;jenkins-hbase4:39199] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-15 03:10:53,404 DEBUG [RS:0;jenkins-hbase4:43199] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-15 03:10:53,404 DEBUG [RS:1;jenkins-hbase4:39199] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-15 03:10:53,404 DEBUG [RS:0;jenkins-hbase4:43199] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-15 03:10:53,404 DEBUG [RS:1;jenkins-hbase4:39199] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-07-15 03:10:53,404 DEBUG [RS:0;jenkins-hbase4:43199] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-07-15 03:10:53,404 DEBUG [RS:1;jenkins-hbase4:39199] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-15 03:10:53,404 DEBUG [RS:0;jenkins-hbase4:43199] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-15 03:10:53,403 DEBUG [RS:2;jenkins-hbase4:38367] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-15 03:10:53,404 DEBUG [RS:0;jenkins-hbase4:43199] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-15 03:10:53,404 DEBUG [RS:2;jenkins-hbase4:38367] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-15 03:10:53,404 DEBUG [RS:1;jenkins-hbase4:39199] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-15 03:10:53,404 DEBUG [RS:2;jenkins-hbase4:38367] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-15 03:10:53,405 DEBUG [RS:1;jenkins-hbase4:39199] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-15 03:10:53,405 DEBUG [RS:1;jenkins-hbase4:39199] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-15 03:10:53,404 DEBUG [RS:0;jenkins-hbase4:43199] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-15 03:10:53,405 DEBUG [RS:2;jenkins-hbase4:38367] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-07-15 03:10:53,405 DEBUG [RS:0;jenkins-hbase4:43199] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-15 03:10:53,405 DEBUG [RS:2;jenkins-hbase4:38367] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-15 03:10:53,405 DEBUG [RS:2;jenkins-hbase4:38367] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-15 03:10:53,406 DEBUG [RS:2;jenkins-hbase4:38367] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-15 03:10:53,406 DEBUG [RS:2;jenkins-hbase4:38367] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-15 03:10:53,410 INFO [RS:0;jenkins-hbase4:43199] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-07-15 03:10:53,411 INFO [RS:0;jenkins-hbase4:43199] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-07-15 03:10:53,411 INFO [RS:0;jenkins-hbase4:43199] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-07-15 03:10:53,414 INFO [RS:1;jenkins-hbase4:39199] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-07-15 03:10:53,415 INFO [RS:1;jenkins-hbase4:39199] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-07-15 03:10:53,415 INFO [RS:1;jenkins-hbase4:39199] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-07-15 03:10:53,417 INFO [RS:2;jenkins-hbase4:38367] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-07-15 03:10:53,417 INFO [RS:2;jenkins-hbase4:38367] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-07-15 03:10:53,417 INFO [RS:2;jenkins-hbase4:38367] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-07-15 03:10:53,448 INFO [RS:2;jenkins-hbase4:38367] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-07-15 03:10:53,448 INFO [RS:0;jenkins-hbase4:43199] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-07-15 03:10:53,448 INFO [RS:1;jenkins-hbase4:39199] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-07-15 03:10:53,453 INFO [RS:2;jenkins-hbase4:38367] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,38367,1689390651355-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-15 03:10:53,454 INFO [RS:1;jenkins-hbase4:39199] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,39199,1689390651299-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-15 03:10:53,459 INFO [RS:0;jenkins-hbase4:43199] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,43199,1689390651225-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-15 03:10:53,481 INFO [RS:1;jenkins-hbase4:39199] regionserver.Replication(203): jenkins-hbase4.apache.org,39199,1689390651299 started 2023-07-15 03:10:53,481 INFO [RS:1;jenkins-hbase4:39199] regionserver.HRegionServer(1637): Serving as jenkins-hbase4.apache.org,39199,1689390651299, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:39199, sessionid=0x10166f610e80002 2023-07-15 03:10:53,486 INFO [RS:0;jenkins-hbase4:43199] regionserver.Replication(203): jenkins-hbase4.apache.org,43199,1689390651225 started 2023-07-15 03:10:53,487 DEBUG [RS:1;jenkins-hbase4:39199] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-07-15 03:10:53,487 INFO [RS:0;jenkins-hbase4:43199] regionserver.HRegionServer(1637): Serving as jenkins-hbase4.apache.org,43199,1689390651225, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:43199, sessionid=0x10166f610e80001 2023-07-15 03:10:53,487 DEBUG [RS:1;jenkins-hbase4:39199] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,39199,1689390651299 2023-07-15 03:10:53,487 DEBUG [RS:1;jenkins-hbase4:39199] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,39199,1689390651299' 2023-07-15 03:10:53,487 DEBUG [RS:1;jenkins-hbase4:39199] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-15 03:10:53,488 DEBUG [RS:1;jenkins-hbase4:39199] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-15 03:10:53,489 DEBUG [RS:1;jenkins-hbase4:39199] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-07-15 03:10:53,489 DEBUG [RS:1;jenkins-hbase4:39199] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-07-15 03:10:53,489 DEBUG [RS:1;jenkins-hbase4:39199] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,39199,1689390651299 2023-07-15 03:10:53,489 DEBUG [RS:1;jenkins-hbase4:39199] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,39199,1689390651299' 2023-07-15 03:10:53,489 DEBUG [RS:1;jenkins-hbase4:39199] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 03:10:53,490 DEBUG [RS:1;jenkins-hbase4:39199] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 03:10:53,491 DEBUG [RS:1;jenkins-hbase4:39199] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-07-15 03:10:53,491 INFO [RS:1;jenkins-hbase4:39199] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-07-15 03:10:53,491 INFO [RS:1;jenkins-hbase4:39199] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-07-15 03:10:53,494 INFO [RS:2;jenkins-hbase4:38367] regionserver.Replication(203): jenkins-hbase4.apache.org,38367,1689390651355 started 2023-07-15 03:10:53,494 DEBUG [RS:0;jenkins-hbase4:43199] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-07-15 03:10:53,494 INFO [RS:2;jenkins-hbase4:38367] regionserver.HRegionServer(1637): Serving as jenkins-hbase4.apache.org,38367,1689390651355, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:38367, sessionid=0x10166f610e80003 2023-07-15 03:10:53,499 DEBUG [RS:2;jenkins-hbase4:38367] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-07-15 03:10:53,499 DEBUG [RS:2;jenkins-hbase4:38367] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,38367,1689390651355 2023-07-15 03:10:53,495 DEBUG [RS:0;jenkins-hbase4:43199] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,43199,1689390651225 2023-07-15 03:10:53,503 DEBUG [RS:0;jenkins-hbase4:43199] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,43199,1689390651225' 2023-07-15 03:10:53,511 DEBUG [RS:0;jenkins-hbase4:43199] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-15 03:10:53,499 DEBUG [RS:2;jenkins-hbase4:38367] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,38367,1689390651355' 2023-07-15 03:10:53,511 DEBUG [RS:2;jenkins-hbase4:38367] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-15 03:10:53,512 DEBUG [RS:0;jenkins-hbase4:43199] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-15 03:10:53,512 DEBUG [RS:2;jenkins-hbase4:38367] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-15 03:10:53,513 DEBUG [RS:0;jenkins-hbase4:43199] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-07-15 03:10:53,513 DEBUG [RS:0;jenkins-hbase4:43199] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-07-15 03:10:53,513 DEBUG [RS:0;jenkins-hbase4:43199] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,43199,1689390651225 2023-07-15 03:10:53,513 DEBUG [RS:0;jenkins-hbase4:43199] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,43199,1689390651225' 2023-07-15 03:10:53,513 DEBUG [RS:0;jenkins-hbase4:43199] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 03:10:53,514 DEBUG [RS:2;jenkins-hbase4:38367] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-07-15 03:10:53,514 DEBUG [RS:2;jenkins-hbase4:38367] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-07-15 03:10:53,514 DEBUG [RS:2;jenkins-hbase4:38367] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,38367,1689390651355 2023-07-15 03:10:53,514 DEBUG [RS:2;jenkins-hbase4:38367] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,38367,1689390651355' 2023-07-15 03:10:53,514 DEBUG [RS:2;jenkins-hbase4:38367] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 03:10:53,514 DEBUG [RS:0;jenkins-hbase4:43199] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 03:10:53,515 DEBUG [RS:2;jenkins-hbase4:38367] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 03:10:53,516 DEBUG [RS:0;jenkins-hbase4:43199] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-07-15 03:10:53,516 INFO [RS:0;jenkins-hbase4:43199] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-07-15 03:10:53,518 INFO [RS:0;jenkins-hbase4:43199] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-07-15 03:10:53,518 DEBUG [RS:2;jenkins-hbase4:38367] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-07-15 03:10:53,518 INFO [RS:2;jenkins-hbase4:38367] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-07-15 03:10:53,518 INFO [RS:2;jenkins-hbase4:38367] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-07-15 03:10:53,522 DEBUG [jenkins-hbase4:41669] assignment.AssignmentManager(2176): Processing assignQueue; systemServersCount=3, allServersCount=3 2023-07-15 03:10:53,529 DEBUG [jenkins-hbase4:41669] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-15 03:10:53,542 DEBUG [jenkins-hbase4:41669] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-15 03:10:53,542 DEBUG [jenkins-hbase4:41669] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-15 03:10:53,542 DEBUG [jenkins-hbase4:41669] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-15 03:10:53,542 DEBUG [jenkins-hbase4:41669] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-15 03:10:53,546 INFO [PEWorker-3] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,38367,1689390651355, state=OPENING 2023-07-15 03:10:53,559 DEBUG [PEWorker-3] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-07-15 03:10:53,561 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): master:41669-0x10166f610e80000, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-15 03:10:53,562 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-07-15 03:10:53,567 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,38367,1689390651355}] 2023-07-15 03:10:53,606 INFO [RS:1;jenkins-hbase4:39199] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C39199%2C1689390651299, suffix=, logDir=hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/WALs/jenkins-hbase4.apache.org,39199,1689390651299, archiveDir=hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/oldWALs, maxLogs=32 2023-07-15 03:10:53,624 INFO [RS:2;jenkins-hbase4:38367] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C38367%2C1689390651355, suffix=, logDir=hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/WALs/jenkins-hbase4.apache.org,38367,1689390651355, archiveDir=hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/oldWALs, maxLogs=32 2023-07-15 03:10:53,627 INFO [RS:0;jenkins-hbase4:43199] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C43199%2C1689390651225, suffix=, logDir=hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/WALs/jenkins-hbase4.apache.org,43199,1689390651225, archiveDir=hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/oldWALs, maxLogs=32 2023-07-15 03:10:53,720 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:43577,DS-e7e1fbba-a873-442a-85a1-984e8658a7e2,DISK] 2023-07-15 03:10:53,722 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:40343,DS-3de7949b-6285-495b-b53d-e7fd8450273b,DISK] 2023-07-15 03:10:53,735 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:42765,DS-f6e80cc3-9793-4176-9663-be8015e10c8f,DISK] 2023-07-15 03:10:53,743 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:40343,DS-3de7949b-6285-495b-b53d-e7fd8450273b,DISK] 2023-07-15 03:10:53,744 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:43577,DS-e7e1fbba-a873-442a-85a1-984e8658a7e2,DISK] 2023-07-15 03:10:53,745 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:42765,DS-f6e80cc3-9793-4176-9663-be8015e10c8f,DISK] 2023-07-15 03:10:53,744 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:42765,DS-f6e80cc3-9793-4176-9663-be8015e10c8f,DISK] 2023-07-15 03:10:53,746 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:40343,DS-3de7949b-6285-495b-b53d-e7fd8450273b,DISK] 2023-07-15 03:10:53,747 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:43577,DS-e7e1fbba-a873-442a-85a1-984e8658a7e2,DISK] 2023-07-15 03:10:53,768 INFO [RS:0;jenkins-hbase4:43199] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/WALs/jenkins-hbase4.apache.org,43199,1689390651225/jenkins-hbase4.apache.org%2C43199%2C1689390651225.1689390653630 2023-07-15 03:10:53,786 INFO [RS:1;jenkins-hbase4:39199] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/WALs/jenkins-hbase4.apache.org,39199,1689390651299/jenkins-hbase4.apache.org%2C39199%2C1689390651299.1689390653609 2023-07-15 03:10:53,790 DEBUG [RS:0;jenkins-hbase4:43199] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:40343,DS-3de7949b-6285-495b-b53d-e7fd8450273b,DISK], DatanodeInfoWithStorage[127.0.0.1:42765,DS-f6e80cc3-9793-4176-9663-be8015e10c8f,DISK], DatanodeInfoWithStorage[127.0.0.1:43577,DS-e7e1fbba-a873-442a-85a1-984e8658a7e2,DISK]] 2023-07-15 03:10:53,791 INFO [RS:2;jenkins-hbase4:38367] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/WALs/jenkins-hbase4.apache.org,38367,1689390651355/jenkins-hbase4.apache.org%2C38367%2C1689390651355.1689390653629 2023-07-15 03:10:53,794 DEBUG [RS:1;jenkins-hbase4:39199] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:40343,DS-3de7949b-6285-495b-b53d-e7fd8450273b,DISK], DatanodeInfoWithStorage[127.0.0.1:43577,DS-e7e1fbba-a873-442a-85a1-984e8658a7e2,DISK], DatanodeInfoWithStorage[127.0.0.1:42765,DS-f6e80cc3-9793-4176-9663-be8015e10c8f,DISK]] 2023-07-15 03:10:53,798 DEBUG [RS:2;jenkins-hbase4:38367] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:43577,DS-e7e1fbba-a873-442a-85a1-984e8658a7e2,DISK], DatanodeInfoWithStorage[127.0.0.1:42765,DS-f6e80cc3-9793-4176-9663-be8015e10c8f,DISK], DatanodeInfoWithStorage[127.0.0.1:40343,DS-3de7949b-6285-495b-b53d-e7fd8450273b,DISK]] 2023-07-15 03:10:53,829 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,38367,1689390651355 2023-07-15 03:10:53,832 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-15 03:10:53,835 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:43916, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-15 03:10:53,852 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:meta,,1.1588230740 2023-07-15 03:10:53,853 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-15 03:10:53,868 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C38367%2C1689390651355.meta, suffix=.meta, logDir=hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/WALs/jenkins-hbase4.apache.org,38367,1689390651355, archiveDir=hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/oldWALs, maxLogs=32 2023-07-15 03:10:53,917 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:40343,DS-3de7949b-6285-495b-b53d-e7fd8450273b,DISK] 2023-07-15 03:10:53,923 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:43577,DS-e7e1fbba-a873-442a-85a1-984e8658a7e2,DISK] 2023-07-15 03:10:53,923 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:42765,DS-f6e80cc3-9793-4176-9663-be8015e10c8f,DISK] 2023-07-15 03:10:53,938 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/WALs/jenkins-hbase4.apache.org,38367,1689390651355/jenkins-hbase4.apache.org%2C38367%2C1689390651355.meta.1689390653871.meta 2023-07-15 03:10:53,942 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:40343,DS-3de7949b-6285-495b-b53d-e7fd8450273b,DISK], DatanodeInfoWithStorage[127.0.0.1:42765,DS-f6e80cc3-9793-4176-9663-be8015e10c8f,DISK], DatanodeInfoWithStorage[127.0.0.1:43577,DS-e7e1fbba-a873-442a-85a1-984e8658a7e2,DISK]] 2023-07-15 03:10:53,943 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-07-15 03:10:53,944 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:meta,,1 service=AccessControlService 2023-07-15 03:10:53,946 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-15 03:10:53,947 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-07-15 03:10:53,950 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-07-15 03:10:53,952 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-07-15 03:10:53,969 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-07-15 03:10:53,969 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-15 03:10:53,969 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 1588230740 2023-07-15 03:10:53,969 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 1588230740 2023-07-15 03:10:53,972 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-07-15 03:10:53,974 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/data/hbase/meta/1588230740/info 2023-07-15 03:10:53,974 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/data/hbase/meta/1588230740/info 2023-07-15 03:10:53,975 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-07-15 03:10:53,976 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-15 03:10:53,976 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-07-15 03:10:53,978 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/data/hbase/meta/1588230740/rep_barrier 2023-07-15 03:10:53,978 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/data/hbase/meta/1588230740/rep_barrier 2023-07-15 03:10:53,978 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-07-15 03:10:53,979 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-15 03:10:53,980 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-07-15 03:10:53,981 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/data/hbase/meta/1588230740/table 2023-07-15 03:10:53,981 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/data/hbase/meta/1588230740/table 2023-07-15 03:10:53,981 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-07-15 03:10:53,982 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-15 03:10:53,984 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/data/hbase/meta/1588230740 2023-07-15 03:10:53,988 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/data/hbase/meta/1588230740 2023-07-15 03:10:53,994 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-07-15 03:10:53,996 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 1588230740 2023-07-15 03:10:53,998 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70237255, jitterRate=0.04661665856838226}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-07-15 03:10:54,002 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 1588230740: 2023-07-15 03:10:54,021 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1689390653814 2023-07-15 03:10:54,048 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:meta,,1.1588230740 2023-07-15 03:10:54,049 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:meta,,1.1588230740 2023-07-15 03:10:54,050 INFO [PEWorker-5] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,38367,1689390651355, state=OPEN 2023-07-15 03:10:54,054 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): master:41669-0x10166f610e80000, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-07-15 03:10:54,054 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-07-15 03:10:54,059 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=3, resume processing ppid=2 2023-07-15 03:10:54,059 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,38367,1689390651355 in 487 msec 2023-07-15 03:10:54,066 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=2, resume processing ppid=1 2023-07-15 03:10:54,066 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 717 msec 2023-07-15 03:10:54,073 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 1.3040 sec 2023-07-15 03:10:54,074 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(953): Wait for region servers to report in: status=null, state=RUNNING, startTime=1689390654073, completionTime=-1 2023-07-15 03:10:54,074 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=3; waited=0ms, expected min=3 server(s), max=3 server(s), master is running 2023-07-15 03:10:54,074 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1517): Joining cluster... 2023-07-15 03:10:54,182 DEBUG [hconnection-0x337e74cd-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-15 03:10:54,186 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:43930, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-15 03:10:54,212 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1529): Number of RegionServers=3 2023-07-15 03:10:54,212 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1689390714212 2023-07-15 03:10:54,212 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1689390774212 2023-07-15 03:10:54,212 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1536): Joined the cluster in 138 msec 2023-07-15 03:10:54,298 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,41669,1689390649760-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-15 03:10:54,298 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,41669,1689390649760-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-07-15 03:10:54,299 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,41669,1689390649760-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-07-15 03:10:54,301 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase4:41669, period=300000, unit=MILLISECONDS is enabled. 2023-07-15 03:10:54,302 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-07-15 03:10:54,308 DEBUG [master/jenkins-hbase4:0.Chore.1] janitor.CatalogJanitor(175): 2023-07-15 03:10:54,320 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-07-15 03:10:54,321 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2148): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-07-15 03:10:54,332 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-07-15 03:10:54,334 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-07-15 03:10:54,338 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-15 03:10:54,364 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/.tmp/data/hbase/namespace/7b14de98886c5a063d2453c7b27e4f02 2023-07-15 03:10:54,370 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/.tmp/data/hbase/namespace/7b14de98886c5a063d2453c7b27e4f02 empty. 2023-07-15 03:10:54,372 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/.tmp/data/hbase/namespace/7b14de98886c5a063d2453c7b27e4f02 2023-07-15 03:10:54,373 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-07-15 03:10:54,426 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-07-15 03:10:54,431 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7675): creating {ENCODED => 7b14de98886c5a063d2453c7b27e4f02, NAME => 'hbase:namespace,,1689390654321.7b14de98886c5a063d2453c7b27e4f02.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/.tmp 2023-07-15 03:10:54,452 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1689390654321.7b14de98886c5a063d2453c7b27e4f02.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-15 03:10:54,453 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1604): Closing 7b14de98886c5a063d2453c7b27e4f02, disabling compactions & flushes 2023-07-15 03:10:54,453 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1689390654321.7b14de98886c5a063d2453c7b27e4f02. 2023-07-15 03:10:54,453 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1689390654321.7b14de98886c5a063d2453c7b27e4f02. 2023-07-15 03:10:54,453 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1689390654321.7b14de98886c5a063d2453c7b27e4f02. after waiting 0 ms 2023-07-15 03:10:54,453 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1689390654321.7b14de98886c5a063d2453c7b27e4f02. 2023-07-15 03:10:54,453 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1838): Closed hbase:namespace,,1689390654321.7b14de98886c5a063d2453c7b27e4f02. 2023-07-15 03:10:54,453 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1558): Region close journal for 7b14de98886c5a063d2453c7b27e4f02: 2023-07-15 03:10:54,459 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-07-15 03:10:54,477 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1689390654321.7b14de98886c5a063d2453c7b27e4f02.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1689390654462"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689390654462"}]},"ts":"1689390654462"} 2023-07-15 03:10:54,511 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-07-15 03:10:54,513 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-15 03:10:54,519 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689390654513"}]},"ts":"1689390654513"} 2023-07-15 03:10:54,525 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-07-15 03:10:54,531 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-15 03:10:54,536 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-15 03:10:54,536 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-15 03:10:54,536 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-15 03:10:54,536 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-15 03:10:54,539 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=7b14de98886c5a063d2453c7b27e4f02, ASSIGN}] 2023-07-15 03:10:54,543 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=7b14de98886c5a063d2453c7b27e4f02, ASSIGN 2023-07-15 03:10:54,545 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=7b14de98886c5a063d2453c7b27e4f02, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,39199,1689390651299; forceNewPlan=false, retain=false 2023-07-15 03:10:54,701 INFO [jenkins-hbase4:41669] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-07-15 03:10:54,703 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=7b14de98886c5a063d2453c7b27e4f02, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,39199,1689390651299 2023-07-15 03:10:54,704 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1689390654321.7b14de98886c5a063d2453c7b27e4f02.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1689390654703"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689390654703"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689390654703"}]},"ts":"1689390654703"} 2023-07-15 03:10:54,712 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure 7b14de98886c5a063d2453c7b27e4f02, server=jenkins-hbase4.apache.org,39199,1689390651299}] 2023-07-15 03:10:54,867 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,39199,1689390651299 2023-07-15 03:10:54,868 DEBUG [RSProcedureDispatcher-pool-1] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-15 03:10:54,871 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:57758, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-15 03:10:54,878 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:namespace,,1689390654321.7b14de98886c5a063d2453c7b27e4f02. 2023-07-15 03:10:54,878 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 7b14de98886c5a063d2453c7b27e4f02, NAME => 'hbase:namespace,,1689390654321.7b14de98886c5a063d2453c7b27e4f02.', STARTKEY => '', ENDKEY => ''} 2023-07-15 03:10:54,879 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:namespace,,1689390654321.7b14de98886c5a063d2453c7b27e4f02. service=AccessControlService 2023-07-15 03:10:54,880 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-15 03:10:54,880 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace 7b14de98886c5a063d2453c7b27e4f02 2023-07-15 03:10:54,880 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1689390654321.7b14de98886c5a063d2453c7b27e4f02.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-15 03:10:54,881 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 7b14de98886c5a063d2453c7b27e4f02 2023-07-15 03:10:54,881 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 7b14de98886c5a063d2453c7b27e4f02 2023-07-15 03:10:54,883 INFO [StoreOpener-7b14de98886c5a063d2453c7b27e4f02-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 7b14de98886c5a063d2453c7b27e4f02 2023-07-15 03:10:54,885 DEBUG [StoreOpener-7b14de98886c5a063d2453c7b27e4f02-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/data/hbase/namespace/7b14de98886c5a063d2453c7b27e4f02/info 2023-07-15 03:10:54,885 DEBUG [StoreOpener-7b14de98886c5a063d2453c7b27e4f02-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/data/hbase/namespace/7b14de98886c5a063d2453c7b27e4f02/info 2023-07-15 03:10:54,886 INFO [StoreOpener-7b14de98886c5a063d2453c7b27e4f02-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 7b14de98886c5a063d2453c7b27e4f02 columnFamilyName info 2023-07-15 03:10:54,887 INFO [StoreOpener-7b14de98886c5a063d2453c7b27e4f02-1] regionserver.HStore(310): Store=7b14de98886c5a063d2453c7b27e4f02/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-15 03:10:54,889 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/data/hbase/namespace/7b14de98886c5a063d2453c7b27e4f02 2023-07-15 03:10:54,890 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/data/hbase/namespace/7b14de98886c5a063d2453c7b27e4f02 2023-07-15 03:10:54,895 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 7b14de98886c5a063d2453c7b27e4f02 2023-07-15 03:10:54,898 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/data/hbase/namespace/7b14de98886c5a063d2453c7b27e4f02/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-15 03:10:54,899 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 7b14de98886c5a063d2453c7b27e4f02; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72305968, jitterRate=0.07744288444519043}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-15 03:10:54,899 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 7b14de98886c5a063d2453c7b27e4f02: 2023-07-15 03:10:54,901 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:namespace,,1689390654321.7b14de98886c5a063d2453c7b27e4f02., pid=6, masterSystemTime=1689390654867 2023-07-15 03:10:54,906 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:namespace,,1689390654321.7b14de98886c5a063d2453c7b27e4f02. 2023-07-15 03:10:54,907 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:namespace,,1689390654321.7b14de98886c5a063d2453c7b27e4f02. 2023-07-15 03:10:54,908 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=7b14de98886c5a063d2453c7b27e4f02, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,39199,1689390651299 2023-07-15 03:10:54,909 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1689390654321.7b14de98886c5a063d2453c7b27e4f02.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1689390654907"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689390654907"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689390654907"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689390654907"}]},"ts":"1689390654907"} 2023-07-15 03:10:54,915 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=6, resume processing ppid=5 2023-07-15 03:10:54,915 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure 7b14de98886c5a063d2453c7b27e4f02, server=jenkins-hbase4.apache.org,39199,1689390651299 in 200 msec 2023-07-15 03:10:54,919 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=5, resume processing ppid=4 2023-07-15 03:10:54,919 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=7b14de98886c5a063d2453c7b27e4f02, ASSIGN in 376 msec 2023-07-15 03:10:54,920 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-15 03:10:54,921 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689390654921"}]},"ts":"1689390654921"} 2023-07-15 03:10:54,923 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-07-15 03:10:54,926 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-07-15 03:10:54,929 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 604 msec 2023-07-15 03:10:54,934 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:41669-0x10166f610e80000, quorum=127.0.0.1:62663, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-07-15 03:10:54,936 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): master:41669-0x10166f610e80000, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-07-15 03:10:54,936 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): master:41669-0x10166f610e80000, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-15 03:10:54,959 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-15 03:10:54,962 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:57770, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-15 03:10:54,979 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-07-15 03:10:55,003 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): master:41669-0x10166f610e80000, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-07-15 03:10:55,010 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 41 msec 2023-07-15 03:10:55,013 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-07-15 03:10:55,025 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): master:41669-0x10166f610e80000, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-07-15 03:10:55,034 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 18 msec 2023-07-15 03:10:55,051 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): master:41669-0x10166f610e80000, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-07-15 03:10:55,053 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): master:41669-0x10166f610e80000, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-07-15 03:10:55,054 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1083): Master has completed initialization 3.620sec 2023-07-15 03:10:55,056 INFO [master/jenkins-hbase4:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-07-15 03:10:55,058 INFO [master/jenkins-hbase4:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-07-15 03:10:55,058 INFO [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-07-15 03:10:55,060 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,41669,1689390649760-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-07-15 03:10:55,060 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,41669,1689390649760-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-07-15 03:10:55,081 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster$4(2112): Client=null/null create 'hbase:acl', {NAME => 'l', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-07-15 03:10:55,082 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:acl 2023-07-15 03:10:55,085 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_PRE_OPERATION 2023-07-15 03:10:55,087 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-15 03:10:55,090 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(700): Client=null/null procedure request for creating table: namespace: "hbase" qualifier: "acl" procId is: 9 2023-07-15 03:10:55,090 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/.tmp/data/hbase/acl/39a45926df72fe7e305cdcf6976a1482 2023-07-15 03:10:55,091 DEBUG [HFileArchiver-2] backup.HFileArchiver(153): Directory hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/.tmp/data/hbase/acl/39a45926df72fe7e305cdcf6976a1482 empty. 2023-07-15 03:10:55,094 DEBUG [HFileArchiver-2] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/.tmp/data/hbase/acl/39a45926df72fe7e305cdcf6976a1482 2023-07-15 03:10:55,094 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived hbase:acl regions 2023-07-15 03:10:55,100 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-15 03:10:55,134 DEBUG [Listener at localhost/46707] zookeeper.ReadOnlyZKClient(139): Connect 0x3f1d84a9 to 127.0.0.1:62663 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-15 03:10:55,135 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/.tmp/data/hbase/acl/.tabledesc/.tableinfo.0000000001 2023-07-15 03:10:55,140 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(7675): creating {ENCODED => 39a45926df72fe7e305cdcf6976a1482, NAME => 'hbase:acl,,1689390655077.39a45926df72fe7e305cdcf6976a1482.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:acl', {NAME => 'l', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/.tmp 2023-07-15 03:10:55,147 DEBUG [Listener at localhost/46707] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5db9272f, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-15 03:10:55,183 DEBUG [hconnection-0x3a807356-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-15 03:10:55,190 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(866): Instantiated hbase:acl,,1689390655077.39a45926df72fe7e305cdcf6976a1482.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-15 03:10:55,190 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1604): Closing 39a45926df72fe7e305cdcf6976a1482, disabling compactions & flushes 2023-07-15 03:10:55,190 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1626): Closing region hbase:acl,,1689390655077.39a45926df72fe7e305cdcf6976a1482. 2023-07-15 03:10:55,191 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:acl,,1689390655077.39a45926df72fe7e305cdcf6976a1482. 2023-07-15 03:10:55,191 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1714): Acquired close lock on hbase:acl,,1689390655077.39a45926df72fe7e305cdcf6976a1482. after waiting 0 ms 2023-07-15 03:10:55,191 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1724): Updates disabled for region hbase:acl,,1689390655077.39a45926df72fe7e305cdcf6976a1482. 2023-07-15 03:10:55,191 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1838): Closed hbase:acl,,1689390655077.39a45926df72fe7e305cdcf6976a1482. 2023-07-15 03:10:55,191 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1558): Region close journal for 39a45926df72fe7e305cdcf6976a1482: 2023-07-15 03:10:55,196 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_ADD_TO_META 2023-07-15 03:10:55,199 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:acl,,1689390655077.39a45926df72fe7e305cdcf6976a1482.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1689390655199"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689390655199"}]},"ts":"1689390655199"} 2023-07-15 03:10:55,200 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:43934, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-15 03:10:55,203 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-07-15 03:10:55,203 INFO [Listener at localhost/46707] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase4.apache.org,41669,1689390649760 2023-07-15 03:10:55,203 INFO [Listener at localhost/46707] hbase.HBaseTestingUtility(2699): Starting mini mapreduce cluster... 2023-07-15 03:10:55,204 INFO [Listener at localhost/46707] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6bc8dbaf-aac0-03cf-90d4-be6af049f709/test.cache.data in system properties and HBase conf 2023-07-15 03:10:55,204 INFO [Listener at localhost/46707] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6bc8dbaf-aac0-03cf-90d4-be6af049f709/hadoop.tmp.dir in system properties and HBase conf 2023-07-15 03:10:55,204 INFO [Listener at localhost/46707] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6bc8dbaf-aac0-03cf-90d4-be6af049f709/hadoop.log.dir in system properties and HBase conf 2023-07-15 03:10:55,204 INFO [Listener at localhost/46707] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6bc8dbaf-aac0-03cf-90d4-be6af049f709/mapreduce.cluster.local.dir in system properties and HBase conf 2023-07-15 03:10:55,205 INFO [Listener at localhost/46707] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6bc8dbaf-aac0-03cf-90d4-be6af049f709/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-07-15 03:10:55,205 INFO [Listener at localhost/46707] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-07-15 03:10:55,205 INFO [Listener at localhost/46707] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6bc8dbaf-aac0-03cf-90d4-be6af049f709/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-07-15 03:10:55,205 INFO [Listener at localhost/46707] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6bc8dbaf-aac0-03cf-90d4-be6af049f709/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-07-15 03:10:55,205 INFO [Listener at localhost/46707] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6bc8dbaf-aac0-03cf-90d4-be6af049f709/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-07-15 03:10:55,205 INFO [Listener at localhost/46707] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6bc8dbaf-aac0-03cf-90d4-be6af049f709/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-07-15 03:10:55,205 INFO [Listener at localhost/46707] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6bc8dbaf-aac0-03cf-90d4-be6af049f709/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-07-15 03:10:55,205 INFO [Listener at localhost/46707] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6bc8dbaf-aac0-03cf-90d4-be6af049f709/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-07-15 03:10:55,205 INFO [Listener at localhost/46707] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6bc8dbaf-aac0-03cf-90d4-be6af049f709/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-07-15 03:10:55,205 INFO [Listener at localhost/46707] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6bc8dbaf-aac0-03cf-90d4-be6af049f709/dfs.journalnode.edits.dir in system properties and HBase conf 2023-07-15 03:10:55,205 INFO [Listener at localhost/46707] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6bc8dbaf-aac0-03cf-90d4-be6af049f709/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-07-15 03:10:55,206 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-15 03:10:55,206 INFO [Listener at localhost/46707] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6bc8dbaf-aac0-03cf-90d4-be6af049f709/nfs.dump.dir in system properties and HBase conf 2023-07-15 03:10:55,206 INFO [Listener at localhost/46707] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6bc8dbaf-aac0-03cf-90d4-be6af049f709/java.io.tmpdir in system properties and HBase conf 2023-07-15 03:10:55,206 INFO [Listener at localhost/46707] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6bc8dbaf-aac0-03cf-90d4-be6af049f709/dfs.journalnode.edits.dir in system properties and HBase conf 2023-07-15 03:10:55,206 INFO [Listener at localhost/46707] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6bc8dbaf-aac0-03cf-90d4-be6af049f709/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-07-15 03:10:55,206 INFO [Listener at localhost/46707] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6bc8dbaf-aac0-03cf-90d4-be6af049f709/fs.s3a.committer.staging.tmp.path in system properties and HBase conf 2023-07-15 03:10:55,206 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-15 03:10:55,207 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:acl","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689390655206"}]},"ts":"1689390655206"} 2023-07-15 03:10:55,209 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=hbase:acl, state=ENABLING in hbase:meta 2023-07-15 03:10:55,216 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-15 03:10:55,217 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-15 03:10:55,217 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-15 03:10:55,217 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-15 03:10:55,217 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-15 03:10:55,218 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:acl, region=39a45926df72fe7e305cdcf6976a1482, ASSIGN}] 2023-07-15 03:10:55,220 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:acl, region=39a45926df72fe7e305cdcf6976a1482, ASSIGN 2023-07-15 03:10:55,222 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:acl, region=39a45926df72fe7e305cdcf6976a1482, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,39199,1689390651299; forceNewPlan=false, retain=false 2023-07-15 03:10:55,373 INFO [jenkins-hbase4:41669] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-07-15 03:10:55,374 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=39a45926df72fe7e305cdcf6976a1482, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,39199,1689390651299 2023-07-15 03:10:55,374 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:acl,,1689390655077.39a45926df72fe7e305cdcf6976a1482.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1689390655374"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689390655374"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689390655374"}]},"ts":"1689390655374"} 2023-07-15 03:10:55,378 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE; OpenRegionProcedure 39a45926df72fe7e305cdcf6976a1482, server=jenkins-hbase4.apache.org,39199,1689390651299}] 2023-07-15 03:10:55,406 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-15 03:10:55,547 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:acl,,1689390655077.39a45926df72fe7e305cdcf6976a1482. 2023-07-15 03:10:55,547 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 39a45926df72fe7e305cdcf6976a1482, NAME => 'hbase:acl,,1689390655077.39a45926df72fe7e305cdcf6976a1482.', STARTKEY => '', ENDKEY => ''} 2023-07-15 03:10:55,548 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:acl,,1689390655077.39a45926df72fe7e305cdcf6976a1482. service=AccessControlService 2023-07-15 03:10:55,548 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-15 03:10:55,548 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table acl 39a45926df72fe7e305cdcf6976a1482 2023-07-15 03:10:55,548 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:acl,,1689390655077.39a45926df72fe7e305cdcf6976a1482.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-15 03:10:55,548 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 39a45926df72fe7e305cdcf6976a1482 2023-07-15 03:10:55,548 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 39a45926df72fe7e305cdcf6976a1482 2023-07-15 03:10:55,555 INFO [StoreOpener-39a45926df72fe7e305cdcf6976a1482-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family l of region 39a45926df72fe7e305cdcf6976a1482 2023-07-15 03:10:55,557 DEBUG [StoreOpener-39a45926df72fe7e305cdcf6976a1482-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/data/hbase/acl/39a45926df72fe7e305cdcf6976a1482/l 2023-07-15 03:10:55,557 DEBUG [StoreOpener-39a45926df72fe7e305cdcf6976a1482-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/data/hbase/acl/39a45926df72fe7e305cdcf6976a1482/l 2023-07-15 03:10:55,558 INFO [StoreOpener-39a45926df72fe7e305cdcf6976a1482-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 39a45926df72fe7e305cdcf6976a1482 columnFamilyName l 2023-07-15 03:10:55,559 INFO [StoreOpener-39a45926df72fe7e305cdcf6976a1482-1] regionserver.HStore(310): Store=39a45926df72fe7e305cdcf6976a1482/l, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-15 03:10:55,566 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/data/hbase/acl/39a45926df72fe7e305cdcf6976a1482 2023-07-15 03:10:55,568 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/data/hbase/acl/39a45926df72fe7e305cdcf6976a1482 2023-07-15 03:10:55,574 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 39a45926df72fe7e305cdcf6976a1482 2023-07-15 03:10:55,581 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/data/hbase/acl/39a45926df72fe7e305cdcf6976a1482/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-15 03:10:55,587 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 39a45926df72fe7e305cdcf6976a1482; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72294335, jitterRate=0.0772695392370224}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-15 03:10:55,587 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 39a45926df72fe7e305cdcf6976a1482: 2023-07-15 03:10:55,589 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:acl,,1689390655077.39a45926df72fe7e305cdcf6976a1482., pid=11, masterSystemTime=1689390655533 2023-07-15 03:10:55,593 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:acl,,1689390655077.39a45926df72fe7e305cdcf6976a1482. 2023-07-15 03:10:55,593 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:acl,,1689390655077.39a45926df72fe7e305cdcf6976a1482. 2023-07-15 03:10:55,594 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=39a45926df72fe7e305cdcf6976a1482, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,39199,1689390651299 2023-07-15 03:10:55,595 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:acl,,1689390655077.39a45926df72fe7e305cdcf6976a1482.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1689390655594"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689390655594"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689390655594"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689390655594"}]},"ts":"1689390655594"} 2023-07-15 03:10:55,612 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=11, resume processing ppid=10 2023-07-15 03:10:55,612 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=11, ppid=10, state=SUCCESS; OpenRegionProcedure 39a45926df72fe7e305cdcf6976a1482, server=jenkins-hbase4.apache.org,39199,1689390651299 in 221 msec 2023-07-15 03:10:55,620 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=10, resume processing ppid=9 2023-07-15 03:10:55,620 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=10, ppid=9, state=SUCCESS; TransitRegionStateProcedure table=hbase:acl, region=39a45926df72fe7e305cdcf6976a1482, ASSIGN in 395 msec 2023-07-15 03:10:55,623 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-15 03:10:55,623 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:acl","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689390655623"}]},"ts":"1689390655623"} 2023-07-15 03:10:55,626 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:acl, state=ENABLED in hbase:meta 2023-07-15 03:10:55,632 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_POST_OPERATION 2023-07-15 03:10:55,636 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=9, state=SUCCESS; CreateTableProcedure table=hbase:acl in 551 msec 2023-07-15 03:10:55,706 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-15 03:10:55,706 INFO [master/jenkins-hbase4:0:becomeActiveMaster] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: hbase:acl, procId: 9 completed 2023-07-15 03:10:55,719 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1175): Balancer post startup initialization complete, took 0 seconds 2023-07-15 03:10:56,551 WARN [Thread-383] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-15 03:10:56,958 INFO [Thread-383] log.Slf4jLog(67): jetty-6.1.26 2023-07-15 03:10:56,965 INFO [Thread-383] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/jobhistory to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6bc8dbaf-aac0-03cf-90d4-be6af049f709/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_37481_jobhistory____.153ozy/webapp 2023-07-15 03:10:57,160 INFO [Thread-383] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.mapreduce.v2.hs.webapp.HsWebServices as a root resource class 2023-07-15 03:10:57,160 INFO [Thread-383] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.mapreduce.v2.hs.webapp.JAXBContextResolver as a provider class 2023-07-15 03:10:57,160 INFO [Thread-383] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-07-15 03:10:57,165 INFO [Thread-383] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-07-15 03:10:57,266 INFO [Thread-383] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.mapreduce.v2.hs.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-15 03:10:57,641 INFO [Thread-383] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-15 03:10:58,257 INFO [Thread-383] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.mapreduce.v2.hs.webapp.HsWebServices to GuiceManagedComponentProvider with the scope "PerRequest" 2023-07-15 03:10:58,319 INFO [Thread-383] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:37481 2023-07-15 03:10:59,526 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-15 03:10:59,555 WARN [Listener at jenkins-hbase4.apache.org/39553] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-15 03:10:59,868 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:namespace' 2023-07-15 03:10:59,870 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:acl' 2023-07-15 03:10:59,871 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:meta' 2023-07-15 03:10:59,904 WARN [Listener at jenkins-hbase4.apache.org/39553] servlet.GuiceFilter(87): Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected. 2023-07-15 03:10:59,905 INFO [Listener at jenkins-hbase4.apache.org/39553] log.Slf4jLog(67): jetty-6.1.26 2023-07-15 03:10:59,913 INFO [Listener at jenkins-hbase4.apache.org/39553] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/cluster to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6bc8dbaf-aac0-03cf-90d4-be6af049f709/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_38065_cluster____e8po1m/webapp 2023-07-15 03:10:59,960 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.RegionServer.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-07-15 03:10:59,961 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.RegionServer.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase RegionServerObservers 2023-07-15 03:10:59,962 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-07-15 03:10:59,962 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase MasterObservers 2023-07-15 03:10:59,962 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver 2023-07-15 03:10:59,962 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver Metrics about HBase MasterObservers 2023-07-15 03:10:59,963 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-07-15 03:10:59,963 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase RegionObservers 2023-07-15 03:10:59,963 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-07-15 03:10:59,963 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint Metrics about HBase RegionObservers 2023-07-15 03:11:00,006 INFO [Listener at jenkins-hbase4.apache.org/39553] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.server.resourcemanager.webapp.JAXBContextResolver as a provider class 2023-07-15 03:11:00,006 INFO [Listener at jenkins-hbase4.apache.org/39553] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.yarn.server.resourcemanager.webapp.RMWebServices as a root resource class 2023-07-15 03:11:00,007 INFO [Listener at jenkins-hbase4.apache.org/39553] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-07-15 03:11:00,007 INFO [Listener at jenkins-hbase4.apache.org/39553] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-07-15 03:11:00,018 INFO [Listener at jenkins-hbase4.apache.org/39553] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.resourcemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-15 03:11:00,263 INFO [Listener at jenkins-hbase4.apache.org/39553] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-15 03:11:00,385 INFO [Listener at jenkins-hbase4.apache.org/39553] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.resourcemanager.webapp.RMWebServices to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-15 03:11:00,394 INFO [Listener at jenkins-hbase4.apache.org/39553] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:38065 2023-07-15 03:11:00,984 WARN [Listener at jenkins-hbase4.apache.org/44987] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-15 03:11:01,026 WARN [Listener at jenkins-hbase4.apache.org/44987] servlet.GuiceFilter(87): Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected. 2023-07-15 03:11:01,027 INFO [Listener at jenkins-hbase4.apache.org/44987] log.Slf4jLog(67): jetty-6.1.26 2023-07-15 03:11:01,036 INFO [Listener at jenkins-hbase4.apache.org/44987] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/node to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6bc8dbaf-aac0-03cf-90d4-be6af049f709/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_33449_node____ccucnr/webapp 2023-07-15 03:11:01,121 INFO [Listener at jenkins-hbase4.apache.org/44987] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices as a root resource class 2023-07-15 03:11:01,121 INFO [Listener at jenkins-hbase4.apache.org/44987] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-07-15 03:11:01,121 INFO [Listener at jenkins-hbase4.apache.org/44987] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver as a provider class 2023-07-15 03:11:01,121 INFO [Listener at jenkins-hbase4.apache.org/44987] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-07-15 03:11:01,135 INFO [Listener at jenkins-hbase4.apache.org/44987] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-15 03:11:01,166 INFO [Listener at jenkins-hbase4.apache.org/44987] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-15 03:11:01,273 INFO [Listener at jenkins-hbase4.apache.org/44987] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-15 03:11:01,292 INFO [Listener at jenkins-hbase4.apache.org/44987] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:33449 2023-07-15 03:11:01,553 WARN [Listener at jenkins-hbase4.apache.org/44817] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-15 03:11:01,574 WARN [Listener at jenkins-hbase4.apache.org/44817] servlet.GuiceFilter(87): Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected. 2023-07-15 03:11:01,574 INFO [Listener at jenkins-hbase4.apache.org/44817] log.Slf4jLog(67): jetty-6.1.26 2023-07-15 03:11:01,582 INFO [Listener at jenkins-hbase4.apache.org/44817] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/node to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6bc8dbaf-aac0-03cf-90d4-be6af049f709/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_39493_node____.otpday/webapp 2023-07-15 03:11:01,641 INFO [Listener at jenkins-hbase4.apache.org/44817] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices as a root resource class 2023-07-15 03:11:01,641 INFO [Listener at jenkins-hbase4.apache.org/44817] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-07-15 03:11:01,641 INFO [Listener at jenkins-hbase4.apache.org/44817] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver as a provider class 2023-07-15 03:11:01,641 INFO [Listener at jenkins-hbase4.apache.org/44817] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-07-15 03:11:01,650 INFO [Listener at jenkins-hbase4.apache.org/44817] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-15 03:11:01,665 INFO [Listener at jenkins-hbase4.apache.org/44817] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-15 03:11:01,752 INFO [Listener at jenkins-hbase4.apache.org/44817] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-15 03:11:01,760 INFO [Listener at jenkins-hbase4.apache.org/44817] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:39493 2023-07-15 03:11:01,792 INFO [Listener at jenkins-hbase4.apache.org/44817] hbase.HBaseTestingUtility(2726): Mini mapreduce cluster started 2023-07-15 03:11:01,793 INFO [Listener at jenkins-hbase4.apache.org/44817] hbase.Waiter(180): Waiting up to [30,000] milli-secs(wait.for.ratio=[1]) 2023-07-15 03:11:01,865 INFO [Listener at jenkins-hbase4.apache.org/44817] hbase.ResourceChecker(147): before: snapshot.TestSecureExportSnapshot#testExportWithTargetName Thread=706, OpenFileDescriptor=896, MaxFileDescriptor=60000, SystemLoadAverage=252, ProcessCount=174, AvailableMemoryMB=4294 2023-07-15 03:11:01,865 WARN [Listener at jenkins-hbase4.apache.org/44817] hbase.ResourceChecker(130): Thread=706 is superior to 500 2023-07-15 03:11:01,880 DEBUG [Listener at jenkins-hbase4.apache.org/44817] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-07-15 03:11:01,886 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:58106, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-07-15 03:11:01,893 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41669] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportWithTargetName', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-15 03:11:01,896 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41669] procedure2.ProcedureExecutor(1029): Stored pid=12, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportWithTargetName 2023-07-15 03:11:01,899 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_PRE_OPERATION 2023-07-15 03:11:01,899 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41669] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportWithTargetName" procId is: 12 2023-07-15 03:11:01,901 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-15 03:11:01,903 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41669] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-15 03:11:01,905 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/.tmp/data/default/testtb-testExportWithTargetName/9de9b665189dc5bcdfd040d038343a47 2023-07-15 03:11:01,906 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/.tmp/data/default/testtb-testExportWithTargetName/9f5de522bde202413f433e886e3efa7d 2023-07-15 03:11:01,907 DEBUG [HFileArchiver-4] backup.HFileArchiver(153): Directory hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/.tmp/data/default/testtb-testExportWithTargetName/9f5de522bde202413f433e886e3efa7d empty. 2023-07-15 03:11:01,907 DEBUG [HFileArchiver-3] backup.HFileArchiver(153): Directory hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/.tmp/data/default/testtb-testExportWithTargetName/9de9b665189dc5bcdfd040d038343a47 empty. 2023-07-15 03:11:01,909 DEBUG [HFileArchiver-4] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/.tmp/data/default/testtb-testExportWithTargetName/9f5de522bde202413f433e886e3efa7d 2023-07-15 03:11:01,911 DEBUG [HFileArchiver-3] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/.tmp/data/default/testtb-testExportWithTargetName/9de9b665189dc5bcdfd040d038343a47 2023-07-15 03:11:01,911 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testExportWithTargetName regions 2023-07-15 03:11:01,942 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/.tmp/data/default/testtb-testExportWithTargetName/.tabledesc/.tableinfo.0000000001 2023-07-15 03:11:01,944 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(7675): creating {ENCODED => 9de9b665189dc5bcdfd040d038343a47, NAME => 'testtb-testExportWithTargetName,,1689390661893.9de9b665189dc5bcdfd040d038343a47.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportWithTargetName', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/.tmp 2023-07-15 03:11:01,944 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(7675): creating {ENCODED => 9f5de522bde202413f433e886e3efa7d, NAME => 'testtb-testExportWithTargetName,1,1689390661893.9f5de522bde202413f433e886e3efa7d.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportWithTargetName', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/.tmp 2023-07-15 03:11:01,979 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,1,1689390661893.9f5de522bde202413f433e886e3efa7d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-15 03:11:01,979 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1604): Closing 9f5de522bde202413f433e886e3efa7d, disabling compactions & flushes 2023-07-15 03:11:01,979 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,1,1689390661893.9f5de522bde202413f433e886e3efa7d. 2023-07-15 03:11:01,979 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,1,1689390661893.9f5de522bde202413f433e886e3efa7d. 2023-07-15 03:11:01,979 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,1,1689390661893.9f5de522bde202413f433e886e3efa7d. after waiting 0 ms 2023-07-15 03:11:01,979 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,1,1689390661893.9f5de522bde202413f433e886e3efa7d. 2023-07-15 03:11:01,979 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,,1689390661893.9de9b665189dc5bcdfd040d038343a47.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-15 03:11:01,979 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,1,1689390661893.9f5de522bde202413f433e886e3efa7d. 2023-07-15 03:11:01,980 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1604): Closing 9de9b665189dc5bcdfd040d038343a47, disabling compactions & flushes 2023-07-15 03:11:01,980 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1558): Region close journal for 9f5de522bde202413f433e886e3efa7d: 2023-07-15 03:11:01,980 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,,1689390661893.9de9b665189dc5bcdfd040d038343a47. 2023-07-15 03:11:01,980 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,,1689390661893.9de9b665189dc5bcdfd040d038343a47. 2023-07-15 03:11:01,980 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,,1689390661893.9de9b665189dc5bcdfd040d038343a47. after waiting 0 ms 2023-07-15 03:11:01,980 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,,1689390661893.9de9b665189dc5bcdfd040d038343a47. 2023-07-15 03:11:01,980 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,,1689390661893.9de9b665189dc5bcdfd040d038343a47. 2023-07-15 03:11:01,980 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1558): Region close journal for 9de9b665189dc5bcdfd040d038343a47: 2023-07-15 03:11:01,984 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_ADD_TO_META 2023-07-15 03:11:01,985 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,1,1689390661893.9f5de522bde202413f433e886e3efa7d.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689390661985"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689390661985"}]},"ts":"1689390661985"} 2023-07-15 03:11:01,985 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,,1689390661893.9de9b665189dc5bcdfd040d038343a47.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689390661985"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689390661985"}]},"ts":"1689390661985"} 2023-07-15 03:11:02,005 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41669] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-15 03:11:02,032 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-15 03:11:02,033 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-15 03:11:02,033 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689390662033"}]},"ts":"1689390662033"} 2023-07-15 03:11:02,035 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=ENABLING in hbase:meta 2023-07-15 03:11:02,042 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-15 03:11:02,044 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-15 03:11:02,044 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-15 03:11:02,044 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-15 03:11:02,044 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-15 03:11:02,044 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=9de9b665189dc5bcdfd040d038343a47, ASSIGN}, {pid=14, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=9f5de522bde202413f433e886e3efa7d, ASSIGN}] 2023-07-15 03:11:02,048 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=9de9b665189dc5bcdfd040d038343a47, ASSIGN 2023-07-15 03:11:02,048 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=14, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=9f5de522bde202413f433e886e3efa7d, ASSIGN 2023-07-15 03:11:02,049 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=9de9b665189dc5bcdfd040d038343a47, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,39199,1689390651299; forceNewPlan=false, retain=false 2023-07-15 03:11:02,049 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=14, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=9f5de522bde202413f433e886e3efa7d, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,38367,1689390651355; forceNewPlan=false, retain=false 2023-07-15 03:11:02,199 INFO [jenkins-hbase4:41669] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-15 03:11:02,202 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=9de9b665189dc5bcdfd040d038343a47, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,39199,1689390651299 2023-07-15 03:11:02,202 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=9f5de522bde202413f433e886e3efa7d, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,38367,1689390651355 2023-07-15 03:11:02,202 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,,1689390661893.9de9b665189dc5bcdfd040d038343a47.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689390662202"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689390662202"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689390662202"}]},"ts":"1689390662202"} 2023-07-15 03:11:02,202 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,1,1689390661893.9f5de522bde202413f433e886e3efa7d.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689390662202"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689390662202"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689390662202"}]},"ts":"1689390662202"} 2023-07-15 03:11:02,205 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=15, ppid=13, state=RUNNABLE; OpenRegionProcedure 9de9b665189dc5bcdfd040d038343a47, server=jenkins-hbase4.apache.org,39199,1689390651299}] 2023-07-15 03:11:02,206 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41669] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-15 03:11:02,207 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=16, ppid=14, state=RUNNABLE; OpenRegionProcedure 9f5de522bde202413f433e886e3efa7d, server=jenkins-hbase4.apache.org,38367,1689390651355}] 2023-07-15 03:11:02,365 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportWithTargetName,,1689390661893.9de9b665189dc5bcdfd040d038343a47. 2023-07-15 03:11:02,366 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 9de9b665189dc5bcdfd040d038343a47, NAME => 'testtb-testExportWithTargetName,,1689390661893.9de9b665189dc5bcdfd040d038343a47.', STARTKEY => '', ENDKEY => '1'} 2023-07-15 03:11:02,366 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportWithTargetName,,1689390661893.9de9b665189dc5bcdfd040d038343a47. service=AccessControlService 2023-07-15 03:11:02,366 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-15 03:11:02,367 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportWithTargetName 9de9b665189dc5bcdfd040d038343a47 2023-07-15 03:11:02,367 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,,1689390661893.9de9b665189dc5bcdfd040d038343a47.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-15 03:11:02,367 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 9de9b665189dc5bcdfd040d038343a47 2023-07-15 03:11:02,367 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 9de9b665189dc5bcdfd040d038343a47 2023-07-15 03:11:02,384 INFO [StoreOpener-9de9b665189dc5bcdfd040d038343a47-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 9de9b665189dc5bcdfd040d038343a47 2023-07-15 03:11:02,384 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportWithTargetName,1,1689390661893.9f5de522bde202413f433e886e3efa7d. 2023-07-15 03:11:02,384 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 9f5de522bde202413f433e886e3efa7d, NAME => 'testtb-testExportWithTargetName,1,1689390661893.9f5de522bde202413f433e886e3efa7d.', STARTKEY => '1', ENDKEY => ''} 2023-07-15 03:11:02,385 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportWithTargetName,1,1689390661893.9f5de522bde202413f433e886e3efa7d. service=AccessControlService 2023-07-15 03:11:02,385 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-15 03:11:02,385 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportWithTargetName 9f5de522bde202413f433e886e3efa7d 2023-07-15 03:11:02,385 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,1,1689390661893.9f5de522bde202413f433e886e3efa7d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-15 03:11:02,385 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 9f5de522bde202413f433e886e3efa7d 2023-07-15 03:11:02,385 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 9f5de522bde202413f433e886e3efa7d 2023-07-15 03:11:02,387 DEBUG [StoreOpener-9de9b665189dc5bcdfd040d038343a47-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/data/default/testtb-testExportWithTargetName/9de9b665189dc5bcdfd040d038343a47/cf 2023-07-15 03:11:02,387 DEBUG [StoreOpener-9de9b665189dc5bcdfd040d038343a47-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/data/default/testtb-testExportWithTargetName/9de9b665189dc5bcdfd040d038343a47/cf 2023-07-15 03:11:02,387 INFO [StoreOpener-9de9b665189dc5bcdfd040d038343a47-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 9de9b665189dc5bcdfd040d038343a47 columnFamilyName cf 2023-07-15 03:11:02,388 INFO [StoreOpener-9f5de522bde202413f433e886e3efa7d-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 9f5de522bde202413f433e886e3efa7d 2023-07-15 03:11:02,388 INFO [StoreOpener-9de9b665189dc5bcdfd040d038343a47-1] regionserver.HStore(310): Store=9de9b665189dc5bcdfd040d038343a47/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-15 03:11:02,391 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/data/default/testtb-testExportWithTargetName/9de9b665189dc5bcdfd040d038343a47 2023-07-15 03:11:02,392 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/data/default/testtb-testExportWithTargetName/9de9b665189dc5bcdfd040d038343a47 2023-07-15 03:11:02,392 DEBUG [StoreOpener-9f5de522bde202413f433e886e3efa7d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/data/default/testtb-testExportWithTargetName/9f5de522bde202413f433e886e3efa7d/cf 2023-07-15 03:11:02,392 DEBUG [StoreOpener-9f5de522bde202413f433e886e3efa7d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/data/default/testtb-testExportWithTargetName/9f5de522bde202413f433e886e3efa7d/cf 2023-07-15 03:11:02,392 INFO [StoreOpener-9f5de522bde202413f433e886e3efa7d-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 9f5de522bde202413f433e886e3efa7d columnFamilyName cf 2023-07-15 03:11:02,393 INFO [StoreOpener-9f5de522bde202413f433e886e3efa7d-1] regionserver.HStore(310): Store=9f5de522bde202413f433e886e3efa7d/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-15 03:11:02,395 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/data/default/testtb-testExportWithTargetName/9f5de522bde202413f433e886e3efa7d 2023-07-15 03:11:02,397 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 9de9b665189dc5bcdfd040d038343a47 2023-07-15 03:11:02,397 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/data/default/testtb-testExportWithTargetName/9f5de522bde202413f433e886e3efa7d 2023-07-15 03:11:02,403 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/data/default/testtb-testExportWithTargetName/9de9b665189dc5bcdfd040d038343a47/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-15 03:11:02,404 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 9de9b665189dc5bcdfd040d038343a47; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=58988567, jitterRate=-0.12100185453891754}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-15 03:11:02,404 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 9de9b665189dc5bcdfd040d038343a47: 2023-07-15 03:11:02,405 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 9f5de522bde202413f433e886e3efa7d 2023-07-15 03:11:02,405 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportWithTargetName,,1689390661893.9de9b665189dc5bcdfd040d038343a47., pid=15, masterSystemTime=1689390662358 2023-07-15 03:11:02,408 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportWithTargetName,,1689390661893.9de9b665189dc5bcdfd040d038343a47. 2023-07-15 03:11:02,408 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportWithTargetName,,1689390661893.9de9b665189dc5bcdfd040d038343a47. 2023-07-15 03:11:02,409 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/data/default/testtb-testExportWithTargetName/9f5de522bde202413f433e886e3efa7d/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-15 03:11:02,409 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=9de9b665189dc5bcdfd040d038343a47, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,39199,1689390651299 2023-07-15 03:11:02,409 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 9f5de522bde202413f433e886e3efa7d; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66055039, jitterRate=-0.015703216195106506}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-15 03:11:02,409 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportWithTargetName,,1689390661893.9de9b665189dc5bcdfd040d038343a47.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689390662409"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689390662409"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689390662409"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689390662409"}]},"ts":"1689390662409"} 2023-07-15 03:11:02,410 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 9f5de522bde202413f433e886e3efa7d: 2023-07-15 03:11:02,411 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportWithTargetName,1,1689390661893.9f5de522bde202413f433e886e3efa7d., pid=16, masterSystemTime=1689390662362 2023-07-15 03:11:02,413 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportWithTargetName,1,1689390661893.9f5de522bde202413f433e886e3efa7d. 2023-07-15 03:11:02,413 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportWithTargetName,1,1689390661893.9f5de522bde202413f433e886e3efa7d. 2023-07-15 03:11:02,414 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=9f5de522bde202413f433e886e3efa7d, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,38367,1689390651355 2023-07-15 03:11:02,415 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportWithTargetName,1,1689390661893.9f5de522bde202413f433e886e3efa7d.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689390662413"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689390662413"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689390662413"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689390662413"}]},"ts":"1689390662413"} 2023-07-15 03:11:02,418 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=15, resume processing ppid=13 2023-07-15 03:11:02,419 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=15, ppid=13, state=SUCCESS; OpenRegionProcedure 9de9b665189dc5bcdfd040d038343a47, server=jenkins-hbase4.apache.org,39199,1689390651299 in 207 msec 2023-07-15 03:11:02,421 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=13, ppid=12, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=9de9b665189dc5bcdfd040d038343a47, ASSIGN in 375 msec 2023-07-15 03:11:02,424 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=16, resume processing ppid=14 2023-07-15 03:11:02,424 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=16, ppid=14, state=SUCCESS; OpenRegionProcedure 9f5de522bde202413f433e886e3efa7d, server=jenkins-hbase4.apache.org,38367,1689390651355 in 213 msec 2023-07-15 03:11:02,427 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=14, resume processing ppid=12 2023-07-15 03:11:02,427 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=14, ppid=12, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=9f5de522bde202413f433e886e3efa7d, ASSIGN in 380 msec 2023-07-15 03:11:02,428 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-15 03:11:02,429 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689390662428"}]},"ts":"1689390662428"} 2023-07-15 03:11:02,431 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=ENABLED in hbase:meta 2023-07-15 03:11:02,435 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_POST_OPERATION 2023-07-15 03:11:02,442 DEBUG [PEWorker-5] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportWithTargetName jenkins: RWXCA 2023-07-15 03:11:02,453 DEBUG [hconnection-0x46b6ebf9-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-15 03:11:02,455 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:41666, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.1 (auth:SIMPLE), service=ClientService 2023-07-15 03:11:02,466 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=39199] access.PermissionStorage(611): Read acl: entry[testtb-testExportWithTargetName], kv [jenkins: RWXCA] 2023-07-15 03:11:02,502 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): regionserver:38367-0x10166f610e80003, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-07-15 03:11:02,502 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): regionserver:43199-0x10166f610e80001, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-07-15 03:11:02,502 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): regionserver:39199-0x10166f610e80002, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-07-15 03:11:02,502 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): master:41669-0x10166f610e80000, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-07-15 03:11:02,503 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): master:41669-0x10166f610e80000, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-15 03:11:02,510 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): regionserver:43199-0x10166f610e80001, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-15 03:11:02,510 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): master:41669-0x10166f610e80000, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-15 03:11:02,510 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): regionserver:38367-0x10166f610e80003, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-15 03:11:02,510 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): regionserver:39199-0x10166f610e80002, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-15 03:11:02,510 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41669] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-15 03:11:02,511 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-07-15 03:11:02,511 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-07-15 03:11:02,511 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-07-15 03:11:02,511 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-07-15 03:11:02,514 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=12, state=SUCCESS; CreateTableProcedure table=testtb-testExportWithTargetName in 617 msec 2023-07-15 03:11:03,012 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41669] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-15 03:11:03,012 INFO [Listener at jenkins-hbase4.apache.org/44817] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportWithTargetName, procId: 12 completed 2023-07-15 03:11:03,013 DEBUG [Listener at jenkins-hbase4.apache.org/44817] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testtb-testExportWithTargetName get assigned. Timeout = 60000ms 2023-07-15 03:11:03,014 INFO [Listener at jenkins-hbase4.apache.org/44817] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-15 03:11:03,019 INFO [Listener at jenkins-hbase4.apache.org/44817] hbase.HBaseTestingUtility(3484): All regions for table testtb-testExportWithTargetName assigned to meta. Checking AM states. 2023-07-15 03:11:03,020 INFO [Listener at jenkins-hbase4.apache.org/44817] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-15 03:11:03,020 INFO [Listener at jenkins-hbase4.apache.org/44817] hbase.HBaseTestingUtility(3504): All regions for table testtb-testExportWithTargetName assigned. 2023-07-15 03:11:03,037 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41669] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-15 03:11:03,037 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41669] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689390663037 (current time:1689390663037). 2023-07-15 03:11:03,037 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41669] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-15 03:11:03,038 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41669] zookeeper.ReadOnlyZKClient(139): Connect 0x003f5239 to 127.0.0.1:62663 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-15 03:11:03,045 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41669] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@42b97608, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-15 03:11:03,047 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41669] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-15 03:11:03,050 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:41676, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-15 03:11:03,052 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41669] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x003f5239 to 127.0.0.1:62663 2023-07-15 03:11:03,052 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41669] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-15 03:11:03,054 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41669] zookeeper.ReadOnlyZKClient(139): Connect 0x59bd1af2 to 127.0.0.1:62663 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-15 03:11:03,068 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41669] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@55a582b7, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-15 03:11:03,071 DEBUG [hconnection-0x375f2600-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-15 03:11:03,075 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:41680, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-15 03:11:03,082 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41669] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-15 03:11:03,084 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:53146, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-15 03:11:03,085 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41669] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x59bd1af2 to 127.0.0.1:62663 2023-07-15 03:11:03,085 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41669] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-15 03:11:03,085 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41669] access.PermissionStorage(611): Read acl: entry[testtb-testExportWithTargetName], kv [jenkins: RWXCA] 2023-07-15 03:11:03,110 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41669] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-15 03:11:03,112 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41669] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-15 03:11:03,136 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41669] procedure2.ProcedureExecutor(1029): Stored pid=17, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-15 03:11:03,138 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=17, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-15 03:11:03,139 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=17, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE; timeout=600000, timestamp=1689391263139 2023-07-15 03:11:03,139 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41669] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-15 03:11:03,139 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName 2023-07-15 03:11:03,142 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=17, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-15 03:11:03,144 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=18, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-15 03:11:03,145 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=17, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE in 14 msec 2023-07-15 03:11:03,146 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=18, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-15 03:11:03,147 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=18, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED; timeout=600000, timestamp=1689391263147 2023-07-15 03:11:03,148 DEBUG [Listener at jenkins-hbase4.apache.org/44817] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-15 03:11:03,148 DEBUG [Listener at jenkins-hbase4.apache.org/44817] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-15 03:11:03,184 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportWithTargetName 2023-07-15 03:11:03,184 INFO [(jenkins-hbase4.apache.org,41669,1689390649760)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportWithTargetName' 2023-07-15 03:11:03,184 DEBUG [(jenkins-hbase4.apache.org,41669,1689390649760)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-15 03:11:03,185 DEBUG [(jenkins-hbase4.apache.org,41669,1689390649760)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' 2023-07-15 03:11:03,185 DEBUG [(jenkins-hbase4.apache.org,41669,1689390649760)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportWithTargetName', kicking off acquire phase on members. 2023-07-15 03:11:03,186 DEBUG [(jenkins-hbase4.apache.org,41669,1689390649760)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41669-0x10166f610e80000, quorum=127.0.0.1:62663, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-15 03:11:03,186 DEBUG [(jenkins-hbase4.apache.org,41669,1689390649760)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-15 03:11:03,193 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): regionserver:43199-0x10166f610e80001, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 03:11:03,193 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): regionserver:38367-0x10166f610e80003, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 03:11:03,193 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 03:11:03,193 DEBUG [(jenkins-hbase4.apache.org,41669,1689390649760)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,38367,1689390651355 2023-07-15 03:11:03,193 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 03:11:03,193 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 03:11:03,193 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): regionserver:39199-0x10166f610e80002, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 03:11:03,194 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 03:11:03,194 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 03:11:03,194 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 03:11:03,194 DEBUG [(jenkins-hbase4.apache.org,41669,1689390649760)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41669-0x10166f610e80000, quorum=127.0.0.1:62663, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,38367,1689390651355 2023-07-15 03:11:03,194 DEBUG [(jenkins-hbase4.apache.org,41669,1689390649760)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39199,1689390651299 2023-07-15 03:11:03,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-15 03:11:03,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-15 03:11:03,194 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-15 03:11:03,196 DEBUG [(jenkins-hbase4.apache.org,41669,1689390649760)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41669-0x10166f610e80000, quorum=127.0.0.1:62663, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39199,1689390651299 2023-07-15 03:11:03,196 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39199-0x10166f610e80002, quorum=127.0.0.1:62663, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-15 03:11:03,196 DEBUG [(jenkins-hbase4.apache.org,41669,1689390649760)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-15 03:11:03,196 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43199-0x10166f610e80001, quorum=127.0.0.1:62663, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-15 03:11:03,197 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38367-0x10166f610e80003, quorum=127.0.0.1:62663, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-15 03:11:03,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 171 2023-07-15 03:11:03,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-15 03:11:03,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 171 2023-07-15 03:11:03,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-15 03:11:03,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 171 2023-07-15 03:11:03,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-15 03:11:03,197 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-15 03:11:03,197 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-15 03:11:03,198 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-15 03:11:03,200 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportWithTargetName 2023-07-15 03:11:03,201 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportWithTargetName 2023-07-15 03:11:03,201 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportWithTargetName 2023-07-15 03:11:03,201 DEBUG [member: 'jenkins-hbase4.apache.org,43199,1689390651225' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-15 03:11:03,201 DEBUG [member: 'jenkins-hbase4.apache.org,43199,1689390651225' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-15 03:11:03,201 DEBUG [member: 'jenkins-hbase4.apache.org,38367,1689390651355' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-15 03:11:03,201 DEBUG [member: 'jenkins-hbase4.apache.org,38367,1689390651355' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-15 03:11:03,203 DEBUG [member: 'jenkins-hbase4.apache.org,39199,1689390651299' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-15 03:11:03,203 DEBUG [member: 'jenkins-hbase4.apache.org,39199,1689390651299' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-15 03:11:03,203 DEBUG [member: 'jenkins-hbase4.apache.org,43199,1689390651225' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-15 03:11:03,204 DEBUG [member: 'jenkins-hbase4.apache.org,39199,1689390651299' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-15 03:11:03,204 DEBUG [member: 'jenkins-hbase4.apache.org,39199,1689390651299' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally acquired 2023-07-15 03:11:03,203 DEBUG [member: 'jenkins-hbase4.apache.org,38367,1689390651355' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-15 03:11:03,204 DEBUG [member: 'jenkins-hbase4.apache.org,39199,1689390651299' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39199,1689390651299' joining acquired barrier for procedure (emptySnaptb0-testExportWithTargetName) in zk 2023-07-15 03:11:03,204 DEBUG [member: 'jenkins-hbase4.apache.org,43199,1689390651225' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally acquired 2023-07-15 03:11:03,204 DEBUG [member: 'jenkins-hbase4.apache.org,43199,1689390651225' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43199,1689390651225' joining acquired barrier for procedure (emptySnaptb0-testExportWithTargetName) in zk 2023-07-15 03:11:03,204 DEBUG [member: 'jenkins-hbase4.apache.org,38367,1689390651355' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally acquired 2023-07-15 03:11:03,205 DEBUG [member: 'jenkins-hbase4.apache.org,38367,1689390651355' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38367,1689390651355' joining acquired barrier for procedure (emptySnaptb0-testExportWithTargetName) in zk 2023-07-15 03:11:03,207 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): master:41669-0x10166f610e80000, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39199,1689390651299 2023-07-15 03:11:03,207 DEBUG [member: 'jenkins-hbase4.apache.org,39199,1689390651299' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-15 03:11:03,207 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39199,1689390651299 2023-07-15 03:11:03,207 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 03:11:03,207 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 03:11:03,209 DEBUG [member: 'jenkins-hbase4.apache.org,43199,1689390651225' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-15 03:11:03,209 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): master:41669-0x10166f610e80000, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,38367,1689390651355 2023-07-15 03:11:03,209 DEBUG [member: 'jenkins-hbase4.apache.org,38367,1689390651355' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-15 03:11:03,209 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 03:11:03,209 DEBUG [member: 'jenkins-hbase4.apache.org,39199,1689390651299' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39199-0x10166f610e80002, quorum=127.0.0.1:62663, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-15 03:11:03,210 DEBUG [member: 'jenkins-hbase4.apache.org,39199,1689390651299' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-15 03:11:03,211 DEBUG [member: 'jenkins-hbase4.apache.org,43199,1689390651225' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43199-0x10166f610e80001, quorum=127.0.0.1:62663, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-15 03:11:03,211 DEBUG [member: 'jenkins-hbase4.apache.org,38367,1689390651355' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38367-0x10166f610e80003, quorum=127.0.0.1:62663, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-15 03:11:03,211 DEBUG [member: 'jenkins-hbase4.apache.org,43199,1689390651225' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-15 03:11:03,211 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 03:11:03,211 DEBUG [member: 'jenkins-hbase4.apache.org,38367,1689390651355' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-15 03:11:03,212 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-15 03:11:03,212 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43199,1689390651225 2023-07-15 03:11:03,213 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39199,1689390651299 2023-07-15 03:11:03,214 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38367,1689390651355 2023-07-15 03:11:03,214 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 03:11:03,215 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39199,1689390651299' joining acquired barrier for procedure 'emptySnaptb0-testExportWithTargetName' on coordinator 2023-07-15 03:11:03,215 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@703b0e13[Count = 1] remaining members to acquire global barrier 2023-07-15 03:11:03,215 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,38367,1689390651355 2023-07-15 03:11:03,215 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 03:11:03,215 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 03:11:03,215 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 03:11:03,216 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 03:11:03,216 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-15 03:11:03,216 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43199,1689390651225 2023-07-15 03:11:03,217 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39199,1689390651299 2023-07-15 03:11:03,217 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38367,1689390651355 2023-07-15 03:11:03,218 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 03:11:03,218 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,38367,1689390651355' joining acquired barrier for procedure 'emptySnaptb0-testExportWithTargetName' on coordinator 2023-07-15 03:11:03,218 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@703b0e13[Count = 0] remaining members to acquire global barrier 2023-07-15 03:11:03,218 DEBUG [(jenkins-hbase4.apache.org,41669,1689390649760)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportWithTargetName' starting 'in-barrier' execution. 2023-07-15 03:11:03,218 DEBUG [(jenkins-hbase4.apache.org,41669,1689390649760)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-15 03:11:03,220 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): regionserver:38367-0x10166f610e80003, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-15 03:11:03,220 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): regionserver:39199-0x10166f610e80002, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-15 03:11:03,220 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-15 03:11:03,220 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): regionserver:43199-0x10166f610e80001, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-15 03:11:03,220 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-15 03:11:03,221 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-15 03:11:03,221 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-15 03:11:03,221 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-15 03:11:03,221 DEBUG [member: 'jenkins-hbase4.apache.org,39199,1689390651299' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-15 03:11:03,221 DEBUG [member: 'jenkins-hbase4.apache.org,38367,1689390651355' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-15 03:11:03,221 DEBUG [(jenkins-hbase4.apache.org,41669,1689390649760)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41669-0x10166f610e80000, quorum=127.0.0.1:62663, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39199,1689390651299 2023-07-15 03:11:03,221 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-15 03:11:03,221 DEBUG [member: 'jenkins-hbase4.apache.org,43199,1689390651225' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-15 03:11:03,221 DEBUG [member: 'jenkins-hbase4.apache.org,43199,1689390651225' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally completed 2023-07-15 03:11:03,221 DEBUG [member: 'jenkins-hbase4.apache.org,43199,1689390651225' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,43199,1689390651225' in zk 2023-07-15 03:11:03,221 DEBUG [(jenkins-hbase4.apache.org,41669,1689390649760)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41669-0x10166f610e80000, quorum=127.0.0.1:62663, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,38367,1689390651355 2023-07-15 03:11:03,221 DEBUG [(jenkins-hbase4.apache.org,41669,1689390649760)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-15 03:11:03,222 DEBUG [member: 'jenkins-hbase4.apache.org,39199,1689390651299' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-15 03:11:03,222 DEBUG [member: 'jenkins-hbase4.apache.org,38367,1689390651355' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-15 03:11:03,222 DEBUG [rs(jenkins-hbase4.apache.org,38367,1689390651355)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,1,1689390661893.9f5de522bde202413f433e886e3efa7d. 2023-07-15 03:11:03,222 DEBUG [rs(jenkins-hbase4.apache.org,39199,1689390651299)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,,1689390661893.9de9b665189dc5bcdfd040d038343a47. 2023-07-15 03:11:03,222 DEBUG [member: 'jenkins-hbase4.apache.org,39199,1689390651299' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-15 03:11:03,222 DEBUG [member: 'jenkins-hbase4.apache.org,38367,1689390651355' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-15 03:11:03,223 DEBUG [rs(jenkins-hbase4.apache.org,38367,1689390651355)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,1,1689390661893.9f5de522bde202413f433e886e3efa7d. started... 2023-07-15 03:11:03,223 DEBUG [rs(jenkins-hbase4.apache.org,39199,1689390651299)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,,1689390661893.9de9b665189dc5bcdfd040d038343a47. started... 2023-07-15 03:11:03,224 DEBUG [member: 'jenkins-hbase4.apache.org,43199,1689390651225' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportWithTargetName' has notified controller of completion 2023-07-15 03:11:03,224 DEBUG [member: 'jenkins-hbase4.apache.org,43199,1689390651225' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-15 03:11:03,224 DEBUG [member: 'jenkins-hbase4.apache.org,43199,1689390651225' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportWithTargetName' completed. 2023-07-15 03:11:03,229 DEBUG [rs(jenkins-hbase4.apache.org,38367,1689390651355)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 9f5de522bde202413f433e886e3efa7d: 2023-07-15 03:11:03,229 DEBUG [rs(jenkins-hbase4.apache.org,39199,1689390651299)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 9de9b665189dc5bcdfd040d038343a47: 2023-07-15 03:11:03,230 DEBUG [rs(jenkins-hbase4.apache.org,39199,1689390651299)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,,1689390661893.9de9b665189dc5bcdfd040d038343a47.' region-info for snapshot=emptySnaptb0-testExportWithTargetName 2023-07-15 03:11:03,230 DEBUG [rs(jenkins-hbase4.apache.org,38367,1689390651355)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,1,1689390661893.9f5de522bde202413f433e886e3efa7d.' region-info for snapshot=emptySnaptb0-testExportWithTargetName 2023-07-15 03:11:03,236 DEBUG [rs(jenkins-hbase4.apache.org,39199,1689390651299)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-15 03:11:03,236 DEBUG [rs(jenkins-hbase4.apache.org,38367,1689390651355)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-15 03:11:03,240 DEBUG [rs(jenkins-hbase4.apache.org,39199,1689390651299)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-15 03:11:03,240 DEBUG [rs(jenkins-hbase4.apache.org,38367,1689390651355)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-15 03:11:03,248 DEBUG [Listener at jenkins-hbase4.apache.org/44817] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-15 03:11:03,252 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41669] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-15 03:11:03,255 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41669] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-07-15 03:11:03,258 DEBUG [Listener at jenkins-hbase4.apache.org/44817] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-15 03:11:03,267 DEBUG [rs(jenkins-hbase4.apache.org,39199,1689390651299)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,,1689390661893.9de9b665189dc5bcdfd040d038343a47. completed. 2023-07-15 03:11:03,267 DEBUG [rs(jenkins-hbase4.apache.org,39199,1689390651299)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,,1689390661893.9de9b665189dc5bcdfd040d038343a47. 2023-07-15 03:11:03,267 DEBUG [member: 'jenkins-hbase4.apache.org,39199,1689390651299' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-15 03:11:03,267 DEBUG [member: 'jenkins-hbase4.apache.org,39199,1689390651299' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-15 03:11:03,267 DEBUG [member: 'jenkins-hbase4.apache.org,39199,1689390651299' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,39199,1689390651299 2023-07-15 03:11:03,270 DEBUG [member: 'jenkins-hbase4.apache.org,39199,1689390651299' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally completed 2023-07-15 03:11:03,270 DEBUG [member: 'jenkins-hbase4.apache.org,39199,1689390651299' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,39199,1689390651299' in zk 2023-07-15 03:11:03,273 DEBUG [member: 'jenkins-hbase4.apache.org,39199,1689390651299' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportWithTargetName' has notified controller of completion 2023-07-15 03:11:03,273 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): master:41669-0x10166f610e80000, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39199,1689390651299 2023-07-15 03:11:03,273 DEBUG [member: 'jenkins-hbase4.apache.org,39199,1689390651299' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-15 03:11:03,273 DEBUG [member: 'jenkins-hbase4.apache.org,39199,1689390651299' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportWithTargetName' completed. 2023-07-15 03:11:03,273 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39199,1689390651299 2023-07-15 03:11:03,274 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 03:11:03,274 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 03:11:03,275 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 03:11:03,275 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 03:11:03,277 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-15 03:11:03,278 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43199,1689390651225 2023-07-15 03:11:03,278 DEBUG [rs(jenkins-hbase4.apache.org,38367,1689390651355)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,1,1689390661893.9f5de522bde202413f433e886e3efa7d. completed. 2023-07-15 03:11:03,279 DEBUG [rs(jenkins-hbase4.apache.org,38367,1689390651355)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,1,1689390661893.9f5de522bde202413f433e886e3efa7d. 2023-07-15 03:11:03,279 DEBUG [member: 'jenkins-hbase4.apache.org,38367,1689390651355' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-15 03:11:03,279 DEBUG [member: 'jenkins-hbase4.apache.org,38367,1689390651355' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-15 03:11:03,279 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39199,1689390651299 2023-07-15 03:11:03,279 DEBUG [member: 'jenkins-hbase4.apache.org,38367,1689390651355' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,38367,1689390651355 2023-07-15 03:11:03,279 DEBUG [member: 'jenkins-hbase4.apache.org,38367,1689390651355' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally completed 2023-07-15 03:11:03,279 DEBUG [member: 'jenkins-hbase4.apache.org,38367,1689390651355' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,38367,1689390651355' in zk 2023-07-15 03:11:03,280 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38367,1689390651355 2023-07-15 03:11:03,282 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): master:41669-0x10166f610e80000, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,38367,1689390651355 2023-07-15 03:11:03,282 DEBUG [member: 'jenkins-hbase4.apache.org,38367,1689390651355' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportWithTargetName' has notified controller of completion 2023-07-15 03:11:03,282 DEBUG [member: 'jenkins-hbase4.apache.org,38367,1689390651355' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-15 03:11:03,282 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 03:11:03,282 DEBUG [member: 'jenkins-hbase4.apache.org,38367,1689390651355' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportWithTargetName' completed. 2023-07-15 03:11:03,284 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-15 03:11:03,285 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43199,1689390651225 2023-07-15 03:11:03,285 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39199,1689390651299 2023-07-15 03:11:03,286 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38367,1689390651355 2023-07-15 03:11:03,287 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,39199,1689390651299': 2023-07-15 03:11:03,287 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39199,1689390651299' released barrier for procedure'emptySnaptb0-testExportWithTargetName', counting down latch. Waiting for 1 more 2023-07-15 03:11:03,287 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,38367,1689390651355 2023-07-15 03:11:03,287 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 03:11:03,287 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 03:11:03,288 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 03:11:03,288 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 03:11:03,288 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-15 03:11:03,289 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43199,1689390651225 2023-07-15 03:11:03,289 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39199,1689390651299 2023-07-15 03:11:03,289 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38367,1689390651355 2023-07-15 03:11:03,290 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 03:11:03,290 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-15 03:11:03,290 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43199,1689390651225 2023-07-15 03:11:03,291 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39199,1689390651299 2023-07-15 03:11:03,291 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38367,1689390651355 2023-07-15 03:11:03,291 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,38367,1689390651355': 2023-07-15 03:11:03,292 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,38367,1689390651355' released barrier for procedure'emptySnaptb0-testExportWithTargetName', counting down latch. Waiting for 0 more 2023-07-15 03:11:03,292 INFO [(jenkins-hbase4.apache.org,41669,1689390649760)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportWithTargetName' execution completed 2023-07-15 03:11:03,292 DEBUG [(jenkins-hbase4.apache.org,41669,1689390649760)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-15 03:11:03,292 DEBUG [(jenkins-hbase4.apache.org,41669,1689390649760)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-15 03:11:03,292 DEBUG [(jenkins-hbase4.apache.org,41669,1689390649760)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportWithTargetName 2023-07-15 03:11:03,292 INFO [(jenkins-hbase4.apache.org,41669,1689390649760)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportWithTargetNameincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-15 03:11:03,295 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): master:41669-0x10166f610e80000, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-15 03:11:03,295 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): regionserver:43199-0x10166f610e80001, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-15 03:11:03,295 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-15 03:11:03,295 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): regionserver:43199-0x10166f610e80001, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 03:11:03,295 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 03:11:03,295 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 03:11:03,295 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-15 03:11:03,295 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): regionserver:39199-0x10166f610e80002, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-15 03:11:03,295 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): regionserver:38367-0x10166f610e80003, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-15 03:11:03,295 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-15 03:11:03,295 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-15 03:11:03,295 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-15 03:11:03,295 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): regionserver:38367-0x10166f610e80003, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 03:11:03,295 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): regionserver:39199-0x10166f610e80002, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 03:11:03,295 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-15 03:11:03,295 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 03:11:03,295 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-15 03:11:03,296 DEBUG [(jenkins-hbase4.apache.org,41669,1689390649760)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41669-0x10166f610e80000, quorum=127.0.0.1:62663, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43199,1689390651225 2023-07-15 03:11:03,296 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 03:11:03,296 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 03:11:03,296 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-15 03:11:03,296 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 03:11:03,296 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 03:11:03,296 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 03:11:03,296 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 03:11:03,296 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-15 03:11:03,296 DEBUG [(jenkins-hbase4.apache.org,41669,1689390649760)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41669-0x10166f610e80000, quorum=127.0.0.1:62663, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39199,1689390651299 2023-07-15 03:11:03,296 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 03:11:03,297 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-15 03:11:03,297 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-15 03:11:03,297 DEBUG [(jenkins-hbase4.apache.org,41669,1689390649760)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41669-0x10166f610e80000, quorum=127.0.0.1:62663, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,38367,1689390651355 2023-07-15 03:11:03,297 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-15 03:11:03,297 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43199,1689390651225 2023-07-15 03:11:03,298 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39199,1689390651299 2023-07-15 03:11:03,298 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38367,1689390651355 2023-07-15 03:11:03,299 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 03:11:03,299 DEBUG [(jenkins-hbase4.apache.org,41669,1689390649760)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41669-0x10166f610e80000, quorum=127.0.0.1:62663, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43199,1689390651225 2023-07-15 03:11:03,299 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-15 03:11:03,300 DEBUG [(jenkins-hbase4.apache.org,41669,1689390649760)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41669-0x10166f610e80000, quorum=127.0.0.1:62663, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39199,1689390651299 2023-07-15 03:11:03,300 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43199,1689390651225 2023-07-15 03:11:03,300 DEBUG [(jenkins-hbase4.apache.org,41669,1689390649760)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41669-0x10166f610e80000, quorum=127.0.0.1:62663, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,38367,1689390651355 2023-07-15 03:11:03,300 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39199,1689390651299 2023-07-15 03:11:03,301 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38367,1689390651355 2023-07-15 03:11:03,315 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): master:41669-0x10166f610e80000, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,38367,1689390651355 2023-07-15 03:11:03,315 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): regionserver:38367-0x10166f610e80003, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 03:11:03,315 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 03:11:03,315 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): regionserver:39199-0x10166f610e80002, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 03:11:03,315 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): regionserver:38367-0x10166f610e80003, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 03:11:03,315 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): regionserver:43199-0x10166f610e80001, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 03:11:03,315 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): master:41669-0x10166f610e80000, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-15 03:11:03,316 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportWithTargetName 2023-07-15 03:11:03,316 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 03:11:03,316 DEBUG [(jenkins-hbase4.apache.org,41669,1689390649760)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-15 03:11:03,316 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportWithTargetName 2023-07-15 03:11:03,316 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): regionserver:43199-0x10166f610e80001, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 03:11:03,316 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 03:11:03,316 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): regionserver:39199-0x10166f610e80002, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 03:11:03,315 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 03:11:03,317 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 03:11:03,316 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 03:11:03,316 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): master:41669-0x10166f610e80000, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39199,1689390651299 2023-07-15 03:11:03,317 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): master:41669-0x10166f610e80000, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43199,1689390651225 2023-07-15 03:11:03,317 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): master:41669-0x10166f610e80000, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-15 03:11:03,317 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): master:41669-0x10166f610e80000, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,38367,1689390651355 2023-07-15 03:11:03,317 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): master:41669-0x10166f610e80000, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-15 03:11:03,317 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): master:41669-0x10166f610e80000, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39199,1689390651299 2023-07-15 03:11:03,317 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): master:41669-0x10166f610e80000, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43199,1689390651225 2023-07-15 03:11:03,317 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): master:41669-0x10166f610e80000, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-15 03:11:03,317 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): master:41669-0x10166f610e80000, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-15 03:11:03,318 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 03:11:03,318 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 03:11:03,318 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 03:11:03,318 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 03:11:03,318 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 03:11:03,318 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 03:11:03,320 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName 2023-07-15 03:11:03,359 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName to hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/.hbase-snapshot/emptySnaptb0-testExportWithTargetName 2023-07-15 03:11:03,400 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed 2023-07-15 03:11:03,400 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName 2023-07-15 03:11:03,401 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName 2023-07-15 03:11:03,401 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName at 1689390663139Consolidate snapshot: emptySnaptb0-testExportWithTargetName at 1689390663316 (+177 ms)Loading Region manifests for emptySnaptb0-testExportWithTargetName at 1689390663317 (+1 ms)Writing data manifest for emptySnaptb0-testExportWithTargetName at 1689390663330 (+13 ms)Verifying snapshot: emptySnaptb0-testExportWithTargetName at 1689390663347 (+17 ms)Snapshot emptySnaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed at 1689390663400 (+53 ms) 2023-07-15 03:11:03,402 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=18, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-15 03:11:03,405 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=18, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED in 261 msec 2023-07-15 03:11:03,459 DEBUG [Listener at jenkins-hbase4.apache.org/44817] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-15 03:11:03,461 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41669] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-15 03:11:03,461 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41669] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-15 03:11:03,479 DEBUG [htable-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-15 03:11:03,485 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:53158, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-15 03:11:03,486 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39199] regionserver.HRegion(8805): writing data to region testtb-testExportWithTargetName,,1689390661893.9de9b665189dc5bcdfd040d038343a47. with WAL disabled. Data may be lost in the event of a crash. 2023-07-15 03:11:03,487 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38367] regionserver.HRegion(8805): writing data to region testtb-testExportWithTargetName,1,1689390661893.9f5de522bde202413f433e886e3efa7d. with WAL disabled. Data may be lost in the event of a crash. 2023-07-15 03:11:03,492 DEBUG [Listener at jenkins-hbase4.apache.org/44817] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportWithTargetName 2023-07-15 03:11:03,493 DEBUG [Listener at jenkins-hbase4.apache.org/44817] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportWithTargetName,,1689390661893.9de9b665189dc5bcdfd040d038343a47. 2023-07-15 03:11:03,494 INFO [Listener at jenkins-hbase4.apache.org/44817] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-15 03:11:03,520 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41669] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-15 03:11:03,520 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41669] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689390663520 (current time:1689390663520). 2023-07-15 03:11:03,520 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41669] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-15 03:11:03,520 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41669] zookeeper.ReadOnlyZKClient(139): Connect 0x1ce98944 to 127.0.0.1:62663 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-15 03:11:03,526 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41669] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2e571e97, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-15 03:11:03,527 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41669] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-15 03:11:03,530 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:41692, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-15 03:11:03,531 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41669] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1ce98944 to 127.0.0.1:62663 2023-07-15 03:11:03,531 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41669] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-15 03:11:03,531 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41669] zookeeper.ReadOnlyZKClient(139): Connect 0x368564c8 to 127.0.0.1:62663 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-15 03:11:03,536 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41669] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@66f678f5, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-15 03:11:03,537 DEBUG [hconnection-0x70c3711a-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-15 03:11:03,538 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:41708, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-15 03:11:03,542 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41669] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-15 03:11:03,544 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:53164, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-15 03:11:03,545 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41669] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x368564c8 to 127.0.0.1:62663 2023-07-15 03:11:03,545 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41669] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-15 03:11:03,545 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41669] access.PermissionStorage(611): Read acl: entry[testtb-testExportWithTargetName], kv [jenkins: RWXCA] 2023-07-15 03:11:03,546 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41669] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-15 03:11:03,546 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41669] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-15 03:11:03,549 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41669] procedure2.ProcedureExecutor(1029): Stored pid=19, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-15 03:11:03,550 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=19, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-15 03:11:03,551 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=19, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE; timeout=600000, timestamp=1689391263551 2023-07-15 03:11:03,551 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41669] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-15 03:11:03,551 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName 2023-07-15 03:11:03,552 DEBUG [Listener at jenkins-hbase4.apache.org/44817] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-15 03:11:03,553 DEBUG [Listener at jenkins-hbase4.apache.org/44817] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-15 03:11:03,554 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=19, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-15 03:11:03,554 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=20, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-15 03:11:03,555 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=19, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE in 6 msec 2023-07-15 03:11:03,556 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=20, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-15 03:11:03,557 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=20, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED; timeout=600000, timestamp=1689391263557 2023-07-15 03:11:03,573 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportWithTargetName 2023-07-15 03:11:03,573 INFO [(jenkins-hbase4.apache.org,41669,1689390649760)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportWithTargetName' 2023-07-15 03:11:03,573 DEBUG [(jenkins-hbase4.apache.org,41669,1689390649760)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-15 03:11:03,574 DEBUG [(jenkins-hbase4.apache.org,41669,1689390649760)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportWithTargetName' starting 'acquire' 2023-07-15 03:11:03,574 DEBUG [(jenkins-hbase4.apache.org,41669,1689390649760)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportWithTargetName', kicking off acquire phase on members. 2023-07-15 03:11:03,574 DEBUG [(jenkins-hbase4.apache.org,41669,1689390649760)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41669-0x10166f610e80000, quorum=127.0.0.1:62663, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-15 03:11:03,574 DEBUG [(jenkins-hbase4.apache.org,41669,1689390649760)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-15 03:11:03,576 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): regionserver:38367-0x10166f610e80003, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 03:11:03,576 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): regionserver:39199-0x10166f610e80002, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 03:11:03,576 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 03:11:03,576 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 03:11:03,576 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 03:11:03,576 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 03:11:03,576 DEBUG [(jenkins-hbase4.apache.org,41669,1689390649760)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,38367,1689390651355 2023-07-15 03:11:03,576 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): regionserver:43199-0x10166f610e80001, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 03:11:03,576 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 03:11:03,576 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 03:11:03,576 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-15 03:11:03,577 DEBUG [(jenkins-hbase4.apache.org,41669,1689390649760)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41669-0x10166f610e80000, quorum=127.0.0.1:62663, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,38367,1689390651355 2023-07-15 03:11:03,577 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-15 03:11:03,577 DEBUG [(jenkins-hbase4.apache.org,41669,1689390649760)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39199,1689390651299 2023-07-15 03:11:03,577 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-15 03:11:03,577 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39199-0x10166f610e80002, quorum=127.0.0.1:62663, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-15 03:11:03,577 DEBUG [(jenkins-hbase4.apache.org,41669,1689390649760)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41669-0x10166f610e80000, quorum=127.0.0.1:62663, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39199,1689390651299 2023-07-15 03:11:03,577 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38367-0x10166f610e80003, quorum=127.0.0.1:62663, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-15 03:11:03,577 DEBUG [(jenkins-hbase4.apache.org,41669,1689390649760)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-15 03:11:03,577 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43199-0x10166f610e80001, quorum=127.0.0.1:62663, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-15 03:11:03,578 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 166 2023-07-15 03:11:03,578 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-15 03:11:03,578 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 166 2023-07-15 03:11:03,578 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-15 03:11:03,578 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 166 2023-07-15 03:11:03,578 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-15 03:11:03,578 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-15 03:11:03,578 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-15 03:11:03,578 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportWithTargetName 2023-07-15 03:11:03,578 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportWithTargetName 2023-07-15 03:11:03,578 DEBUG [member: 'jenkins-hbase4.apache.org,39199,1689390651299' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-15 03:11:03,578 DEBUG [member: 'jenkins-hbase4.apache.org,38367,1689390651355' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-15 03:11:03,578 DEBUG [member: 'jenkins-hbase4.apache.org,38367,1689390651355' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-15 03:11:03,578 DEBUG [member: 'jenkins-hbase4.apache.org,39199,1689390651299' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-15 03:11:03,579 DEBUG [member: 'jenkins-hbase4.apache.org,38367,1689390651355' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-15 03:11:03,580 DEBUG [member: 'jenkins-hbase4.apache.org,39199,1689390651299' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-15 03:11:03,578 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-15 03:11:03,580 DEBUG [member: 'jenkins-hbase4.apache.org,39199,1689390651299' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportWithTargetName' locally acquired 2023-07-15 03:11:03,580 DEBUG [member: 'jenkins-hbase4.apache.org,38367,1689390651355' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportWithTargetName' locally acquired 2023-07-15 03:11:03,580 DEBUG [member: 'jenkins-hbase4.apache.org,39199,1689390651299' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39199,1689390651299' joining acquired barrier for procedure (snaptb0-testExportWithTargetName) in zk 2023-07-15 03:11:03,580 DEBUG [member: 'jenkins-hbase4.apache.org,38367,1689390651355' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38367,1689390651355' joining acquired barrier for procedure (snaptb0-testExportWithTargetName) in zk 2023-07-15 03:11:03,580 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportWithTargetName 2023-07-15 03:11:03,580 DEBUG [member: 'jenkins-hbase4.apache.org,43199,1689390651225' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-15 03:11:03,580 DEBUG [member: 'jenkins-hbase4.apache.org,43199,1689390651225' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-15 03:11:03,581 DEBUG [member: 'jenkins-hbase4.apache.org,43199,1689390651225' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-15 03:11:03,581 DEBUG [member: 'jenkins-hbase4.apache.org,43199,1689390651225' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportWithTargetName' locally acquired 2023-07-15 03:11:03,581 DEBUG [member: 'jenkins-hbase4.apache.org,43199,1689390651225' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43199,1689390651225' joining acquired barrier for procedure (snaptb0-testExportWithTargetName) in zk 2023-07-15 03:11:03,584 DEBUG [member: 'jenkins-hbase4.apache.org,39199,1689390651299' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-15 03:11:03,584 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): master:41669-0x10166f610e80000, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39199,1689390651299 2023-07-15 03:11:03,584 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39199,1689390651299 2023-07-15 03:11:03,584 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 03:11:03,584 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 03:11:03,585 DEBUG [member: 'jenkins-hbase4.apache.org,43199,1689390651225' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-15 03:11:03,585 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 03:11:03,585 DEBUG [member: 'jenkins-hbase4.apache.org,39199,1689390651299' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39199-0x10166f610e80002, quorum=127.0.0.1:62663, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-15 03:11:03,585 DEBUG [member: 'jenkins-hbase4.apache.org,39199,1689390651299' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-15 03:11:03,585 DEBUG [member: 'jenkins-hbase4.apache.org,38367,1689390651355' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-15 03:11:03,585 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 03:11:03,586 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): master:41669-0x10166f610e80000, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,38367,1689390651355 2023-07-15 03:11:03,585 DEBUG [member: 'jenkins-hbase4.apache.org,43199,1689390651225' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43199-0x10166f610e80001, quorum=127.0.0.1:62663, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-15 03:11:03,586 DEBUG [member: 'jenkins-hbase4.apache.org,43199,1689390651225' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-15 03:11:03,586 DEBUG [member: 'jenkins-hbase4.apache.org,38367,1689390651355' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38367-0x10166f610e80003, quorum=127.0.0.1:62663, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-15 03:11:03,586 DEBUG [member: 'jenkins-hbase4.apache.org,38367,1689390651355' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-15 03:11:03,586 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-15 03:11:03,587 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43199,1689390651225 2023-07-15 03:11:03,587 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39199,1689390651299 2023-07-15 03:11:03,588 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38367,1689390651355 2023-07-15 03:11:03,588 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 03:11:03,588 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39199,1689390651299' joining acquired barrier for procedure 'snaptb0-testExportWithTargetName' on coordinator 2023-07-15 03:11:03,588 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@78b7dec3[Count = 1] remaining members to acquire global barrier 2023-07-15 03:11:03,589 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,38367,1689390651355 2023-07-15 03:11:03,589 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 03:11:03,589 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 03:11:03,590 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 03:11:03,591 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 03:11:03,591 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-15 03:11:03,592 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43199,1689390651225 2023-07-15 03:11:03,592 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39199,1689390651299 2023-07-15 03:11:03,592 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38367,1689390651355 2023-07-15 03:11:03,592 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 03:11:03,593 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,38367,1689390651355' joining acquired barrier for procedure 'snaptb0-testExportWithTargetName' on coordinator 2023-07-15 03:11:03,593 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@78b7dec3[Count = 0] remaining members to acquire global barrier 2023-07-15 03:11:03,593 DEBUG [(jenkins-hbase4.apache.org,41669,1689390649760)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportWithTargetName' starting 'in-barrier' execution. 2023-07-15 03:11:03,593 DEBUG [(jenkins-hbase4.apache.org,41669,1689390649760)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-15 03:11:03,597 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): regionserver:39199-0x10166f610e80002, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-15 03:11:03,597 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): regionserver:43199-0x10166f610e80001, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-15 03:11:03,597 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-15 03:11:03,597 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-15 03:11:03,597 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): regionserver:38367-0x10166f610e80003, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-15 03:11:03,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-15 03:11:03,597 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-15 03:11:03,597 DEBUG [member: 'jenkins-hbase4.apache.org,43199,1689390651225' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-15 03:11:03,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-15 03:11:03,597 DEBUG [member: 'jenkins-hbase4.apache.org,43199,1689390651225' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportWithTargetName' locally completed 2023-07-15 03:11:03,598 DEBUG [member: 'jenkins-hbase4.apache.org,39199,1689390651299' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-15 03:11:03,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-15 03:11:03,598 DEBUG [member: 'jenkins-hbase4.apache.org,43199,1689390651225' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,43199,1689390651225' in zk 2023-07-15 03:11:03,598 DEBUG [member: 'jenkins-hbase4.apache.org,39199,1689390651299' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-15 03:11:03,598 DEBUG [member: 'jenkins-hbase4.apache.org,39199,1689390651299' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-15 03:11:03,598 DEBUG [member: 'jenkins-hbase4.apache.org,38367,1689390651355' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-15 03:11:03,598 DEBUG [rs(jenkins-hbase4.apache.org,39199,1689390651299)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,,1689390661893.9de9b665189dc5bcdfd040d038343a47. 2023-07-15 03:11:03,598 DEBUG [rs(jenkins-hbase4.apache.org,39199,1689390651299)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,,1689390661893.9de9b665189dc5bcdfd040d038343a47. started... 2023-07-15 03:11:03,598 DEBUG [member: 'jenkins-hbase4.apache.org,38367,1689390651355' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-15 03:11:03,598 DEBUG [member: 'jenkins-hbase4.apache.org,38367,1689390651355' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-15 03:11:03,598 DEBUG [rs(jenkins-hbase4.apache.org,38367,1689390651355)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,1,1689390661893.9f5de522bde202413f433e886e3efa7d. 2023-07-15 03:11:03,598 DEBUG [(jenkins-hbase4.apache.org,41669,1689390649760)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41669-0x10166f610e80000, quorum=127.0.0.1:62663, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39199,1689390651299 2023-07-15 03:11:03,598 DEBUG [rs(jenkins-hbase4.apache.org,38367,1689390651355)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,1,1689390661893.9f5de522bde202413f433e886e3efa7d. started... 2023-07-15 03:11:03,599 INFO [rs(jenkins-hbase4.apache.org,38367,1689390651355)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 9f5de522bde202413f433e886e3efa7d 1/1 column families, dataSize=3.00 KB heapSize=6.72 KB 2023-07-15 03:11:03,598 INFO [rs(jenkins-hbase4.apache.org,39199,1689390651299)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 9de9b665189dc5bcdfd040d038343a47 1/1 column families, dataSize=266 B heapSize=832 B 2023-07-15 03:11:03,602 DEBUG [member: 'jenkins-hbase4.apache.org,43199,1689390651225' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportWithTargetName' has notified controller of completion 2023-07-15 03:11:03,602 DEBUG [member: 'jenkins-hbase4.apache.org,43199,1689390651225' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-15 03:11:03,602 DEBUG [(jenkins-hbase4.apache.org,41669,1689390649760)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41669-0x10166f610e80000, quorum=127.0.0.1:62663, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,38367,1689390651355 2023-07-15 03:11:03,604 DEBUG [(jenkins-hbase4.apache.org,41669,1689390649760)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-15 03:11:03,602 DEBUG [member: 'jenkins-hbase4.apache.org,43199,1689390651225' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportWithTargetName' completed. 2023-07-15 03:11:03,653 DEBUG [Listener at jenkins-hbase4.apache.org/44817] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-15 03:11:03,660 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41669] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-15 03:11:03,660 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41669] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-07-15 03:11:03,661 DEBUG [Listener at jenkins-hbase4.apache.org/44817] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-15 03:11:03,733 INFO [rs(jenkins-hbase4.apache.org,38367,1689390651355)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.00 KB at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/data/default/testtb-testExportWithTargetName/9f5de522bde202413f433e886e3efa7d/.tmp/cf/6f8639431da946039391e0decbc90acf 2023-07-15 03:11:03,737 INFO [rs(jenkins-hbase4.apache.org,39199,1689390651299)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=266 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/data/default/testtb-testExportWithTargetName/9de9b665189dc5bcdfd040d038343a47/.tmp/cf/f977b2f5ac85415fa45d49ae3c11abe0 2023-07-15 03:11:03,791 DEBUG [rs(jenkins-hbase4.apache.org,39199,1689390651299)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/data/default/testtb-testExportWithTargetName/9de9b665189dc5bcdfd040d038343a47/.tmp/cf/f977b2f5ac85415fa45d49ae3c11abe0 as hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/data/default/testtb-testExportWithTargetName/9de9b665189dc5bcdfd040d038343a47/cf/f977b2f5ac85415fa45d49ae3c11abe0 2023-07-15 03:11:03,791 DEBUG [rs(jenkins-hbase4.apache.org,38367,1689390651355)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/data/default/testtb-testExportWithTargetName/9f5de522bde202413f433e886e3efa7d/.tmp/cf/6f8639431da946039391e0decbc90acf as hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/data/default/testtb-testExportWithTargetName/9f5de522bde202413f433e886e3efa7d/cf/6f8639431da946039391e0decbc90acf 2023-07-15 03:11:03,804 INFO [rs(jenkins-hbase4.apache.org,39199,1689390651299)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/data/default/testtb-testExportWithTargetName/9de9b665189dc5bcdfd040d038343a47/cf/f977b2f5ac85415fa45d49ae3c11abe0, entries=4, sequenceid=6, filesize=5.1 K 2023-07-15 03:11:03,810 INFO [rs(jenkins-hbase4.apache.org,38367,1689390651355)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/data/default/testtb-testExportWithTargetName/9f5de522bde202413f433e886e3efa7d/cf/6f8639431da946039391e0decbc90acf, entries=46, sequenceid=6, filesize=7.9 K 2023-07-15 03:11:03,812 INFO [rs(jenkins-hbase4.apache.org,39199,1689390651299)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~266 B/266, heapSize ~816 B/816, currentSize=0 B/0 for 9de9b665189dc5bcdfd040d038343a47 in 214ms, sequenceid=6, compaction requested=false 2023-07-15 03:11:03,812 DEBUG [rs(jenkins-hbase4.apache.org,39199,1689390651299)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportWithTargetName' 2023-07-15 03:11:03,813 INFO [rs(jenkins-hbase4.apache.org,38367,1689390651355)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.00 KB/3070, heapSize ~6.70 KB/6864, currentSize=0 B/0 for 9f5de522bde202413f433e886e3efa7d in 214ms, sequenceid=6, compaction requested=false 2023-07-15 03:11:03,814 DEBUG [rs(jenkins-hbase4.apache.org,38367,1689390651355)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 9f5de522bde202413f433e886e3efa7d: 2023-07-15 03:11:03,814 DEBUG [rs(jenkins-hbase4.apache.org,39199,1689390651299)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 9de9b665189dc5bcdfd040d038343a47: 2023-07-15 03:11:03,815 DEBUG [rs(jenkins-hbase4.apache.org,38367,1689390651355)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,1,1689390661893.9f5de522bde202413f433e886e3efa7d.' region-info for snapshot=snaptb0-testExportWithTargetName 2023-07-15 03:11:03,815 DEBUG [rs(jenkins-hbase4.apache.org,38367,1689390651355)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-15 03:11:03,815 DEBUG [rs(jenkins-hbase4.apache.org,38367,1689390651355)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/data/default/testtb-testExportWithTargetName/9f5de522bde202413f433e886e3efa7d/cf/6f8639431da946039391e0decbc90acf] hfiles 2023-07-15 03:11:03,815 DEBUG [rs(jenkins-hbase4.apache.org,38367,1689390651355)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/data/default/testtb-testExportWithTargetName/9f5de522bde202413f433e886e3efa7d/cf/6f8639431da946039391e0decbc90acf for snapshot=snaptb0-testExportWithTargetName 2023-07-15 03:11:03,815 DEBUG [rs(jenkins-hbase4.apache.org,39199,1689390651299)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,,1689390661893.9de9b665189dc5bcdfd040d038343a47.' region-info for snapshot=snaptb0-testExportWithTargetName 2023-07-15 03:11:03,815 DEBUG [rs(jenkins-hbase4.apache.org,39199,1689390651299)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-15 03:11:03,815 DEBUG [rs(jenkins-hbase4.apache.org,39199,1689390651299)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/data/default/testtb-testExportWithTargetName/9de9b665189dc5bcdfd040d038343a47/cf/f977b2f5ac85415fa45d49ae3c11abe0] hfiles 2023-07-15 03:11:03,815 DEBUG [rs(jenkins-hbase4.apache.org,39199,1689390651299)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/data/default/testtb-testExportWithTargetName/9de9b665189dc5bcdfd040d038343a47/cf/f977b2f5ac85415fa45d49ae3c11abe0 for snapshot=snaptb0-testExportWithTargetName 2023-07-15 03:11:03,840 DEBUG [rs(jenkins-hbase4.apache.org,38367,1689390651355)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,1,1689390661893.9f5de522bde202413f433e886e3efa7d. completed. 2023-07-15 03:11:03,840 DEBUG [rs(jenkins-hbase4.apache.org,38367,1689390651355)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,1,1689390661893.9f5de522bde202413f433e886e3efa7d. 2023-07-15 03:11:03,840 DEBUG [member: 'jenkins-hbase4.apache.org,38367,1689390651355' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-15 03:11:03,840 DEBUG [member: 'jenkins-hbase4.apache.org,38367,1689390651355' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-15 03:11:03,840 DEBUG [member: 'jenkins-hbase4.apache.org,38367,1689390651355' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,38367,1689390651355 2023-07-15 03:11:03,840 DEBUG [member: 'jenkins-hbase4.apache.org,38367,1689390651355' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportWithTargetName' locally completed 2023-07-15 03:11:03,840 DEBUG [member: 'jenkins-hbase4.apache.org,38367,1689390651355' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,38367,1689390651355' in zk 2023-07-15 03:11:03,843 DEBUG [member: 'jenkins-hbase4.apache.org,38367,1689390651355' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportWithTargetName' has notified controller of completion 2023-07-15 03:11:03,843 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): master:41669-0x10166f610e80000, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,38367,1689390651355 2023-07-15 03:11:03,843 DEBUG [member: 'jenkins-hbase4.apache.org,38367,1689390651355' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-15 03:11:03,843 DEBUG [member: 'jenkins-hbase4.apache.org,38367,1689390651355' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportWithTargetName' completed. 2023-07-15 03:11:03,843 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,38367,1689390651355 2023-07-15 03:11:03,844 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 03:11:03,844 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 03:11:03,845 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 03:11:03,845 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 03:11:03,846 DEBUG [rs(jenkins-hbase4.apache.org,39199,1689390651299)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,,1689390661893.9de9b665189dc5bcdfd040d038343a47. completed. 2023-07-15 03:11:03,846 DEBUG [rs(jenkins-hbase4.apache.org,39199,1689390651299)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,,1689390661893.9de9b665189dc5bcdfd040d038343a47. 2023-07-15 03:11:03,846 DEBUG [member: 'jenkins-hbase4.apache.org,39199,1689390651299' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-15 03:11:03,846 DEBUG [member: 'jenkins-hbase4.apache.org,39199,1689390651299' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-15 03:11:03,846 DEBUG [member: 'jenkins-hbase4.apache.org,39199,1689390651299' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,39199,1689390651299 2023-07-15 03:11:03,846 DEBUG [member: 'jenkins-hbase4.apache.org,39199,1689390651299' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportWithTargetName' locally completed 2023-07-15 03:11:03,846 DEBUG [member: 'jenkins-hbase4.apache.org,39199,1689390651299' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,39199,1689390651299' in zk 2023-07-15 03:11:03,846 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-15 03:11:03,847 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43199,1689390651225 2023-07-15 03:11:03,848 DEBUG [member: 'jenkins-hbase4.apache.org,39199,1689390651299' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportWithTargetName' has notified controller of completion 2023-07-15 03:11:03,848 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): master:41669-0x10166f610e80000, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39199,1689390651299 2023-07-15 03:11:03,848 DEBUG [member: 'jenkins-hbase4.apache.org,39199,1689390651299' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-15 03:11:03,848 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39199,1689390651299 2023-07-15 03:11:03,848 DEBUG [member: 'jenkins-hbase4.apache.org,39199,1689390651299' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportWithTargetName' completed. 2023-07-15 03:11:03,849 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38367,1689390651355 2023-07-15 03:11:03,850 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 03:11:03,850 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-15 03:11:03,850 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43199,1689390651225 2023-07-15 03:11:03,851 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39199,1689390651299 2023-07-15 03:11:03,851 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38367,1689390651355 2023-07-15 03:11:03,852 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,38367,1689390651355': 2023-07-15 03:11:03,852 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,38367,1689390651355' released barrier for procedure'snaptb0-testExportWithTargetName', counting down latch. Waiting for 1 more 2023-07-15 03:11:03,852 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39199,1689390651299 2023-07-15 03:11:03,852 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 03:11:03,852 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 03:11:03,853 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 03:11:03,853 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 03:11:03,854 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-15 03:11:03,854 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43199,1689390651225 2023-07-15 03:11:03,855 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39199,1689390651299 2023-07-15 03:11:03,855 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38367,1689390651355 2023-07-15 03:11:03,856 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 03:11:03,856 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-15 03:11:03,856 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43199,1689390651225 2023-07-15 03:11:03,857 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39199,1689390651299 2023-07-15 03:11:03,857 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38367,1689390651355 2023-07-15 03:11:03,857 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,39199,1689390651299': 2023-07-15 03:11:03,857 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39199,1689390651299' released barrier for procedure'snaptb0-testExportWithTargetName', counting down latch. Waiting for 0 more 2023-07-15 03:11:03,857 INFO [(jenkins-hbase4.apache.org,41669,1689390649760)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportWithTargetName' execution completed 2023-07-15 03:11:03,858 DEBUG [(jenkins-hbase4.apache.org,41669,1689390649760)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-15 03:11:03,858 DEBUG [(jenkins-hbase4.apache.org,41669,1689390649760)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-15 03:11:03,858 DEBUG [(jenkins-hbase4.apache.org,41669,1689390649760)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportWithTargetName 2023-07-15 03:11:03,858 INFO [(jenkins-hbase4.apache.org,41669,1689390649760)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportWithTargetNameincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-15 03:11:03,859 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): regionserver:38367-0x10166f610e80003, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-15 03:11:03,860 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): master:41669-0x10166f610e80000, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-15 03:11:03,860 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-15 03:11:03,860 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): regionserver:43199-0x10166f610e80001, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-15 03:11:03,860 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): regionserver:39199-0x10166f610e80002, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-15 03:11:03,860 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): regionserver:38367-0x10166f610e80003, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 03:11:03,860 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-15 03:11:03,860 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): regionserver:39199-0x10166f610e80002, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 03:11:03,860 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-15 03:11:03,860 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): regionserver:43199-0x10166f610e80001, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 03:11:03,860 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-15 03:11:03,860 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-15 03:11:03,860 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 03:11:03,860 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 03:11:03,860 DEBUG [(jenkins-hbase4.apache.org,41669,1689390649760)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41669-0x10166f610e80000, quorum=127.0.0.1:62663, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43199,1689390651225 2023-07-15 03:11:03,860 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-15 03:11:03,860 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-15 03:11:03,861 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 03:11:03,861 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 03:11:03,861 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 03:11:03,861 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 03:11:03,861 DEBUG [(jenkins-hbase4.apache.org,41669,1689390649760)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41669-0x10166f610e80000, quorum=127.0.0.1:62663, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39199,1689390651299 2023-07-15 03:11:03,861 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 03:11:03,861 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 03:11:03,861 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 03:11:03,862 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-15 03:11:03,862 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-15 03:11:03,862 DEBUG [(jenkins-hbase4.apache.org,41669,1689390649760)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41669-0x10166f610e80000, quorum=127.0.0.1:62663, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,38367,1689390651355 2023-07-15 03:11:03,862 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-15 03:11:03,862 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-15 03:11:03,863 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 03:11:03,863 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-15 03:11:03,864 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43199,1689390651225 2023-07-15 03:11:03,864 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39199,1689390651299 2023-07-15 03:11:03,864 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38367,1689390651355 2023-07-15 03:11:03,865 DEBUG [(jenkins-hbase4.apache.org,41669,1689390649760)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41669-0x10166f610e80000, quorum=127.0.0.1:62663, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43199,1689390651225 2023-07-15 03:11:03,865 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 03:11:03,865 DEBUG [(jenkins-hbase4.apache.org,41669,1689390649760)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41669-0x10166f610e80000, quorum=127.0.0.1:62663, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39199,1689390651299 2023-07-15 03:11:03,865 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-15 03:11:03,865 DEBUG [(jenkins-hbase4.apache.org,41669,1689390649760)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41669-0x10166f610e80000, quorum=127.0.0.1:62663, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,38367,1689390651355 2023-07-15 03:11:03,866 DEBUG [Listener at jenkins-hbase4.apache.org/44817] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-15 03:11:03,866 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43199,1689390651225 2023-07-15 03:11:03,866 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39199,1689390651299 2023-07-15 03:11:03,867 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38367,1689390651355 2023-07-15 03:11:03,867 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41669] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-15 03:11:03,867 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41669] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-07-15 03:11:03,868 DEBUG [Listener at jenkins-hbase4.apache.org/44817] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-15 03:11:03,879 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): regionserver:43199-0x10166f610e80001, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 03:11:03,879 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 03:11:03,879 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 03:11:03,879 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): master:41669-0x10166f610e80000, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,38367,1689390651355 2023-07-15 03:11:03,879 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): master:41669-0x10166f610e80000, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-15 03:11:03,879 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): master:41669-0x10166f610e80000, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39199,1689390651299 2023-07-15 03:11:03,879 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): master:41669-0x10166f610e80000, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43199,1689390651225 2023-07-15 03:11:03,879 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): master:41669-0x10166f610e80000, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-15 03:11:03,880 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): regionserver:38367-0x10166f610e80003, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 03:11:03,880 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): regionserver:39199-0x10166f610e80002, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 03:11:03,880 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 03:11:03,880 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 03:11:03,880 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): regionserver:38367-0x10166f610e80003, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 03:11:03,880 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 03:11:03,881 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 03:11:03,880 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): regionserver:39199-0x10166f610e80002, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 03:11:03,882 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): regionserver:43199-0x10166f610e80001, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 03:11:03,882 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 03:11:03,882 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 03:11:03,882 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 03:11:03,882 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 03:11:03,882 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 03:11:03,882 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 03:11:03,885 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): master:41669-0x10166f610e80000, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,38367,1689390651355 2023-07-15 03:11:03,885 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): master:41669-0x10166f610e80000, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-15 03:11:03,885 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): master:41669-0x10166f610e80000, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39199,1689390651299 2023-07-15 03:11:03,885 DEBUG [(jenkins-hbase4.apache.org,41669,1689390649760)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-15 03:11:03,885 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): master:41669-0x10166f610e80000, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43199,1689390651225 2023-07-15 03:11:03,885 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): master:41669-0x10166f610e80000, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-15 03:11:03,885 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportWithTargetName 2023-07-15 03:11:03,886 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): master:41669-0x10166f610e80000, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-15 03:11:03,886 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportWithTargetName 2023-07-15 03:11:03,887 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName 2023-07-15 03:11:03,924 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName to hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/.hbase-snapshot/snaptb0-testExportWithTargetName 2023-07-15 03:11:03,968 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed 2023-07-15 03:11:03,968 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName 2023-07-15 03:11:03,968 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName 2023-07-15 03:11:03,969 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName at 1689390663551Consolidate snapshot: snaptb0-testExportWithTargetName at 1689390663886 (+335 ms)Loading Region manifests for snaptb0-testExportWithTargetName at 1689390663886Writing data manifest for snaptb0-testExportWithTargetName at 1689390663892 (+6 ms)Verifying snapshot: snaptb0-testExportWithTargetName at 1689390663913 (+21 ms)Snapshot snaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed at 1689390663968 (+55 ms) 2023-07-15 03:11:03,971 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=20, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-15 03:11:03,975 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=20, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED in 419 msec 2023-07-15 03:11:04,168 DEBUG [Listener at jenkins-hbase4.apache.org/44817] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-15 03:11:04,171 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41669] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-15 03:11:04,171 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41669] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-15 03:11:04,172 INFO [Listener at jenkins-hbase4.apache.org/44817] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/export-test/export-1689390664172 2023-07-15 03:11:04,172 INFO [Listener at jenkins-hbase4.apache.org/44817] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:37513, tgtDir=hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/export-test/export-1689390664172, rawTgtDir=hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/export-test/export-1689390664172, srcFsUri=hdfs://localhost:37513, srcDir=hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280 2023-07-15 03:11:04,214 DEBUG [Listener at jenkins-hbase4.apache.org/44817] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:37513, inputRoot=hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280 2023-07-15 03:11:04,215 DEBUG [Listener at jenkins-hbase4.apache.org/44817] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_41584426_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/export-test/export-1689390664172, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/export-test/export-1689390664172/.hbase-snapshot/.tmp/testExportWithTargetName 2023-07-15 03:11:04,215 INFO [Listener at jenkins-hbase4.apache.org/44817] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:37513, inputRoot=hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280, snapshotDir=hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/.hbase-snapshot/snaptb0-testExportWithTargetName. 2023-07-15 03:11:04,232 INFO [Listener at jenkins-hbase4.apache.org/44817] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/.hbase-snapshot/snaptb0-testExportWithTargetName to hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/export-test/export-1689390664172/.hbase-snapshot/.tmp/testExportWithTargetName 2023-07-15 03:11:04,299 DEBUG [Listener at jenkins-hbase4.apache.org/44817] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-15 03:11:04,299 DEBUG [Listener at jenkins-hbase4.apache.org/44817] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-15 03:11:04,300 DEBUG [Listener at jenkins-hbase4.apache.org/44817] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-15 03:11:04,300 DEBUG [Listener at jenkins-hbase4.apache.org/44817] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-15 03:11:05,430 DEBUG [Listener at jenkins-hbase4.apache.org/44817] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6bc8dbaf-aac0-03cf-90d4-be6af049f709/hadoop-4651594893856561772.jar 2023-07-15 03:11:05,431 DEBUG [Listener at jenkins-hbase4.apache.org/44817] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-15 03:11:05,431 DEBUG [Listener at jenkins-hbase4.apache.org/44817] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-15 03:11:05,514 DEBUG [Listener at jenkins-hbase4.apache.org/44817] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6bc8dbaf-aac0-03cf-90d4-be6af049f709/hadoop-6267985681758402142.jar 2023-07-15 03:11:05,515 DEBUG [Listener at jenkins-hbase4.apache.org/44817] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-15 03:11:05,515 DEBUG [Listener at jenkins-hbase4.apache.org/44817] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-15 03:11:05,516 DEBUG [Listener at jenkins-hbase4.apache.org/44817] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-15 03:11:05,516 DEBUG [Listener at jenkins-hbase4.apache.org/44817] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-15 03:11:05,517 DEBUG [Listener at jenkins-hbase4.apache.org/44817] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-15 03:11:05,517 DEBUG [Listener at jenkins-hbase4.apache.org/44817] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-15 03:11:05,518 DEBUG [Listener at jenkins-hbase4.apache.org/44817] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-15 03:11:05,519 DEBUG [Listener at jenkins-hbase4.apache.org/44817] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-15 03:11:05,519 DEBUG [Listener at jenkins-hbase4.apache.org/44817] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-15 03:11:05,520 DEBUG [Listener at jenkins-hbase4.apache.org/44817] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-15 03:11:05,521 DEBUG [Listener at jenkins-hbase4.apache.org/44817] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-15 03:11:05,522 DEBUG [Listener at jenkins-hbase4.apache.org/44817] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-15 03:11:05,522 DEBUG [Listener at jenkins-hbase4.apache.org/44817] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-15 03:11:05,523 DEBUG [Listener at jenkins-hbase4.apache.org/44817] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-15 03:11:05,523 DEBUG [Listener at jenkins-hbase4.apache.org/44817] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-15 03:11:05,524 DEBUG [Listener at jenkins-hbase4.apache.org/44817] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-15 03:11:05,529 DEBUG [Listener at jenkins-hbase4.apache.org/44817] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-15 03:11:05,530 DEBUG [Listener at jenkins-hbase4.apache.org/44817] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-15 03:11:05,531 DEBUG [Listener at jenkins-hbase4.apache.org/44817] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-15 03:11:05,531 DEBUG [Listener at jenkins-hbase4.apache.org/44817] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-15 03:11:05,532 DEBUG [Listener at jenkins-hbase4.apache.org/44817] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-15 03:11:05,533 DEBUG [Listener at jenkins-hbase4.apache.org/44817] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-15 03:11:05,533 DEBUG [Listener at jenkins-hbase4.apache.org/44817] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-15 03:11:07,368 WARN [Listener at jenkins-hbase4.apache.org/44817] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-15 03:11:07,411 INFO [Listener at jenkins-hbase4.apache.org/44817] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportWithTargetName' hfile list 2023-07-15 03:11:07,423 DEBUG [Listener at jenkins-hbase4.apache.org/44817] snapshot.ExportSnapshot(671): export split=0 size=13.0 K 2023-07-15 03:11:07,900 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-15 03:11:07,996 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-15 03:11:07,996 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-15 03:11:08,653 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689390660463_0001_000001 (auth:SIMPLE) 2023-07-15 03:11:13,785 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689390660463_0001_000001 (auth:SIMPLE) 2023-07-15 03:11:16,060 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689390660463_0001_000001 (auth:SIMPLE) 2023-07-15 03:11:19,276 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689390660463_0001_000001 (auth:SIMPLE) 2023-07-15 03:11:21,380 INFO [Listener at jenkins-hbase4.apache.org/44817] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-15 03:11:21,383 INFO [Listener at jenkins-hbase4.apache.org/44817] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-15 03:11:21,391 INFO [Listener at jenkins-hbase4.apache.org/44817] snapshot.ExportSnapshot(1127): Export Completed: testExportWithTargetName 2023-07-15 03:11:21,391 INFO [Listener at jenkins-hbase4.apache.org/44817] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-15 03:11:21,392 INFO [Listener at jenkins-hbase4.apache.org/44817] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-15 03:11:21,392 DEBUG [Listener at jenkins-hbase4.apache.org/44817] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-924468511_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/.hbase-snapshot/snaptb0-testExportWithTargetName at hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/.hbase-snapshot/snaptb0-testExportWithTargetName 2023-07-15 03:11:21,393 DEBUG [Listener at jenkins-hbase4.apache.org/44817] snapshot.TestExportSnapshot(367): hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/.hbase-snapshot/snaptb0-testExportWithTargetName/.snapshotinfo 2023-07-15 03:11:21,393 DEBUG [Listener at jenkins-hbase4.apache.org/44817] snapshot.TestExportSnapshot(367): hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/.hbase-snapshot/snaptb0-testExportWithTargetName/data.manifest 2023-07-15 03:11:21,393 DEBUG [Listener at jenkins-hbase4.apache.org/44817] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-924468511_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/export-test/export-1689390664172/.hbase-snapshot/testExportWithTargetName at hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/export-test/export-1689390664172/.hbase-snapshot/testExportWithTargetName 2023-07-15 03:11:21,394 DEBUG [Listener at jenkins-hbase4.apache.org/44817] snapshot.TestExportSnapshot(367): hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/export-test/export-1689390664172/.hbase-snapshot/testExportWithTargetName/.snapshotinfo 2023-07-15 03:11:21,394 DEBUG [Listener at jenkins-hbase4.apache.org/44817] snapshot.TestExportSnapshot(367): hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/export-test/export-1689390664172/.hbase-snapshot/testExportWithTargetName/data.manifest 2023-07-15 03:11:21,405 INFO [Listener at jenkins-hbase4.apache.org/44817] client.HBaseAdmin$15(890): Started disable of testtb-testExportWithTargetName 2023-07-15 03:11:21,409 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41669] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportWithTargetName 2023-07-15 03:11:21,417 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41669] procedure2.ProcedureExecutor(1029): Stored pid=21, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportWithTargetName 2023-07-15 03:11:21,422 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689390681422"}]},"ts":"1689390681422"} 2023-07-15 03:11:21,423 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41669] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-07-15 03:11:21,424 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=DISABLING in hbase:meta 2023-07-15 03:11:21,426 INFO [PEWorker-4] procedure.DisableTableProcedure(293): Set testtb-testExportWithTargetName to state=DISABLING 2023-07-15 03:11:21,428 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=22, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=9de9b665189dc5bcdfd040d038343a47, UNASSIGN}, {pid=23, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=9f5de522bde202413f433e886e3efa7d, UNASSIGN}] 2023-07-15 03:11:21,430 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=22, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=9de9b665189dc5bcdfd040d038343a47, UNASSIGN 2023-07-15 03:11:21,430 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=23, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=9f5de522bde202413f433e886e3efa7d, UNASSIGN 2023-07-15 03:11:21,431 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=23 updating hbase:meta row=9f5de522bde202413f433e886e3efa7d, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,38367,1689390651355 2023-07-15 03:11:21,431 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=22 updating hbase:meta row=9de9b665189dc5bcdfd040d038343a47, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,39199,1689390651299 2023-07-15 03:11:21,432 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,,1689390661893.9de9b665189dc5bcdfd040d038343a47.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689390681431"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689390681431"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689390681431"}]},"ts":"1689390681431"} 2023-07-15 03:11:21,432 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,1,1689390661893.9f5de522bde202413f433e886e3efa7d.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689390681431"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689390681431"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689390681431"}]},"ts":"1689390681431"} 2023-07-15 03:11:21,434 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=24, ppid=23, state=RUNNABLE; CloseRegionProcedure 9f5de522bde202413f433e886e3efa7d, server=jenkins-hbase4.apache.org,38367,1689390651355}] 2023-07-15 03:11:21,434 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=25, ppid=22, state=RUNNABLE; CloseRegionProcedure 9de9b665189dc5bcdfd040d038343a47, server=jenkins-hbase4.apache.org,39199,1689390651299}] 2023-07-15 03:11:21,525 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41669] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-07-15 03:11:21,595 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 9de9b665189dc5bcdfd040d038343a47 2023-07-15 03:11:21,595 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 9f5de522bde202413f433e886e3efa7d 2023-07-15 03:11:21,595 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 9de9b665189dc5bcdfd040d038343a47, disabling compactions & flushes 2023-07-15 03:11:21,595 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 9f5de522bde202413f433e886e3efa7d, disabling compactions & flushes 2023-07-15 03:11:21,595 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,,1689390661893.9de9b665189dc5bcdfd040d038343a47. 2023-07-15 03:11:21,595 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,1,1689390661893.9f5de522bde202413f433e886e3efa7d. 2023-07-15 03:11:21,595 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,,1689390661893.9de9b665189dc5bcdfd040d038343a47. 2023-07-15 03:11:21,595 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,1,1689390661893.9f5de522bde202413f433e886e3efa7d. 2023-07-15 03:11:21,595 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,,1689390661893.9de9b665189dc5bcdfd040d038343a47. after waiting 0 ms 2023-07-15 03:11:21,595 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,1,1689390661893.9f5de522bde202413f433e886e3efa7d. after waiting 0 ms 2023-07-15 03:11:21,596 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,1,1689390661893.9f5de522bde202413f433e886e3efa7d. 2023-07-15 03:11:21,596 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,,1689390661893.9de9b665189dc5bcdfd040d038343a47. 2023-07-15 03:11:21,609 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/data/default/testtb-testExportWithTargetName/9de9b665189dc5bcdfd040d038343a47/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-15 03:11:21,609 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/data/default/testtb-testExportWithTargetName/9f5de522bde202413f433e886e3efa7d/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-15 03:11:21,610 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-15 03:11:21,610 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-15 03:11:21,611 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,1,1689390661893.9f5de522bde202413f433e886e3efa7d. 2023-07-15 03:11:21,611 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,,1689390661893.9de9b665189dc5bcdfd040d038343a47. 2023-07-15 03:11:21,611 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 9f5de522bde202413f433e886e3efa7d: 2023-07-15 03:11:21,611 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 9de9b665189dc5bcdfd040d038343a47: 2023-07-15 03:11:21,614 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 9f5de522bde202413f433e886e3efa7d 2023-07-15 03:11:21,614 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=23 updating hbase:meta row=9f5de522bde202413f433e886e3efa7d, regionState=CLOSED 2023-07-15 03:11:21,615 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 9de9b665189dc5bcdfd040d038343a47 2023-07-15 03:11:21,615 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,1,1689390661893.9f5de522bde202413f433e886e3efa7d.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689390681614"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689390681614"}]},"ts":"1689390681614"} 2023-07-15 03:11:21,615 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=22 updating hbase:meta row=9de9b665189dc5bcdfd040d038343a47, regionState=CLOSED 2023-07-15 03:11:21,615 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,,1689390661893.9de9b665189dc5bcdfd040d038343a47.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689390681615"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689390681615"}]},"ts":"1689390681615"} 2023-07-15 03:11:21,619 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=24, resume processing ppid=23 2023-07-15 03:11:21,619 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=24, ppid=23, state=SUCCESS; CloseRegionProcedure 9f5de522bde202413f433e886e3efa7d, server=jenkins-hbase4.apache.org,38367,1689390651355 in 182 msec 2023-07-15 03:11:21,620 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=25, resume processing ppid=22 2023-07-15 03:11:21,620 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=25, ppid=22, state=SUCCESS; CloseRegionProcedure 9de9b665189dc5bcdfd040d038343a47, server=jenkins-hbase4.apache.org,39199,1689390651299 in 183 msec 2023-07-15 03:11:21,621 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=23, ppid=21, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=9f5de522bde202413f433e886e3efa7d, UNASSIGN in 191 msec 2023-07-15 03:11:21,623 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=22, resume processing ppid=21 2023-07-15 03:11:21,623 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=22, ppid=21, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=9de9b665189dc5bcdfd040d038343a47, UNASSIGN in 192 msec 2023-07-15 03:11:21,624 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689390681624"}]},"ts":"1689390681624"} 2023-07-15 03:11:21,625 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=DISABLED in hbase:meta 2023-07-15 03:11:21,627 INFO [PEWorker-1] procedure.DisableTableProcedure(305): Set testtb-testExportWithTargetName to state=DISABLED 2023-07-15 03:11:21,629 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=21, state=SUCCESS; DisableTableProcedure table=testtb-testExportWithTargetName in 216 msec 2023-07-15 03:11:21,726 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41669] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-07-15 03:11:21,726 INFO [Listener at jenkins-hbase4.apache.org/44817] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportWithTargetName, procId: 21 completed 2023-07-15 03:11:21,732 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41669] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportWithTargetName 2023-07-15 03:11:21,739 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41669] procedure2.ProcedureExecutor(1029): Stored pid=26, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-15 03:11:21,742 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=26, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-15 03:11:21,743 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41669] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportWithTargetName 2023-07-15 03:11:21,745 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=26, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-15 03:11:21,748 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=39199] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportWithTargetName 2023-07-15 03:11:21,751 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): regionserver:38367-0x10166f610e80003, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-15 03:11:21,751 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): regionserver:43199-0x10166f610e80001, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-15 03:11:21,751 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): regionserver:39199-0x10166f610e80002, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-15 03:11:21,751 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): master:41669-0x10166f610e80000, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-15 03:11:21,752 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF 2023-07-15 03:11:21,752 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF 2023-07-15 03:11:21,752 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF 2023-07-15 03:11:21,752 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF 2023-07-15 03:11:21,752 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/.tmp/data/default/testtb-testExportWithTargetName/9de9b665189dc5bcdfd040d038343a47 2023-07-15 03:11:21,753 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/.tmp/data/default/testtb-testExportWithTargetName/9f5de522bde202413f433e886e3efa7d 2023-07-15 03:11:21,756 DEBUG [HFileArchiver-6] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/.tmp/data/default/testtb-testExportWithTargetName/9f5de522bde202413f433e886e3efa7d/cf, FileablePath, hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/.tmp/data/default/testtb-testExportWithTargetName/9f5de522bde202413f433e886e3efa7d/recovered.edits] 2023-07-15 03:11:21,756 DEBUG [HFileArchiver-5] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/.tmp/data/default/testtb-testExportWithTargetName/9de9b665189dc5bcdfd040d038343a47/cf, FileablePath, hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/.tmp/data/default/testtb-testExportWithTargetName/9de9b665189dc5bcdfd040d038343a47/recovered.edits] 2023-07-15 03:11:21,759 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): regionserver:39199-0x10166f610e80002, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-15 03:11:21,759 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): regionserver:38367-0x10166f610e80003, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-15 03:11:21,759 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): regionserver:38367-0x10166f610e80003, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-15 03:11:21,759 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): regionserver:43199-0x10166f610e80001, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-15 03:11:21,759 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): regionserver:43199-0x10166f610e80001, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-15 03:11:21,759 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): master:41669-0x10166f610e80000, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-15 03:11:21,759 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): master:41669-0x10166f610e80000, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-15 03:11:21,759 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): regionserver:39199-0x10166f610e80002, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-15 03:11:21,763 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41669] master.MasterRpcServices(1230): Checking to see if procedure is done pid=26 2023-07-15 03:11:21,765 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/.tmp/data/default/testtb-testExportWithTargetName/9f5de522bde202413f433e886e3efa7d/cf/6f8639431da946039391e0decbc90acf to hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/archive/data/default/testtb-testExportWithTargetName/9f5de522bde202413f433e886e3efa7d/cf/6f8639431da946039391e0decbc90acf 2023-07-15 03:11:21,766 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/.tmp/data/default/testtb-testExportWithTargetName/9de9b665189dc5bcdfd040d038343a47/cf/f977b2f5ac85415fa45d49ae3c11abe0 to hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/archive/data/default/testtb-testExportWithTargetName/9de9b665189dc5bcdfd040d038343a47/cf/f977b2f5ac85415fa45d49ae3c11abe0 2023-07-15 03:11:21,770 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/.tmp/data/default/testtb-testExportWithTargetName/9f5de522bde202413f433e886e3efa7d/recovered.edits/9.seqid to hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/archive/data/default/testtb-testExportWithTargetName/9f5de522bde202413f433e886e3efa7d/recovered.edits/9.seqid 2023-07-15 03:11:21,770 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/.tmp/data/default/testtb-testExportWithTargetName/9de9b665189dc5bcdfd040d038343a47/recovered.edits/9.seqid to hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/archive/data/default/testtb-testExportWithTargetName/9de9b665189dc5bcdfd040d038343a47/recovered.edits/9.seqid 2023-07-15 03:11:21,771 DEBUG [HFileArchiver-6] backup.HFileArchiver(596): Deleted hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/.tmp/data/default/testtb-testExportWithTargetName/9f5de522bde202413f433e886e3efa7d 2023-07-15 03:11:21,771 DEBUG [HFileArchiver-5] backup.HFileArchiver(596): Deleted hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/.tmp/data/default/testtb-testExportWithTargetName/9de9b665189dc5bcdfd040d038343a47 2023-07-15 03:11:21,771 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testtb-testExportWithTargetName regions 2023-07-15 03:11:21,774 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=26, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-15 03:11:21,799 WARN [PEWorker-2] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportWithTargetName from hbase:meta 2023-07-15 03:11:21,802 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportWithTargetName' descriptor. 2023-07-15 03:11:21,804 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=26, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-15 03:11:21,804 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportWithTargetName' from region states. 2023-07-15 03:11:21,804 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportWithTargetName,,1689390661893.9de9b665189dc5bcdfd040d038343a47.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689390681804"}]},"ts":"9223372036854775807"} 2023-07-15 03:11:21,804 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportWithTargetName,1,1689390661893.9f5de522bde202413f433e886e3efa7d.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689390681804"}]},"ts":"9223372036854775807"} 2023-07-15 03:11:21,807 INFO [PEWorker-2] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-15 03:11:21,807 DEBUG [PEWorker-2] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 9de9b665189dc5bcdfd040d038343a47, NAME => 'testtb-testExportWithTargetName,,1689390661893.9de9b665189dc5bcdfd040d038343a47.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 9f5de522bde202413f433e886e3efa7d, NAME => 'testtb-testExportWithTargetName,1,1689390661893.9f5de522bde202413f433e886e3efa7d.', STARTKEY => '1', ENDKEY => ''}] 2023-07-15 03:11:21,807 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportWithTargetName' as deleted. 2023-07-15 03:11:21,807 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689390681807"}]},"ts":"9223372036854775807"} 2023-07-15 03:11:21,810 INFO [PEWorker-2] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportWithTargetName state from META 2023-07-15 03:11:21,813 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(130): Finished pid=26, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-15 03:11:21,815 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=26, state=SUCCESS; DeleteTableProcedure table=testtb-testExportWithTargetName in 80 msec 2023-07-15 03:11:21,864 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41669] master.MasterRpcServices(1230): Checking to see if procedure is done pid=26 2023-07-15 03:11:21,865 INFO [Listener at jenkins-hbase4.apache.org/44817] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportWithTargetName, procId: 26 completed 2023-07-15 03:11:21,883 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41669] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportWithTargetName" 2023-07-15 03:11:21,886 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41669] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportWithTargetName 2023-07-15 03:11:21,890 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41669] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportWithTargetName" 2023-07-15 03:11:21,892 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41669] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportWithTargetName 2023-07-15 03:11:21,924 INFO [Listener at jenkins-hbase4.apache.org/44817] hbase.ResourceChecker(175): after: snapshot.TestSecureExportSnapshot#testExportWithTargetName Thread=751 (was 706) Potentially hanging thread: IPC Client (1988502388) connection to jenkins-hbase4.apache.org/172.31.14.131:42007 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6bc8dbaf-aac0-03cf-90d4-be6af049f709/cluster_2988be05-db52-9f51-9e27-39bd2563d627/dfs/data/data3/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6bc8dbaf-aac0-03cf-90d4-be6af049f709/cluster_2988be05-db52-9f51-9e27-39bd2563d627/dfs/data/data6/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-4 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-6 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-361551869_1 at /127.0.0.1:48904 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: member: 'jenkins-hbase4.apache.org,43199,1689390651225' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-924468511_17 at /127.0.0.1:48934 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6bc8dbaf-aac0-03cf-90d4-be6af049f709/cluster_2988be05-db52-9f51-9e27-39bd2563d627/dfs/data/data1/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1988502388) connection to jenkins-hbase4.apache.org/172.31.14.131:45069 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-924468511_17 at /127.0.0.1:48864 [Waiting for operation #6] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ContainersLauncher #0 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.read1(BufferedReader.java:212) java.io.BufferedReader.read(BufferedReader.java:286) org.apache.hadoop.util.Shell$ShellCommandExecutor.parseExecResult(Shell.java:1229) org.apache.hadoop.util.Shell.runCommand(Shell.java:984) org.apache.hadoop.util.Shell.run(Shell.java:884) org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:1216) org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor.launchContainer(DefaultContainerExecutor.java:294) org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.launchContainer(ContainerLaunch.java:442) org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:293) org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:97) java.util.concurrent.FutureTask.run(FutureTask.java:266) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-5 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-3 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x337e74cd-shared-pool-12 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: htable-pool-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ContainersLauncher #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-1286 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: hconnection-0x337e74cd-shared-pool-10 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: (jenkins-hbase4.apache.org,41669,1689390649760)-proc-coordinator-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: htable-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x337e74cd-shared-pool-11 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-2 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: member: 'jenkins-hbase4.apache.org,39199,1689390651299' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x337e74cd-shared-pool-9 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MutableQuantiles-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6bc8dbaf-aac0-03cf-90d4-be6af049f709/cluster_2988be05-db52-9f51-9e27-39bd2563d627/dfs/data/data2/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6bc8dbaf-aac0-03cf-90d4-be6af049f709/cluster_2988be05-db52-9f51-9e27-39bd2563d627/dfs/data/data4/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6bc8dbaf-aac0-03cf-90d4-be6af049f709/cluster_2988be05-db52-9f51-9e27-39bd2563d627/dfs/data/data5/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: member: 'jenkins-hbase4.apache.org,38367,1689390651355' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-924468511_17 at /127.0.0.1:59254 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Container metrics unregistration java.lang.Object.wait(Native Method) java.util.TimerThread.mainLoop(Timer.java:552) java.util.TimerThread.run(Timer.java:505) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-361551869_1 at /127.0.0.1:45262 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=915 (was 896) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=382 (was 252) - SystemLoadAverage LEAK? -, ProcessCount=180 (was 174) - ProcessCount LEAK? -, AvailableMemoryMB=2466 (was 4294) 2023-07-15 03:11:21,925 WARN [Listener at jenkins-hbase4.apache.org/44817] hbase.ResourceChecker(130): Thread=751 is superior to 500 2023-07-15 03:11:21,949 INFO [Listener at jenkins-hbase4.apache.org/44817] hbase.ResourceChecker(147): before: snapshot.TestSecureExportSnapshot#testExportFileSystemState Thread=751, OpenFileDescriptor=915, MaxFileDescriptor=60000, SystemLoadAverage=382, ProcessCount=180, AvailableMemoryMB=2465 2023-07-15 03:11:21,949 WARN [Listener at jenkins-hbase4.apache.org/44817] hbase.ResourceChecker(130): Thread=751 is superior to 500 2023-07-15 03:11:21,951 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41669] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-15 03:11:21,954 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41669] procedure2.ProcedureExecutor(1029): Stored pid=27, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemState 2023-07-15 03:11:21,957 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_PRE_OPERATION 2023-07-15 03:11:21,957 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41669] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemState" procId is: 27 2023-07-15 03:11:21,958 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-15 03:11:21,959 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41669] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-07-15 03:11:21,965 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/.tmp/data/default/testtb-testExportFileSystemState/6309c56827df62d41865efb6b441a423 2023-07-15 03:11:21,965 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/.tmp/data/default/testtb-testExportFileSystemState/d07866052fb30133af4706631514c75e 2023-07-15 03:11:21,966 DEBUG [HFileArchiver-8] backup.HFileArchiver(153): Directory hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/.tmp/data/default/testtb-testExportFileSystemState/d07866052fb30133af4706631514c75e empty. 2023-07-15 03:11:21,966 DEBUG [HFileArchiver-7] backup.HFileArchiver(153): Directory hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/.tmp/data/default/testtb-testExportFileSystemState/6309c56827df62d41865efb6b441a423 empty. 2023-07-15 03:11:21,967 DEBUG [HFileArchiver-8] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/.tmp/data/default/testtb-testExportFileSystemState/d07866052fb30133af4706631514c75e 2023-07-15 03:11:21,967 DEBUG [HFileArchiver-7] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/.tmp/data/default/testtb-testExportFileSystemState/6309c56827df62d41865efb6b441a423 2023-07-15 03:11:21,967 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemState regions 2023-07-15 03:11:22,006 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/.tmp/data/default/testtb-testExportFileSystemState/.tabledesc/.tableinfo.0000000001 2023-07-15 03:11:22,008 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(7675): creating {ENCODED => 6309c56827df62d41865efb6b441a423, NAME => 'testtb-testExportFileSystemState,,1689390681951.6309c56827df62d41865efb6b441a423.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/.tmp 2023-07-15 03:11:22,008 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(7675): creating {ENCODED => d07866052fb30133af4706631514c75e, NAME => 'testtb-testExportFileSystemState,1,1689390681951.d07866052fb30133af4706631514c75e.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/.tmp 2023-07-15 03:11:22,043 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,,1689390681951.6309c56827df62d41865efb6b441a423.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-15 03:11:22,044 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1604): Closing 6309c56827df62d41865efb6b441a423, disabling compactions & flushes 2023-07-15 03:11:22,044 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,,1689390681951.6309c56827df62d41865efb6b441a423. 2023-07-15 03:11:22,044 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,,1689390681951.6309c56827df62d41865efb6b441a423. 2023-07-15 03:11:22,044 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,,1689390681951.6309c56827df62d41865efb6b441a423. after waiting 0 ms 2023-07-15 03:11:22,044 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,,1689390681951.6309c56827df62d41865efb6b441a423. 2023-07-15 03:11:22,044 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,,1689390681951.6309c56827df62d41865efb6b441a423. 2023-07-15 03:11:22,044 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1558): Region close journal for 6309c56827df62d41865efb6b441a423: 2023-07-15 03:11:22,046 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,1,1689390681951.d07866052fb30133af4706631514c75e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-15 03:11:22,047 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1604): Closing d07866052fb30133af4706631514c75e, disabling compactions & flushes 2023-07-15 03:11:22,047 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,1,1689390681951.d07866052fb30133af4706631514c75e. 2023-07-15 03:11:22,047 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,1,1689390681951.d07866052fb30133af4706631514c75e. 2023-07-15 03:11:22,047 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,1,1689390681951.d07866052fb30133af4706631514c75e. after waiting 0 ms 2023-07-15 03:11:22,047 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,1,1689390681951.d07866052fb30133af4706631514c75e. 2023-07-15 03:11:22,047 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,1,1689390681951.d07866052fb30133af4706631514c75e. 2023-07-15 03:11:22,047 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1558): Region close journal for d07866052fb30133af4706631514c75e: 2023-07-15 03:11:22,051 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_ADD_TO_META 2023-07-15 03:11:22,052 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,,1689390681951.6309c56827df62d41865efb6b441a423.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689390682051"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689390682051"}]},"ts":"1689390682051"} 2023-07-15 03:11:22,052 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,1,1689390681951.d07866052fb30133af4706631514c75e.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689390682051"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689390682051"}]},"ts":"1689390682051"} 2023-07-15 03:11:22,055 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-15 03:11:22,057 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-15 03:11:22,057 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689390682057"}]},"ts":"1689390682057"} 2023-07-15 03:11:22,059 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=ENABLING in hbase:meta 2023-07-15 03:11:22,061 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41669] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-07-15 03:11:22,067 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-15 03:11:22,069 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-15 03:11:22,069 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-15 03:11:22,069 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-15 03:11:22,069 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-15 03:11:22,069 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=6309c56827df62d41865efb6b441a423, ASSIGN}, {pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=d07866052fb30133af4706631514c75e, ASSIGN}] 2023-07-15 03:11:22,073 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=6309c56827df62d41865efb6b441a423, ASSIGN 2023-07-15 03:11:22,073 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=d07866052fb30133af4706631514c75e, ASSIGN 2023-07-15 03:11:22,075 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=d07866052fb30133af4706631514c75e, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,38367,1689390651355; forceNewPlan=false, retain=false 2023-07-15 03:11:22,075 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=6309c56827df62d41865efb6b441a423, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,43199,1689390651225; forceNewPlan=false, retain=false 2023-07-15 03:11:22,225 INFO [jenkins-hbase4:41669] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-15 03:11:22,228 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=28 updating hbase:meta row=6309c56827df62d41865efb6b441a423, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,43199,1689390651225 2023-07-15 03:11:22,228 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=29 updating hbase:meta row=d07866052fb30133af4706631514c75e, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,38367,1689390651355 2023-07-15 03:11:22,228 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,,1689390681951.6309c56827df62d41865efb6b441a423.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689390682228"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689390682228"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689390682228"}]},"ts":"1689390682228"} 2023-07-15 03:11:22,229 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,1,1689390681951.d07866052fb30133af4706631514c75e.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689390682228"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689390682228"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689390682228"}]},"ts":"1689390682228"} 2023-07-15 03:11:22,231 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=30, ppid=28, state=RUNNABLE; OpenRegionProcedure 6309c56827df62d41865efb6b441a423, server=jenkins-hbase4.apache.org,43199,1689390651225}] 2023-07-15 03:11:22,232 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=31, ppid=29, state=RUNNABLE; OpenRegionProcedure d07866052fb30133af4706631514c75e, server=jenkins-hbase4.apache.org,38367,1689390651355}] 2023-07-15 03:11:22,262 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41669] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-07-15 03:11:22,389 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,43199,1689390651225 2023-07-15 03:11:22,389 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-15 03:11:22,395 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:42466, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-15 03:11:22,399 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemState,1,1689390681951.d07866052fb30133af4706631514c75e. 2023-07-15 03:11:22,399 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => d07866052fb30133af4706631514c75e, NAME => 'testtb-testExportFileSystemState,1,1689390681951.d07866052fb30133af4706631514c75e.', STARTKEY => '1', ENDKEY => ''} 2023-07-15 03:11:22,400 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemState,1,1689390681951.d07866052fb30133af4706631514c75e. service=AccessControlService 2023-07-15 03:11:22,400 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-15 03:11:22,400 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemState d07866052fb30133af4706631514c75e 2023-07-15 03:11:22,400 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,1,1689390681951.d07866052fb30133af4706631514c75e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-15 03:11:22,400 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for d07866052fb30133af4706631514c75e 2023-07-15 03:11:22,400 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for d07866052fb30133af4706631514c75e 2023-07-15 03:11:22,407 INFO [StoreOpener-d07866052fb30133af4706631514c75e-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region d07866052fb30133af4706631514c75e 2023-07-15 03:11:22,425 DEBUG [StoreOpener-d07866052fb30133af4706631514c75e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/data/default/testtb-testExportFileSystemState/d07866052fb30133af4706631514c75e/cf 2023-07-15 03:11:22,425 DEBUG [StoreOpener-d07866052fb30133af4706631514c75e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/data/default/testtb-testExportFileSystemState/d07866052fb30133af4706631514c75e/cf 2023-07-15 03:11:22,426 INFO [StoreOpener-d07866052fb30133af4706631514c75e-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region d07866052fb30133af4706631514c75e columnFamilyName cf 2023-07-15 03:11:22,426 INFO [StoreOpener-d07866052fb30133af4706631514c75e-1] regionserver.HStore(310): Store=d07866052fb30133af4706631514c75e/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-15 03:11:22,430 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemState,,1689390681951.6309c56827df62d41865efb6b441a423. 2023-07-15 03:11:22,433 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/data/default/testtb-testExportFileSystemState/d07866052fb30133af4706631514c75e 2023-07-15 03:11:22,435 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 6309c56827df62d41865efb6b441a423, NAME => 'testtb-testExportFileSystemState,,1689390681951.6309c56827df62d41865efb6b441a423.', STARTKEY => '', ENDKEY => '1'} 2023-07-15 03:11:22,435 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/data/default/testtb-testExportFileSystemState/d07866052fb30133af4706631514c75e 2023-07-15 03:11:22,435 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemState,,1689390681951.6309c56827df62d41865efb6b441a423. service=AccessControlService 2023-07-15 03:11:22,436 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-15 03:11:22,436 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemState 6309c56827df62d41865efb6b441a423 2023-07-15 03:11:22,436 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,,1689390681951.6309c56827df62d41865efb6b441a423.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-15 03:11:22,436 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 6309c56827df62d41865efb6b441a423 2023-07-15 03:11:22,436 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 6309c56827df62d41865efb6b441a423 2023-07-15 03:11:22,439 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for d07866052fb30133af4706631514c75e 2023-07-15 03:11:22,451 INFO [StoreOpener-6309c56827df62d41865efb6b441a423-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 6309c56827df62d41865efb6b441a423 2023-07-15 03:11:22,456 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/data/default/testtb-testExportFileSystemState/d07866052fb30133af4706631514c75e/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-15 03:11:22,456 DEBUG [StoreOpener-6309c56827df62d41865efb6b441a423-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/data/default/testtb-testExportFileSystemState/6309c56827df62d41865efb6b441a423/cf 2023-07-15 03:11:22,456 DEBUG [StoreOpener-6309c56827df62d41865efb6b441a423-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/data/default/testtb-testExportFileSystemState/6309c56827df62d41865efb6b441a423/cf 2023-07-15 03:11:22,457 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened d07866052fb30133af4706631514c75e; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70570908, jitterRate=0.051588475704193115}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-15 03:11:22,457 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for d07866052fb30133af4706631514c75e: 2023-07-15 03:11:22,457 INFO [StoreOpener-6309c56827df62d41865efb6b441a423-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 6309c56827df62d41865efb6b441a423 columnFamilyName cf 2023-07-15 03:11:22,459 INFO [StoreOpener-6309c56827df62d41865efb6b441a423-1] regionserver.HStore(310): Store=6309c56827df62d41865efb6b441a423/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-15 03:11:22,459 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemState,1,1689390681951.d07866052fb30133af4706631514c75e., pid=31, masterSystemTime=1689390682389 2023-07-15 03:11:22,462 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/data/default/testtb-testExportFileSystemState/6309c56827df62d41865efb6b441a423 2023-07-15 03:11:22,463 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/data/default/testtb-testExportFileSystemState/6309c56827df62d41865efb6b441a423 2023-07-15 03:11:22,466 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemState,1,1689390681951.d07866052fb30133af4706631514c75e. 2023-07-15 03:11:22,466 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemState,1,1689390681951.d07866052fb30133af4706631514c75e. 2023-07-15 03:11:22,469 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=29 updating hbase:meta row=d07866052fb30133af4706631514c75e, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,38367,1689390651355 2023-07-15 03:11:22,469 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemState,1,1689390681951.d07866052fb30133af4706631514c75e.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689390682469"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689390682469"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689390682469"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689390682469"}]},"ts":"1689390682469"} 2023-07-15 03:11:22,472 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 6309c56827df62d41865efb6b441a423 2023-07-15 03:11:22,491 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/data/default/testtb-testExportFileSystemState/6309c56827df62d41865efb6b441a423/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-15 03:11:22,492 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=31, resume processing ppid=29 2023-07-15 03:11:22,494 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 6309c56827df62d41865efb6b441a423; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69247874, jitterRate=0.031873732805252075}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-15 03:11:22,494 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 6309c56827df62d41865efb6b441a423: 2023-07-15 03:11:22,494 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=31, ppid=29, state=SUCCESS; OpenRegionProcedure d07866052fb30133af4706631514c75e, server=jenkins-hbase4.apache.org,38367,1689390651355 in 241 msec 2023-07-15 03:11:22,499 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemState,,1689390681951.6309c56827df62d41865efb6b441a423., pid=30, masterSystemTime=1689390682389 2023-07-15 03:11:22,508 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=29, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=d07866052fb30133af4706631514c75e, ASSIGN in 426 msec 2023-07-15 03:11:22,509 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemState,,1689390681951.6309c56827df62d41865efb6b441a423. 2023-07-15 03:11:22,512 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemState,,1689390681951.6309c56827df62d41865efb6b441a423. 2023-07-15 03:11:22,512 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=28 updating hbase:meta row=6309c56827df62d41865efb6b441a423, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,43199,1689390651225 2023-07-15 03:11:22,513 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemState,,1689390681951.6309c56827df62d41865efb6b441a423.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689390682512"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689390682512"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689390682512"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689390682512"}]},"ts":"1689390682512"} 2023-07-15 03:11:22,525 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=30, resume processing ppid=28 2023-07-15 03:11:22,526 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=30, ppid=28, state=SUCCESS; OpenRegionProcedure 6309c56827df62d41865efb6b441a423, server=jenkins-hbase4.apache.org,43199,1689390651225 in 286 msec 2023-07-15 03:11:22,531 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=28, resume processing ppid=27 2023-07-15 03:11:22,532 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=28, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=6309c56827df62d41865efb6b441a423, ASSIGN in 457 msec 2023-07-15 03:11:22,533 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-15 03:11:22,534 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689390682534"}]},"ts":"1689390682534"} 2023-07-15 03:11:22,536 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=ENABLED in hbase:meta 2023-07-15 03:11:22,539 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_POST_OPERATION 2023-07-15 03:11:22,540 DEBUG [PEWorker-2] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemState jenkins: RWXCA 2023-07-15 03:11:22,543 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=39199] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemState], kv [jenkins: RWXCA] 2023-07-15 03:11:22,545 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): regionserver:38367-0x10166f610e80003, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-15 03:11:22,546 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): regionserver:39199-0x10166f610e80002, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-15 03:11:22,546 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): master:41669-0x10166f610e80000, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-15 03:11:22,546 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): regionserver:43199-0x10166f610e80001, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-15 03:11:22,547 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-15 03:11:22,548 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-15 03:11:22,548 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-15 03:11:22,549 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-15 03:11:22,550 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=27, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemState in 594 msec 2023-07-15 03:11:22,564 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41669] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-07-15 03:11:22,565 INFO [Listener at jenkins-hbase4.apache.org/44817] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemState, procId: 27 completed 2023-07-15 03:11:22,565 DEBUG [Listener at jenkins-hbase4.apache.org/44817] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testtb-testExportFileSystemState get assigned. Timeout = 60000ms 2023-07-15 03:11:22,565 INFO [Listener at jenkins-hbase4.apache.org/44817] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-15 03:11:22,569 INFO [Listener at jenkins-hbase4.apache.org/44817] hbase.HBaseTestingUtility(3484): All regions for table testtb-testExportFileSystemState assigned to meta. Checking AM states. 2023-07-15 03:11:22,569 INFO [Listener at jenkins-hbase4.apache.org/44817] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-15 03:11:22,570 INFO [Listener at jenkins-hbase4.apache.org/44817] hbase.HBaseTestingUtility(3504): All regions for table testtb-testExportFileSystemState assigned. 2023-07-15 03:11:22,573 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41669] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-15 03:11:22,573 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41669] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689390682573 (current time:1689390682573). 2023-07-15 03:11:22,573 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41669] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-15 03:11:22,573 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41669] zookeeper.ReadOnlyZKClient(139): Connect 0x763ffb4c to 127.0.0.1:62663 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-15 03:11:22,588 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41669] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@21d03875, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-15 03:11:22,590 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41669] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-15 03:11:22,594 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:47624, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-15 03:11:22,595 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41669] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x763ffb4c to 127.0.0.1:62663 2023-07-15 03:11:22,595 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41669] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-15 03:11:22,596 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41669] zookeeper.ReadOnlyZKClient(139): Connect 0x5aa913d5 to 127.0.0.1:62663 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-15 03:11:22,617 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41669] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@53c57657, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-15 03:11:22,620 DEBUG [hconnection-0x73f6ffca-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-15 03:11:22,621 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:47628, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-15 03:11:22,626 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41669] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-15 03:11:22,628 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:48588, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-15 03:11:22,629 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41669] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x5aa913d5 to 127.0.0.1:62663 2023-07-15 03:11:22,629 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41669] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-15 03:11:22,629 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41669] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemState], kv [jenkins: RWXCA] 2023-07-15 03:11:22,630 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41669] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-15 03:11:22,630 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41669] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-15 03:11:22,633 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41669] procedure2.ProcedureExecutor(1029): Stored pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-15 03:11:22,635 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-15 03:11:22,636 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=32, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1689391282636 2023-07-15 03:11:22,636 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState 2023-07-15 03:11:22,636 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41669] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-15 03:11:22,638 DEBUG [Listener at jenkins-hbase4.apache.org/44817] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-15 03:11:22,638 DEBUG [Listener at jenkins-hbase4.apache.org/44817] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-15 03:11:22,639 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=33, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-15 03:11:22,640 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=32, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-15 03:11:22,642 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=32, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE in 8 msec 2023-07-15 03:11:22,644 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=33, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-15 03:11:22,646 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=33, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED; timeout=600000, timestamp=1689391282646 2023-07-15 03:11:22,738 DEBUG [Listener at jenkins-hbase4.apache.org/44817] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-15 03:11:22,740 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41669] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-15 03:11:22,740 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41669] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-15 03:11:22,740 DEBUG [Listener at jenkins-hbase4.apache.org/44817] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-15 03:11:22,940 DEBUG [Listener at jenkins-hbase4.apache.org/44817] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-15 03:11:22,941 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41669] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-15 03:11:22,941 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41669] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-15 03:11:22,942 DEBUG [Listener at jenkins-hbase4.apache.org/44817] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-15 03:11:23,066 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportFileSystemState 2023-07-15 03:11:23,066 INFO [(jenkins-hbase4.apache.org,41669,1689390649760)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportFileSystemState' 2023-07-15 03:11:23,066 DEBUG [(jenkins-hbase4.apache.org,41669,1689390649760)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-15 03:11:23,066 DEBUG [(jenkins-hbase4.apache.org,41669,1689390649760)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' 2023-07-15 03:11:23,066 DEBUG [(jenkins-hbase4.apache.org,41669,1689390649760)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportFileSystemState', kicking off acquire phase on members. 2023-07-15 03:11:23,066 DEBUG [(jenkins-hbase4.apache.org,41669,1689390649760)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41669-0x10166f610e80000, quorum=127.0.0.1:62663, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-15 03:11:23,067 DEBUG [(jenkins-hbase4.apache.org,41669,1689390649760)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-15 03:11:23,068 DEBUG [(jenkins-hbase4.apache.org,41669,1689390649760)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,38367,1689390651355 2023-07-15 03:11:23,068 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): regionserver:43199-0x10166f610e80001, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 03:11:23,068 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): regionserver:38367-0x10166f610e80003, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 03:11:23,069 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 03:11:23,069 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 03:11:23,069 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 03:11:23,068 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): regionserver:39199-0x10166f610e80002, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 03:11:23,069 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 03:11:23,069 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 03:11:23,069 DEBUG [(jenkins-hbase4.apache.org,41669,1689390649760)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41669-0x10166f610e80000, quorum=127.0.0.1:62663, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,38367,1689390651355 2023-07-15 03:11:23,069 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 03:11:23,069 DEBUG [(jenkins-hbase4.apache.org,41669,1689390649760)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43199,1689390651225 2023-07-15 03:11:23,073 DEBUG [(jenkins-hbase4.apache.org,41669,1689390649760)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41669-0x10166f610e80000, quorum=127.0.0.1:62663, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43199,1689390651225 2023-07-15 03:11:23,073 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-15 03:11:23,073 DEBUG [(jenkins-hbase4.apache.org,41669,1689390649760)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-15 03:11:23,073 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-15 03:11:23,073 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-15 03:11:23,074 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43199-0x10166f610e80001, quorum=127.0.0.1:62663, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-15 03:11:23,074 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38367-0x10166f610e80003, quorum=127.0.0.1:62663, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-15 03:11:23,074 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 174 2023-07-15 03:11:23,075 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-15 03:11:23,075 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 174 2023-07-15 03:11:23,075 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-15 03:11:23,075 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-15 03:11:23,075 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-15 03:11:23,075 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemState 2023-07-15 03:11:23,075 DEBUG [member: 'jenkins-hbase4.apache.org,43199,1689390651225' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-15 03:11:23,075 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemState 2023-07-15 03:11:23,075 DEBUG [member: 'jenkins-hbase4.apache.org,43199,1689390651225' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-15 03:11:23,075 DEBUG [member: 'jenkins-hbase4.apache.org,38367,1689390651355' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-15 03:11:23,077 DEBUG [member: 'jenkins-hbase4.apache.org,38367,1689390651355' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-15 03:11:23,077 DEBUG [member: 'jenkins-hbase4.apache.org,43199,1689390651225' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-15 03:11:23,078 DEBUG [member: 'jenkins-hbase4.apache.org,38367,1689390651355' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-15 03:11:23,078 DEBUG [member: 'jenkins-hbase4.apache.org,43199,1689390651225' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally acquired 2023-07-15 03:11:23,078 DEBUG [member: 'jenkins-hbase4.apache.org,38367,1689390651355' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally acquired 2023-07-15 03:11:23,078 DEBUG [member: 'jenkins-hbase4.apache.org,43199,1689390651225' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43199,1689390651225' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemState) in zk 2023-07-15 03:11:23,078 DEBUG [member: 'jenkins-hbase4.apache.org,38367,1689390651355' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38367,1689390651355' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemState) in zk 2023-07-15 03:11:23,078 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39199-0x10166f610e80002, quorum=127.0.0.1:62663, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-15 03:11:23,085 DEBUG [member: 'jenkins-hbase4.apache.org,43199,1689390651225' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-15 03:11:23,085 DEBUG [member: 'jenkins-hbase4.apache.org,38367,1689390651355' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-15 03:11:23,085 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): master:41669-0x10166f610e80000, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43199,1689390651225 2023-07-15 03:11:23,085 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): master:41669-0x10166f610e80000, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,38367,1689390651355 2023-07-15 03:11:23,085 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 174 2023-07-15 03:11:23,085 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43199,1689390651225 2023-07-15 03:11:23,085 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 03:11:23,086 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 03:11:23,086 DEBUG [member: 'jenkins-hbase4.apache.org,38367,1689390651355' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38367-0x10166f610e80003, quorum=127.0.0.1:62663, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-15 03:11:23,086 DEBUG [member: 'jenkins-hbase4.apache.org,38367,1689390651355' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-15 03:11:23,085 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-15 03:11:23,085 DEBUG [member: 'jenkins-hbase4.apache.org,43199,1689390651225' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43199-0x10166f610e80001, quorum=127.0.0.1:62663, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-15 03:11:23,086 DEBUG [member: 'jenkins-hbase4.apache.org,43199,1689390651225' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-15 03:11:23,086 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 03:11:23,086 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-15 03:11:23,086 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 03:11:23,086 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemState 2023-07-15 03:11:23,086 DEBUG [member: 'jenkins-hbase4.apache.org,39199,1689390651299' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-15 03:11:23,087 DEBUG [member: 'jenkins-hbase4.apache.org,39199,1689390651299' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-15 03:11:23,088 DEBUG [member: 'jenkins-hbase4.apache.org,39199,1689390651299' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-15 03:11:23,088 DEBUG [member: 'jenkins-hbase4.apache.org,39199,1689390651299' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally acquired 2023-07-15 03:11:23,088 DEBUG [member: 'jenkins-hbase4.apache.org,39199,1689390651299' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39199,1689390651299' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemState) in zk 2023-07-15 03:11:23,088 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-15 03:11:23,088 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43199,1689390651225 2023-07-15 03:11:23,090 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38367,1689390651355 2023-07-15 03:11:23,090 DEBUG [member: 'jenkins-hbase4.apache.org,39199,1689390651299' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-15 03:11:23,090 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 03:11:23,090 DEBUG [member: 'jenkins-hbase4.apache.org,39199,1689390651299' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39199-0x10166f610e80002, quorum=127.0.0.1:62663, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-15 03:11:23,090 DEBUG [member: 'jenkins-hbase4.apache.org,39199,1689390651299' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-15 03:11:23,090 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43199,1689390651225' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemState' on coordinator 2023-07-15 03:11:23,090 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5347c32[Count = 1] remaining members to acquire global barrier 2023-07-15 03:11:23,090 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,38367,1689390651355 2023-07-15 03:11:23,090 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 03:11:23,091 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 03:11:23,091 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 03:11:23,091 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 03:11:23,092 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-15 03:11:23,092 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43199,1689390651225 2023-07-15 03:11:23,092 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39199,1689390651299 2023-07-15 03:11:23,093 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38367,1689390651355 2023-07-15 03:11:23,093 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 03:11:23,094 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,38367,1689390651355' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemState' on coordinator 2023-07-15 03:11:23,094 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5347c32[Count = 0] remaining members to acquire global barrier 2023-07-15 03:11:23,094 DEBUG [(jenkins-hbase4.apache.org,41669,1689390649760)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportFileSystemState' starting 'in-barrier' execution. 2023-07-15 03:11:23,094 DEBUG [(jenkins-hbase4.apache.org,41669,1689390649760)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-15 03:11:23,095 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): regionserver:43199-0x10166f610e80001, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-15 03:11:23,095 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): regionserver:39199-0x10166f610e80002, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-15 03:11:23,095 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-15 03:11:23,095 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-15 03:11:23,096 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-15 03:11:23,095 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): regionserver:38367-0x10166f610e80003, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-15 03:11:23,096 DEBUG [member: 'jenkins-hbase4.apache.org,43199,1689390651225' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-15 03:11:23,096 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-15 03:11:23,096 DEBUG [(jenkins-hbase4.apache.org,41669,1689390649760)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41669-0x10166f610e80000, quorum=127.0.0.1:62663, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43199,1689390651225 2023-07-15 03:11:23,096 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-15 03:11:23,096 DEBUG [member: 'jenkins-hbase4.apache.org,43199,1689390651225' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-15 03:11:23,096 DEBUG [rs(jenkins-hbase4.apache.org,43199,1689390651225)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,,1689390681951.6309c56827df62d41865efb6b441a423. 2023-07-15 03:11:23,096 DEBUG [member: 'jenkins-hbase4.apache.org,43199,1689390651225' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-15 03:11:23,096 DEBUG [member: 'jenkins-hbase4.apache.org,39199,1689390651299' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-15 03:11:23,096 DEBUG [(jenkins-hbase4.apache.org,41669,1689390649760)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41669-0x10166f610e80000, quorum=127.0.0.1:62663, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,38367,1689390651355 2023-07-15 03:11:23,096 DEBUG [(jenkins-hbase4.apache.org,41669,1689390649760)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-15 03:11:23,096 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-15 03:11:23,096 DEBUG [member: 'jenkins-hbase4.apache.org,39199,1689390651299' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally completed 2023-07-15 03:11:23,096 DEBUG [rs(jenkins-hbase4.apache.org,43199,1689390651225)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,,1689390681951.6309c56827df62d41865efb6b441a423. started... 2023-07-15 03:11:23,097 DEBUG [member: 'jenkins-hbase4.apache.org,39199,1689390651299' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,39199,1689390651299' in zk 2023-07-15 03:11:23,096 DEBUG [member: 'jenkins-hbase4.apache.org,38367,1689390651355' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-15 03:11:23,098 DEBUG [rs(jenkins-hbase4.apache.org,43199,1689390651225)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 6309c56827df62d41865efb6b441a423: 2023-07-15 03:11:23,098 DEBUG [member: 'jenkins-hbase4.apache.org,38367,1689390651355' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-15 03:11:23,098 DEBUG [member: 'jenkins-hbase4.apache.org,38367,1689390651355' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-15 03:11:23,098 DEBUG [rs(jenkins-hbase4.apache.org,38367,1689390651355)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,1,1689390681951.d07866052fb30133af4706631514c75e. 2023-07-15 03:11:23,098 DEBUG [rs(jenkins-hbase4.apache.org,38367,1689390651355)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,1,1689390681951.d07866052fb30133af4706631514c75e. started... 2023-07-15 03:11:23,098 DEBUG [rs(jenkins-hbase4.apache.org,43199,1689390651225)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,,1689390681951.6309c56827df62d41865efb6b441a423.' region-info for snapshot=emptySnaptb0-testExportFileSystemState 2023-07-15 03:11:23,098 DEBUG [rs(jenkins-hbase4.apache.org,43199,1689390651225)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-15 03:11:23,099 DEBUG [rs(jenkins-hbase4.apache.org,43199,1689390651225)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-15 03:11:23,099 DEBUG [rs(jenkins-hbase4.apache.org,38367,1689390651355)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for d07866052fb30133af4706631514c75e: 2023-07-15 03:11:23,100 DEBUG [rs(jenkins-hbase4.apache.org,38367,1689390651355)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,1,1689390681951.d07866052fb30133af4706631514c75e.' region-info for snapshot=emptySnaptb0-testExportFileSystemState 2023-07-15 03:11:23,100 DEBUG [rs(jenkins-hbase4.apache.org,38367,1689390651355)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-15 03:11:23,100 DEBUG [rs(jenkins-hbase4.apache.org,38367,1689390651355)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-15 03:11:23,113 DEBUG [member: 'jenkins-hbase4.apache.org,39199,1689390651299' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemState' has notified controller of completion 2023-07-15 03:11:23,113 DEBUG [member: 'jenkins-hbase4.apache.org,39199,1689390651299' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-15 03:11:23,113 DEBUG [member: 'jenkins-hbase4.apache.org,39199,1689390651299' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemState' completed. 2023-07-15 03:11:23,174 DEBUG [rs(jenkins-hbase4.apache.org,43199,1689390651225)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,,1689390681951.6309c56827df62d41865efb6b441a423. completed. 2023-07-15 03:11:23,174 DEBUG [rs(jenkins-hbase4.apache.org,43199,1689390651225)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,,1689390681951.6309c56827df62d41865efb6b441a423. 2023-07-15 03:11:23,174 DEBUG [member: 'jenkins-hbase4.apache.org,43199,1689390651225' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-15 03:11:23,174 DEBUG [member: 'jenkins-hbase4.apache.org,43199,1689390651225' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-15 03:11:23,174 DEBUG [member: 'jenkins-hbase4.apache.org,43199,1689390651225' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,43199,1689390651225 2023-07-15 03:11:23,174 DEBUG [member: 'jenkins-hbase4.apache.org,43199,1689390651225' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally completed 2023-07-15 03:11:23,174 DEBUG [member: 'jenkins-hbase4.apache.org,43199,1689390651225' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,43199,1689390651225' in zk 2023-07-15 03:11:23,175 DEBUG [rs(jenkins-hbase4.apache.org,38367,1689390651355)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,1,1689390681951.d07866052fb30133af4706631514c75e. completed. 2023-07-15 03:11:23,175 DEBUG [rs(jenkins-hbase4.apache.org,38367,1689390651355)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,1,1689390681951.d07866052fb30133af4706631514c75e. 2023-07-15 03:11:23,175 DEBUG [member: 'jenkins-hbase4.apache.org,38367,1689390651355' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-15 03:11:23,175 DEBUG [member: 'jenkins-hbase4.apache.org,38367,1689390651355' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-15 03:11:23,175 DEBUG [member: 'jenkins-hbase4.apache.org,38367,1689390651355' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,38367,1689390651355 2023-07-15 03:11:23,175 DEBUG [member: 'jenkins-hbase4.apache.org,38367,1689390651355' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally completed 2023-07-15 03:11:23,175 DEBUG [member: 'jenkins-hbase4.apache.org,38367,1689390651355' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,38367,1689390651355' in zk 2023-07-15 03:11:23,177 DEBUG [member: 'jenkins-hbase4.apache.org,43199,1689390651225' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemState' has notified controller of completion 2023-07-15 03:11:23,177 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): master:41669-0x10166f610e80000, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43199,1689390651225 2023-07-15 03:11:23,177 DEBUG [member: 'jenkins-hbase4.apache.org,43199,1689390651225' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-15 03:11:23,177 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43199,1689390651225 2023-07-15 03:11:23,177 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 03:11:23,178 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 03:11:23,177 DEBUG [member: 'jenkins-hbase4.apache.org,43199,1689390651225' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemState' completed. 2023-07-15 03:11:23,180 DEBUG [member: 'jenkins-hbase4.apache.org,38367,1689390651355' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemState' has notified controller of completion 2023-07-15 03:11:23,180 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): master:41669-0x10166f610e80000, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,38367,1689390651355 2023-07-15 03:11:23,180 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 03:11:23,180 DEBUG [member: 'jenkins-hbase4.apache.org,38367,1689390651355' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-15 03:11:23,180 DEBUG [member: 'jenkins-hbase4.apache.org,38367,1689390651355' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemState' completed. 2023-07-15 03:11:23,181 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 03:11:23,181 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-15 03:11:23,182 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43199,1689390651225 2023-07-15 03:11:23,182 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39199,1689390651299 2023-07-15 03:11:23,182 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38367,1689390651355 2023-07-15 03:11:23,183 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 03:11:23,183 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-15 03:11:23,183 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43199,1689390651225 2023-07-15 03:11:23,184 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39199,1689390651299 2023-07-15 03:11:23,184 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38367,1689390651355 2023-07-15 03:11:23,185 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,43199,1689390651225': 2023-07-15 03:11:23,185 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43199,1689390651225' released barrier for procedure'emptySnaptb0-testExportFileSystemState', counting down latch. Waiting for 1 more 2023-07-15 03:11:23,185 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,38367,1689390651355 2023-07-15 03:11:23,185 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 03:11:23,185 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 03:11:23,185 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 03:11:23,185 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 03:11:23,186 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-15 03:11:23,186 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43199,1689390651225 2023-07-15 03:11:23,187 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39199,1689390651299 2023-07-15 03:11:23,187 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38367,1689390651355 2023-07-15 03:11:23,188 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 03:11:23,188 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-15 03:11:23,188 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43199,1689390651225 2023-07-15 03:11:23,189 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39199,1689390651299 2023-07-15 03:11:23,189 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38367,1689390651355 2023-07-15 03:11:23,189 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,38367,1689390651355': 2023-07-15 03:11:23,190 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,38367,1689390651355' released barrier for procedure'emptySnaptb0-testExportFileSystemState', counting down latch. Waiting for 0 more 2023-07-15 03:11:23,190 INFO [(jenkins-hbase4.apache.org,41669,1689390649760)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportFileSystemState' execution completed 2023-07-15 03:11:23,190 DEBUG [(jenkins-hbase4.apache.org,41669,1689390649760)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-15 03:11:23,190 DEBUG [(jenkins-hbase4.apache.org,41669,1689390649760)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-15 03:11:23,190 DEBUG [(jenkins-hbase4.apache.org,41669,1689390649760)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportFileSystemState 2023-07-15 03:11:23,190 INFO [(jenkins-hbase4.apache.org,41669,1689390649760)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-15 03:11:23,192 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): regionserver:38367-0x10166f610e80003, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-15 03:11:23,192 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): regionserver:39199-0x10166f610e80002, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-15 03:11:23,192 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-15 03:11:23,192 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-15 03:11:23,192 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): master:41669-0x10166f610e80000, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-15 03:11:23,192 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-15 03:11:23,192 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-15 03:11:23,192 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 03:11:23,192 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 03:11:23,192 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): regionserver:39199-0x10166f610e80002, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 03:11:23,192 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): regionserver:38367-0x10166f610e80003, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 03:11:23,192 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): regionserver:43199-0x10166f610e80001, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-15 03:11:23,192 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-15 03:11:23,192 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-15 03:11:23,192 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-15 03:11:23,192 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): regionserver:43199-0x10166f610e80001, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 03:11:23,192 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 03:11:23,193 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 03:11:23,193 DEBUG [(jenkins-hbase4.apache.org,41669,1689390649760)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41669-0x10166f610e80000, quorum=127.0.0.1:62663, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43199,1689390651225 2023-07-15 03:11:23,193 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 03:11:23,193 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 03:11:23,193 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 03:11:23,193 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-15 03:11:23,193 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 03:11:23,193 DEBUG [(jenkins-hbase4.apache.org,41669,1689390649760)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41669-0x10166f610e80000, quorum=127.0.0.1:62663, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39199,1689390651299 2023-07-15 03:11:23,193 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-15 03:11:23,193 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 03:11:23,194 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-15 03:11:23,194 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 03:11:23,194 DEBUG [(jenkins-hbase4.apache.org,41669,1689390649760)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41669-0x10166f610e80000, quorum=127.0.0.1:62663, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,38367,1689390651355 2023-07-15 03:11:23,194 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-15 03:11:23,194 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-15 03:11:23,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43199,1689390651225 2023-07-15 03:11:23,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39199,1689390651299 2023-07-15 03:11:23,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38367,1689390651355 2023-07-15 03:11:23,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 03:11:23,196 DEBUG [(jenkins-hbase4.apache.org,41669,1689390649760)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41669-0x10166f610e80000, quorum=127.0.0.1:62663, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43199,1689390651225 2023-07-15 03:11:23,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-15 03:11:23,197 DEBUG [(jenkins-hbase4.apache.org,41669,1689390649760)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41669-0x10166f610e80000, quorum=127.0.0.1:62663, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39199,1689390651299 2023-07-15 03:11:23,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43199,1689390651225 2023-07-15 03:11:23,198 DEBUG [(jenkins-hbase4.apache.org,41669,1689390649760)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41669-0x10166f610e80000, quorum=127.0.0.1:62663, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,38367,1689390651355 2023-07-15 03:11:23,198 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39199,1689390651299 2023-07-15 03:11:23,198 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38367,1689390651355 2023-07-15 03:11:23,202 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): master:41669-0x10166f610e80000, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,38367,1689390651355 2023-07-15 03:11:23,202 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): master:41669-0x10166f610e80000, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-15 03:11:23,202 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): master:41669-0x10166f610e80000, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39199,1689390651299 2023-07-15 03:11:23,202 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): master:41669-0x10166f610e80000, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43199,1689390651225 2023-07-15 03:11:23,202 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): master:41669-0x10166f610e80000, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-15 03:11:23,202 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): master:41669-0x10166f610e80000, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,38367,1689390651355 2023-07-15 03:11:23,202 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): master:41669-0x10166f610e80000, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-15 03:11:23,202 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): master:41669-0x10166f610e80000, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39199,1689390651299 2023-07-15 03:11:23,202 DEBUG [(jenkins-hbase4.apache.org,41669,1689390649760)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-15 03:11:23,202 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): regionserver:38367-0x10166f610e80003, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 03:11:23,202 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): regionserver:43199-0x10166f610e80001, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 03:11:23,203 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 03:11:23,204 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): regionserver:43199-0x10166f610e80001, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 03:11:23,204 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 03:11:23,202 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): regionserver:39199-0x10166f610e80002, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 03:11:23,204 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): regionserver:39199-0x10166f610e80002, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 03:11:23,202 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportFileSystemState 2023-07-15 03:11:23,202 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): master:41669-0x10166f610e80000, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43199,1689390651225 2023-07-15 03:11:23,204 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportFileSystemState 2023-07-15 03:11:23,204 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): master:41669-0x10166f610e80000, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-15 03:11:23,204 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 03:11:23,203 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 03:11:23,204 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 03:11:23,203 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): regionserver:38367-0x10166f610e80003, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 03:11:23,204 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 03:11:23,204 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): master:41669-0x10166f610e80000, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-15 03:11:23,205 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 03:11:23,205 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 03:11:23,205 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState 2023-07-15 03:11:23,205 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 03:11:23,205 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 03:11:23,207 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 03:11:23,207 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 03:11:23,227 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState to hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/.hbase-snapshot/emptySnaptb0-testExportFileSystemState 2023-07-15 03:11:23,242 DEBUG [Listener at jenkins-hbase4.apache.org/44817] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-15 03:11:23,243 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41669] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-15 03:11:23,243 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41669] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-15 03:11:23,244 DEBUG [Listener at jenkins-hbase4.apache.org/44817] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-07-15 03:11:23,255 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed 2023-07-15 03:11:23,255 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState 2023-07-15 03:11:23,255 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState 2023-07-15 03:11:23,255 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState at 1689390682636Consolidate snapshot: emptySnaptb0-testExportFileSystemState at 1689390683204 (+568 ms)Loading Region manifests for emptySnaptb0-testExportFileSystemState at 1689390683204Writing data manifest for emptySnaptb0-testExportFileSystemState at 1689390683209 (+5 ms)Verifying snapshot: emptySnaptb0-testExportFileSystemState at 1689390683220 (+11 ms)Snapshot emptySnaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed at 1689390683255 (+35 ms) 2023-07-15 03:11:23,258 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=33, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-15 03:11:23,261 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=33, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED in 621 msec 2023-07-15 03:11:23,744 DEBUG [Listener at jenkins-hbase4.apache.org/44817] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-15 03:11:23,747 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41669] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-15 03:11:23,747 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41669] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-15 03:11:23,755 DEBUG [htable-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-15 03:11:23,757 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38367] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemState,1,1689390681951.d07866052fb30133af4706631514c75e. with WAL disabled. Data may be lost in the event of a crash. 2023-07-15 03:11:23,764 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:42482, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-15 03:11:23,765 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43199] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemState,,1689390681951.6309c56827df62d41865efb6b441a423. with WAL disabled. Data may be lost in the event of a crash. 2023-07-15 03:11:23,768 DEBUG [Listener at jenkins-hbase4.apache.org/44817] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemState 2023-07-15 03:11:23,769 DEBUG [Listener at jenkins-hbase4.apache.org/44817] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemState,,1689390681951.6309c56827df62d41865efb6b441a423. 2023-07-15 03:11:23,770 INFO [Listener at jenkins-hbase4.apache.org/44817] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-15 03:11:23,782 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41669] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-15 03:11:23,782 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41669] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689390683782 (current time:1689390683782). 2023-07-15 03:11:23,782 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41669] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-15 03:11:23,783 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41669] zookeeper.ReadOnlyZKClient(139): Connect 0x0eca714b to 127.0.0.1:62663 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-15 03:11:23,790 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41669] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@49679acf, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-15 03:11:23,791 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41669] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-15 03:11:23,792 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:47642, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-15 03:11:23,793 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41669] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x0eca714b to 127.0.0.1:62663 2023-07-15 03:11:23,793 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41669] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-15 03:11:23,793 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41669] zookeeper.ReadOnlyZKClient(139): Connect 0x4c931b46 to 127.0.0.1:62663 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-15 03:11:23,803 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41669] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@64ca3aba, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-15 03:11:23,804 DEBUG [hconnection-0x46062fc1-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-15 03:11:23,808 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:47654, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-15 03:11:23,811 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41669] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-15 03:11:23,814 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:48590, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-15 03:11:23,816 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41669] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4c931b46 to 127.0.0.1:62663 2023-07-15 03:11:23,816 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41669] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-15 03:11:23,816 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41669] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemState], kv [jenkins: RWXCA] 2023-07-15 03:11:23,817 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41669] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-15 03:11:23,817 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41669] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-15 03:11:23,820 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41669] procedure2.ProcedureExecutor(1029): Stored pid=34, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-15 03:11:23,821 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=34, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-15 03:11:23,822 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=34, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1689391283822 2023-07-15 03:11:23,822 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState 2023-07-15 03:11:23,822 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41669] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-15 03:11:23,824 DEBUG [Listener at jenkins-hbase4.apache.org/44817] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-15 03:11:23,824 DEBUG [Listener at jenkins-hbase4.apache.org/44817] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-15 03:11:23,824 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=35, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-15 03:11:23,826 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=34, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-15 03:11:23,828 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=34, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE in 7 msec 2023-07-15 03:11:23,829 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=35, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-15 03:11:23,830 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=35, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED; timeout=600000, timestamp=1689391283830 2023-07-15 03:11:23,852 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemState 2023-07-15 03:11:23,852 INFO [(jenkins-hbase4.apache.org,41669,1689390649760)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemState' 2023-07-15 03:11:23,853 DEBUG [(jenkins-hbase4.apache.org,41669,1689390649760)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-15 03:11:23,854 DEBUG [(jenkins-hbase4.apache.org,41669,1689390649760)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemState' starting 'acquire' 2023-07-15 03:11:23,854 DEBUG [(jenkins-hbase4.apache.org,41669,1689390649760)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemState', kicking off acquire phase on members. 2023-07-15 03:11:23,855 DEBUG [(jenkins-hbase4.apache.org,41669,1689390649760)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41669-0x10166f610e80000, quorum=127.0.0.1:62663, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-15 03:11:23,855 DEBUG [(jenkins-hbase4.apache.org,41669,1689390649760)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-15 03:11:23,857 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): regionserver:38367-0x10166f610e80003, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 03:11:23,857 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): regionserver:39199-0x10166f610e80002, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 03:11:23,857 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 03:11:23,857 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 03:11:23,857 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 03:11:23,857 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): regionserver:43199-0x10166f610e80001, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 03:11:23,857 DEBUG [(jenkins-hbase4.apache.org,41669,1689390649760)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,38367,1689390651355 2023-07-15 03:11:23,857 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 03:11:23,858 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 03:11:23,857 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 03:11:23,858 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-15 03:11:23,858 DEBUG [(jenkins-hbase4.apache.org,41669,1689390649760)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41669-0x10166f610e80000, quorum=127.0.0.1:62663, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,38367,1689390651355 2023-07-15 03:11:23,858 DEBUG [(jenkins-hbase4.apache.org,41669,1689390649760)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43199,1689390651225 2023-07-15 03:11:23,858 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-15 03:11:23,858 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-15 03:11:23,858 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39199-0x10166f610e80002, quorum=127.0.0.1:62663, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-15 03:11:23,858 DEBUG [(jenkins-hbase4.apache.org,41669,1689390649760)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41669-0x10166f610e80000, quorum=127.0.0.1:62663, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43199,1689390651225 2023-07-15 03:11:23,858 DEBUG [(jenkins-hbase4.apache.org,41669,1689390649760)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-15 03:11:23,858 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43199-0x10166f610e80001, quorum=127.0.0.1:62663, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-15 03:11:23,859 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 169 2023-07-15 03:11:23,859 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-15 03:11:23,859 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38367-0x10166f610e80003, quorum=127.0.0.1:62663, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-15 03:11:23,859 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 169 2023-07-15 03:11:23,859 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-15 03:11:23,859 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-15 03:11:23,859 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-15 03:11:23,859 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 169 2023-07-15 03:11:23,859 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-15 03:11:23,859 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemState 2023-07-15 03:11:23,859 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-15 03:11:23,859 DEBUG [member: 'jenkins-hbase4.apache.org,39199,1689390651299' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-15 03:11:23,859 DEBUG [member: 'jenkins-hbase4.apache.org,39199,1689390651299' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-15 03:11:23,861 DEBUG [member: 'jenkins-hbase4.apache.org,39199,1689390651299' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-15 03:11:23,861 DEBUG [member: 'jenkins-hbase4.apache.org,39199,1689390651299' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemState' locally acquired 2023-07-15 03:11:23,861 DEBUG [member: 'jenkins-hbase4.apache.org,39199,1689390651299' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39199,1689390651299' joining acquired barrier for procedure (snaptb0-testExportFileSystemState) in zk 2023-07-15 03:11:23,861 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemState 2023-07-15 03:11:23,861 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemState 2023-07-15 03:11:23,861 DEBUG [member: 'jenkins-hbase4.apache.org,43199,1689390651225' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-15 03:11:23,861 DEBUG [member: 'jenkins-hbase4.apache.org,38367,1689390651355' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-15 03:11:23,861 DEBUG [member: 'jenkins-hbase4.apache.org,38367,1689390651355' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-15 03:11:23,861 DEBUG [member: 'jenkins-hbase4.apache.org,43199,1689390651225' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-15 03:11:23,863 DEBUG [member: 'jenkins-hbase4.apache.org,38367,1689390651355' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-15 03:11:23,863 DEBUG [member: 'jenkins-hbase4.apache.org,38367,1689390651355' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemState' locally acquired 2023-07-15 03:11:23,863 DEBUG [member: 'jenkins-hbase4.apache.org,38367,1689390651355' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38367,1689390651355' joining acquired barrier for procedure (snaptb0-testExportFileSystemState) in zk 2023-07-15 03:11:23,864 DEBUG [member: 'jenkins-hbase4.apache.org,43199,1689390651225' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-15 03:11:23,864 DEBUG [member: 'jenkins-hbase4.apache.org,43199,1689390651225' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemState' locally acquired 2023-07-15 03:11:23,864 DEBUG [member: 'jenkins-hbase4.apache.org,43199,1689390651225' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43199,1689390651225' joining acquired barrier for procedure (snaptb0-testExportFileSystemState) in zk 2023-07-15 03:11:23,865 DEBUG [member: 'jenkins-hbase4.apache.org,39199,1689390651299' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-15 03:11:23,866 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): master:41669-0x10166f610e80000, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,38367,1689390651355 2023-07-15 03:11:23,866 DEBUG [member: 'jenkins-hbase4.apache.org,38367,1689390651355' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-15 03:11:23,866 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,38367,1689390651355 2023-07-15 03:11:23,866 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 03:11:23,866 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 03:11:23,866 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemState' 2023-07-15 03:11:23,867 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): master:41669-0x10166f610e80000, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43199,1689390651225 2023-07-15 03:11:23,867 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 03:11:23,867 DEBUG [member: 'jenkins-hbase4.apache.org,38367,1689390651355' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38367-0x10166f610e80003, quorum=127.0.0.1:62663, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-15 03:11:23,867 DEBUG [member: 'jenkins-hbase4.apache.org,38367,1689390651355' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-15 03:11:23,867 DEBUG [member: 'jenkins-hbase4.apache.org,43199,1689390651225' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-15 03:11:23,867 DEBUG [member: 'jenkins-hbase4.apache.org,39199,1689390651299' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39199-0x10166f610e80002, quorum=127.0.0.1:62663, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-15 03:11:23,867 DEBUG [member: 'jenkins-hbase4.apache.org,39199,1689390651299' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-15 03:11:23,867 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 03:11:23,867 DEBUG [member: 'jenkins-hbase4.apache.org,43199,1689390651225' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43199-0x10166f610e80001, quorum=127.0.0.1:62663, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-15 03:11:23,867 DEBUG [member: 'jenkins-hbase4.apache.org,43199,1689390651225' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-15 03:11:23,868 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-15 03:11:23,868 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43199,1689390651225 2023-07-15 03:11:23,868 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39199,1689390651299 2023-07-15 03:11:23,868 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38367,1689390651355 2023-07-15 03:11:23,869 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 03:11:23,869 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,38367,1689390651355' joining acquired barrier for procedure 'snaptb0-testExportFileSystemState' on coordinator 2023-07-15 03:11:23,869 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@43b3eb91[Count = 1] remaining members to acquire global barrier 2023-07-15 03:11:23,869 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43199,1689390651225 2023-07-15 03:11:23,869 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 03:11:23,869 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 03:11:23,870 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 03:11:23,870 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 03:11:23,870 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-15 03:11:23,870 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43199,1689390651225 2023-07-15 03:11:23,871 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39199,1689390651299 2023-07-15 03:11:23,871 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38367,1689390651355 2023-07-15 03:11:23,871 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 03:11:23,871 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43199,1689390651225' joining acquired barrier for procedure 'snaptb0-testExportFileSystemState' on coordinator 2023-07-15 03:11:23,871 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@43b3eb91[Count = 0] remaining members to acquire global barrier 2023-07-15 03:11:23,871 DEBUG [(jenkins-hbase4.apache.org,41669,1689390649760)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemState' starting 'in-barrier' execution. 2023-07-15 03:11:23,871 DEBUG [(jenkins-hbase4.apache.org,41669,1689390649760)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-15 03:11:23,873 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): regionserver:39199-0x10166f610e80002, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-15 03:11:23,873 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): regionserver:38367-0x10166f610e80003, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-15 03:11:23,873 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): regionserver:43199-0x10166f610e80001, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-15 03:11:23,873 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-15 03:11:23,873 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-15 03:11:23,873 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-15 03:11:23,874 DEBUG [(jenkins-hbase4.apache.org,41669,1689390649760)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41669-0x10166f610e80000, quorum=127.0.0.1:62663, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,38367,1689390651355 2023-07-15 03:11:23,873 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-15 03:11:23,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-15 03:11:23,874 DEBUG [member: 'jenkins-hbase4.apache.org,38367,1689390651355' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-15 03:11:23,873 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-15 03:11:23,874 DEBUG [member: 'jenkins-hbase4.apache.org,39199,1689390651299' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-15 03:11:23,874 DEBUG [member: 'jenkins-hbase4.apache.org,43199,1689390651225' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-15 03:11:23,874 DEBUG [member: 'jenkins-hbase4.apache.org,38367,1689390651355' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-15 03:11:23,874 DEBUG [member: 'jenkins-hbase4.apache.org,38367,1689390651355' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-15 03:11:23,874 DEBUG [(jenkins-hbase4.apache.org,41669,1689390649760)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41669-0x10166f610e80000, quorum=127.0.0.1:62663, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43199,1689390651225 2023-07-15 03:11:23,874 DEBUG [member: 'jenkins-hbase4.apache.org,43199,1689390651225' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-15 03:11:23,874 DEBUG [member: 'jenkins-hbase4.apache.org,43199,1689390651225' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-15 03:11:23,874 DEBUG [member: 'jenkins-hbase4.apache.org,39199,1689390651299' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemState' locally completed 2023-07-15 03:11:23,874 DEBUG [rs(jenkins-hbase4.apache.org,43199,1689390651225)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,,1689390681951.6309c56827df62d41865efb6b441a423. 2023-07-15 03:11:23,874 DEBUG [(jenkins-hbase4.apache.org,41669,1689390649760)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-15 03:11:23,874 DEBUG [rs(jenkins-hbase4.apache.org,43199,1689390651225)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,,1689390681951.6309c56827df62d41865efb6b441a423. started... 2023-07-15 03:11:23,874 DEBUG [rs(jenkins-hbase4.apache.org,38367,1689390651355)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,1,1689390681951.d07866052fb30133af4706631514c75e. 2023-07-15 03:11:23,874 DEBUG [member: 'jenkins-hbase4.apache.org,39199,1689390651299' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,39199,1689390651299' in zk 2023-07-15 03:11:23,874 DEBUG [rs(jenkins-hbase4.apache.org,38367,1689390651355)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,1,1689390681951.d07866052fb30133af4706631514c75e. started... 2023-07-15 03:11:23,875 INFO [rs(jenkins-hbase4.apache.org,43199,1689390651225)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 6309c56827df62d41865efb6b441a423 1/1 column families, dataSize=266 B heapSize=832 B 2023-07-15 03:11:23,875 INFO [rs(jenkins-hbase4.apache.org,38367,1689390651355)-snapshot-pool-0] regionserver.HRegion(2745): Flushing d07866052fb30133af4706631514c75e 1/1 column families, dataSize=3.00 KB heapSize=6.72 KB 2023-07-15 03:11:23,876 DEBUG [member: 'jenkins-hbase4.apache.org,39199,1689390651299' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemState' has notified controller of completion 2023-07-15 03:11:23,876 DEBUG [member: 'jenkins-hbase4.apache.org,39199,1689390651299' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-15 03:11:23,876 DEBUG [member: 'jenkins-hbase4.apache.org,39199,1689390651299' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemState' completed. 2023-07-15 03:11:23,897 INFO [rs(jenkins-hbase4.apache.org,43199,1689390651225)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=266 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/data/default/testtb-testExportFileSystemState/6309c56827df62d41865efb6b441a423/.tmp/cf/4a10fb36413940c19d996480c964ce07 2023-07-15 03:11:23,897 INFO [rs(jenkins-hbase4.apache.org,38367,1689390651355)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.00 KB at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/data/default/testtb-testExportFileSystemState/d07866052fb30133af4706631514c75e/.tmp/cf/6f9015dcaa5440f5a1ed7c5c2de972b3 2023-07-15 03:11:23,909 DEBUG [rs(jenkins-hbase4.apache.org,38367,1689390651355)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/data/default/testtb-testExportFileSystemState/d07866052fb30133af4706631514c75e/.tmp/cf/6f9015dcaa5440f5a1ed7c5c2de972b3 as hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/data/default/testtb-testExportFileSystemState/d07866052fb30133af4706631514c75e/cf/6f9015dcaa5440f5a1ed7c5c2de972b3 2023-07-15 03:11:23,911 DEBUG [rs(jenkins-hbase4.apache.org,43199,1689390651225)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/data/default/testtb-testExportFileSystemState/6309c56827df62d41865efb6b441a423/.tmp/cf/4a10fb36413940c19d996480c964ce07 as hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/data/default/testtb-testExportFileSystemState/6309c56827df62d41865efb6b441a423/cf/4a10fb36413940c19d996480c964ce07 2023-07-15 03:11:23,915 INFO [rs(jenkins-hbase4.apache.org,38367,1689390651355)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/data/default/testtb-testExportFileSystemState/d07866052fb30133af4706631514c75e/cf/6f9015dcaa5440f5a1ed7c5c2de972b3, entries=46, sequenceid=6, filesize=7.9 K 2023-07-15 03:11:23,917 INFO [rs(jenkins-hbase4.apache.org,38367,1689390651355)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.00 KB/3070, heapSize ~6.70 KB/6864, currentSize=0 B/0 for d07866052fb30133af4706631514c75e in 42ms, sequenceid=6, compaction requested=false 2023-07-15 03:11:23,918 DEBUG [rs(jenkins-hbase4.apache.org,38367,1689390651355)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for d07866052fb30133af4706631514c75e: 2023-07-15 03:11:23,918 DEBUG [rs(jenkins-hbase4.apache.org,38367,1689390651355)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,1,1689390681951.d07866052fb30133af4706631514c75e.' region-info for snapshot=snaptb0-testExportFileSystemState 2023-07-15 03:11:23,919 DEBUG [rs(jenkins-hbase4.apache.org,38367,1689390651355)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-15 03:11:23,919 DEBUG [rs(jenkins-hbase4.apache.org,38367,1689390651355)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/data/default/testtb-testExportFileSystemState/d07866052fb30133af4706631514c75e/cf/6f9015dcaa5440f5a1ed7c5c2de972b3] hfiles 2023-07-15 03:11:23,919 DEBUG [rs(jenkins-hbase4.apache.org,38367,1689390651355)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/data/default/testtb-testExportFileSystemState/d07866052fb30133af4706631514c75e/cf/6f9015dcaa5440f5a1ed7c5c2de972b3 for snapshot=snaptb0-testExportFileSystemState 2023-07-15 03:11:23,919 INFO [rs(jenkins-hbase4.apache.org,43199,1689390651225)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/data/default/testtb-testExportFileSystemState/6309c56827df62d41865efb6b441a423/cf/4a10fb36413940c19d996480c964ce07, entries=4, sequenceid=6, filesize=5.1 K 2023-07-15 03:11:23,921 INFO [rs(jenkins-hbase4.apache.org,43199,1689390651225)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~266 B/266, heapSize ~816 B/816, currentSize=0 B/0 for 6309c56827df62d41865efb6b441a423 in 46ms, sequenceid=6, compaction requested=false 2023-07-15 03:11:23,921 DEBUG [rs(jenkins-hbase4.apache.org,43199,1689390651225)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 6309c56827df62d41865efb6b441a423: 2023-07-15 03:11:23,922 DEBUG [rs(jenkins-hbase4.apache.org,43199,1689390651225)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,,1689390681951.6309c56827df62d41865efb6b441a423.' region-info for snapshot=snaptb0-testExportFileSystemState 2023-07-15 03:11:23,922 DEBUG [rs(jenkins-hbase4.apache.org,43199,1689390651225)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-15 03:11:23,922 DEBUG [rs(jenkins-hbase4.apache.org,43199,1689390651225)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/data/default/testtb-testExportFileSystemState/6309c56827df62d41865efb6b441a423/cf/4a10fb36413940c19d996480c964ce07] hfiles 2023-07-15 03:11:23,922 DEBUG [rs(jenkins-hbase4.apache.org,43199,1689390651225)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/data/default/testtb-testExportFileSystemState/6309c56827df62d41865efb6b441a423/cf/4a10fb36413940c19d996480c964ce07 for snapshot=snaptb0-testExportFileSystemState 2023-07-15 03:11:23,924 DEBUG [Listener at jenkins-hbase4.apache.org/44817] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-15 03:11:23,925 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41669] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-15 03:11:23,925 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41669] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-15 03:11:23,925 DEBUG [Listener at jenkins-hbase4.apache.org/44817] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-15 03:11:23,929 DEBUG [rs(jenkins-hbase4.apache.org,38367,1689390651355)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,1,1689390681951.d07866052fb30133af4706631514c75e. completed. 2023-07-15 03:11:23,929 DEBUG [rs(jenkins-hbase4.apache.org,38367,1689390651355)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,1,1689390681951.d07866052fb30133af4706631514c75e. 2023-07-15 03:11:23,930 DEBUG [member: 'jenkins-hbase4.apache.org,38367,1689390651355' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-15 03:11:23,930 DEBUG [member: 'jenkins-hbase4.apache.org,38367,1689390651355' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-15 03:11:23,930 DEBUG [member: 'jenkins-hbase4.apache.org,38367,1689390651355' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,38367,1689390651355 2023-07-15 03:11:23,930 DEBUG [member: 'jenkins-hbase4.apache.org,38367,1689390651355' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemState' locally completed 2023-07-15 03:11:23,930 DEBUG [member: 'jenkins-hbase4.apache.org,38367,1689390651355' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,38367,1689390651355' in zk 2023-07-15 03:11:23,938 DEBUG [rs(jenkins-hbase4.apache.org,43199,1689390651225)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,,1689390681951.6309c56827df62d41865efb6b441a423. completed. 2023-07-15 03:11:23,938 DEBUG [rs(jenkins-hbase4.apache.org,43199,1689390651225)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,,1689390681951.6309c56827df62d41865efb6b441a423. 2023-07-15 03:11:23,938 DEBUG [member: 'jenkins-hbase4.apache.org,43199,1689390651225' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-15 03:11:23,938 DEBUG [member: 'jenkins-hbase4.apache.org,43199,1689390651225' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-15 03:11:23,938 DEBUG [member: 'jenkins-hbase4.apache.org,43199,1689390651225' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,43199,1689390651225 2023-07-15 03:11:23,938 DEBUG [member: 'jenkins-hbase4.apache.org,43199,1689390651225' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemState' locally completed 2023-07-15 03:11:23,938 DEBUG [member: 'jenkins-hbase4.apache.org,43199,1689390651225' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,43199,1689390651225' in zk 2023-07-15 03:11:23,938 DEBUG [member: 'jenkins-hbase4.apache.org,38367,1689390651355' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemState' has notified controller of completion 2023-07-15 03:11:23,939 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): master:41669-0x10166f610e80000, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,38367,1689390651355 2023-07-15 03:11:23,939 DEBUG [member: 'jenkins-hbase4.apache.org,38367,1689390651355' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-15 03:11:23,939 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,38367,1689390651355 2023-07-15 03:11:23,940 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 03:11:23,939 DEBUG [member: 'jenkins-hbase4.apache.org,38367,1689390651355' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemState' completed. 2023-07-15 03:11:23,940 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 03:11:23,942 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): master:41669-0x10166f610e80000, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43199,1689390651225 2023-07-15 03:11:23,942 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 03:11:23,942 DEBUG [member: 'jenkins-hbase4.apache.org,43199,1689390651225' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemState' has notified controller of completion 2023-07-15 03:11:23,942 DEBUG [member: 'jenkins-hbase4.apache.org,43199,1689390651225' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-15 03:11:23,942 DEBUG [member: 'jenkins-hbase4.apache.org,43199,1689390651225' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemState' completed. 2023-07-15 03:11:23,944 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 03:11:23,944 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-15 03:11:23,944 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43199,1689390651225 2023-07-15 03:11:23,945 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39199,1689390651299 2023-07-15 03:11:23,945 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38367,1689390651355 2023-07-15 03:11:23,945 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 03:11:23,945 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-15 03:11:23,946 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43199,1689390651225 2023-07-15 03:11:23,946 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39199,1689390651299 2023-07-15 03:11:23,946 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38367,1689390651355 2023-07-15 03:11:23,947 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,38367,1689390651355': 2023-07-15 03:11:23,947 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,38367,1689390651355' released barrier for procedure'snaptb0-testExportFileSystemState', counting down latch. Waiting for 1 more 2023-07-15 03:11:23,947 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43199,1689390651225 2023-07-15 03:11:23,947 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 03:11:23,947 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 03:11:23,947 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 03:11:23,947 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 03:11:23,947 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-15 03:11:23,948 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43199,1689390651225 2023-07-15 03:11:23,948 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39199,1689390651299 2023-07-15 03:11:23,948 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38367,1689390651355 2023-07-15 03:11:23,948 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 03:11:23,949 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-15 03:11:23,949 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43199,1689390651225 2023-07-15 03:11:23,949 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39199,1689390651299 2023-07-15 03:11:23,950 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38367,1689390651355 2023-07-15 03:11:23,950 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,43199,1689390651225': 2023-07-15 03:11:23,950 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43199,1689390651225' released barrier for procedure'snaptb0-testExportFileSystemState', counting down latch. Waiting for 0 more 2023-07-15 03:11:23,950 INFO [(jenkins-hbase4.apache.org,41669,1689390649760)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemState' execution completed 2023-07-15 03:11:23,950 DEBUG [(jenkins-hbase4.apache.org,41669,1689390649760)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-15 03:11:23,950 DEBUG [(jenkins-hbase4.apache.org,41669,1689390649760)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-15 03:11:23,950 DEBUG [(jenkins-hbase4.apache.org,41669,1689390649760)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemState 2023-07-15 03:11:23,950 INFO [(jenkins-hbase4.apache.org,41669,1689390649760)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-15 03:11:23,952 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): regionserver:43199-0x10166f610e80001, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-15 03:11:23,952 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): regionserver:38367-0x10166f610e80003, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-15 03:11:23,952 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): master:41669-0x10166f610e80000, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-15 03:11:23,952 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): regionserver:39199-0x10166f610e80002, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-15 03:11:23,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-15 03:11:23,953 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-15 03:11:23,952 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-15 03:11:23,952 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): regionserver:38367-0x10166f610e80003, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 03:11:23,952 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-15 03:11:23,952 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): regionserver:43199-0x10166f610e80001, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 03:11:23,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-15 03:11:23,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-15 03:11:23,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-15 03:11:23,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 03:11:23,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 03:11:23,953 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 03:11:23,953 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): regionserver:39199-0x10166f610e80002, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 03:11:23,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 03:11:23,954 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 03:11:23,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 03:11:23,953 DEBUG [(jenkins-hbase4.apache.org,41669,1689390649760)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41669-0x10166f610e80000, quorum=127.0.0.1:62663, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43199,1689390651225 2023-07-15 03:11:23,954 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 03:11:23,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 03:11:23,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 03:11:23,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-15 03:11:23,954 DEBUG [(jenkins-hbase4.apache.org,41669,1689390649760)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41669-0x10166f610e80000, quorum=127.0.0.1:62663, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39199,1689390651299 2023-07-15 03:11:23,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-15 03:11:23,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-15 03:11:23,955 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-15 03:11:23,955 DEBUG [(jenkins-hbase4.apache.org,41669,1689390649760)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41669-0x10166f610e80000, quorum=127.0.0.1:62663, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,38367,1689390651355 2023-07-15 03:11:23,955 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 03:11:23,956 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-15 03:11:23,956 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43199,1689390651225 2023-07-15 03:11:23,956 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39199,1689390651299 2023-07-15 03:11:23,957 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38367,1689390651355 2023-07-15 03:11:23,957 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 03:11:23,957 DEBUG [(jenkins-hbase4.apache.org,41669,1689390649760)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41669-0x10166f610e80000, quorum=127.0.0.1:62663, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43199,1689390651225 2023-07-15 03:11:23,957 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-15 03:11:23,957 DEBUG [(jenkins-hbase4.apache.org,41669,1689390649760)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41669-0x10166f610e80000, quorum=127.0.0.1:62663, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39199,1689390651299 2023-07-15 03:11:23,958 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43199,1689390651225 2023-07-15 03:11:23,958 DEBUG [(jenkins-hbase4.apache.org,41669,1689390649760)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41669-0x10166f610e80000, quorum=127.0.0.1:62663, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,38367,1689390651355 2023-07-15 03:11:23,958 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39199,1689390651299 2023-07-15 03:11:23,958 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38367,1689390651355 2023-07-15 03:11:23,961 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): master:41669-0x10166f610e80000, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,38367,1689390651355 2023-07-15 03:11:23,962 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): regionserver:38367-0x10166f610e80003, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 03:11:23,962 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): master:41669-0x10166f610e80000, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-15 03:11:23,962 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): master:41669-0x10166f610e80000, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39199,1689390651299 2023-07-15 03:11:23,962 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): master:41669-0x10166f610e80000, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43199,1689390651225 2023-07-15 03:11:23,962 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): master:41669-0x10166f610e80000, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-15 03:11:23,962 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): master:41669-0x10166f610e80000, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,38367,1689390651355 2023-07-15 03:11:23,962 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): master:41669-0x10166f610e80000, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-15 03:11:23,962 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): master:41669-0x10166f610e80000, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39199,1689390651299 2023-07-15 03:11:23,962 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): master:41669-0x10166f610e80000, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43199,1689390651225 2023-07-15 03:11:23,962 DEBUG [(jenkins-hbase4.apache.org,41669,1689390649760)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-15 03:11:23,962 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): regionserver:43199-0x10166f610e80001, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 03:11:23,962 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): master:41669-0x10166f610e80000, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-15 03:11:23,963 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 03:11:23,962 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemState 2023-07-15 03:11:23,962 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): regionserver:38367-0x10166f610e80003, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 03:11:23,964 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemState 2023-07-15 03:11:23,962 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): regionserver:39199-0x10166f610e80002, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 03:11:23,962 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 03:11:23,964 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 03:11:23,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 03:11:23,964 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): regionserver:39199-0x10166f610e80002, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 03:11:23,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 03:11:23,963 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): master:41669-0x10166f610e80000, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-15 03:11:23,963 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): regionserver:43199-0x10166f610e80001, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 03:11:23,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 03:11:23,964 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 03:11:23,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 03:11:23,964 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 03:11:23,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 03:11:23,964 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 03:11:23,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 03:11:23,964 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-15 03:11:23,985 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState to hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/.hbase-snapshot/snaptb0-testExportFileSystemState 2023-07-15 03:11:24,015 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed 2023-07-15 03:11:24,016 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-15 03:11:24,016 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-15 03:11:24,016 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState at 1689390683822Consolidate snapshot: snaptb0-testExportFileSystemState at 1689390683964 (+142 ms)Loading Region manifests for snaptb0-testExportFileSystemState at 1689390683964Writing data manifest for snaptb0-testExportFileSystemState at 1689390683968 (+4 ms)Verifying snapshot: snaptb0-testExportFileSystemState at 1689390683978 (+10 ms)Snapshot snaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed at 1689390684015 (+37 ms) 2023-07-15 03:11:24,018 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=35, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-15 03:11:24,020 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=35, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED in 196 msec 2023-07-15 03:11:24,125 DEBUG [Listener at jenkins-hbase4.apache.org/44817] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-15 03:11:24,129 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41669] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-15 03:11:24,129 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41669] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-15 03:11:24,129 INFO [Listener at jenkins-hbase4.apache.org/44817] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/export-test/export-1689390684129 2023-07-15 03:11:24,129 INFO [Listener at jenkins-hbase4.apache.org/44817] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:37513, tgtDir=hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/export-test/export-1689390684129, rawTgtDir=hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/export-test/export-1689390684129, srcFsUri=hdfs://localhost:37513, srcDir=hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280 2023-07-15 03:11:24,173 DEBUG [Listener at jenkins-hbase4.apache.org/44817] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:37513, inputRoot=hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280 2023-07-15 03:11:24,173 DEBUG [Listener at jenkins-hbase4.apache.org/44817] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1271580619_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/export-test/export-1689390684129, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/export-test/export-1689390684129/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-15 03:11:24,173 INFO [Listener at jenkins-hbase4.apache.org/44817] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:37513, inputRoot=hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280, snapshotDir=hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/.hbase-snapshot/snaptb0-testExportFileSystemState. 2023-07-15 03:11:24,203 INFO [Listener at jenkins-hbase4.apache.org/44817] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/.hbase-snapshot/snaptb0-testExportFileSystemState to hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/export-test/export-1689390684129/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-15 03:11:24,253 DEBUG [Listener at jenkins-hbase4.apache.org/44817] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-15 03:11:24,253 DEBUG [Listener at jenkins-hbase4.apache.org/44817] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-15 03:11:24,254 DEBUG [Listener at jenkins-hbase4.apache.org/44817] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-15 03:11:24,254 DEBUG [Listener at jenkins-hbase4.apache.org/44817] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-15 03:11:25,192 DEBUG [Listener at jenkins-hbase4.apache.org/44817] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6bc8dbaf-aac0-03cf-90d4-be6af049f709/hadoop-2390247601223829187.jar 2023-07-15 03:11:25,192 DEBUG [Listener at jenkins-hbase4.apache.org/44817] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-15 03:11:25,193 DEBUG [Listener at jenkins-hbase4.apache.org/44817] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-15 03:11:25,263 DEBUG [Listener at jenkins-hbase4.apache.org/44817] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6bc8dbaf-aac0-03cf-90d4-be6af049f709/hadoop-8928660940322341715.jar 2023-07-15 03:11:25,263 DEBUG [Listener at jenkins-hbase4.apache.org/44817] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-15 03:11:25,264 DEBUG [Listener at jenkins-hbase4.apache.org/44817] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-15 03:11:25,264 DEBUG [Listener at jenkins-hbase4.apache.org/44817] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-15 03:11:25,264 DEBUG [Listener at jenkins-hbase4.apache.org/44817] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-15 03:11:25,265 DEBUG [Listener at jenkins-hbase4.apache.org/44817] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-15 03:11:25,265 DEBUG [Listener at jenkins-hbase4.apache.org/44817] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-15 03:11:25,266 DEBUG [Listener at jenkins-hbase4.apache.org/44817] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-15 03:11:25,266 DEBUG [Listener at jenkins-hbase4.apache.org/44817] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-15 03:11:25,267 DEBUG [Listener at jenkins-hbase4.apache.org/44817] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-15 03:11:25,267 DEBUG [Listener at jenkins-hbase4.apache.org/44817] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-15 03:11:25,267 DEBUG [Listener at jenkins-hbase4.apache.org/44817] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-15 03:11:25,268 DEBUG [Listener at jenkins-hbase4.apache.org/44817] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-15 03:11:25,268 DEBUG [Listener at jenkins-hbase4.apache.org/44817] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-15 03:11:25,269 DEBUG [Listener at jenkins-hbase4.apache.org/44817] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-15 03:11:25,269 DEBUG [Listener at jenkins-hbase4.apache.org/44817] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-15 03:11:25,270 DEBUG [Listener at jenkins-hbase4.apache.org/44817] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-15 03:11:25,270 DEBUG [Listener at jenkins-hbase4.apache.org/44817] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-15 03:11:25,271 DEBUG [Listener at jenkins-hbase4.apache.org/44817] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-15 03:11:25,271 DEBUG [Listener at jenkins-hbase4.apache.org/44817] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-15 03:11:25,271 DEBUG [Listener at jenkins-hbase4.apache.org/44817] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-15 03:11:25,272 DEBUG [Listener at jenkins-hbase4.apache.org/44817] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-15 03:11:25,272 DEBUG [Listener at jenkins-hbase4.apache.org/44817] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-15 03:11:25,273 DEBUG [Listener at jenkins-hbase4.apache.org/44817] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-15 03:11:25,479 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689390660463_0001_000001 (auth:SIMPLE) 2023-07-15 03:11:26,962 WARN [Listener at jenkins-hbase4.apache.org/44817] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-15 03:11:26,965 INFO [Listener at jenkins-hbase4.apache.org/44817] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportFileSystemState' hfile list 2023-07-15 03:11:26,968 DEBUG [Listener at jenkins-hbase4.apache.org/44817] snapshot.ExportSnapshot(671): export split=0 size=13.0 K 2023-07-15 03:11:27,074 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-15 03:11:27,074 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-15 03:11:27,221 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-15 03:11:27,489 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689390660463_0002_000001 (auth:SIMPLE) 2023-07-15 03:11:32,155 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689390660463_0002_000001 (auth:SIMPLE) 2023-07-15 03:11:34,404 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689390660463_0002_000001 (auth:SIMPLE) 2023-07-15 03:11:37,125 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689390660463_0002_000001 (auth:SIMPLE) 2023-07-15 03:11:38,205 INFO [Listener at jenkins-hbase4.apache.org/44817] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-15 03:11:38,208 INFO [Listener at jenkins-hbase4.apache.org/44817] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-15 03:11:38,219 INFO [Listener at jenkins-hbase4.apache.org/44817] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testExportFileSystemState 2023-07-15 03:11:38,219 INFO [Listener at jenkins-hbase4.apache.org/44817] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-15 03:11:38,220 INFO [Listener at jenkins-hbase4.apache.org/44817] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-15 03:11:38,220 DEBUG [Listener at jenkins-hbase4.apache.org/44817] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-924468511_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/.hbase-snapshot/snaptb0-testExportFileSystemState at hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/.hbase-snapshot/snaptb0-testExportFileSystemState 2023-07-15 03:11:38,221 DEBUG [Listener at jenkins-hbase4.apache.org/44817] snapshot.TestExportSnapshot(367): hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/.hbase-snapshot/snaptb0-testExportFileSystemState/.snapshotinfo 2023-07-15 03:11:38,221 DEBUG [Listener at jenkins-hbase4.apache.org/44817] snapshot.TestExportSnapshot(367): hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/.hbase-snapshot/snaptb0-testExportFileSystemState/data.manifest 2023-07-15 03:11:38,221 DEBUG [Listener at jenkins-hbase4.apache.org/44817] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-924468511_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/export-test/export-1689390684129/.hbase-snapshot/snaptb0-testExportFileSystemState at hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/export-test/export-1689390684129/.hbase-snapshot/snaptb0-testExportFileSystemState 2023-07-15 03:11:38,221 DEBUG [Listener at jenkins-hbase4.apache.org/44817] snapshot.TestExportSnapshot(367): hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/export-test/export-1689390684129/.hbase-snapshot/snaptb0-testExportFileSystemState/.snapshotinfo 2023-07-15 03:11:38,222 DEBUG [Listener at jenkins-hbase4.apache.org/44817] snapshot.TestExportSnapshot(367): hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/export-test/export-1689390684129/.hbase-snapshot/snaptb0-testExportFileSystemState/data.manifest 2023-07-15 03:11:38,233 INFO [Listener at jenkins-hbase4.apache.org/44817] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemState 2023-07-15 03:11:38,234 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41669] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemState 2023-07-15 03:11:38,235 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41669] procedure2.ProcedureExecutor(1029): Stored pid=36, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemState 2023-07-15 03:11:38,240 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689390698240"}]},"ts":"1689390698240"} 2023-07-15 03:11:38,241 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41669] master.MasterRpcServices(1230): Checking to see if procedure is done pid=36 2023-07-15 03:11:38,242 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=DISABLING in hbase:meta 2023-07-15 03:11:38,245 INFO [PEWorker-1] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemState to state=DISABLING 2023-07-15 03:11:38,246 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=37, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=6309c56827df62d41865efb6b441a423, UNASSIGN}, {pid=38, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=d07866052fb30133af4706631514c75e, UNASSIGN}] 2023-07-15 03:11:38,248 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=38, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=d07866052fb30133af4706631514c75e, UNASSIGN 2023-07-15 03:11:38,249 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=37, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=6309c56827df62d41865efb6b441a423, UNASSIGN 2023-07-15 03:11:38,249 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=38 updating hbase:meta row=d07866052fb30133af4706631514c75e, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,38367,1689390651355 2023-07-15 03:11:38,250 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=37 updating hbase:meta row=6309c56827df62d41865efb6b441a423, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,43199,1689390651225 2023-07-15 03:11:38,250 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,1,1689390681951.d07866052fb30133af4706631514c75e.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689390698249"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689390698249"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689390698249"}]},"ts":"1689390698249"} 2023-07-15 03:11:38,250 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,,1689390681951.6309c56827df62d41865efb6b441a423.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689390698250"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689390698250"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689390698250"}]},"ts":"1689390698250"} 2023-07-15 03:11:38,251 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=39, ppid=38, state=RUNNABLE; CloseRegionProcedure d07866052fb30133af4706631514c75e, server=jenkins-hbase4.apache.org,38367,1689390651355}] 2023-07-15 03:11:38,252 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=40, ppid=37, state=RUNNABLE; CloseRegionProcedure 6309c56827df62d41865efb6b441a423, server=jenkins-hbase4.apache.org,43199,1689390651225}] 2023-07-15 03:11:38,342 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41669] master.MasterRpcServices(1230): Checking to see if procedure is done pid=36 2023-07-15 03:11:38,404 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close d07866052fb30133af4706631514c75e 2023-07-15 03:11:38,405 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing d07866052fb30133af4706631514c75e, disabling compactions & flushes 2023-07-15 03:11:38,405 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,1,1689390681951.d07866052fb30133af4706631514c75e. 2023-07-15 03:11:38,405 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,1,1689390681951.d07866052fb30133af4706631514c75e. 2023-07-15 03:11:38,405 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,1,1689390681951.d07866052fb30133af4706631514c75e. after waiting 0 ms 2023-07-15 03:11:38,405 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,1,1689390681951.d07866052fb30133af4706631514c75e. 2023-07-15 03:11:38,411 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 6309c56827df62d41865efb6b441a423 2023-07-15 03:11:38,411 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 6309c56827df62d41865efb6b441a423, disabling compactions & flushes 2023-07-15 03:11:38,411 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,,1689390681951.6309c56827df62d41865efb6b441a423. 2023-07-15 03:11:38,413 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,,1689390681951.6309c56827df62d41865efb6b441a423. 2023-07-15 03:11:38,414 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,,1689390681951.6309c56827df62d41865efb6b441a423. after waiting 0 ms 2023-07-15 03:11:38,414 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,,1689390681951.6309c56827df62d41865efb6b441a423. 2023-07-15 03:11:38,430 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/data/default/testtb-testExportFileSystemState/d07866052fb30133af4706631514c75e/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-15 03:11:38,431 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-15 03:11:38,434 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,1,1689390681951.d07866052fb30133af4706631514c75e. 2023-07-15 03:11:38,434 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for d07866052fb30133af4706631514c75e: 2023-07-15 03:11:38,434 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/data/default/testtb-testExportFileSystemState/6309c56827df62d41865efb6b441a423/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-15 03:11:38,435 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-15 03:11:38,436 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,,1689390681951.6309c56827df62d41865efb6b441a423. 2023-07-15 03:11:38,436 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 6309c56827df62d41865efb6b441a423: 2023-07-15 03:11:38,438 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed d07866052fb30133af4706631514c75e 2023-07-15 03:11:38,439 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=38 updating hbase:meta row=d07866052fb30133af4706631514c75e, regionState=CLOSED 2023-07-15 03:11:38,439 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,1,1689390681951.d07866052fb30133af4706631514c75e.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689390698439"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689390698439"}]},"ts":"1689390698439"} 2023-07-15 03:11:38,439 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 6309c56827df62d41865efb6b441a423 2023-07-15 03:11:38,440 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=37 updating hbase:meta row=6309c56827df62d41865efb6b441a423, regionState=CLOSED 2023-07-15 03:11:38,440 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,,1689390681951.6309c56827df62d41865efb6b441a423.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689390698440"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689390698440"}]},"ts":"1689390698440"} 2023-07-15 03:11:38,445 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=39, resume processing ppid=38 2023-07-15 03:11:38,445 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=39, ppid=38, state=SUCCESS; CloseRegionProcedure d07866052fb30133af4706631514c75e, server=jenkins-hbase4.apache.org,38367,1689390651355 in 190 msec 2023-07-15 03:11:38,446 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=40, resume processing ppid=37 2023-07-15 03:11:38,447 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=40, ppid=37, state=SUCCESS; CloseRegionProcedure 6309c56827df62d41865efb6b441a423, server=jenkins-hbase4.apache.org,43199,1689390651225 in 190 msec 2023-07-15 03:11:38,447 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=38, ppid=36, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=d07866052fb30133af4706631514c75e, UNASSIGN in 199 msec 2023-07-15 03:11:38,449 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=37, resume processing ppid=36 2023-07-15 03:11:38,449 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=37, ppid=36, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=6309c56827df62d41865efb6b441a423, UNASSIGN in 201 msec 2023-07-15 03:11:38,449 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689390698449"}]},"ts":"1689390698449"} 2023-07-15 03:11:38,451 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=DISABLED in hbase:meta 2023-07-15 03:11:38,453 INFO [PEWorker-3] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemState to state=DISABLED 2023-07-15 03:11:38,455 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=36, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemState in 219 msec 2023-07-15 03:11:38,543 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41669] master.MasterRpcServices(1230): Checking to see if procedure is done pid=36 2023-07-15 03:11:38,544 INFO [Listener at jenkins-hbase4.apache.org/44817] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemState, procId: 36 completed 2023-07-15 03:11:38,545 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41669] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemState 2023-07-15 03:11:38,546 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41669] procedure2.ProcedureExecutor(1029): Stored pid=41, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-15 03:11:38,548 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=41, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-15 03:11:38,548 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41669] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemState 2023-07-15 03:11:38,549 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=41, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-15 03:11:38,551 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=39199] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemState 2023-07-15 03:11:38,555 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): regionserver:43199-0x10166f610e80001, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-15 03:11:38,555 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): master:41669-0x10166f610e80000, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-15 03:11:38,555 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): regionserver:39199-0x10166f610e80002, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-15 03:11:38,555 DEBUG [HFileArchiver-10] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/.tmp/data/default/testtb-testExportFileSystemState/d07866052fb30133af4706631514c75e 2023-07-15 03:11:38,555 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): regionserver:38367-0x10166f610e80003, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-15 03:11:38,555 DEBUG [HFileArchiver-9] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/.tmp/data/default/testtb-testExportFileSystemState/6309c56827df62d41865efb6b441a423 2023-07-15 03:11:38,555 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-07-15 03:11:38,555 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-07-15 03:11:38,555 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-07-15 03:11:38,555 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-07-15 03:11:38,556 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): regionserver:43199-0x10166f610e80001, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-15 03:11:38,556 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): regionserver:38367-0x10166f610e80003, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-15 03:11:38,556 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): regionserver:39199-0x10166f610e80002, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-15 03:11:38,556 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): regionserver:38367-0x10166f610e80003, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-15 03:11:38,556 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): regionserver:39199-0x10166f610e80002, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-15 03:11:38,556 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): regionserver:43199-0x10166f610e80001, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-15 03:11:38,556 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): master:41669-0x10166f610e80000, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-15 03:11:38,557 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): master:41669-0x10166f610e80000, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-15 03:11:38,557 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41669] master.MasterRpcServices(1230): Checking to see if procedure is done pid=41 2023-07-15 03:11:38,558 DEBUG [HFileArchiver-10] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/.tmp/data/default/testtb-testExportFileSystemState/d07866052fb30133af4706631514c75e/cf, FileablePath, hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/.tmp/data/default/testtb-testExportFileSystemState/d07866052fb30133af4706631514c75e/recovered.edits] 2023-07-15 03:11:38,558 DEBUG [HFileArchiver-9] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/.tmp/data/default/testtb-testExportFileSystemState/6309c56827df62d41865efb6b441a423/cf, FileablePath, hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/.tmp/data/default/testtb-testExportFileSystemState/6309c56827df62d41865efb6b441a423/recovered.edits] 2023-07-15 03:11:38,562 DEBUG [HFileArchiver-10] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/.tmp/data/default/testtb-testExportFileSystemState/d07866052fb30133af4706631514c75e/cf/6f9015dcaa5440f5a1ed7c5c2de972b3 to hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/archive/data/default/testtb-testExportFileSystemState/d07866052fb30133af4706631514c75e/cf/6f9015dcaa5440f5a1ed7c5c2de972b3 2023-07-15 03:11:38,563 DEBUG [HFileArchiver-9] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/.tmp/data/default/testtb-testExportFileSystemState/6309c56827df62d41865efb6b441a423/cf/4a10fb36413940c19d996480c964ce07 to hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/archive/data/default/testtb-testExportFileSystemState/6309c56827df62d41865efb6b441a423/cf/4a10fb36413940c19d996480c964ce07 2023-07-15 03:11:38,566 DEBUG [HFileArchiver-10] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/.tmp/data/default/testtb-testExportFileSystemState/d07866052fb30133af4706631514c75e/recovered.edits/9.seqid to hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/archive/data/default/testtb-testExportFileSystemState/d07866052fb30133af4706631514c75e/recovered.edits/9.seqid 2023-07-15 03:11:38,566 DEBUG [HFileArchiver-9] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/.tmp/data/default/testtb-testExportFileSystemState/6309c56827df62d41865efb6b441a423/recovered.edits/9.seqid to hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/archive/data/default/testtb-testExportFileSystemState/6309c56827df62d41865efb6b441a423/recovered.edits/9.seqid 2023-07-15 03:11:38,567 DEBUG [HFileArchiver-10] backup.HFileArchiver(596): Deleted hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/.tmp/data/default/testtb-testExportFileSystemState/d07866052fb30133af4706631514c75e 2023-07-15 03:11:38,567 DEBUG [HFileArchiver-9] backup.HFileArchiver(596): Deleted hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/.tmp/data/default/testtb-testExportFileSystemState/6309c56827df62d41865efb6b441a423 2023-07-15 03:11:38,567 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemState regions 2023-07-15 03:11:38,570 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=41, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-15 03:11:38,572 WARN [PEWorker-1] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportFileSystemState from hbase:meta 2023-07-15 03:11:38,574 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemState' descriptor. 2023-07-15 03:11:38,576 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=41, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-15 03:11:38,576 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemState' from region states. 2023-07-15 03:11:38,576 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemState,,1689390681951.6309c56827df62d41865efb6b441a423.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689390698576"}]},"ts":"9223372036854775807"} 2023-07-15 03:11:38,576 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemState,1,1689390681951.d07866052fb30133af4706631514c75e.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689390698576"}]},"ts":"9223372036854775807"} 2023-07-15 03:11:38,578 INFO [PEWorker-1] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-15 03:11:38,578 DEBUG [PEWorker-1] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 6309c56827df62d41865efb6b441a423, NAME => 'testtb-testExportFileSystemState,,1689390681951.6309c56827df62d41865efb6b441a423.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => d07866052fb30133af4706631514c75e, NAME => 'testtb-testExportFileSystemState,1,1689390681951.d07866052fb30133af4706631514c75e.', STARTKEY => '1', ENDKEY => ''}] 2023-07-15 03:11:38,578 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemState' as deleted. 2023-07-15 03:11:38,578 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689390698578"}]},"ts":"9223372036854775807"} 2023-07-15 03:11:38,580 INFO [PEWorker-1] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemState state from META 2023-07-15 03:11:38,582 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(130): Finished pid=41, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-15 03:11:38,583 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=41, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemState in 37 msec 2023-07-15 03:11:38,659 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41669] master.MasterRpcServices(1230): Checking to see if procedure is done pid=41 2023-07-15 03:11:38,659 INFO [Listener at jenkins-hbase4.apache.org/44817] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemState, procId: 41 completed 2023-07-15 03:11:38,670 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41669] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportFileSystemState" 2023-07-15 03:11:38,672 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41669] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportFileSystemState 2023-07-15 03:11:38,674 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41669] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemState" 2023-07-15 03:11:38,676 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41669] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemState 2023-07-15 03:11:38,707 INFO [Listener at jenkins-hbase4.apache.org/44817] hbase.ResourceChecker(175): after: snapshot.TestSecureExportSnapshot#testExportFileSystemState Thread=760 (was 751) Potentially hanging thread: hconnection-0x337e74cd-shared-pool-16 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-1941 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: ApplicationMasterLauncher #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_886609069_1 at /127.0.0.1:51490 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-9 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-8 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x337e74cd-shared-pool-18 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-924468511_17 at /127.0.0.1:60690 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-3-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-924468511_17 at /127.0.0.1:51508 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-3-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1988502388) connection to jenkins-hbase4.apache.org/172.31.14.131:37237 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: LogDeleter #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1988502388) connection to jenkins-hbase4.apache.org/172.31.14.131:44987 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: hconnection-0x337e74cd-shared-pool-15 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-10 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x337e74cd-shared-pool-17 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-924468511_17 at /127.0.0.1:57806 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-7 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-4 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=921 (was 915) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=386 (was 382) - SystemLoadAverage LEAK? -, ProcessCount=181 (was 180) - ProcessCount LEAK? -, AvailableMemoryMB=2405 (was 2465) 2023-07-15 03:11:38,708 WARN [Listener at jenkins-hbase4.apache.org/44817] hbase.ResourceChecker(130): Thread=760 is superior to 500 2023-07-15 03:11:38,734 INFO [Listener at jenkins-hbase4.apache.org/44817] hbase.ResourceChecker(147): before: snapshot.TestSecureExportSnapshot#testConsecutiveExports Thread=760, OpenFileDescriptor=921, MaxFileDescriptor=60000, SystemLoadAverage=386, ProcessCount=181, AvailableMemoryMB=2404 2023-07-15 03:11:38,734 WARN [Listener at jenkins-hbase4.apache.org/44817] hbase.ResourceChecker(130): Thread=760 is superior to 500 2023-07-15 03:11:38,737 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41669] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testConsecutiveExports', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-15 03:11:38,744 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41669] procedure2.ProcedureExecutor(1029): Stored pid=42, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testConsecutiveExports 2023-07-15 03:11:38,747 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_PRE_OPERATION 2023-07-15 03:11:38,747 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41669] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testConsecutiveExports" procId is: 42 2023-07-15 03:11:38,748 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-15 03:11:38,749 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41669] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-07-15 03:11:38,751 DEBUG [HFileArchiver-11] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/.tmp/data/default/testtb-testConsecutiveExports/de9ddf08085cd17321bc48a010873944 2023-07-15 03:11:38,751 DEBUG [HFileArchiver-12] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/.tmp/data/default/testtb-testConsecutiveExports/058f828cdb63c6451b36e292b4fe48f3 2023-07-15 03:11:38,752 DEBUG [HFileArchiver-12] backup.HFileArchiver(153): Directory hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/.tmp/data/default/testtb-testConsecutiveExports/058f828cdb63c6451b36e292b4fe48f3 empty. 2023-07-15 03:11:38,752 DEBUG [HFileArchiver-11] backup.HFileArchiver(153): Directory hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/.tmp/data/default/testtb-testConsecutiveExports/de9ddf08085cd17321bc48a010873944 empty. 2023-07-15 03:11:38,752 DEBUG [HFileArchiver-12] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/.tmp/data/default/testtb-testConsecutiveExports/058f828cdb63c6451b36e292b4fe48f3 2023-07-15 03:11:38,753 DEBUG [HFileArchiver-11] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/.tmp/data/default/testtb-testConsecutiveExports/de9ddf08085cd17321bc48a010873944 2023-07-15 03:11:38,753 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testConsecutiveExports regions 2023-07-15 03:11:38,779 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/.tmp/data/default/testtb-testConsecutiveExports/.tabledesc/.tableinfo.0000000001 2023-07-15 03:11:38,781 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(7675): creating {ENCODED => 058f828cdb63c6451b36e292b4fe48f3, NAME => 'testtb-testConsecutiveExports,1,1689390698736.058f828cdb63c6451b36e292b4fe48f3.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testConsecutiveExports', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/.tmp 2023-07-15 03:11:38,781 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(7675): creating {ENCODED => de9ddf08085cd17321bc48a010873944, NAME => 'testtb-testConsecutiveExports,,1689390698736.de9ddf08085cd17321bc48a010873944.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testConsecutiveExports', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/.tmp 2023-07-15 03:11:38,829 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,1,1689390698736.058f828cdb63c6451b36e292b4fe48f3.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-15 03:11:38,829 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1604): Closing 058f828cdb63c6451b36e292b4fe48f3, disabling compactions & flushes 2023-07-15 03:11:38,829 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,1,1689390698736.058f828cdb63c6451b36e292b4fe48f3. 2023-07-15 03:11:38,829 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,1,1689390698736.058f828cdb63c6451b36e292b4fe48f3. 2023-07-15 03:11:38,829 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,1,1689390698736.058f828cdb63c6451b36e292b4fe48f3. after waiting 0 ms 2023-07-15 03:11:38,829 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,1,1689390698736.058f828cdb63c6451b36e292b4fe48f3. 2023-07-15 03:11:38,829 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,1,1689390698736.058f828cdb63c6451b36e292b4fe48f3. 2023-07-15 03:11:38,829 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1558): Region close journal for 058f828cdb63c6451b36e292b4fe48f3: 2023-07-15 03:11:38,830 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,,1689390698736.de9ddf08085cd17321bc48a010873944.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-15 03:11:38,830 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1604): Closing de9ddf08085cd17321bc48a010873944, disabling compactions & flushes 2023-07-15 03:11:38,830 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,,1689390698736.de9ddf08085cd17321bc48a010873944. 2023-07-15 03:11:38,830 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,,1689390698736.de9ddf08085cd17321bc48a010873944. 2023-07-15 03:11:38,830 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,,1689390698736.de9ddf08085cd17321bc48a010873944. after waiting 0 ms 2023-07-15 03:11:38,830 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,,1689390698736.de9ddf08085cd17321bc48a010873944. 2023-07-15 03:11:38,830 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,,1689390698736.de9ddf08085cd17321bc48a010873944. 2023-07-15 03:11:38,830 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1558): Region close journal for de9ddf08085cd17321bc48a010873944: 2023-07-15 03:11:38,843 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_ADD_TO_META 2023-07-15 03:11:38,844 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,1,1689390698736.058f828cdb63c6451b36e292b4fe48f3.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689390698844"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689390698844"}]},"ts":"1689390698844"} 2023-07-15 03:11:38,844 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,,1689390698736.de9ddf08085cd17321bc48a010873944.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689390698844"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689390698844"}]},"ts":"1689390698844"} 2023-07-15 03:11:38,850 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41669] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-07-15 03:11:38,860 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-15 03:11:38,861 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-15 03:11:38,861 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689390698861"}]},"ts":"1689390698861"} 2023-07-15 03:11:38,863 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=ENABLING in hbase:meta 2023-07-15 03:11:38,866 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-15 03:11:38,867 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-15 03:11:38,868 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-15 03:11:38,868 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-15 03:11:38,868 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-15 03:11:38,868 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=43, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=de9ddf08085cd17321bc48a010873944, ASSIGN}, {pid=44, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=058f828cdb63c6451b36e292b4fe48f3, ASSIGN}] 2023-07-15 03:11:38,871 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=44, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=058f828cdb63c6451b36e292b4fe48f3, ASSIGN 2023-07-15 03:11:38,871 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=43, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=de9ddf08085cd17321bc48a010873944, ASSIGN 2023-07-15 03:11:38,872 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=44, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=058f828cdb63c6451b36e292b4fe48f3, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,38367,1689390651355; forceNewPlan=false, retain=false 2023-07-15 03:11:38,872 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=43, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=de9ddf08085cd17321bc48a010873944, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,39199,1689390651299; forceNewPlan=false, retain=false 2023-07-15 03:11:39,022 INFO [jenkins-hbase4:41669] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-15 03:11:39,025 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=43 updating hbase:meta row=de9ddf08085cd17321bc48a010873944, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,39199,1689390651299 2023-07-15 03:11:39,025 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=44 updating hbase:meta row=058f828cdb63c6451b36e292b4fe48f3, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,38367,1689390651355 2023-07-15 03:11:39,025 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,,1689390698736.de9ddf08085cd17321bc48a010873944.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689390699025"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689390699025"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689390699025"}]},"ts":"1689390699025"} 2023-07-15 03:11:39,025 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,1,1689390698736.058f828cdb63c6451b36e292b4fe48f3.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689390699025"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689390699025"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689390699025"}]},"ts":"1689390699025"} 2023-07-15 03:11:39,027 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=45, ppid=43, state=RUNNABLE; OpenRegionProcedure de9ddf08085cd17321bc48a010873944, server=jenkins-hbase4.apache.org,39199,1689390651299}] 2023-07-15 03:11:39,028 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=46, ppid=44, state=RUNNABLE; OpenRegionProcedure 058f828cdb63c6451b36e292b4fe48f3, server=jenkins-hbase4.apache.org,38367,1689390651355}] 2023-07-15 03:11:39,051 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41669] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-07-15 03:11:39,186 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testConsecutiveExports,1,1689390698736.058f828cdb63c6451b36e292b4fe48f3. 2023-07-15 03:11:39,187 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 058f828cdb63c6451b36e292b4fe48f3, NAME => 'testtb-testConsecutiveExports,1,1689390698736.058f828cdb63c6451b36e292b4fe48f3.', STARTKEY => '1', ENDKEY => ''} 2023-07-15 03:11:39,187 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testConsecutiveExports,,1689390698736.de9ddf08085cd17321bc48a010873944. 2023-07-15 03:11:39,187 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => de9ddf08085cd17321bc48a010873944, NAME => 'testtb-testConsecutiveExports,,1689390698736.de9ddf08085cd17321bc48a010873944.', STARTKEY => '', ENDKEY => '1'} 2023-07-15 03:11:39,187 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testConsecutiveExports,1,1689390698736.058f828cdb63c6451b36e292b4fe48f3. service=AccessControlService 2023-07-15 03:11:39,187 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testConsecutiveExports,,1689390698736.de9ddf08085cd17321bc48a010873944. service=AccessControlService 2023-07-15 03:11:39,187 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-15 03:11:39,187 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-15 03:11:39,187 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testConsecutiveExports 058f828cdb63c6451b36e292b4fe48f3 2023-07-15 03:11:39,188 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testConsecutiveExports de9ddf08085cd17321bc48a010873944 2023-07-15 03:11:39,188 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,1,1689390698736.058f828cdb63c6451b36e292b4fe48f3.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-15 03:11:39,188 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,,1689390698736.de9ddf08085cd17321bc48a010873944.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-15 03:11:39,188 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 058f828cdb63c6451b36e292b4fe48f3 2023-07-15 03:11:39,188 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for de9ddf08085cd17321bc48a010873944 2023-07-15 03:11:39,188 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 058f828cdb63c6451b36e292b4fe48f3 2023-07-15 03:11:39,188 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for de9ddf08085cd17321bc48a010873944 2023-07-15 03:11:39,189 INFO [StoreOpener-de9ddf08085cd17321bc48a010873944-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region de9ddf08085cd17321bc48a010873944 2023-07-15 03:11:39,191 DEBUG [StoreOpener-de9ddf08085cd17321bc48a010873944-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/data/default/testtb-testConsecutiveExports/de9ddf08085cd17321bc48a010873944/cf 2023-07-15 03:11:39,191 DEBUG [StoreOpener-de9ddf08085cd17321bc48a010873944-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/data/default/testtb-testConsecutiveExports/de9ddf08085cd17321bc48a010873944/cf 2023-07-15 03:11:39,191 INFO [StoreOpener-de9ddf08085cd17321bc48a010873944-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region de9ddf08085cd17321bc48a010873944 columnFamilyName cf 2023-07-15 03:11:39,191 INFO [StoreOpener-058f828cdb63c6451b36e292b4fe48f3-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 058f828cdb63c6451b36e292b4fe48f3 2023-07-15 03:11:39,192 INFO [StoreOpener-de9ddf08085cd17321bc48a010873944-1] regionserver.HStore(310): Store=de9ddf08085cd17321bc48a010873944/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-15 03:11:39,193 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/data/default/testtb-testConsecutiveExports/de9ddf08085cd17321bc48a010873944 2023-07-15 03:11:39,193 DEBUG [StoreOpener-058f828cdb63c6451b36e292b4fe48f3-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/data/default/testtb-testConsecutiveExports/058f828cdb63c6451b36e292b4fe48f3/cf 2023-07-15 03:11:39,193 DEBUG [StoreOpener-058f828cdb63c6451b36e292b4fe48f3-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/data/default/testtb-testConsecutiveExports/058f828cdb63c6451b36e292b4fe48f3/cf 2023-07-15 03:11:39,193 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/data/default/testtb-testConsecutiveExports/de9ddf08085cd17321bc48a010873944 2023-07-15 03:11:39,194 INFO [StoreOpener-058f828cdb63c6451b36e292b4fe48f3-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 058f828cdb63c6451b36e292b4fe48f3 columnFamilyName cf 2023-07-15 03:11:39,194 INFO [StoreOpener-058f828cdb63c6451b36e292b4fe48f3-1] regionserver.HStore(310): Store=058f828cdb63c6451b36e292b4fe48f3/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-15 03:11:39,196 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/data/default/testtb-testConsecutiveExports/058f828cdb63c6451b36e292b4fe48f3 2023-07-15 03:11:39,196 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/data/default/testtb-testConsecutiveExports/058f828cdb63c6451b36e292b4fe48f3 2023-07-15 03:11:39,198 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for de9ddf08085cd17321bc48a010873944 2023-07-15 03:11:39,199 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 058f828cdb63c6451b36e292b4fe48f3 2023-07-15 03:11:39,200 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/data/default/testtb-testConsecutiveExports/de9ddf08085cd17321bc48a010873944/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-15 03:11:39,201 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened de9ddf08085cd17321bc48a010873944; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69875509, jitterRate=0.04122622311115265}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-15 03:11:39,201 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for de9ddf08085cd17321bc48a010873944: 2023-07-15 03:11:39,202 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testConsecutiveExports,,1689390698736.de9ddf08085cd17321bc48a010873944., pid=45, masterSystemTime=1689390699179 2023-07-15 03:11:39,202 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/data/default/testtb-testConsecutiveExports/058f828cdb63c6451b36e292b4fe48f3/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-15 03:11:39,203 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 058f828cdb63c6451b36e292b4fe48f3; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65553944, jitterRate=-0.023170113563537598}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-15 03:11:39,203 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 058f828cdb63c6451b36e292b4fe48f3: 2023-07-15 03:11:39,204 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testConsecutiveExports,1,1689390698736.058f828cdb63c6451b36e292b4fe48f3., pid=46, masterSystemTime=1689390699180 2023-07-15 03:11:39,205 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testConsecutiveExports,,1689390698736.de9ddf08085cd17321bc48a010873944. 2023-07-15 03:11:39,205 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testConsecutiveExports,,1689390698736.de9ddf08085cd17321bc48a010873944. 2023-07-15 03:11:39,206 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=43 updating hbase:meta row=de9ddf08085cd17321bc48a010873944, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,39199,1689390651299 2023-07-15 03:11:39,206 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testConsecutiveExports,,1689390698736.de9ddf08085cd17321bc48a010873944.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689390699206"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689390699206"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689390699206"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689390699206"}]},"ts":"1689390699206"} 2023-07-15 03:11:39,207 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testConsecutiveExports,1,1689390698736.058f828cdb63c6451b36e292b4fe48f3. 2023-07-15 03:11:39,207 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=44 updating hbase:meta row=058f828cdb63c6451b36e292b4fe48f3, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,38367,1689390651355 2023-07-15 03:11:39,207 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testConsecutiveExports,1,1689390698736.058f828cdb63c6451b36e292b4fe48f3. 2023-07-15 03:11:39,207 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testConsecutiveExports,1,1689390698736.058f828cdb63c6451b36e292b4fe48f3.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689390699207"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689390699207"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689390699207"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689390699207"}]},"ts":"1689390699207"} 2023-07-15 03:11:39,211 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=45, resume processing ppid=43 2023-07-15 03:11:39,211 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=45, ppid=43, state=SUCCESS; OpenRegionProcedure de9ddf08085cd17321bc48a010873944, server=jenkins-hbase4.apache.org,39199,1689390651299 in 181 msec 2023-07-15 03:11:39,212 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=46, resume processing ppid=44 2023-07-15 03:11:39,212 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=46, ppid=44, state=SUCCESS; OpenRegionProcedure 058f828cdb63c6451b36e292b4fe48f3, server=jenkins-hbase4.apache.org,38367,1689390651355 in 181 msec 2023-07-15 03:11:39,213 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=43, ppid=42, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=de9ddf08085cd17321bc48a010873944, ASSIGN in 343 msec 2023-07-15 03:11:39,214 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=44, resume processing ppid=42 2023-07-15 03:11:39,214 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=44, ppid=42, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=058f828cdb63c6451b36e292b4fe48f3, ASSIGN in 344 msec 2023-07-15 03:11:39,215 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-15 03:11:39,215 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689390699215"}]},"ts":"1689390699215"} 2023-07-15 03:11:39,216 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=ENABLED in hbase:meta 2023-07-15 03:11:39,219 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_POST_OPERATION 2023-07-15 03:11:39,219 DEBUG [PEWorker-2] access.PermissionStorage(175): Writing permission with rowKey testtb-testConsecutiveExports jenkins: RWXCA 2023-07-15 03:11:39,221 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=39199] access.PermissionStorage(611): Read acl: entry[testtb-testConsecutiveExports], kv [jenkins: RWXCA] 2023-07-15 03:11:39,223 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): regionserver:38367-0x10166f610e80003, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-15 03:11:39,223 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): master:41669-0x10166f610e80000, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-15 03:11:39,223 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): regionserver:39199-0x10166f610e80002, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-15 03:11:39,223 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): regionserver:43199-0x10166f610e80001, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-15 03:11:39,230 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-07-15 03:11:39,230 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-07-15 03:11:39,230 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-07-15 03:11:39,231 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-07-15 03:11:39,232 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=42, state=SUCCESS; CreateTableProcedure table=testtb-testConsecutiveExports in 493 msec 2023-07-15 03:11:39,353 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41669] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-07-15 03:11:39,353 INFO [Listener at jenkins-hbase4.apache.org/44817] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testConsecutiveExports, procId: 42 completed 2023-07-15 03:11:39,353 DEBUG [Listener at jenkins-hbase4.apache.org/44817] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testtb-testConsecutiveExports get assigned. Timeout = 60000ms 2023-07-15 03:11:39,353 INFO [Listener at jenkins-hbase4.apache.org/44817] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-15 03:11:39,356 INFO [Listener at jenkins-hbase4.apache.org/44817] hbase.HBaseTestingUtility(3484): All regions for table testtb-testConsecutiveExports assigned to meta. Checking AM states. 2023-07-15 03:11:39,357 INFO [Listener at jenkins-hbase4.apache.org/44817] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-15 03:11:39,357 INFO [Listener at jenkins-hbase4.apache.org/44817] hbase.HBaseTestingUtility(3504): All regions for table testtb-testConsecutiveExports assigned. 2023-07-15 03:11:39,359 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41669] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-15 03:11:39,359 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41669] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689390699359 (current time:1689390699359). 2023-07-15 03:11:39,359 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41669] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-15 03:11:39,360 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41669] zookeeper.ReadOnlyZKClient(139): Connect 0x1c116888 to 127.0.0.1:62663 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-15 03:11:39,366 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41669] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@39795f9b, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-15 03:11:39,368 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41669] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-15 03:11:39,370 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:47346, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-15 03:11:39,371 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41669] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1c116888 to 127.0.0.1:62663 2023-07-15 03:11:39,371 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41669] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-15 03:11:39,372 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41669] zookeeper.ReadOnlyZKClient(139): Connect 0x582623df to 127.0.0.1:62663 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-15 03:11:39,377 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41669] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4fe4557b, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-15 03:11:39,378 DEBUG [hconnection-0x3c124e9b-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-15 03:11:39,381 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:47352, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-15 03:11:39,384 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41669] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-15 03:11:39,387 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:37930, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-15 03:11:39,388 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41669] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x582623df to 127.0.0.1:62663 2023-07-15 03:11:39,388 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41669] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-15 03:11:39,388 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41669] access.PermissionStorage(611): Read acl: entry[testtb-testConsecutiveExports], kv [jenkins: RWXCA] 2023-07-15 03:11:39,389 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41669] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-15 03:11:39,389 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41669] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-15 03:11:39,391 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41669] procedure2.ProcedureExecutor(1029): Stored pid=47, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-15 03:11:39,392 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=47, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-15 03:11:39,393 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=47, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE; timeout=600000, timestamp=1689391299393 2023-07-15 03:11:39,393 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41669] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-15 03:11:39,393 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports 2023-07-15 03:11:39,394 DEBUG [Listener at jenkins-hbase4.apache.org/44817] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-15 03:11:39,394 DEBUG [Listener at jenkins-hbase4.apache.org/44817] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-15 03:11:39,399 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=48, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-15 03:11:39,400 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=47, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-15 03:11:39,402 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=47, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE in 10 msec 2023-07-15 03:11:39,403 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=48, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-15 03:11:39,404 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=48, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED; timeout=600000, timestamp=1689391299404 2023-07-15 03:11:39,416 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testConsecutiveExports 2023-07-15 03:11:39,416 INFO [(jenkins-hbase4.apache.org,41669,1689390649760)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testConsecutiveExports' 2023-07-15 03:11:39,416 DEBUG [(jenkins-hbase4.apache.org,41669,1689390649760)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-15 03:11:39,417 DEBUG [(jenkins-hbase4.apache.org,41669,1689390649760)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' 2023-07-15 03:11:39,417 DEBUG [(jenkins-hbase4.apache.org,41669,1689390649760)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testConsecutiveExports', kicking off acquire phase on members. 2023-07-15 03:11:39,418 DEBUG [(jenkins-hbase4.apache.org,41669,1689390649760)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41669-0x10166f610e80000, quorum=127.0.0.1:62663, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-15 03:11:39,418 DEBUG [(jenkins-hbase4.apache.org,41669,1689390649760)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-15 03:11:39,419 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): regionserver:38367-0x10166f610e80003, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 03:11:39,419 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): regionserver:39199-0x10166f610e80002, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 03:11:39,419 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 03:11:39,419 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 03:11:39,419 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 03:11:39,419 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 03:11:39,419 DEBUG [(jenkins-hbase4.apache.org,41669,1689390649760)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,38367,1689390651355 2023-07-15 03:11:39,419 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): regionserver:43199-0x10166f610e80001, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 03:11:39,419 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 03:11:39,419 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 03:11:39,419 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-15 03:11:39,419 DEBUG [(jenkins-hbase4.apache.org,41669,1689390649760)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41669-0x10166f610e80000, quorum=127.0.0.1:62663, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,38367,1689390651355 2023-07-15 03:11:39,420 DEBUG [(jenkins-hbase4.apache.org,41669,1689390649760)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39199,1689390651299 2023-07-15 03:11:39,419 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-15 03:11:39,420 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-15 03:11:39,420 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39199-0x10166f610e80002, quorum=127.0.0.1:62663, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-15 03:11:39,420 DEBUG [(jenkins-hbase4.apache.org,41669,1689390649760)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41669-0x10166f610e80000, quorum=127.0.0.1:62663, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39199,1689390651299 2023-07-15 03:11:39,420 DEBUG [(jenkins-hbase4.apache.org,41669,1689390649760)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-15 03:11:39,420 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43199-0x10166f610e80001, quorum=127.0.0.1:62663, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-15 03:11:39,421 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38367-0x10166f610e80003, quorum=127.0.0.1:62663, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-15 03:11:39,421 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 165 2023-07-15 03:11:39,421 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-15 03:11:39,421 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-15 03:11:39,421 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testConsecutiveExports 2023-07-15 03:11:39,421 DEBUG [member: 'jenkins-hbase4.apache.org,39199,1689390651299' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-15 03:11:39,421 DEBUG [member: 'jenkins-hbase4.apache.org,39199,1689390651299' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-15 03:11:39,422 DEBUG [member: 'jenkins-hbase4.apache.org,39199,1689390651299' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-15 03:11:39,422 DEBUG [member: 'jenkins-hbase4.apache.org,39199,1689390651299' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally acquired 2023-07-15 03:11:39,422 DEBUG [member: 'jenkins-hbase4.apache.org,39199,1689390651299' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39199,1689390651299' joining acquired barrier for procedure (emptySnaptb0-testConsecutiveExports) in zk 2023-07-15 03:11:39,424 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): master:41669-0x10166f610e80000, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39199,1689390651299 2023-07-15 03:11:39,424 DEBUG [member: 'jenkins-hbase4.apache.org,39199,1689390651299' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-15 03:11:39,424 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 165 2023-07-15 03:11:39,424 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39199,1689390651299 2023-07-15 03:11:39,424 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 03:11:39,424 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 03:11:39,424 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 165 2023-07-15 03:11:39,424 DEBUG [member: 'jenkins-hbase4.apache.org,39199,1689390651299' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39199-0x10166f610e80002, quorum=127.0.0.1:62663, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-15 03:11:39,424 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-15 03:11:39,424 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-15 03:11:39,424 DEBUG [member: 'jenkins-hbase4.apache.org,39199,1689390651299' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-15 03:11:39,425 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-15 03:11:39,425 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 03:11:39,425 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-15 03:11:39,425 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 03:11:39,425 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-15 03:11:39,426 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testConsecutiveExports 2023-07-15 03:11:39,426 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39199,1689390651299 2023-07-15 03:11:39,426 DEBUG [member: 'jenkins-hbase4.apache.org,43199,1689390651225' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-15 03:11:39,426 DEBUG [member: 'jenkins-hbase4.apache.org,43199,1689390651225' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-15 03:11:39,426 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testConsecutiveExports 2023-07-15 03:11:39,427 DEBUG [member: 'jenkins-hbase4.apache.org,43199,1689390651225' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-15 03:11:39,427 DEBUG [member: 'jenkins-hbase4.apache.org,38367,1689390651355' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-15 03:11:39,427 DEBUG [member: 'jenkins-hbase4.apache.org,43199,1689390651225' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally acquired 2023-07-15 03:11:39,427 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 03:11:39,427 DEBUG [member: 'jenkins-hbase4.apache.org,38367,1689390651355' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-15 03:11:39,427 DEBUG [member: 'jenkins-hbase4.apache.org,43199,1689390651225' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43199,1689390651225' joining acquired barrier for procedure (emptySnaptb0-testConsecutiveExports) in zk 2023-07-15 03:11:39,431 DEBUG [member: 'jenkins-hbase4.apache.org,38367,1689390651355' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-15 03:11:39,431 DEBUG [member: 'jenkins-hbase4.apache.org,38367,1689390651355' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally acquired 2023-07-15 03:11:39,431 DEBUG [member: 'jenkins-hbase4.apache.org,38367,1689390651355' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38367,1689390651355' joining acquired barrier for procedure (emptySnaptb0-testConsecutiveExports) in zk 2023-07-15 03:11:39,431 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39199,1689390651299' joining acquired barrier for procedure 'emptySnaptb0-testConsecutiveExports' on coordinator 2023-07-15 03:11:39,431 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6a75a08f[Count = 1] remaining members to acquire global barrier 2023-07-15 03:11:39,433 DEBUG [member: 'jenkins-hbase4.apache.org,43199,1689390651225' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-15 03:11:39,433 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): master:41669-0x10166f610e80000, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,38367,1689390651355 2023-07-15 03:11:39,433 DEBUG [member: 'jenkins-hbase4.apache.org,38367,1689390651355' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-15 03:11:39,433 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,38367,1689390651355 2023-07-15 03:11:39,433 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 03:11:39,433 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 03:11:39,433 DEBUG [member: 'jenkins-hbase4.apache.org,43199,1689390651225' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43199-0x10166f610e80001, quorum=127.0.0.1:62663, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-15 03:11:39,433 DEBUG [member: 'jenkins-hbase4.apache.org,43199,1689390651225' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-15 03:11:39,433 DEBUG [member: 'jenkins-hbase4.apache.org,38367,1689390651355' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38367-0x10166f610e80003, quorum=127.0.0.1:62663, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-15 03:11:39,433 DEBUG [member: 'jenkins-hbase4.apache.org,38367,1689390651355' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-15 03:11:39,433 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 03:11:39,433 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 03:11:39,434 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-15 03:11:39,434 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43199,1689390651225 2023-07-15 03:11:39,434 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39199,1689390651299 2023-07-15 03:11:39,434 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38367,1689390651355 2023-07-15 03:11:39,435 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 03:11:39,435 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,38367,1689390651355' joining acquired barrier for procedure 'emptySnaptb0-testConsecutiveExports' on coordinator 2023-07-15 03:11:39,435 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6a75a08f[Count = 0] remaining members to acquire global barrier 2023-07-15 03:11:39,435 DEBUG [(jenkins-hbase4.apache.org,41669,1689390649760)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testConsecutiveExports' starting 'in-barrier' execution. 2023-07-15 03:11:39,435 DEBUG [(jenkins-hbase4.apache.org,41669,1689390649760)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-15 03:11:39,438 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): regionserver:38367-0x10166f610e80003, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-15 03:11:39,438 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): regionserver:43199-0x10166f610e80001, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-15 03:11:39,438 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): regionserver:39199-0x10166f610e80002, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-15 03:11:39,438 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-15 03:11:39,438 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-15 03:11:39,438 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-15 03:11:39,438 DEBUG [(jenkins-hbase4.apache.org,41669,1689390649760)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41669-0x10166f610e80000, quorum=127.0.0.1:62663, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39199,1689390651299 2023-07-15 03:11:39,438 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-15 03:11:39,438 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-15 03:11:39,438 DEBUG [member: 'jenkins-hbase4.apache.org,39199,1689390651299' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-15 03:11:39,438 DEBUG [member: 'jenkins-hbase4.apache.org,43199,1689390651225' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-15 03:11:39,438 DEBUG [member: 'jenkins-hbase4.apache.org,43199,1689390651225' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally completed 2023-07-15 03:11:39,438 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-15 03:11:39,438 DEBUG [member: 'jenkins-hbase4.apache.org,43199,1689390651225' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,43199,1689390651225' in zk 2023-07-15 03:11:39,438 DEBUG [(jenkins-hbase4.apache.org,41669,1689390649760)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41669-0x10166f610e80000, quorum=127.0.0.1:62663, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,38367,1689390651355 2023-07-15 03:11:39,438 DEBUG [(jenkins-hbase4.apache.org,41669,1689390649760)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-15 03:11:39,438 DEBUG [rs(jenkins-hbase4.apache.org,39199,1689390651299)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,,1689390698736.de9ddf08085cd17321bc48a010873944. 2023-07-15 03:11:39,438 DEBUG [member: 'jenkins-hbase4.apache.org,38367,1689390651355' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-15 03:11:39,438 DEBUG [member: 'jenkins-hbase4.apache.org,39199,1689390651299' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-15 03:11:39,439 DEBUG [rs(jenkins-hbase4.apache.org,39199,1689390651299)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,,1689390698736.de9ddf08085cd17321bc48a010873944. started... 2023-07-15 03:11:39,439 DEBUG [member: 'jenkins-hbase4.apache.org,38367,1689390651355' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-15 03:11:39,439 DEBUG [member: 'jenkins-hbase4.apache.org,38367,1689390651355' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-15 03:11:39,439 DEBUG [member: 'jenkins-hbase4.apache.org,39199,1689390651299' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-15 03:11:39,439 DEBUG [rs(jenkins-hbase4.apache.org,38367,1689390651355)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,1,1689390698736.058f828cdb63c6451b36e292b4fe48f3. 2023-07-15 03:11:39,440 DEBUG [rs(jenkins-hbase4.apache.org,38367,1689390651355)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,1,1689390698736.058f828cdb63c6451b36e292b4fe48f3. started... 2023-07-15 03:11:39,440 DEBUG [rs(jenkins-hbase4.apache.org,39199,1689390651299)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for de9ddf08085cd17321bc48a010873944: 2023-07-15 03:11:39,441 DEBUG [rs(jenkins-hbase4.apache.org,38367,1689390651355)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 058f828cdb63c6451b36e292b4fe48f3: 2023-07-15 03:11:39,441 DEBUG [rs(jenkins-hbase4.apache.org,39199,1689390651299)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,,1689390698736.de9ddf08085cd17321bc48a010873944.' region-info for snapshot=emptySnaptb0-testConsecutiveExports 2023-07-15 03:11:39,441 DEBUG [rs(jenkins-hbase4.apache.org,39199,1689390651299)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-15 03:11:39,441 DEBUG [rs(jenkins-hbase4.apache.org,38367,1689390651355)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,1,1689390698736.058f828cdb63c6451b36e292b4fe48f3.' region-info for snapshot=emptySnaptb0-testConsecutiveExports 2023-07-15 03:11:39,441 DEBUG [rs(jenkins-hbase4.apache.org,39199,1689390651299)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-15 03:11:39,442 DEBUG [rs(jenkins-hbase4.apache.org,38367,1689390651355)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-15 03:11:39,442 DEBUG [rs(jenkins-hbase4.apache.org,38367,1689390651355)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-15 03:11:39,444 DEBUG [member: 'jenkins-hbase4.apache.org,43199,1689390651225' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testConsecutiveExports' has notified controller of completion 2023-07-15 03:11:39,444 DEBUG [member: 'jenkins-hbase4.apache.org,43199,1689390651225' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-15 03:11:39,444 DEBUG [member: 'jenkins-hbase4.apache.org,43199,1689390651225' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testConsecutiveExports' completed. 2023-07-15 03:11:39,456 DEBUG [rs(jenkins-hbase4.apache.org,38367,1689390651355)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,1,1689390698736.058f828cdb63c6451b36e292b4fe48f3. completed. 2023-07-15 03:11:39,456 DEBUG [rs(jenkins-hbase4.apache.org,38367,1689390651355)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,1,1689390698736.058f828cdb63c6451b36e292b4fe48f3. 2023-07-15 03:11:39,456 DEBUG [member: 'jenkins-hbase4.apache.org,38367,1689390651355' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-15 03:11:39,457 DEBUG [member: 'jenkins-hbase4.apache.org,38367,1689390651355' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-15 03:11:39,457 DEBUG [member: 'jenkins-hbase4.apache.org,38367,1689390651355' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,38367,1689390651355 2023-07-15 03:11:39,457 DEBUG [member: 'jenkins-hbase4.apache.org,38367,1689390651355' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally completed 2023-07-15 03:11:39,457 DEBUG [member: 'jenkins-hbase4.apache.org,38367,1689390651355' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,38367,1689390651355' in zk 2023-07-15 03:11:39,459 DEBUG [member: 'jenkins-hbase4.apache.org,38367,1689390651355' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testConsecutiveExports' has notified controller of completion 2023-07-15 03:11:39,459 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): master:41669-0x10166f610e80000, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,38367,1689390651355 2023-07-15 03:11:39,459 DEBUG [member: 'jenkins-hbase4.apache.org,38367,1689390651355' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-15 03:11:39,459 DEBUG [rs(jenkins-hbase4.apache.org,39199,1689390651299)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,,1689390698736.de9ddf08085cd17321bc48a010873944. completed. 2023-07-15 03:11:39,459 DEBUG [member: 'jenkins-hbase4.apache.org,38367,1689390651355' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testConsecutiveExports' completed. 2023-07-15 03:11:39,459 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,38367,1689390651355 2023-07-15 03:11:39,460 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 03:11:39,460 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 03:11:39,459 DEBUG [rs(jenkins-hbase4.apache.org,39199,1689390651299)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,,1689390698736.de9ddf08085cd17321bc48a010873944. 2023-07-15 03:11:39,461 DEBUG [member: 'jenkins-hbase4.apache.org,39199,1689390651299' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-15 03:11:39,461 DEBUG [member: 'jenkins-hbase4.apache.org,39199,1689390651299' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-15 03:11:39,461 DEBUG [member: 'jenkins-hbase4.apache.org,39199,1689390651299' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,39199,1689390651299 2023-07-15 03:11:39,461 DEBUG [member: 'jenkins-hbase4.apache.org,39199,1689390651299' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally completed 2023-07-15 03:11:39,461 DEBUG [member: 'jenkins-hbase4.apache.org,39199,1689390651299' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,39199,1689390651299' in zk 2023-07-15 03:11:39,461 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 03:11:39,461 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 03:11:39,462 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): master:41669-0x10166f610e80000, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39199,1689390651299 2023-07-15 03:11:39,462 DEBUG [member: 'jenkins-hbase4.apache.org,39199,1689390651299' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testConsecutiveExports' has notified controller of completion 2023-07-15 03:11:39,462 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-15 03:11:39,462 DEBUG [member: 'jenkins-hbase4.apache.org,39199,1689390651299' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-15 03:11:39,462 DEBUG [member: 'jenkins-hbase4.apache.org,39199,1689390651299' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testConsecutiveExports' completed. 2023-07-15 03:11:39,464 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43199,1689390651225 2023-07-15 03:11:39,464 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39199,1689390651299 2023-07-15 03:11:39,464 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38367,1689390651355 2023-07-15 03:11:39,465 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 03:11:39,465 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-15 03:11:39,465 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43199,1689390651225 2023-07-15 03:11:39,465 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39199,1689390651299 2023-07-15 03:11:39,466 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38367,1689390651355 2023-07-15 03:11:39,466 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,38367,1689390651355': 2023-07-15 03:11:39,466 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,38367,1689390651355' released barrier for procedure'emptySnaptb0-testConsecutiveExports', counting down latch. Waiting for 1 more 2023-07-15 03:11:39,466 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39199,1689390651299 2023-07-15 03:11:39,466 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 03:11:39,466 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 03:11:39,466 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 03:11:39,467 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 03:11:39,467 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-15 03:11:39,467 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43199,1689390651225 2023-07-15 03:11:39,468 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39199,1689390651299 2023-07-15 03:11:39,468 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38367,1689390651355 2023-07-15 03:11:39,468 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 03:11:39,468 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-15 03:11:39,469 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43199,1689390651225 2023-07-15 03:11:39,469 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39199,1689390651299 2023-07-15 03:11:39,469 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38367,1689390651355 2023-07-15 03:11:39,470 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,39199,1689390651299': 2023-07-15 03:11:39,470 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39199,1689390651299' released barrier for procedure'emptySnaptb0-testConsecutiveExports', counting down latch. Waiting for 0 more 2023-07-15 03:11:39,470 INFO [(jenkins-hbase4.apache.org,41669,1689390649760)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testConsecutiveExports' execution completed 2023-07-15 03:11:39,470 DEBUG [(jenkins-hbase4.apache.org,41669,1689390649760)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-15 03:11:39,470 DEBUG [(jenkins-hbase4.apache.org,41669,1689390649760)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-15 03:11:39,470 DEBUG [(jenkins-hbase4.apache.org,41669,1689390649760)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testConsecutiveExports 2023-07-15 03:11:39,470 INFO [(jenkins-hbase4.apache.org,41669,1689390649760)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testConsecutiveExportsincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-15 03:11:39,471 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): regionserver:43199-0x10166f610e80001, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-15 03:11:39,471 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): regionserver:39199-0x10166f610e80002, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-15 03:11:39,472 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): regionserver:43199-0x10166f610e80001, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 03:11:39,472 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): regionserver:39199-0x10166f610e80002, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 03:11:39,472 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-15 03:11:39,472 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-15 03:11:39,471 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): master:41669-0x10166f610e80000, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-15 03:11:39,472 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-15 03:11:39,472 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): regionserver:38367-0x10166f610e80003, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-15 03:11:39,472 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-15 03:11:39,472 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-15 03:11:39,472 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 03:11:39,472 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 03:11:39,472 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-15 03:11:39,472 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-15 03:11:39,472 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): regionserver:38367-0x10166f610e80003, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 03:11:39,472 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 03:11:39,473 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 03:11:39,473 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 03:11:39,473 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 03:11:39,473 DEBUG [(jenkins-hbase4.apache.org,41669,1689390649760)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41669-0x10166f610e80000, quorum=127.0.0.1:62663, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43199,1689390651225 2023-07-15 03:11:39,473 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 03:11:39,473 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-15 03:11:39,473 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 03:11:39,473 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 03:11:39,475 DEBUG [(jenkins-hbase4.apache.org,41669,1689390649760)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41669-0x10166f610e80000, quorum=127.0.0.1:62663, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39199,1689390651299 2023-07-15 03:11:39,475 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-15 03:11:39,475 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-15 03:11:39,475 DEBUG [(jenkins-hbase4.apache.org,41669,1689390649760)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41669-0x10166f610e80000, quorum=127.0.0.1:62663, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,38367,1689390651355 2023-07-15 03:11:39,475 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 03:11:39,476 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-15 03:11:39,476 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43199,1689390651225 2023-07-15 03:11:39,477 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39199,1689390651299 2023-07-15 03:11:39,477 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38367,1689390651355 2023-07-15 03:11:39,477 DEBUG [(jenkins-hbase4.apache.org,41669,1689390649760)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41669-0x10166f610e80000, quorum=127.0.0.1:62663, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43199,1689390651225 2023-07-15 03:11:39,477 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 03:11:39,478 DEBUG [(jenkins-hbase4.apache.org,41669,1689390649760)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41669-0x10166f610e80000, quorum=127.0.0.1:62663, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39199,1689390651299 2023-07-15 03:11:39,478 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-15 03:11:39,478 DEBUG [(jenkins-hbase4.apache.org,41669,1689390649760)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41669-0x10166f610e80000, quorum=127.0.0.1:62663, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,38367,1689390651355 2023-07-15 03:11:39,478 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43199,1689390651225 2023-07-15 03:11:39,478 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-15 03:11:39,478 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39199,1689390651299 2023-07-15 03:11:39,479 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38367,1689390651355 2023-07-15 03:11:39,482 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): master:41669-0x10166f610e80000, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,38367,1689390651355 2023-07-15 03:11:39,482 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): regionserver:39199-0x10166f610e80002, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 03:11:39,482 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): regionserver:43199-0x10166f610e80001, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 03:11:39,482 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 03:11:39,482 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): regionserver:43199-0x10166f610e80001, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 03:11:39,482 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): regionserver:38367-0x10166f610e80003, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 03:11:39,482 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): master:41669-0x10166f610e80000, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-15 03:11:39,482 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 03:11:39,482 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 03:11:39,482 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): regionserver:39199-0x10166f610e80002, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 03:11:39,482 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testConsecutiveExports 2023-07-15 03:11:39,482 DEBUG [(jenkins-hbase4.apache.org,41669,1689390649760)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-15 03:11:39,482 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): master:41669-0x10166f610e80000, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39199,1689390651299 2023-07-15 03:11:39,482 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): regionserver:38367-0x10166f610e80003, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 03:11:39,484 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): master:41669-0x10166f610e80000, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43199,1689390651225 2023-07-15 03:11:39,482 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 03:11:39,482 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 03:11:39,484 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 03:11:39,484 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 03:11:39,484 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 03:11:39,484 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): master:41669-0x10166f610e80000, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-15 03:11:39,484 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): master:41669-0x10166f610e80000, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,38367,1689390651355 2023-07-15 03:11:39,484 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): master:41669-0x10166f610e80000, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-15 03:11:39,484 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): master:41669-0x10166f610e80000, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39199,1689390651299 2023-07-15 03:11:39,484 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): master:41669-0x10166f610e80000, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43199,1689390651225 2023-07-15 03:11:39,484 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): master:41669-0x10166f610e80000, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-15 03:11:39,484 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): master:41669-0x10166f610e80000, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-15 03:11:39,482 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testConsecutiveExports 2023-07-15 03:11:39,484 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 03:11:39,484 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 03:11:39,484 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 03:11:39,484 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 03:11:39,485 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports 2023-07-15 03:11:39,494 DEBUG [Listener at jenkins-hbase4.apache.org/44817] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-15 03:11:39,495 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41669] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-07-15 03:11:39,495 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41669] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' is still in progress! 2023-07-15 03:11:39,496 DEBUG [Listener at jenkins-hbase4.apache.org/44817] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-15 03:11:39,507 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports to hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/.hbase-snapshot/emptySnaptb0-testConsecutiveExports 2023-07-15 03:11:39,542 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed 2023-07-15 03:11:39,542 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports 2023-07-15 03:11:39,542 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports 2023-07-15 03:11:39,542 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports at 1689390699393Consolidate snapshot: emptySnaptb0-testConsecutiveExports at 1689390699482 (+89 ms)Loading Region manifests for emptySnaptb0-testConsecutiveExports at 1689390699484 (+2 ms)Writing data manifest for emptySnaptb0-testConsecutiveExports at 1689390699488 (+4 ms)Verifying snapshot: emptySnaptb0-testConsecutiveExports at 1689390699501 (+13 ms)Snapshot emptySnaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed at 1689390699542 (+41 ms) 2023-07-15 03:11:39,548 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=48, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-15 03:11:39,550 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=48, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED in 154 msec 2023-07-15 03:11:39,696 DEBUG [Listener at jenkins-hbase4.apache.org/44817] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-15 03:11:39,697 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41669] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-07-15 03:11:39,697 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41669] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-15 03:11:39,705 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39199] regionserver.HRegion(8805): writing data to region testtb-testConsecutiveExports,,1689390698736.de9ddf08085cd17321bc48a010873944. with WAL disabled. Data may be lost in the event of a crash. 2023-07-15 03:11:39,706 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38367] regionserver.HRegion(8805): writing data to region testtb-testConsecutiveExports,1,1689390698736.058f828cdb63c6451b36e292b4fe48f3. with WAL disabled. Data may be lost in the event of a crash. 2023-07-15 03:11:39,709 DEBUG [Listener at jenkins-hbase4.apache.org/44817] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testConsecutiveExports 2023-07-15 03:11:39,709 DEBUG [Listener at jenkins-hbase4.apache.org/44817] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testConsecutiveExports,,1689390698736.de9ddf08085cd17321bc48a010873944. 2023-07-15 03:11:39,710 INFO [Listener at jenkins-hbase4.apache.org/44817] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-15 03:11:39,724 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41669] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-15 03:11:39,724 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41669] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689390699724 (current time:1689390699724). 2023-07-15 03:11:39,724 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41669] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-15 03:11:39,725 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41669] zookeeper.ReadOnlyZKClient(139): Connect 0x5fe52ed5 to 127.0.0.1:62663 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-15 03:11:39,737 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41669] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5d584e58, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-15 03:11:39,740 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41669] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-15 03:11:39,742 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:47362, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-15 03:11:39,744 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41669] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x5fe52ed5 to 127.0.0.1:62663 2023-07-15 03:11:39,744 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41669] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-15 03:11:39,745 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41669] zookeeper.ReadOnlyZKClient(139): Connect 0x506f9348 to 127.0.0.1:62663 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-15 03:11:39,750 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41669] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4fda3d93, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-15 03:11:39,751 DEBUG [hconnection-0xa9df187-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-15 03:11:39,752 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:47376, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-15 03:11:39,756 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41669] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-15 03:11:39,757 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:37946, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-15 03:11:39,758 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41669] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x506f9348 to 127.0.0.1:62663 2023-07-15 03:11:39,758 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41669] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-15 03:11:39,758 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41669] access.PermissionStorage(611): Read acl: entry[testtb-testConsecutiveExports], kv [jenkins: RWXCA] 2023-07-15 03:11:39,759 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41669] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-15 03:11:39,759 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41669] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-15 03:11:39,762 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41669] procedure2.ProcedureExecutor(1029): Stored pid=49, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-15 03:11:39,762 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=49, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-15 03:11:39,763 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=49, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE; timeout=600000, timestamp=1689391299763 2023-07-15 03:11:39,763 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41669] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-15 03:11:39,763 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports 2023-07-15 03:11:39,765 DEBUG [Listener at jenkins-hbase4.apache.org/44817] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-15 03:11:39,765 DEBUG [Listener at jenkins-hbase4.apache.org/44817] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-15 03:11:39,766 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=49, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-15 03:11:39,766 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=50, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-15 03:11:39,767 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=49, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE in 5 msec 2023-07-15 03:11:39,768 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=50, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-15 03:11:39,769 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=50, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED; timeout=600000, timestamp=1689391299769 2023-07-15 03:11:39,781 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testConsecutiveExports 2023-07-15 03:11:39,781 INFO [(jenkins-hbase4.apache.org,41669,1689390649760)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testConsecutiveExports' 2023-07-15 03:11:39,781 DEBUG [(jenkins-hbase4.apache.org,41669,1689390649760)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-15 03:11:39,783 DEBUG [(jenkins-hbase4.apache.org,41669,1689390649760)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testConsecutiveExports' starting 'acquire' 2023-07-15 03:11:39,783 DEBUG [(jenkins-hbase4.apache.org,41669,1689390649760)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testConsecutiveExports', kicking off acquire phase on members. 2023-07-15 03:11:39,783 DEBUG [(jenkins-hbase4.apache.org,41669,1689390649760)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41669-0x10166f610e80000, quorum=127.0.0.1:62663, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-15 03:11:39,783 DEBUG [(jenkins-hbase4.apache.org,41669,1689390649760)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-15 03:11:39,785 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): regionserver:38367-0x10166f610e80003, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 03:11:39,785 DEBUG [(jenkins-hbase4.apache.org,41669,1689390649760)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,38367,1689390651355 2023-07-15 03:11:39,785 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 03:11:39,785 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): regionserver:43199-0x10166f610e80001, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 03:11:39,785 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): regionserver:39199-0x10166f610e80002, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 03:11:39,785 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 03:11:39,785 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 03:11:39,785 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 03:11:39,785 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 03:11:39,785 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 03:11:39,785 DEBUG [(jenkins-hbase4.apache.org,41669,1689390649760)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41669-0x10166f610e80000, quorum=127.0.0.1:62663, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,38367,1689390651355 2023-07-15 03:11:39,785 DEBUG [(jenkins-hbase4.apache.org,41669,1689390649760)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39199,1689390651299 2023-07-15 03:11:39,786 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-15 03:11:39,790 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-15 03:11:39,790 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-15 03:11:39,790 DEBUG [(jenkins-hbase4.apache.org,41669,1689390649760)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41669-0x10166f610e80000, quorum=127.0.0.1:62663, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39199,1689390651299 2023-07-15 03:11:39,790 DEBUG [(jenkins-hbase4.apache.org,41669,1689390649760)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-15 03:11:39,790 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38367-0x10166f610e80003, quorum=127.0.0.1:62663, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-15 03:11:39,790 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39199-0x10166f610e80002, quorum=127.0.0.1:62663, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-15 03:11:39,791 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43199-0x10166f610e80001, quorum=127.0.0.1:62663, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-15 03:11:39,791 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 160 2023-07-15 03:11:39,791 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 160 2023-07-15 03:11:39,791 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-15 03:11:39,791 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-15 03:11:39,791 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-15 03:11:39,791 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 160 2023-07-15 03:11:39,791 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-15 03:11:39,792 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-15 03:11:39,791 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-15 03:11:39,792 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testConsecutiveExports 2023-07-15 03:11:39,792 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testConsecutiveExports 2023-07-15 03:11:39,792 DEBUG [member: 'jenkins-hbase4.apache.org,43199,1689390651225' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-15 03:11:39,792 DEBUG [member: 'jenkins-hbase4.apache.org,38367,1689390651355' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-15 03:11:39,792 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testConsecutiveExports 2023-07-15 03:11:39,792 DEBUG [member: 'jenkins-hbase4.apache.org,38367,1689390651355' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-15 03:11:39,792 DEBUG [member: 'jenkins-hbase4.apache.org,43199,1689390651225' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-15 03:11:39,796 DEBUG [member: 'jenkins-hbase4.apache.org,38367,1689390651355' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-15 03:11:39,797 DEBUG [member: 'jenkins-hbase4.apache.org,38367,1689390651355' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testConsecutiveExports' locally acquired 2023-07-15 03:11:39,797 DEBUG [member: 'jenkins-hbase4.apache.org,43199,1689390651225' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-15 03:11:39,797 DEBUG [member: 'jenkins-hbase4.apache.org,43199,1689390651225' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testConsecutiveExports' locally acquired 2023-07-15 03:11:39,792 DEBUG [member: 'jenkins-hbase4.apache.org,39199,1689390651299' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-15 03:11:39,797 DEBUG [member: 'jenkins-hbase4.apache.org,43199,1689390651225' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43199,1689390651225' joining acquired barrier for procedure (snaptb0-testConsecutiveExports) in zk 2023-07-15 03:11:39,797 DEBUG [member: 'jenkins-hbase4.apache.org,38367,1689390651355' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38367,1689390651355' joining acquired barrier for procedure (snaptb0-testConsecutiveExports) in zk 2023-07-15 03:11:39,797 DEBUG [member: 'jenkins-hbase4.apache.org,39199,1689390651299' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-15 03:11:39,798 DEBUG [member: 'jenkins-hbase4.apache.org,39199,1689390651299' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-15 03:11:39,798 DEBUG [member: 'jenkins-hbase4.apache.org,39199,1689390651299' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testConsecutiveExports' locally acquired 2023-07-15 03:11:39,798 DEBUG [member: 'jenkins-hbase4.apache.org,39199,1689390651299' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39199,1689390651299' joining acquired barrier for procedure (snaptb0-testConsecutiveExports) in zk 2023-07-15 03:11:39,800 DEBUG [member: 'jenkins-hbase4.apache.org,43199,1689390651225' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-15 03:11:39,801 DEBUG [member: 'jenkins-hbase4.apache.org,38367,1689390651355' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-15 03:11:39,801 DEBUG [member: 'jenkins-hbase4.apache.org,39199,1689390651299' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-15 03:11:39,801 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): master:41669-0x10166f610e80000, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,38367,1689390651355 2023-07-15 03:11:39,801 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): master:41669-0x10166f610e80000, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39199,1689390651299 2023-07-15 03:11:39,801 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,38367,1689390651355 2023-07-15 03:11:39,801 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 03:11:39,802 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 03:11:39,802 DEBUG [member: 'jenkins-hbase4.apache.org,39199,1689390651299' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39199-0x10166f610e80002, quorum=127.0.0.1:62663, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-15 03:11:39,802 DEBUG [member: 'jenkins-hbase4.apache.org,39199,1689390651299' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-15 03:11:39,802 DEBUG [member: 'jenkins-hbase4.apache.org,38367,1689390651355' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38367-0x10166f610e80003, quorum=127.0.0.1:62663, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-15 03:11:39,802 DEBUG [member: 'jenkins-hbase4.apache.org,38367,1689390651355' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-15 03:11:39,801 DEBUG [member: 'jenkins-hbase4.apache.org,43199,1689390651225' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43199-0x10166f610e80001, quorum=127.0.0.1:62663, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-15 03:11:39,802 DEBUG [member: 'jenkins-hbase4.apache.org,43199,1689390651225' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-15 03:11:39,802 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 03:11:39,802 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 03:11:39,803 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-15 03:11:39,803 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43199,1689390651225 2023-07-15 03:11:39,803 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39199,1689390651299 2023-07-15 03:11:39,804 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38367,1689390651355 2023-07-15 03:11:39,804 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 03:11:39,804 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,38367,1689390651355' joining acquired barrier for procedure 'snaptb0-testConsecutiveExports' on coordinator 2023-07-15 03:11:39,804 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7a921680[Count = 1] remaining members to acquire global barrier 2023-07-15 03:11:39,804 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39199,1689390651299 2023-07-15 03:11:39,804 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 03:11:39,804 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 03:11:39,805 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 03:11:39,805 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 03:11:39,805 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-15 03:11:39,806 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43199,1689390651225 2023-07-15 03:11:39,806 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39199,1689390651299 2023-07-15 03:11:39,806 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38367,1689390651355 2023-07-15 03:11:39,806 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 03:11:39,807 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39199,1689390651299' joining acquired barrier for procedure 'snaptb0-testConsecutiveExports' on coordinator 2023-07-15 03:11:39,807 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7a921680[Count = 0] remaining members to acquire global barrier 2023-07-15 03:11:39,807 DEBUG [(jenkins-hbase4.apache.org,41669,1689390649760)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testConsecutiveExports' starting 'in-barrier' execution. 2023-07-15 03:11:39,807 DEBUG [(jenkins-hbase4.apache.org,41669,1689390649760)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-15 03:11:39,809 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): regionserver:39199-0x10166f610e80002, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-15 03:11:39,809 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): regionserver:43199-0x10166f610e80001, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-15 03:11:39,809 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-15 03:11:39,809 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-15 03:11:39,809 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-15 03:11:39,809 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): regionserver:38367-0x10166f610e80003, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-15 03:11:39,809 DEBUG [member: 'jenkins-hbase4.apache.org,39199,1689390651299' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-15 03:11:39,809 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-15 03:11:39,809 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-15 03:11:39,809 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-15 03:11:39,810 DEBUG [member: 'jenkins-hbase4.apache.org,43199,1689390651225' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-15 03:11:39,810 DEBUG [(jenkins-hbase4.apache.org,41669,1689390649760)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41669-0x10166f610e80000, quorum=127.0.0.1:62663, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,38367,1689390651355 2023-07-15 03:11:39,810 DEBUG [member: 'jenkins-hbase4.apache.org,43199,1689390651225' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testConsecutiveExports' locally completed 2023-07-15 03:11:39,810 DEBUG [rs(jenkins-hbase4.apache.org,39199,1689390651299)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,,1689390698736.de9ddf08085cd17321bc48a010873944. 2023-07-15 03:11:39,810 DEBUG [member: 'jenkins-hbase4.apache.org,39199,1689390651299' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-15 03:11:39,810 DEBUG [rs(jenkins-hbase4.apache.org,39199,1689390651299)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,,1689390698736.de9ddf08085cd17321bc48a010873944. started... 2023-07-15 03:11:39,810 DEBUG [member: 'jenkins-hbase4.apache.org,38367,1689390651355' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-15 03:11:39,810 DEBUG [(jenkins-hbase4.apache.org,41669,1689390649760)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41669-0x10166f610e80000, quorum=127.0.0.1:62663, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39199,1689390651299 2023-07-15 03:11:39,810 INFO [rs(jenkins-hbase4.apache.org,39199,1689390651299)-snapshot-pool-0] regionserver.HRegion(2745): Flushing de9ddf08085cd17321bc48a010873944 1/1 column families, dataSize=266 B heapSize=832 B 2023-07-15 03:11:39,810 DEBUG [member: 'jenkins-hbase4.apache.org,39199,1689390651299' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-15 03:11:39,810 DEBUG [member: 'jenkins-hbase4.apache.org,43199,1689390651225' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,43199,1689390651225' in zk 2023-07-15 03:11:39,810 DEBUG [rs(jenkins-hbase4.apache.org,38367,1689390651355)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,1,1689390698736.058f828cdb63c6451b36e292b4fe48f3. 2023-07-15 03:11:39,810 DEBUG [member: 'jenkins-hbase4.apache.org,38367,1689390651355' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-15 03:11:39,810 DEBUG [member: 'jenkins-hbase4.apache.org,38367,1689390651355' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-15 03:11:39,810 DEBUG [(jenkins-hbase4.apache.org,41669,1689390649760)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-15 03:11:39,810 DEBUG [rs(jenkins-hbase4.apache.org,38367,1689390651355)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,1,1689390698736.058f828cdb63c6451b36e292b4fe48f3. started... 2023-07-15 03:11:39,811 INFO [rs(jenkins-hbase4.apache.org,38367,1689390651355)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 058f828cdb63c6451b36e292b4fe48f3 1/1 column families, dataSize=3.00 KB heapSize=6.72 KB 2023-07-15 03:11:39,812 DEBUG [member: 'jenkins-hbase4.apache.org,43199,1689390651225' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testConsecutiveExports' has notified controller of completion 2023-07-15 03:11:39,812 DEBUG [member: 'jenkins-hbase4.apache.org,43199,1689390651225' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-15 03:11:39,812 DEBUG [member: 'jenkins-hbase4.apache.org,43199,1689390651225' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testConsecutiveExports' completed. 2023-07-15 03:11:39,855 INFO [rs(jenkins-hbase4.apache.org,38367,1689390651355)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.00 KB at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/data/default/testtb-testConsecutiveExports/058f828cdb63c6451b36e292b4fe48f3/.tmp/cf/7c7954f3e2ba41628cb09d4357bdae46 2023-07-15 03:11:39,856 INFO [rs(jenkins-hbase4.apache.org,39199,1689390651299)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=266 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/data/default/testtb-testConsecutiveExports/de9ddf08085cd17321bc48a010873944/.tmp/cf/4c2c5128e146424e893620d423607e0c 2023-07-15 03:11:39,865 DEBUG [Listener at jenkins-hbase4.apache.org/44817] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-15 03:11:39,866 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41669] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-07-15 03:11:39,866 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41669] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' is still in progress! 2023-07-15 03:11:39,866 DEBUG [Listener at jenkins-hbase4.apache.org/44817] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-15 03:11:39,869 DEBUG [rs(jenkins-hbase4.apache.org,38367,1689390651355)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/data/default/testtb-testConsecutiveExports/058f828cdb63c6451b36e292b4fe48f3/.tmp/cf/7c7954f3e2ba41628cb09d4357bdae46 as hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/data/default/testtb-testConsecutiveExports/058f828cdb63c6451b36e292b4fe48f3/cf/7c7954f3e2ba41628cb09d4357bdae46 2023-07-15 03:11:39,875 INFO [rs(jenkins-hbase4.apache.org,38367,1689390651355)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/data/default/testtb-testConsecutiveExports/058f828cdb63c6451b36e292b4fe48f3/cf/7c7954f3e2ba41628cb09d4357bdae46, entries=46, sequenceid=6, filesize=7.9 K 2023-07-15 03:11:39,876 INFO [rs(jenkins-hbase4.apache.org,38367,1689390651355)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.00 KB/3070, heapSize ~6.70 KB/6864, currentSize=0 B/0 for 058f828cdb63c6451b36e292b4fe48f3 in 65ms, sequenceid=6, compaction requested=false 2023-07-15 03:11:39,876 DEBUG [rs(jenkins-hbase4.apache.org,38367,1689390651355)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testConsecutiveExports' 2023-07-15 03:11:39,877 DEBUG [rs(jenkins-hbase4.apache.org,38367,1689390651355)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 058f828cdb63c6451b36e292b4fe48f3: 2023-07-15 03:11:39,877 DEBUG [rs(jenkins-hbase4.apache.org,38367,1689390651355)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,1,1689390698736.058f828cdb63c6451b36e292b4fe48f3.' region-info for snapshot=snaptb0-testConsecutiveExports 2023-07-15 03:11:39,877 DEBUG [rs(jenkins-hbase4.apache.org,38367,1689390651355)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-15 03:11:39,877 DEBUG [rs(jenkins-hbase4.apache.org,38367,1689390651355)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/data/default/testtb-testConsecutiveExports/058f828cdb63c6451b36e292b4fe48f3/cf/7c7954f3e2ba41628cb09d4357bdae46] hfiles 2023-07-15 03:11:39,877 DEBUG [rs(jenkins-hbase4.apache.org,38367,1689390651355)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/data/default/testtb-testConsecutiveExports/058f828cdb63c6451b36e292b4fe48f3/cf/7c7954f3e2ba41628cb09d4357bdae46 for snapshot=snaptb0-testConsecutiveExports 2023-07-15 03:11:39,877 DEBUG [rs(jenkins-hbase4.apache.org,39199,1689390651299)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/data/default/testtb-testConsecutiveExports/de9ddf08085cd17321bc48a010873944/.tmp/cf/4c2c5128e146424e893620d423607e0c as hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/data/default/testtb-testConsecutiveExports/de9ddf08085cd17321bc48a010873944/cf/4c2c5128e146424e893620d423607e0c 2023-07-15 03:11:39,887 INFO [rs(jenkins-hbase4.apache.org,39199,1689390651299)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/data/default/testtb-testConsecutiveExports/de9ddf08085cd17321bc48a010873944/cf/4c2c5128e146424e893620d423607e0c, entries=4, sequenceid=6, filesize=5.1 K 2023-07-15 03:11:39,888 INFO [rs(jenkins-hbase4.apache.org,39199,1689390651299)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~266 B/266, heapSize ~816 B/816, currentSize=0 B/0 for de9ddf08085cd17321bc48a010873944 in 78ms, sequenceid=6, compaction requested=false 2023-07-15 03:11:39,891 DEBUG [rs(jenkins-hbase4.apache.org,39199,1689390651299)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for de9ddf08085cd17321bc48a010873944: 2023-07-15 03:11:39,892 DEBUG [rs(jenkins-hbase4.apache.org,39199,1689390651299)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,,1689390698736.de9ddf08085cd17321bc48a010873944.' region-info for snapshot=snaptb0-testConsecutiveExports 2023-07-15 03:11:39,892 DEBUG [rs(jenkins-hbase4.apache.org,39199,1689390651299)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-15 03:11:39,892 DEBUG [rs(jenkins-hbase4.apache.org,39199,1689390651299)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/data/default/testtb-testConsecutiveExports/de9ddf08085cd17321bc48a010873944/cf/4c2c5128e146424e893620d423607e0c] hfiles 2023-07-15 03:11:39,892 DEBUG [rs(jenkins-hbase4.apache.org,39199,1689390651299)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/data/default/testtb-testConsecutiveExports/de9ddf08085cd17321bc48a010873944/cf/4c2c5128e146424e893620d423607e0c for snapshot=snaptb0-testConsecutiveExports 2023-07-15 03:11:39,894 DEBUG [rs(jenkins-hbase4.apache.org,38367,1689390651355)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,1,1689390698736.058f828cdb63c6451b36e292b4fe48f3. completed. 2023-07-15 03:11:39,894 DEBUG [rs(jenkins-hbase4.apache.org,38367,1689390651355)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,1,1689390698736.058f828cdb63c6451b36e292b4fe48f3. 2023-07-15 03:11:39,894 DEBUG [member: 'jenkins-hbase4.apache.org,38367,1689390651355' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-15 03:11:39,894 DEBUG [member: 'jenkins-hbase4.apache.org,38367,1689390651355' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-15 03:11:39,894 DEBUG [member: 'jenkins-hbase4.apache.org,38367,1689390651355' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,38367,1689390651355 2023-07-15 03:11:39,895 DEBUG [member: 'jenkins-hbase4.apache.org,38367,1689390651355' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testConsecutiveExports' locally completed 2023-07-15 03:11:39,895 DEBUG [member: 'jenkins-hbase4.apache.org,38367,1689390651355' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,38367,1689390651355' in zk 2023-07-15 03:11:39,899 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): master:41669-0x10166f610e80000, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,38367,1689390651355 2023-07-15 03:11:39,899 DEBUG [member: 'jenkins-hbase4.apache.org,38367,1689390651355' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testConsecutiveExports' has notified controller of completion 2023-07-15 03:11:39,899 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,38367,1689390651355 2023-07-15 03:11:39,899 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 03:11:39,899 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 03:11:39,899 DEBUG [member: 'jenkins-hbase4.apache.org,38367,1689390651355' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-15 03:11:39,900 DEBUG [member: 'jenkins-hbase4.apache.org,38367,1689390651355' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testConsecutiveExports' completed. 2023-07-15 03:11:39,901 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 03:11:39,902 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 03:11:39,902 DEBUG [rs(jenkins-hbase4.apache.org,39199,1689390651299)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,,1689390698736.de9ddf08085cd17321bc48a010873944. completed. 2023-07-15 03:11:39,902 DEBUG [rs(jenkins-hbase4.apache.org,39199,1689390651299)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,,1689390698736.de9ddf08085cd17321bc48a010873944. 2023-07-15 03:11:39,902 DEBUG [member: 'jenkins-hbase4.apache.org,39199,1689390651299' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-15 03:11:39,903 DEBUG [member: 'jenkins-hbase4.apache.org,39199,1689390651299' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-15 03:11:39,902 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-15 03:11:39,903 DEBUG [member: 'jenkins-hbase4.apache.org,39199,1689390651299' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,39199,1689390651299 2023-07-15 03:11:39,903 DEBUG [member: 'jenkins-hbase4.apache.org,39199,1689390651299' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testConsecutiveExports' locally completed 2023-07-15 03:11:39,903 DEBUG [member: 'jenkins-hbase4.apache.org,39199,1689390651299' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,39199,1689390651299' in zk 2023-07-15 03:11:39,903 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43199,1689390651225 2023-07-15 03:11:39,903 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39199,1689390651299 2023-07-15 03:11:39,904 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): master:41669-0x10166f610e80000, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39199,1689390651299 2023-07-15 03:11:39,904 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38367,1689390651355 2023-07-15 03:11:39,904 DEBUG [member: 'jenkins-hbase4.apache.org,39199,1689390651299' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testConsecutiveExports' has notified controller of completion 2023-07-15 03:11:39,904 DEBUG [member: 'jenkins-hbase4.apache.org,39199,1689390651299' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-15 03:11:39,905 DEBUG [member: 'jenkins-hbase4.apache.org,39199,1689390651299' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testConsecutiveExports' completed. 2023-07-15 03:11:39,906 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 03:11:39,907 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-15 03:11:39,907 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43199,1689390651225 2023-07-15 03:11:39,907 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39199,1689390651299 2023-07-15 03:11:39,907 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38367,1689390651355 2023-07-15 03:11:39,908 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,38367,1689390651355': 2023-07-15 03:11:39,908 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,38367,1689390651355' released barrier for procedure'snaptb0-testConsecutiveExports', counting down latch. Waiting for 1 more 2023-07-15 03:11:39,908 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39199,1689390651299 2023-07-15 03:11:39,908 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 03:11:39,908 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 03:11:39,908 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 03:11:39,909 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 03:11:39,909 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-15 03:11:39,909 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43199,1689390651225 2023-07-15 03:11:39,909 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39199,1689390651299 2023-07-15 03:11:39,909 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38367,1689390651355 2023-07-15 03:11:39,910 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 03:11:39,910 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-15 03:11:39,910 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43199,1689390651225 2023-07-15 03:11:39,910 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39199,1689390651299 2023-07-15 03:11:39,911 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38367,1689390651355 2023-07-15 03:11:39,911 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,39199,1689390651299': 2023-07-15 03:11:39,911 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39199,1689390651299' released barrier for procedure'snaptb0-testConsecutiveExports', counting down latch. Waiting for 0 more 2023-07-15 03:11:39,911 INFO [(jenkins-hbase4.apache.org,41669,1689390649760)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testConsecutiveExports' execution completed 2023-07-15 03:11:39,911 DEBUG [(jenkins-hbase4.apache.org,41669,1689390649760)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-15 03:11:39,911 DEBUG [(jenkins-hbase4.apache.org,41669,1689390649760)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-15 03:11:39,911 DEBUG [(jenkins-hbase4.apache.org,41669,1689390649760)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testConsecutiveExports 2023-07-15 03:11:39,911 INFO [(jenkins-hbase4.apache.org,41669,1689390649760)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testConsecutiveExportsincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-15 03:11:39,914 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): regionserver:43199-0x10166f610e80001, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-15 03:11:39,915 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): regionserver:38367-0x10166f610e80003, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-15 03:11:39,915 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): regionserver:43199-0x10166f610e80001, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 03:11:39,915 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): regionserver:38367-0x10166f610e80003, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 03:11:39,915 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): regionserver:39199-0x10166f610e80002, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-15 03:11:39,915 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): regionserver:39199-0x10166f610e80002, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 03:11:39,915 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-15 03:11:39,915 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-15 03:11:39,915 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-15 03:11:39,915 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): master:41669-0x10166f610e80000, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-15 03:11:39,915 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-15 03:11:39,915 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-15 03:11:39,915 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 03:11:39,915 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 03:11:39,915 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-15 03:11:39,915 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-15 03:11:39,916 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 03:11:39,916 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 03:11:39,917 DEBUG [(jenkins-hbase4.apache.org,41669,1689390649760)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41669-0x10166f610e80000, quorum=127.0.0.1:62663, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43199,1689390651225 2023-07-15 03:11:39,917 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 03:11:39,917 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 03:11:39,917 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 03:11:39,917 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-15 03:11:39,917 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 03:11:39,917 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 03:11:39,917 DEBUG [(jenkins-hbase4.apache.org,41669,1689390649760)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41669-0x10166f610e80000, quorum=127.0.0.1:62663, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39199,1689390651299 2023-07-15 03:11:39,918 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-15 03:11:39,918 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-15 03:11:39,918 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-15 03:11:39,918 DEBUG [(jenkins-hbase4.apache.org,41669,1689390649760)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41669-0x10166f610e80000, quorum=127.0.0.1:62663, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,38367,1689390651355 2023-07-15 03:11:39,918 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 03:11:39,919 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-15 03:11:39,919 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43199,1689390651225 2023-07-15 03:11:39,919 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39199,1689390651299 2023-07-15 03:11:39,920 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38367,1689390651355 2023-07-15 03:11:39,920 DEBUG [(jenkins-hbase4.apache.org,41669,1689390649760)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41669-0x10166f610e80000, quorum=127.0.0.1:62663, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43199,1689390651225 2023-07-15 03:11:39,920 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 03:11:39,921 DEBUG [(jenkins-hbase4.apache.org,41669,1689390649760)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41669-0x10166f610e80000, quorum=127.0.0.1:62663, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39199,1689390651299 2023-07-15 03:11:39,921 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-15 03:11:39,921 DEBUG [(jenkins-hbase4.apache.org,41669,1689390649760)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41669-0x10166f610e80000, quorum=127.0.0.1:62663, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,38367,1689390651355 2023-07-15 03:11:39,921 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43199,1689390651225 2023-07-15 03:11:39,922 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39199,1689390651299 2023-07-15 03:11:39,922 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38367,1689390651355 2023-07-15 03:11:39,927 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): regionserver:38367-0x10166f610e80003, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 03:11:39,927 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): regionserver:43199-0x10166f610e80001, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 03:11:39,927 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): regionserver:43199-0x10166f610e80001, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 03:11:39,927 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): regionserver:38367-0x10166f610e80003, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 03:11:39,927 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 03:11:39,927 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 03:11:39,927 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): master:41669-0x10166f610e80000, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,38367,1689390651355 2023-07-15 03:11:39,928 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): regionserver:39199-0x10166f610e80002, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 03:11:39,927 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 03:11:39,928 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 03:11:39,928 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 03:11:39,928 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 03:11:39,928 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): regionserver:39199-0x10166f610e80002, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 03:11:39,928 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): master:41669-0x10166f610e80000, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-15 03:11:39,928 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): master:41669-0x10166f610e80000, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39199,1689390651299 2023-07-15 03:11:39,928 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): master:41669-0x10166f610e80000, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43199,1689390651225 2023-07-15 03:11:39,928 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): master:41669-0x10166f610e80000, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-15 03:11:39,928 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testConsecutiveExports 2023-07-15 03:11:39,928 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 03:11:39,928 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 03:11:39,928 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 03:11:39,929 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 03:11:39,929 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 03:11:39,929 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 03:11:39,928 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testConsecutiveExports 2023-07-15 03:11:39,928 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): master:41669-0x10166f610e80000, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,38367,1689390651355 2023-07-15 03:11:39,929 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): master:41669-0x10166f610e80000, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-15 03:11:39,929 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): master:41669-0x10166f610e80000, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39199,1689390651299 2023-07-15 03:11:39,929 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): master:41669-0x10166f610e80000, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43199,1689390651225 2023-07-15 03:11:39,929 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): master:41669-0x10166f610e80000, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-15 03:11:39,929 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): master:41669-0x10166f610e80000, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-15 03:11:39,928 DEBUG [(jenkins-hbase4.apache.org,41669,1689390649760)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-15 03:11:39,932 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-15 03:11:39,957 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports to hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-15 03:11:39,978 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed 2023-07-15 03:11:39,978 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-15 03:11:39,978 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-15 03:11:39,978 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports at 1689390699764Consolidate snapshot: snaptb0-testConsecutiveExports at 1689390699928 (+164 ms)Loading Region manifests for snaptb0-testConsecutiveExports at 1689390699929 (+1 ms)Writing data manifest for snaptb0-testConsecutiveExports at 1689390699935 (+6 ms)Verifying snapshot: snaptb0-testConsecutiveExports at 1689390699950 (+15 ms)Snapshot snaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed at 1689390699978 (+28 ms) 2023-07-15 03:11:39,981 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=50, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-15 03:11:39,985 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=50, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED in 217 msec 2023-07-15 03:11:40,067 DEBUG [Listener at jenkins-hbase4.apache.org/44817] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-15 03:11:40,068 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41669] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-07-15 03:11:40,068 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41669] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-15 03:11:40,068 INFO [Listener at jenkins-hbase4.apache.org/44817] snapshot.TestExportSnapshot(389): Local export destination path: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6bc8dbaf-aac0-03cf-90d4-be6af049f709/local-export-1689390700068 2023-07-15 03:11:40,068 INFO [Listener at jenkins-hbase4.apache.org/44817] snapshot.TestExportSnapshot(255): tgtFsUri=file:///, tgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6bc8dbaf-aac0-03cf-90d4-be6af049f709/local-export-1689390700068, rawTgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6bc8dbaf-aac0-03cf-90d4-be6af049f709/local-export-1689390700068, srcFsUri=hdfs://localhost:37513, srcDir=hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280 2023-07-15 03:11:40,091 DEBUG [Listener at jenkins-hbase4.apache.org/44817] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:37513, inputRoot=hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280 2023-07-15 03:11:40,091 DEBUG [Listener at jenkins-hbase4.apache.org/44817] snapshot.ExportSnapshot(999): outputFs=org.apache.hadoop.fs.LocalFileSystem@521cfa4c, outputRoot=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6bc8dbaf-aac0-03cf-90d4-be6af049f709/local-export-1689390700068, skipTmp=false, initialOutputSnapshotDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6bc8dbaf-aac0-03cf-90d4-be6af049f709/local-export-1689390700068/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-15 03:11:40,091 INFO [Listener at jenkins-hbase4.apache.org/44817] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:37513, inputRoot=hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280, snapshotDir=hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/.hbase-snapshot/snaptb0-testConsecutiveExports. 2023-07-15 03:11:40,099 INFO [Listener at jenkins-hbase4.apache.org/44817] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/.hbase-snapshot/snaptb0-testConsecutiveExports to file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6bc8dbaf-aac0-03cf-90d4-be6af049f709/local-export-1689390700068/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-15 03:11:40,115 DEBUG [Listener at jenkins-hbase4.apache.org/44817] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-15 03:11:40,115 DEBUG [Listener at jenkins-hbase4.apache.org/44817] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-15 03:11:40,115 DEBUG [Listener at jenkins-hbase4.apache.org/44817] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-15 03:11:40,116 DEBUG [Listener at jenkins-hbase4.apache.org/44817] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-15 03:11:41,069 DEBUG [Listener at jenkins-hbase4.apache.org/44817] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6bc8dbaf-aac0-03cf-90d4-be6af049f709/hadoop-826575671403341164.jar 2023-07-15 03:11:41,069 DEBUG [Listener at jenkins-hbase4.apache.org/44817] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-15 03:11:41,070 DEBUG [Listener at jenkins-hbase4.apache.org/44817] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-15 03:11:41,138 DEBUG [Listener at jenkins-hbase4.apache.org/44817] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6bc8dbaf-aac0-03cf-90d4-be6af049f709/hadoop-3962387386698982827.jar 2023-07-15 03:11:41,139 DEBUG [Listener at jenkins-hbase4.apache.org/44817] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-15 03:11:41,139 DEBUG [Listener at jenkins-hbase4.apache.org/44817] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-15 03:11:41,140 DEBUG [Listener at jenkins-hbase4.apache.org/44817] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-15 03:11:41,140 DEBUG [Listener at jenkins-hbase4.apache.org/44817] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-15 03:11:41,141 DEBUG [Listener at jenkins-hbase4.apache.org/44817] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-15 03:11:41,141 DEBUG [Listener at jenkins-hbase4.apache.org/44817] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-15 03:11:41,141 DEBUG [Listener at jenkins-hbase4.apache.org/44817] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-15 03:11:41,142 DEBUG [Listener at jenkins-hbase4.apache.org/44817] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-15 03:11:41,142 DEBUG [Listener at jenkins-hbase4.apache.org/44817] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-15 03:11:41,143 DEBUG [Listener at jenkins-hbase4.apache.org/44817] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-15 03:11:41,143 DEBUG [Listener at jenkins-hbase4.apache.org/44817] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-15 03:11:41,143 DEBUG [Listener at jenkins-hbase4.apache.org/44817] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-15 03:11:41,144 DEBUG [Listener at jenkins-hbase4.apache.org/44817] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-15 03:11:41,144 DEBUG [Listener at jenkins-hbase4.apache.org/44817] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-15 03:11:41,144 DEBUG [Listener at jenkins-hbase4.apache.org/44817] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-15 03:11:41,145 DEBUG [Listener at jenkins-hbase4.apache.org/44817] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-15 03:11:41,145 DEBUG [Listener at jenkins-hbase4.apache.org/44817] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-15 03:11:41,146 DEBUG [Listener at jenkins-hbase4.apache.org/44817] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-15 03:11:41,146 DEBUG [Listener at jenkins-hbase4.apache.org/44817] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-15 03:11:41,147 DEBUG [Listener at jenkins-hbase4.apache.org/44817] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-15 03:11:41,147 DEBUG [Listener at jenkins-hbase4.apache.org/44817] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-15 03:11:41,147 DEBUG [Listener at jenkins-hbase4.apache.org/44817] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-15 03:11:41,148 DEBUG [Listener at jenkins-hbase4.apache.org/44817] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-15 03:11:41,558 WARN [Listener at jenkins-hbase4.apache.org/44817] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-15 03:11:41,561 INFO [Listener at jenkins-hbase4.apache.org/44817] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testConsecutiveExports' hfile list 2023-07-15 03:11:41,563 DEBUG [Listener at jenkins-hbase4.apache.org/44817] snapshot.ExportSnapshot(671): export split=0 size=13.0 K 2023-07-15 03:11:43,303 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-15 03:11:43,303 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-15 03:11:43,305 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689390660463_0002_000001 (auth:SIMPLE) 2023-07-15 03:11:43,806 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689390660463_0003_000001 (auth:SIMPLE) 2023-07-15 03:11:44,019 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-15 03:11:48,412 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689390660463_0003_000001 (auth:SIMPLE) 2023-07-15 03:11:50,687 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689390660463_0003_000001 (auth:SIMPLE) 2023-07-15 03:11:53,314 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689390660463_0003_000001 (auth:SIMPLE) 2023-07-15 03:11:54,744 INFO [Listener at jenkins-hbase4.apache.org/44817] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-15 03:11:54,744 INFO [Listener at jenkins-hbase4.apache.org/44817] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-15 03:11:54,748 INFO [Listener at jenkins-hbase4.apache.org/44817] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testConsecutiveExports 2023-07-15 03:11:54,748 INFO [Listener at jenkins-hbase4.apache.org/44817] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-15 03:11:54,748 INFO [Listener at jenkins-hbase4.apache.org/44817] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-15 03:11:54,749 DEBUG [Listener at jenkins-hbase4.apache.org/44817] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-924468511_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/.hbase-snapshot/snaptb0-testConsecutiveExports at hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-15 03:11:54,751 DEBUG [Listener at jenkins-hbase4.apache.org/44817] snapshot.TestExportSnapshot(367): hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-07-15 03:11:54,751 DEBUG [Listener at jenkins-hbase4.apache.org/44817] snapshot.TestExportSnapshot(367): hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-07-15 03:11:54,751 DEBUG [Listener at jenkins-hbase4.apache.org/44817] snapshot.TestExportSnapshot(362): List files in org.apache.hadoop.fs.LocalFileSystem@22523188 in root file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6bc8dbaf-aac0-03cf-90d4-be6af049f709/local-export-1689390700068/.hbase-snapshot/snaptb0-testConsecutiveExports at file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6bc8dbaf-aac0-03cf-90d4-be6af049f709/local-export-1689390700068/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-15 03:11:54,751 DEBUG [Listener at jenkins-hbase4.apache.org/44817] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6bc8dbaf-aac0-03cf-90d4-be6af049f709/local-export-1689390700068/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-07-15 03:11:54,751 DEBUG [Listener at jenkins-hbase4.apache.org/44817] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6bc8dbaf-aac0-03cf-90d4-be6af049f709/local-export-1689390700068/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-07-15 03:11:54,753 INFO [Listener at jenkins-hbase4.apache.org/44817] snapshot.TestExportSnapshot(255): tgtFsUri=file:///, tgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6bc8dbaf-aac0-03cf-90d4-be6af049f709/local-export-1689390700068, rawTgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6bc8dbaf-aac0-03cf-90d4-be6af049f709/local-export-1689390700068, srcFsUri=hdfs://localhost:37513, srcDir=hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280 2023-07-15 03:11:54,774 DEBUG [Listener at jenkins-hbase4.apache.org/44817] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:37513, inputRoot=hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280 2023-07-15 03:11:54,774 DEBUG [Listener at jenkins-hbase4.apache.org/44817] snapshot.ExportSnapshot(999): outputFs=org.apache.hadoop.fs.LocalFileSystem@620b558c, outputRoot=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6bc8dbaf-aac0-03cf-90d4-be6af049f709/local-export-1689390700068, skipTmp=false, initialOutputSnapshotDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6bc8dbaf-aac0-03cf-90d4-be6af049f709/local-export-1689390700068/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-15 03:11:54,775 INFO [Listener at jenkins-hbase4.apache.org/44817] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:37513, inputRoot=hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280, snapshotDir=hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/.hbase-snapshot/snaptb0-testConsecutiveExports. 2023-07-15 03:11:54,793 INFO [Listener at jenkins-hbase4.apache.org/44817] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/.hbase-snapshot/snaptb0-testConsecutiveExports to file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6bc8dbaf-aac0-03cf-90d4-be6af049f709/local-export-1689390700068/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-15 03:11:54,806 DEBUG [Listener at jenkins-hbase4.apache.org/44817] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-15 03:11:54,807 DEBUG [Listener at jenkins-hbase4.apache.org/44817] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-15 03:11:54,807 DEBUG [Listener at jenkins-hbase4.apache.org/44817] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-15 03:11:54,807 DEBUG [Listener at jenkins-hbase4.apache.org/44817] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-15 03:11:55,767 DEBUG [Listener at jenkins-hbase4.apache.org/44817] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6bc8dbaf-aac0-03cf-90d4-be6af049f709/hadoop-4322291068037806587.jar 2023-07-15 03:11:55,768 DEBUG [Listener at jenkins-hbase4.apache.org/44817] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-15 03:11:55,768 DEBUG [Listener at jenkins-hbase4.apache.org/44817] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-15 03:11:55,836 DEBUG [Listener at jenkins-hbase4.apache.org/44817] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6bc8dbaf-aac0-03cf-90d4-be6af049f709/hadoop-8472933914843451219.jar 2023-07-15 03:11:55,837 DEBUG [Listener at jenkins-hbase4.apache.org/44817] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-15 03:11:55,837 DEBUG [Listener at jenkins-hbase4.apache.org/44817] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-15 03:11:55,838 DEBUG [Listener at jenkins-hbase4.apache.org/44817] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-15 03:11:55,838 DEBUG [Listener at jenkins-hbase4.apache.org/44817] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-15 03:11:55,839 DEBUG [Listener at jenkins-hbase4.apache.org/44817] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-15 03:11:55,839 DEBUG [Listener at jenkins-hbase4.apache.org/44817] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-15 03:11:55,840 DEBUG [Listener at jenkins-hbase4.apache.org/44817] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-15 03:11:55,840 DEBUG [Listener at jenkins-hbase4.apache.org/44817] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-15 03:11:55,841 DEBUG [Listener at jenkins-hbase4.apache.org/44817] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-15 03:11:55,842 DEBUG [Listener at jenkins-hbase4.apache.org/44817] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-15 03:11:55,842 DEBUG [Listener at jenkins-hbase4.apache.org/44817] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-15 03:11:55,843 DEBUG [Listener at jenkins-hbase4.apache.org/44817] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-15 03:11:55,843 DEBUG [Listener at jenkins-hbase4.apache.org/44817] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-15 03:11:55,844 DEBUG [Listener at jenkins-hbase4.apache.org/44817] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-15 03:11:55,844 DEBUG [Listener at jenkins-hbase4.apache.org/44817] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-15 03:11:55,845 DEBUG [Listener at jenkins-hbase4.apache.org/44817] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-15 03:11:55,846 DEBUG [Listener at jenkins-hbase4.apache.org/44817] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-15 03:11:55,846 DEBUG [Listener at jenkins-hbase4.apache.org/44817] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-15 03:11:55,847 DEBUG [Listener at jenkins-hbase4.apache.org/44817] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-15 03:11:55,847 DEBUG [Listener at jenkins-hbase4.apache.org/44817] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-15 03:11:55,847 DEBUG [Listener at jenkins-hbase4.apache.org/44817] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-15 03:11:55,848 DEBUG [Listener at jenkins-hbase4.apache.org/44817] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-15 03:11:55,848 DEBUG [Listener at jenkins-hbase4.apache.org/44817] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-15 03:11:56,230 WARN [Listener at jenkins-hbase4.apache.org/44817] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-15 03:11:56,233 INFO [Listener at jenkins-hbase4.apache.org/44817] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testConsecutiveExports' hfile list 2023-07-15 03:11:56,235 DEBUG [Listener at jenkins-hbase4.apache.org/44817] snapshot.ExportSnapshot(671): export split=0 size=13.0 K 2023-07-15 03:11:59,491 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-15 03:11:59,491 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-15 03:11:59,494 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689390660463_0003_000001 (auth:SIMPLE) 2023-07-15 03:12:00,318 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689390660463_0004_000001 (auth:SIMPLE) 2023-07-15 03:12:04,760 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689390660463_0004_000001 (auth:SIMPLE) 2023-07-15 03:12:07,008 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689390660463_0004_000001 (auth:SIMPLE) 2023-07-15 03:12:10,309 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689390660463_0004_000001 (auth:SIMPLE) 2023-07-15 03:12:11,429 INFO [Listener at jenkins-hbase4.apache.org/44817] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-15 03:12:11,430 INFO [Listener at jenkins-hbase4.apache.org/44817] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-15 03:12:11,433 INFO [Listener at jenkins-hbase4.apache.org/44817] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testConsecutiveExports 2023-07-15 03:12:11,433 INFO [Listener at jenkins-hbase4.apache.org/44817] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-15 03:12:11,434 INFO [Listener at jenkins-hbase4.apache.org/44817] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-15 03:12:11,434 DEBUG [Listener at jenkins-hbase4.apache.org/44817] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-924468511_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/.hbase-snapshot/snaptb0-testConsecutiveExports at hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-15 03:12:11,437 DEBUG [Listener at jenkins-hbase4.apache.org/44817] snapshot.TestExportSnapshot(367): hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-07-15 03:12:11,437 DEBUG [Listener at jenkins-hbase4.apache.org/44817] snapshot.TestExportSnapshot(367): hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-07-15 03:12:11,437 DEBUG [Listener at jenkins-hbase4.apache.org/44817] snapshot.TestExportSnapshot(362): List files in org.apache.hadoop.fs.LocalFileSystem@22523188 in root file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6bc8dbaf-aac0-03cf-90d4-be6af049f709/local-export-1689390700068/.hbase-snapshot/snaptb0-testConsecutiveExports at file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6bc8dbaf-aac0-03cf-90d4-be6af049f709/local-export-1689390700068/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-15 03:12:11,437 DEBUG [Listener at jenkins-hbase4.apache.org/44817] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6bc8dbaf-aac0-03cf-90d4-be6af049f709/local-export-1689390700068/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-07-15 03:12:11,437 DEBUG [Listener at jenkins-hbase4.apache.org/44817] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6bc8dbaf-aac0-03cf-90d4-be6af049f709/local-export-1689390700068/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-07-15 03:12:11,450 INFO [Listener at jenkins-hbase4.apache.org/44817] client.HBaseAdmin$15(890): Started disable of testtb-testConsecutiveExports 2023-07-15 03:12:11,451 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41669] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testConsecutiveExports 2023-07-15 03:12:11,452 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41669] procedure2.ProcedureExecutor(1029): Stored pid=51, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testConsecutiveExports 2023-07-15 03:12:11,457 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41669] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-07-15 03:12:11,460 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689390731460"}]},"ts":"1689390731460"} 2023-07-15 03:12:11,462 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=DISABLING in hbase:meta 2023-07-15 03:12:11,464 INFO [PEWorker-4] procedure.DisableTableProcedure(293): Set testtb-testConsecutiveExports to state=DISABLING 2023-07-15 03:12:11,465 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=52, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=de9ddf08085cd17321bc48a010873944, UNASSIGN}, {pid=53, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=058f828cdb63c6451b36e292b4fe48f3, UNASSIGN}] 2023-07-15 03:12:11,468 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=52, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=de9ddf08085cd17321bc48a010873944, UNASSIGN 2023-07-15 03:12:11,468 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=53, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=058f828cdb63c6451b36e292b4fe48f3, UNASSIGN 2023-07-15 03:12:11,470 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=52 updating hbase:meta row=de9ddf08085cd17321bc48a010873944, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,39199,1689390651299 2023-07-15 03:12:11,470 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=53 updating hbase:meta row=058f828cdb63c6451b36e292b4fe48f3, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,38367,1689390651355 2023-07-15 03:12:11,471 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,,1689390698736.de9ddf08085cd17321bc48a010873944.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689390731470"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689390731470"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689390731470"}]},"ts":"1689390731470"} 2023-07-15 03:12:11,471 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,1,1689390698736.058f828cdb63c6451b36e292b4fe48f3.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689390731470"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689390731470"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689390731470"}]},"ts":"1689390731470"} 2023-07-15 03:12:11,472 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=54, ppid=52, state=RUNNABLE; CloseRegionProcedure de9ddf08085cd17321bc48a010873944, server=jenkins-hbase4.apache.org,39199,1689390651299}] 2023-07-15 03:12:11,473 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=55, ppid=53, state=RUNNABLE; CloseRegionProcedure 058f828cdb63c6451b36e292b4fe48f3, server=jenkins-hbase4.apache.org,38367,1689390651355}] 2023-07-15 03:12:11,558 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41669] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-07-15 03:12:11,626 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close de9ddf08085cd17321bc48a010873944 2023-07-15 03:12:11,626 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 058f828cdb63c6451b36e292b4fe48f3 2023-07-15 03:12:11,626 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing de9ddf08085cd17321bc48a010873944, disabling compactions & flushes 2023-07-15 03:12:11,626 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,,1689390698736.de9ddf08085cd17321bc48a010873944. 2023-07-15 03:12:11,626 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 058f828cdb63c6451b36e292b4fe48f3, disabling compactions & flushes 2023-07-15 03:12:11,626 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,,1689390698736.de9ddf08085cd17321bc48a010873944. 2023-07-15 03:12:11,626 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,1,1689390698736.058f828cdb63c6451b36e292b4fe48f3. 2023-07-15 03:12:11,626 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,,1689390698736.de9ddf08085cd17321bc48a010873944. after waiting 0 ms 2023-07-15 03:12:11,626 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,,1689390698736.de9ddf08085cd17321bc48a010873944. 2023-07-15 03:12:11,626 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,1,1689390698736.058f828cdb63c6451b36e292b4fe48f3. 2023-07-15 03:12:11,626 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,1,1689390698736.058f828cdb63c6451b36e292b4fe48f3. after waiting 0 ms 2023-07-15 03:12:11,626 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,1,1689390698736.058f828cdb63c6451b36e292b4fe48f3. 2023-07-15 03:12:11,647 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/data/default/testtb-testConsecutiveExports/058f828cdb63c6451b36e292b4fe48f3/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-15 03:12:11,647 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/data/default/testtb-testConsecutiveExports/de9ddf08085cd17321bc48a010873944/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-15 03:12:11,648 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-15 03:12:11,648 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-15 03:12:11,650 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,1,1689390698736.058f828cdb63c6451b36e292b4fe48f3. 2023-07-15 03:12:11,650 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,,1689390698736.de9ddf08085cd17321bc48a010873944. 2023-07-15 03:12:11,650 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 058f828cdb63c6451b36e292b4fe48f3: 2023-07-15 03:12:11,650 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for de9ddf08085cd17321bc48a010873944: 2023-07-15 03:12:11,652 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 058f828cdb63c6451b36e292b4fe48f3 2023-07-15 03:12:11,653 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=53 updating hbase:meta row=058f828cdb63c6451b36e292b4fe48f3, regionState=CLOSED 2023-07-15 03:12:11,653 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,1,1689390698736.058f828cdb63c6451b36e292b4fe48f3.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689390731653"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689390731653"}]},"ts":"1689390731653"} 2023-07-15 03:12:11,654 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed de9ddf08085cd17321bc48a010873944 2023-07-15 03:12:11,656 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=52 updating hbase:meta row=de9ddf08085cd17321bc48a010873944, regionState=CLOSED 2023-07-15 03:12:11,656 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,,1689390698736.de9ddf08085cd17321bc48a010873944.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689390731656"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689390731656"}]},"ts":"1689390731656"} 2023-07-15 03:12:11,658 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=55, resume processing ppid=53 2023-07-15 03:12:11,658 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=55, ppid=53, state=SUCCESS; CloseRegionProcedure 058f828cdb63c6451b36e292b4fe48f3, server=jenkins-hbase4.apache.org,38367,1689390651355 in 182 msec 2023-07-15 03:12:11,660 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=54, resume processing ppid=52 2023-07-15 03:12:11,661 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=53, ppid=51, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=058f828cdb63c6451b36e292b4fe48f3, UNASSIGN in 193 msec 2023-07-15 03:12:11,661 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=54, ppid=52, state=SUCCESS; CloseRegionProcedure de9ddf08085cd17321bc48a010873944, server=jenkins-hbase4.apache.org,39199,1689390651299 in 186 msec 2023-07-15 03:12:11,666 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=52, resume processing ppid=51 2023-07-15 03:12:11,666 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=52, ppid=51, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=de9ddf08085cd17321bc48a010873944, UNASSIGN in 196 msec 2023-07-15 03:12:11,669 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689390731669"}]},"ts":"1689390731669"} 2023-07-15 03:12:11,672 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=DISABLED in hbase:meta 2023-07-15 03:12:11,675 INFO [PEWorker-2] procedure.DisableTableProcedure(305): Set testtb-testConsecutiveExports to state=DISABLED 2023-07-15 03:12:11,678 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=51, state=SUCCESS; DisableTableProcedure table=testtb-testConsecutiveExports in 225 msec 2023-07-15 03:12:11,760 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41669] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-07-15 03:12:11,760 INFO [Listener at jenkins-hbase4.apache.org/44817] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testConsecutiveExports, procId: 51 completed 2023-07-15 03:12:11,762 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41669] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testConsecutiveExports 2023-07-15 03:12:11,763 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41669] procedure2.ProcedureExecutor(1029): Stored pid=56, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-15 03:12:11,766 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=56, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-15 03:12:11,766 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41669] access.PermissionStorage(259): Removing permissions of removed table testtb-testConsecutiveExports 2023-07-15 03:12:11,769 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=56, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-15 03:12:11,769 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=39199] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testConsecutiveExports 2023-07-15 03:12:11,780 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): regionserver:38367-0x10166f610e80003, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-15 03:12:11,780 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): regionserver:39199-0x10166f610e80002, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-15 03:12:11,780 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): master:41669-0x10166f610e80000, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-15 03:12:11,780 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): regionserver:43199-0x10166f610e80001, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-15 03:12:11,781 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-07-15 03:12:11,781 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-07-15 03:12:11,781 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-07-15 03:12:11,782 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): regionserver:39199-0x10166f610e80002, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-15 03:12:11,782 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): regionserver:39199-0x10166f610e80002, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-15 03:12:11,783 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): master:41669-0x10166f610e80000, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-15 03:12:11,783 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): master:41669-0x10166f610e80000, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-15 03:12:11,783 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data null 2023-07-15 03:12:11,783 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-15 03:12:11,783 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): regionserver:43199-0x10166f610e80001, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-15 03:12:11,783 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): regionserver:38367-0x10166f610e80003, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-15 03:12:11,783 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): regionserver:38367-0x10166f610e80003, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-15 03:12:11,783 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/.tmp/data/default/testtb-testConsecutiveExports/de9ddf08085cd17321bc48a010873944 2023-07-15 03:12:11,785 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41669] master.MasterRpcServices(1230): Checking to see if procedure is done pid=56 2023-07-15 03:12:11,787 DEBUG [HFileArchiver-14] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/.tmp/data/default/testtb-testConsecutiveExports/058f828cdb63c6451b36e292b4fe48f3 2023-07-15 03:12:11,787 DEBUG [HFileArchiver-13] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/.tmp/data/default/testtb-testConsecutiveExports/de9ddf08085cd17321bc48a010873944/cf, FileablePath, hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/.tmp/data/default/testtb-testConsecutiveExports/de9ddf08085cd17321bc48a010873944/recovered.edits] 2023-07-15 03:12:11,791 DEBUG [HFileArchiver-14] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/.tmp/data/default/testtb-testConsecutiveExports/058f828cdb63c6451b36e292b4fe48f3/cf, FileablePath, hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/.tmp/data/default/testtb-testConsecutiveExports/058f828cdb63c6451b36e292b4fe48f3/recovered.edits] 2023-07-15 03:12:11,797 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/.tmp/data/default/testtb-testConsecutiveExports/058f828cdb63c6451b36e292b4fe48f3/cf/7c7954f3e2ba41628cb09d4357bdae46 to hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/archive/data/default/testtb-testConsecutiveExports/058f828cdb63c6451b36e292b4fe48f3/cf/7c7954f3e2ba41628cb09d4357bdae46 2023-07-15 03:12:11,806 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/.tmp/data/default/testtb-testConsecutiveExports/de9ddf08085cd17321bc48a010873944/cf/4c2c5128e146424e893620d423607e0c to hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/archive/data/default/testtb-testConsecutiveExports/de9ddf08085cd17321bc48a010873944/cf/4c2c5128e146424e893620d423607e0c 2023-07-15 03:12:11,811 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/.tmp/data/default/testtb-testConsecutiveExports/058f828cdb63c6451b36e292b4fe48f3/recovered.edits/9.seqid to hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/archive/data/default/testtb-testConsecutiveExports/058f828cdb63c6451b36e292b4fe48f3/recovered.edits/9.seqid 2023-07-15 03:12:11,811 DEBUG [HFileArchiver-14] backup.HFileArchiver(596): Deleted hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/.tmp/data/default/testtb-testConsecutiveExports/058f828cdb63c6451b36e292b4fe48f3 2023-07-15 03:12:11,812 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/.tmp/data/default/testtb-testConsecutiveExports/de9ddf08085cd17321bc48a010873944/recovered.edits/9.seqid to hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/archive/data/default/testtb-testConsecutiveExports/de9ddf08085cd17321bc48a010873944/recovered.edits/9.seqid 2023-07-15 03:12:11,813 DEBUG [HFileArchiver-13] backup.HFileArchiver(596): Deleted hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/.tmp/data/default/testtb-testConsecutiveExports/de9ddf08085cd17321bc48a010873944 2023-07-15 03:12:11,813 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testtb-testConsecutiveExports regions 2023-07-15 03:12:11,819 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=56, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-15 03:12:11,839 WARN [PEWorker-5] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testConsecutiveExports from hbase:meta 2023-07-15 03:12:11,852 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(421): Removing 'testtb-testConsecutiveExports' descriptor. 2023-07-15 03:12:11,854 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=56, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-15 03:12:11,854 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(411): Removing 'testtb-testConsecutiveExports' from region states. 2023-07-15 03:12:11,854 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testConsecutiveExports,,1689390698736.de9ddf08085cd17321bc48a010873944.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689390731854"}]},"ts":"9223372036854775807"} 2023-07-15 03:12:11,855 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testConsecutiveExports,1,1689390698736.058f828cdb63c6451b36e292b4fe48f3.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689390731854"}]},"ts":"9223372036854775807"} 2023-07-15 03:12:11,867 INFO [PEWorker-5] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-15 03:12:11,867 DEBUG [PEWorker-5] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => de9ddf08085cd17321bc48a010873944, NAME => 'testtb-testConsecutiveExports,,1689390698736.de9ddf08085cd17321bc48a010873944.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 058f828cdb63c6451b36e292b4fe48f3, NAME => 'testtb-testConsecutiveExports,1,1689390698736.058f828cdb63c6451b36e292b4fe48f3.', STARTKEY => '1', ENDKEY => ''}] 2023-07-15 03:12:11,867 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(415): Marking 'testtb-testConsecutiveExports' as deleted. 2023-07-15 03:12:11,868 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689390731868"}]},"ts":"9223372036854775807"} 2023-07-15 03:12:11,886 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41669] master.MasterRpcServices(1230): Checking to see if procedure is done pid=56 2023-07-15 03:12:11,913 INFO [PEWorker-5] hbase.MetaTableAccessor(1658): Deleted table testtb-testConsecutiveExports state from META 2023-07-15 03:12:11,918 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(130): Finished pid=56, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-15 03:12:11,921 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=56, state=SUCCESS; DeleteTableProcedure table=testtb-testConsecutiveExports in 156 msec 2023-07-15 03:12:12,088 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41669] master.MasterRpcServices(1230): Checking to see if procedure is done pid=56 2023-07-15 03:12:12,088 INFO [Listener at jenkins-hbase4.apache.org/44817] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testConsecutiveExports, procId: 56 completed 2023-07-15 03:12:12,102 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41669] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testConsecutiveExports" 2023-07-15 03:12:12,106 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41669] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testConsecutiveExports 2023-07-15 03:12:12,108 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41669] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testConsecutiveExports" 2023-07-15 03:12:12,110 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41669] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testConsecutiveExports 2023-07-15 03:12:12,141 INFO [Listener at jenkins-hbase4.apache.org/44817] hbase.ResourceChecker(175): after: snapshot.TestSecureExportSnapshot#testConsecutiveExports Thread=747 (was 760), OpenFileDescriptor=893 (was 921), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=360 (was 386), ProcessCount=183 (was 181) - ProcessCount LEAK? -, AvailableMemoryMB=2592 (was 2404) - AvailableMemoryMB LEAK? - 2023-07-15 03:12:12,141 WARN [Listener at jenkins-hbase4.apache.org/44817] hbase.ResourceChecker(130): Thread=747 is superior to 500 2023-07-15 03:12:12,198 INFO [Listener at jenkins-hbase4.apache.org/44817] hbase.ResourceChecker(147): before: snapshot.TestSecureExportSnapshot#testExportFileSystemStateWithMergeRegion Thread=747, OpenFileDescriptor=893, MaxFileDescriptor=60000, SystemLoadAverage=360, ProcessCount=183, AvailableMemoryMB=2573 2023-07-15 03:12:12,198 WARN [Listener at jenkins-hbase4.apache.org/44817] hbase.ResourceChecker(130): Thread=747 is superior to 500 2023-07-15 03:12:12,200 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41669] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemStateWithMergeRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-15 03:12:12,201 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41669] procedure2.ProcedureExecutor(1029): Stored pid=57, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-15 03:12:12,204 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_PRE_OPERATION 2023-07-15 03:12:12,205 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41669] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemStateWithMergeRegion" procId is: 57 2023-07-15 03:12:12,205 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-15 03:12:12,206 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41669] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-07-15 03:12:12,209 DEBUG [HFileArchiver-15] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/e2d26928a79bc451f2d14aec9f529adf 2023-07-15 03:12:12,210 DEBUG [HFileArchiver-16] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/69b083820c2a58813f79ecd7d05b8ee7 2023-07-15 03:12:12,210 DEBUG [HFileArchiver-16] backup.HFileArchiver(153): Directory hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/69b083820c2a58813f79ecd7d05b8ee7 empty. 2023-07-15 03:12:12,210 DEBUG [HFileArchiver-15] backup.HFileArchiver(153): Directory hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/e2d26928a79bc451f2d14aec9f529adf empty. 2023-07-15 03:12:12,211 DEBUG [HFileArchiver-16] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/69b083820c2a58813f79ecd7d05b8ee7 2023-07-15 03:12:12,211 DEBUG [HFileArchiver-15] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/e2d26928a79bc451f2d14aec9f529adf 2023-07-15 03:12:12,211 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion regions 2023-07-15 03:12:12,252 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/.tabledesc/.tableinfo.0000000001 2023-07-15 03:12:12,253 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(7675): creating {ENCODED => e2d26928a79bc451f2d14aec9f529adf, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,,1689390732199.e2d26928a79bc451f2d14aec9f529adf.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/.tmp 2023-07-15 03:12:12,254 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(7675): creating {ENCODED => 69b083820c2a58813f79ecd7d05b8ee7, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,1,1689390732199.69b083820c2a58813f79ecd7d05b8ee7.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/.tmp 2023-07-15 03:12:12,288 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,1,1689390732199.69b083820c2a58813f79ecd7d05b8ee7.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-15 03:12:12,288 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1604): Closing 69b083820c2a58813f79ecd7d05b8ee7, disabling compactions & flushes 2023-07-15 03:12:12,288 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,1,1689390732199.69b083820c2a58813f79ecd7d05b8ee7. 2023-07-15 03:12:12,288 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1689390732199.69b083820c2a58813f79ecd7d05b8ee7. 2023-07-15 03:12:12,288 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1689390732199.69b083820c2a58813f79ecd7d05b8ee7. after waiting 0 ms 2023-07-15 03:12:12,288 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,1,1689390732199.69b083820c2a58813f79ecd7d05b8ee7. 2023-07-15 03:12:12,288 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,1,1689390732199.69b083820c2a58813f79ecd7d05b8ee7. 2023-07-15 03:12:12,288 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1558): Region close journal for 69b083820c2a58813f79ecd7d05b8ee7: 2023-07-15 03:12:12,289 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,,1689390732199.e2d26928a79bc451f2d14aec9f529adf.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-15 03:12:12,289 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1604): Closing e2d26928a79bc451f2d14aec9f529adf, disabling compactions & flushes 2023-07-15 03:12:12,289 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,,1689390732199.e2d26928a79bc451f2d14aec9f529adf. 2023-07-15 03:12:12,289 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,,1689390732199.e2d26928a79bc451f2d14aec9f529adf. 2023-07-15 03:12:12,289 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,,1689390732199.e2d26928a79bc451f2d14aec9f529adf. after waiting 0 ms 2023-07-15 03:12:12,289 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,,1689390732199.e2d26928a79bc451f2d14aec9f529adf. 2023-07-15 03:12:12,289 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,,1689390732199.e2d26928a79bc451f2d14aec9f529adf. 2023-07-15 03:12:12,289 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1558): Region close journal for e2d26928a79bc451f2d14aec9f529adf: 2023-07-15 03:12:12,292 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_ADD_TO_META 2023-07-15 03:12:12,293 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1689390732199.69b083820c2a58813f79ecd7d05b8ee7.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689390732293"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689390732293"}]},"ts":"1689390732293"} 2023-07-15 03:12:12,294 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1689390732199.e2d26928a79bc451f2d14aec9f529adf.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689390732293"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689390732293"}]},"ts":"1689390732293"} 2023-07-15 03:12:12,303 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-15 03:12:12,304 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-15 03:12:12,305 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689390732305"}]},"ts":"1689390732305"} 2023-07-15 03:12:12,307 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=ENABLING in hbase:meta 2023-07-15 03:12:12,307 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41669] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-07-15 03:12:12,310 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-15 03:12:12,312 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-15 03:12:12,312 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-15 03:12:12,312 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-15 03:12:12,312 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-15 03:12:12,312 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=58, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=e2d26928a79bc451f2d14aec9f529adf, ASSIGN}, {pid=59, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=69b083820c2a58813f79ecd7d05b8ee7, ASSIGN}] 2023-07-15 03:12:12,315 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=58, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=e2d26928a79bc451f2d14aec9f529adf, ASSIGN 2023-07-15 03:12:12,315 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=59, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=69b083820c2a58813f79ecd7d05b8ee7, ASSIGN 2023-07-15 03:12:12,316 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=59, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=69b083820c2a58813f79ecd7d05b8ee7, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,38367,1689390651355; forceNewPlan=false, retain=false 2023-07-15 03:12:12,316 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=58, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=e2d26928a79bc451f2d14aec9f529adf, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,39199,1689390651299; forceNewPlan=false, retain=false 2023-07-15 03:12:12,467 INFO [jenkins-hbase4:41669] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-15 03:12:12,470 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=58 updating hbase:meta row=e2d26928a79bc451f2d14aec9f529adf, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,39199,1689390651299 2023-07-15 03:12:12,470 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=59 updating hbase:meta row=69b083820c2a58813f79ecd7d05b8ee7, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,38367,1689390651355 2023-07-15 03:12:12,471 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1689390732199.e2d26928a79bc451f2d14aec9f529adf.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689390732470"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689390732470"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689390732470"}]},"ts":"1689390732470"} 2023-07-15 03:12:12,471 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1689390732199.69b083820c2a58813f79ecd7d05b8ee7.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689390732470"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689390732470"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689390732470"}]},"ts":"1689390732470"} 2023-07-15 03:12:12,477 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=60, ppid=58, state=RUNNABLE; OpenRegionProcedure e2d26928a79bc451f2d14aec9f529adf, server=jenkins-hbase4.apache.org,39199,1689390651299}] 2023-07-15 03:12:12,479 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=61, ppid=59, state=RUNNABLE; OpenRegionProcedure 69b083820c2a58813f79ecd7d05b8ee7, server=jenkins-hbase4.apache.org,38367,1689390651355}] 2023-07-15 03:12:12,508 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41669] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-07-15 03:12:12,635 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion,,1689390732199.e2d26928a79bc451f2d14aec9f529adf. 2023-07-15 03:12:12,635 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => e2d26928a79bc451f2d14aec9f529adf, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,,1689390732199.e2d26928a79bc451f2d14aec9f529adf.', STARTKEY => '', ENDKEY => '1'} 2023-07-15 03:12:12,635 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion,,1689390732199.e2d26928a79bc451f2d14aec9f529adf. service=AccessControlService 2023-07-15 03:12:12,636 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-15 03:12:12,636 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion e2d26928a79bc451f2d14aec9f529adf 2023-07-15 03:12:12,636 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,,1689390732199.e2d26928a79bc451f2d14aec9f529adf.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-15 03:12:12,636 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for e2d26928a79bc451f2d14aec9f529adf 2023-07-15 03:12:12,636 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for e2d26928a79bc451f2d14aec9f529adf 2023-07-15 03:12:12,638 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion,1,1689390732199.69b083820c2a58813f79ecd7d05b8ee7. 2023-07-15 03:12:12,638 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 69b083820c2a58813f79ecd7d05b8ee7, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,1,1689390732199.69b083820c2a58813f79ecd7d05b8ee7.', STARTKEY => '1', ENDKEY => ''} 2023-07-15 03:12:12,639 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion,1,1689390732199.69b083820c2a58813f79ecd7d05b8ee7. service=AccessControlService 2023-07-15 03:12:12,639 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-15 03:12:12,639 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion 69b083820c2a58813f79ecd7d05b8ee7 2023-07-15 03:12:12,639 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,1,1689390732199.69b083820c2a58813f79ecd7d05b8ee7.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-15 03:12:12,639 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 69b083820c2a58813f79ecd7d05b8ee7 2023-07-15 03:12:12,639 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 69b083820c2a58813f79ecd7d05b8ee7 2023-07-15 03:12:12,640 INFO [StoreOpener-e2d26928a79bc451f2d14aec9f529adf-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region e2d26928a79bc451f2d14aec9f529adf 2023-07-15 03:12:12,647 DEBUG [StoreOpener-e2d26928a79bc451f2d14aec9f529adf-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/data/default/testtb-testExportFileSystemStateWithMergeRegion/e2d26928a79bc451f2d14aec9f529adf/cf 2023-07-15 03:12:12,648 DEBUG [StoreOpener-e2d26928a79bc451f2d14aec9f529adf-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/data/default/testtb-testExportFileSystemStateWithMergeRegion/e2d26928a79bc451f2d14aec9f529adf/cf 2023-07-15 03:12:12,650 INFO [StoreOpener-e2d26928a79bc451f2d14aec9f529adf-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e2d26928a79bc451f2d14aec9f529adf columnFamilyName cf 2023-07-15 03:12:12,660 INFO [StoreOpener-e2d26928a79bc451f2d14aec9f529adf-1] regionserver.HStore(310): Store=e2d26928a79bc451f2d14aec9f529adf/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-15 03:12:12,662 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/data/default/testtb-testExportFileSystemStateWithMergeRegion/e2d26928a79bc451f2d14aec9f529adf 2023-07-15 03:12:12,662 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/data/default/testtb-testExportFileSystemStateWithMergeRegion/e2d26928a79bc451f2d14aec9f529adf 2023-07-15 03:12:12,663 INFO [StoreOpener-69b083820c2a58813f79ecd7d05b8ee7-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 69b083820c2a58813f79ecd7d05b8ee7 2023-07-15 03:12:12,664 DEBUG [StoreOpener-69b083820c2a58813f79ecd7d05b8ee7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/data/default/testtb-testExportFileSystemStateWithMergeRegion/69b083820c2a58813f79ecd7d05b8ee7/cf 2023-07-15 03:12:12,664 DEBUG [StoreOpener-69b083820c2a58813f79ecd7d05b8ee7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/data/default/testtb-testExportFileSystemStateWithMergeRegion/69b083820c2a58813f79ecd7d05b8ee7/cf 2023-07-15 03:12:12,665 INFO [StoreOpener-69b083820c2a58813f79ecd7d05b8ee7-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 69b083820c2a58813f79ecd7d05b8ee7 columnFamilyName cf 2023-07-15 03:12:12,666 INFO [StoreOpener-69b083820c2a58813f79ecd7d05b8ee7-1] regionserver.HStore(310): Store=69b083820c2a58813f79ecd7d05b8ee7/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-15 03:12:12,666 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for e2d26928a79bc451f2d14aec9f529adf 2023-07-15 03:12:12,668 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/data/default/testtb-testExportFileSystemStateWithMergeRegion/69b083820c2a58813f79ecd7d05b8ee7 2023-07-15 03:12:12,669 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/data/default/testtb-testExportFileSystemStateWithMergeRegion/69b083820c2a58813f79ecd7d05b8ee7 2023-07-15 03:12:12,672 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 69b083820c2a58813f79ecd7d05b8ee7 2023-07-15 03:12:12,683 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/data/default/testtb-testExportFileSystemStateWithMergeRegion/e2d26928a79bc451f2d14aec9f529adf/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-15 03:12:12,684 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened e2d26928a79bc451f2d14aec9f529adf; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74160489, jitterRate=0.10507740080356598}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-15 03:12:12,684 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for e2d26928a79bc451f2d14aec9f529adf: 2023-07-15 03:12:12,685 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/data/default/testtb-testExportFileSystemStateWithMergeRegion/69b083820c2a58813f79ecd7d05b8ee7/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-15 03:12:12,686 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 69b083820c2a58813f79ecd7d05b8ee7; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68810995, jitterRate=0.025363728404045105}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-15 03:12:12,686 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion,,1689390732199.e2d26928a79bc451f2d14aec9f529adf., pid=60, masterSystemTime=1689390732631 2023-07-15 03:12:12,686 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 69b083820c2a58813f79ecd7d05b8ee7: 2023-07-15 03:12:12,688 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion,,1689390732199.e2d26928a79bc451f2d14aec9f529adf. 2023-07-15 03:12:12,688 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion,,1689390732199.e2d26928a79bc451f2d14aec9f529adf. 2023-07-15 03:12:12,688 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion,1,1689390732199.69b083820c2a58813f79ecd7d05b8ee7., pid=61, masterSystemTime=1689390732632 2023-07-15 03:12:12,689 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=58 updating hbase:meta row=e2d26928a79bc451f2d14aec9f529adf, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,39199,1689390651299 2023-07-15 03:12:12,689 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1689390732199.e2d26928a79bc451f2d14aec9f529adf.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689390732689"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689390732689"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689390732689"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689390732689"}]},"ts":"1689390732689"} 2023-07-15 03:12:12,690 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion,1,1689390732199.69b083820c2a58813f79ecd7d05b8ee7. 2023-07-15 03:12:12,690 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion,1,1689390732199.69b083820c2a58813f79ecd7d05b8ee7. 2023-07-15 03:12:12,692 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=59 updating hbase:meta row=69b083820c2a58813f79ecd7d05b8ee7, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,38367,1689390651355 2023-07-15 03:12:12,692 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1689390732199.69b083820c2a58813f79ecd7d05b8ee7.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689390732692"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689390732692"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689390732692"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689390732692"}]},"ts":"1689390732692"} 2023-07-15 03:12:12,706 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=60, resume processing ppid=58 2023-07-15 03:12:12,706 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=60, ppid=58, state=SUCCESS; OpenRegionProcedure e2d26928a79bc451f2d14aec9f529adf, server=jenkins-hbase4.apache.org,39199,1689390651299 in 215 msec 2023-07-15 03:12:12,708 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=61, resume processing ppid=59 2023-07-15 03:12:12,708 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=61, ppid=59, state=SUCCESS; OpenRegionProcedure 69b083820c2a58813f79ecd7d05b8ee7, server=jenkins-hbase4.apache.org,38367,1689390651355 in 225 msec 2023-07-15 03:12:12,709 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=58, ppid=57, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=e2d26928a79bc451f2d14aec9f529adf, ASSIGN in 394 msec 2023-07-15 03:12:12,710 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=59, resume processing ppid=57 2023-07-15 03:12:12,710 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=59, ppid=57, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=69b083820c2a58813f79ecd7d05b8ee7, ASSIGN in 396 msec 2023-07-15 03:12:12,711 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-15 03:12:12,711 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689390732711"}]},"ts":"1689390732711"} 2023-07-15 03:12:12,713 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=ENABLED in hbase:meta 2023-07-15 03:12:12,715 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_POST_OPERATION 2023-07-15 03:12:12,716 DEBUG [PEWorker-4] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemStateWithMergeRegion jenkins: RWXCA 2023-07-15 03:12:12,718 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=39199] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion], kv [jenkins: RWXCA] 2023-07-15 03:12:12,723 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): master:41669-0x10166f610e80000, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-15 03:12:12,723 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): regionserver:38367-0x10166f610e80003, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-15 03:12:12,723 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): regionserver:39199-0x10166f610e80002, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-15 03:12:12,723 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): regionserver:43199-0x10166f610e80001, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-15 03:12:12,726 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-15 03:12:12,727 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-15 03:12:12,727 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-15 03:12:12,727 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-15 03:12:12,729 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=57, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion in 526 msec 2023-07-15 03:12:12,811 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41669] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-07-15 03:12:12,812 INFO [Listener at jenkins-hbase4.apache.org/44817] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion, procId: 57 completed 2023-07-15 03:12:12,812 DEBUG [Listener at jenkins-hbase4.apache.org/44817] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testtb-testExportFileSystemStateWithMergeRegion get assigned. Timeout = 60000ms 2023-07-15 03:12:12,812 INFO [Listener at jenkins-hbase4.apache.org/44817] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-15 03:12:12,816 INFO [Listener at jenkins-hbase4.apache.org/44817] hbase.HBaseTestingUtility(3484): All regions for table testtb-testExportFileSystemStateWithMergeRegion assigned to meta. Checking AM states. 2023-07-15 03:12:12,816 INFO [Listener at jenkins-hbase4.apache.org/44817] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-15 03:12:12,816 INFO [Listener at jenkins-hbase4.apache.org/44817] hbase.HBaseTestingUtility(3504): All regions for table testtb-testExportFileSystemStateWithMergeRegion assigned. 2023-07-15 03:12:12,820 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41669] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-15 03:12:12,820 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41669] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689390732820 (current time:1689390732820). 2023-07-15 03:12:12,820 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41669] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-15 03:12:12,820 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41669] zookeeper.ReadOnlyZKClient(139): Connect 0x1478d7ee to 127.0.0.1:62663 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-15 03:12:12,829 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41669] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@293bc37, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-15 03:12:12,831 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41669] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-15 03:12:12,832 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:60116, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-15 03:12:12,834 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41669] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1478d7ee to 127.0.0.1:62663 2023-07-15 03:12:12,834 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41669] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-15 03:12:12,834 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41669] zookeeper.ReadOnlyZKClient(139): Connect 0x7d1b5489 to 127.0.0.1:62663 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-15 03:12:12,855 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41669] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2f0e2b63, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-15 03:12:12,946 DEBUG [hconnection-0x30e358b1-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-15 03:12:12,951 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:60124, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-15 03:12:12,957 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41669] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-15 03:12:12,961 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:53224, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-15 03:12:12,962 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41669] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7d1b5489 to 127.0.0.1:62663 2023-07-15 03:12:12,962 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41669] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-15 03:12:12,962 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41669] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion], kv [jenkins: RWXCA] 2023-07-15 03:12:12,964 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41669] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-15 03:12:12,964 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41669] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-15 03:12:12,967 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41669] procedure2.ProcedureExecutor(1029): Stored pid=62, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-15 03:12:12,968 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=62, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-15 03:12:12,969 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=62, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE; timeout=600000, timestamp=1689391332969 2023-07-15 03:12:12,969 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41669] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-15 03:12:12,969 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion 2023-07-15 03:12:12,972 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=63, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-15 03:12:12,972 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=62, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-15 03:12:12,972 DEBUG [Listener at jenkins-hbase4.apache.org/44817] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-15 03:12:12,973 DEBUG [Listener at jenkins-hbase4.apache.org/44817] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-15 03:12:12,974 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=62, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE in 7 msec 2023-07-15 03:12:12,975 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=63, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-15 03:12:12,976 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=63, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED; timeout=600000, timestamp=1689391332976 2023-07-15 03:12:12,990 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 03:12:12,990 INFO [(jenkins-hbase4.apache.org,41669,1689390649760)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' 2023-07-15 03:12:12,990 DEBUG [(jenkins-hbase4.apache.org,41669,1689390649760)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-15 03:12:12,992 DEBUG [(jenkins-hbase4.apache.org,41669,1689390649760)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' 2023-07-15 03:12:12,992 DEBUG [(jenkins-hbase4.apache.org,41669,1689390649760)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion', kicking off acquire phase on members. 2023-07-15 03:12:12,992 DEBUG [(jenkins-hbase4.apache.org,41669,1689390649760)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41669-0x10166f610e80000, quorum=127.0.0.1:62663, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 03:12:12,993 DEBUG [(jenkins-hbase4.apache.org,41669,1689390649760)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 03:12:12,994 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): regionserver:43199-0x10166f610e80001, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 03:12:12,994 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): regionserver:39199-0x10166f610e80002, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 03:12:12,994 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 03:12:12,994 DEBUG [(jenkins-hbase4.apache.org,41669,1689390649760)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,38367,1689390651355 2023-07-15 03:12:12,994 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): regionserver:38367-0x10166f610e80003, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 03:12:12,994 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 03:12:12,994 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 03:12:12,994 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 03:12:12,994 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 03:12:12,995 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 03:12:12,995 DEBUG [(jenkins-hbase4.apache.org,41669,1689390649760)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41669-0x10166f610e80000, quorum=127.0.0.1:62663, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,38367,1689390651355 2023-07-15 03:12:12,995 DEBUG [(jenkins-hbase4.apache.org,41669,1689390649760)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39199,1689390651299 2023-07-15 03:12:12,995 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 03:12:12,995 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 03:12:12,995 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 03:12:12,995 DEBUG [(jenkins-hbase4.apache.org,41669,1689390649760)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41669-0x10166f610e80000, quorum=127.0.0.1:62663, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39199,1689390651299 2023-07-15 03:12:12,995 DEBUG [(jenkins-hbase4.apache.org,41669,1689390649760)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-15 03:12:12,995 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39199-0x10166f610e80002, quorum=127.0.0.1:62663, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 03:12:12,995 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43199-0x10166f610e80001, quorum=127.0.0.1:62663, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 03:12:12,996 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38367-0x10166f610e80003, quorum=127.0.0.1:62663, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 03:12:12,996 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 219 2023-07-15 03:12:12,996 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 03:12:12,996 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 219 2023-07-15 03:12:12,996 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 219 2023-07-15 03:12:12,996 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-15 03:12:12,996 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 03:12:12,996 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 03:12:12,996 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-15 03:12:12,996 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 03:12:12,996 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-15 03:12:12,996 DEBUG [member: 'jenkins-hbase4.apache.org,39199,1689390651299' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-15 03:12:12,997 DEBUG [member: 'jenkins-hbase4.apache.org,39199,1689390651299' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-15 03:12:13,000 DEBUG [member: 'jenkins-hbase4.apache.org,39199,1689390651299' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-15 03:12:13,000 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 03:12:13,000 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 03:12:13,000 DEBUG [member: 'jenkins-hbase4.apache.org,38367,1689390651355' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-15 03:12:13,000 DEBUG [member: 'jenkins-hbase4.apache.org,43199,1689390651225' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-15 03:12:13,000 DEBUG [member: 'jenkins-hbase4.apache.org,43199,1689390651225' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-15 03:12:13,000 DEBUG [member: 'jenkins-hbase4.apache.org,39199,1689390651299' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-15 03:12:13,000 DEBUG [member: 'jenkins-hbase4.apache.org,38367,1689390651355' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-15 03:12:13,000 DEBUG [member: 'jenkins-hbase4.apache.org,39199,1689390651299' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39199,1689390651299' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-15 03:12:13,003 DEBUG [member: 'jenkins-hbase4.apache.org,43199,1689390651225' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-15 03:12:13,003 DEBUG [member: 'jenkins-hbase4.apache.org,43199,1689390651225' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-15 03:12:13,003 DEBUG [member: 'jenkins-hbase4.apache.org,38367,1689390651355' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-15 03:12:13,003 DEBUG [member: 'jenkins-hbase4.apache.org,38367,1689390651355' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-15 03:12:13,003 DEBUG [member: 'jenkins-hbase4.apache.org,38367,1689390651355' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38367,1689390651355' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-15 03:12:13,003 DEBUG [member: 'jenkins-hbase4.apache.org,43199,1689390651225' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43199,1689390651225' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-15 03:12:13,003 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): master:41669-0x10166f610e80000, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39199,1689390651299 2023-07-15 03:12:13,003 DEBUG [member: 'jenkins-hbase4.apache.org,39199,1689390651299' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 03:12:13,003 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39199,1689390651299 2023-07-15 03:12:13,003 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 03:12:13,003 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 03:12:13,009 DEBUG [member: 'jenkins-hbase4.apache.org,39199,1689390651299' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39199-0x10166f610e80002, quorum=127.0.0.1:62663, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 03:12:13,009 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 03:12:13,009 DEBUG [member: 'jenkins-hbase4.apache.org,39199,1689390651299' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-15 03:12:13,010 DEBUG [member: 'jenkins-hbase4.apache.org,38367,1689390651355' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 03:12:13,010 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 03:12:13,010 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): master:41669-0x10166f610e80000, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,38367,1689390651355 2023-07-15 03:12:13,012 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 03:12:13,012 DEBUG [member: 'jenkins-hbase4.apache.org,38367,1689390651355' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38367-0x10166f610e80003, quorum=127.0.0.1:62663, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 03:12:13,012 DEBUG [member: 'jenkins-hbase4.apache.org,38367,1689390651355' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-15 03:12:13,012 DEBUG [member: 'jenkins-hbase4.apache.org,43199,1689390651225' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 03:12:13,012 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43199,1689390651225 2023-07-15 03:12:13,012 DEBUG [member: 'jenkins-hbase4.apache.org,43199,1689390651225' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43199-0x10166f610e80001, quorum=127.0.0.1:62663, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 03:12:13,012 DEBUG [member: 'jenkins-hbase4.apache.org,43199,1689390651225' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-15 03:12:13,012 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39199,1689390651299 2023-07-15 03:12:13,013 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38367,1689390651355 2023-07-15 03:12:13,013 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 03:12:13,013 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39199,1689390651299' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-07-15 03:12:13,014 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5c61300c[Count = 1] remaining members to acquire global barrier 2023-07-15 03:12:13,014 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,38367,1689390651355 2023-07-15 03:12:13,014 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 03:12:13,014 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 03:12:13,014 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 03:12:13,014 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 03:12:13,016 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 03:12:13,017 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43199,1689390651225 2023-07-15 03:12:13,017 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39199,1689390651299 2023-07-15 03:12:13,017 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38367,1689390651355 2023-07-15 03:12:13,018 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 03:12:13,018 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,38367,1689390651355' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-07-15 03:12:13,018 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5c61300c[Count = 0] remaining members to acquire global barrier 2023-07-15 03:12:13,018 DEBUG [(jenkins-hbase4.apache.org,41669,1689390649760)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'in-barrier' execution. 2023-07-15 03:12:13,018 DEBUG [(jenkins-hbase4.apache.org,41669,1689390649760)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 03:12:13,019 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): regionserver:39199-0x10166f610e80002, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 03:12:13,020 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): regionserver:43199-0x10166f610e80001, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 03:12:13,020 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 03:12:13,020 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 03:12:13,020 DEBUG [member: 'jenkins-hbase4.apache.org,39199,1689390651299' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-15 03:12:13,020 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): regionserver:38367-0x10166f610e80003, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 03:12:13,020 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 03:12:13,020 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 03:12:13,020 DEBUG [member: 'jenkins-hbase4.apache.org,43199,1689390651225' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-15 03:12:13,020 DEBUG [member: 'jenkins-hbase4.apache.org,43199,1689390651225' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-15 03:12:13,020 DEBUG [rs(jenkins-hbase4.apache.org,39199,1689390651299)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1689390732199.e2d26928a79bc451f2d14aec9f529adf. 2023-07-15 03:12:13,020 DEBUG [member: 'jenkins-hbase4.apache.org,43199,1689390651225' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,43199,1689390651225' in zk 2023-07-15 03:12:13,020 DEBUG [(jenkins-hbase4.apache.org,41669,1689390649760)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41669-0x10166f610e80000, quorum=127.0.0.1:62663, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39199,1689390651299 2023-07-15 03:12:13,020 DEBUG [member: 'jenkins-hbase4.apache.org,39199,1689390651299' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-15 03:12:13,020 DEBUG [member: 'jenkins-hbase4.apache.org,39199,1689390651299' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-15 03:12:13,020 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 03:12:13,020 DEBUG [rs(jenkins-hbase4.apache.org,39199,1689390651299)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1689390732199.e2d26928a79bc451f2d14aec9f529adf. started... 2023-07-15 03:12:13,021 DEBUG [(jenkins-hbase4.apache.org,41669,1689390649760)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41669-0x10166f610e80000, quorum=127.0.0.1:62663, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,38367,1689390651355 2023-07-15 03:12:13,021 DEBUG [(jenkins-hbase4.apache.org,41669,1689390649760)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-15 03:12:13,020 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 03:12:13,023 DEBUG [rs(jenkins-hbase4.apache.org,39199,1689390651299)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for e2d26928a79bc451f2d14aec9f529adf: 2023-07-15 03:12:13,023 DEBUG [member: 'jenkins-hbase4.apache.org,38367,1689390651355' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-15 03:12:13,024 DEBUG [rs(jenkins-hbase4.apache.org,39199,1689390651299)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,,1689390732199.e2d26928a79bc451f2d14aec9f529adf.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 03:12:13,024 DEBUG [rs(jenkins-hbase4.apache.org,39199,1689390651299)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-15 03:12:13,024 DEBUG [rs(jenkins-hbase4.apache.org,39199,1689390651299)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-15 03:12:13,027 DEBUG [member: 'jenkins-hbase4.apache.org,38367,1689390651355' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-15 03:12:13,027 DEBUG [member: 'jenkins-hbase4.apache.org,38367,1689390651355' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-15 03:12:13,027 DEBUG [rs(jenkins-hbase4.apache.org,38367,1689390651355)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1689390732199.69b083820c2a58813f79ecd7d05b8ee7. 2023-07-15 03:12:13,027 DEBUG [rs(jenkins-hbase4.apache.org,38367,1689390651355)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1689390732199.69b083820c2a58813f79ecd7d05b8ee7. started... 2023-07-15 03:12:13,029 DEBUG [rs(jenkins-hbase4.apache.org,38367,1689390651355)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 69b083820c2a58813f79ecd7d05b8ee7: 2023-07-15 03:12:13,030 DEBUG [rs(jenkins-hbase4.apache.org,38367,1689390651355)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,1,1689390732199.69b083820c2a58813f79ecd7d05b8ee7.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 03:12:13,030 DEBUG [rs(jenkins-hbase4.apache.org,38367,1689390651355)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-15 03:12:13,030 DEBUG [rs(jenkins-hbase4.apache.org,38367,1689390651355)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-15 03:12:13,031 DEBUG [member: 'jenkins-hbase4.apache.org,43199,1689390651225' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-15 03:12:13,031 DEBUG [member: 'jenkins-hbase4.apache.org,43199,1689390651225' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-15 03:12:13,031 DEBUG [member: 'jenkins-hbase4.apache.org,43199,1689390651225' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-15 03:12:13,054 DEBUG [rs(jenkins-hbase4.apache.org,38367,1689390651355)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1689390732199.69b083820c2a58813f79ecd7d05b8ee7. completed. 2023-07-15 03:12:13,054 DEBUG [rs(jenkins-hbase4.apache.org,38367,1689390651355)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1689390732199.69b083820c2a58813f79ecd7d05b8ee7. 2023-07-15 03:12:13,054 DEBUG [member: 'jenkins-hbase4.apache.org,38367,1689390651355' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-15 03:12:13,055 DEBUG [member: 'jenkins-hbase4.apache.org,38367,1689390651355' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-15 03:12:13,055 DEBUG [member: 'jenkins-hbase4.apache.org,38367,1689390651355' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,38367,1689390651355 2023-07-15 03:12:13,055 DEBUG [member: 'jenkins-hbase4.apache.org,38367,1689390651355' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-15 03:12:13,055 DEBUG [member: 'jenkins-hbase4.apache.org,38367,1689390651355' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,38367,1689390651355' in zk 2023-07-15 03:12:13,057 DEBUG [rs(jenkins-hbase4.apache.org,39199,1689390651299)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1689390732199.e2d26928a79bc451f2d14aec9f529adf. completed. 2023-07-15 03:12:13,057 DEBUG [rs(jenkins-hbase4.apache.org,39199,1689390651299)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1689390732199.e2d26928a79bc451f2d14aec9f529adf. 2023-07-15 03:12:13,057 DEBUG [member: 'jenkins-hbase4.apache.org,39199,1689390651299' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-15 03:12:13,057 DEBUG [member: 'jenkins-hbase4.apache.org,39199,1689390651299' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-15 03:12:13,057 DEBUG [member: 'jenkins-hbase4.apache.org,39199,1689390651299' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,39199,1689390651299 2023-07-15 03:12:13,057 DEBUG [member: 'jenkins-hbase4.apache.org,39199,1689390651299' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-15 03:12:13,057 DEBUG [member: 'jenkins-hbase4.apache.org,39199,1689390651299' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,39199,1689390651299' in zk 2023-07-15 03:12:13,057 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): master:41669-0x10166f610e80000, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,38367,1689390651355 2023-07-15 03:12:13,057 DEBUG [member: 'jenkins-hbase4.apache.org,38367,1689390651355' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-15 03:12:13,057 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,38367,1689390651355 2023-07-15 03:12:13,058 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 03:12:13,058 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 03:12:13,057 DEBUG [member: 'jenkins-hbase4.apache.org,38367,1689390651355' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-15 03:12:13,058 DEBUG [member: 'jenkins-hbase4.apache.org,38367,1689390651355' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-15 03:12:13,060 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): master:41669-0x10166f610e80000, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39199,1689390651299 2023-07-15 03:12:13,060 DEBUG [member: 'jenkins-hbase4.apache.org,39199,1689390651299' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-15 03:12:13,060 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 03:12:13,060 DEBUG [member: 'jenkins-hbase4.apache.org,39199,1689390651299' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-15 03:12:13,060 DEBUG [member: 'jenkins-hbase4.apache.org,39199,1689390651299' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-15 03:12:13,061 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 03:12:13,061 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 03:12:13,062 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43199,1689390651225 2023-07-15 03:12:13,062 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39199,1689390651299 2023-07-15 03:12:13,062 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38367,1689390651355 2023-07-15 03:12:13,062 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 03:12:13,063 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 03:12:13,063 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43199,1689390651225 2023-07-15 03:12:13,063 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39199,1689390651299 2023-07-15 03:12:13,063 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38367,1689390651355 2023-07-15 03:12:13,064 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,38367,1689390651355': 2023-07-15 03:12:13,064 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,38367,1689390651355' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 1 more 2023-07-15 03:12:13,064 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39199,1689390651299 2023-07-15 03:12:13,064 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 03:12:13,064 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 03:12:13,065 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 03:12:13,066 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 03:12:13,066 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 03:12:13,067 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43199,1689390651225 2023-07-15 03:12:13,067 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39199,1689390651299 2023-07-15 03:12:13,067 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38367,1689390651355 2023-07-15 03:12:13,068 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 03:12:13,068 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 03:12:13,068 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43199,1689390651225 2023-07-15 03:12:13,069 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39199,1689390651299 2023-07-15 03:12:13,069 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38367,1689390651355 2023-07-15 03:12:13,073 DEBUG [Listener at jenkins-hbase4.apache.org/44817] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-15 03:12:13,073 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,39199,1689390651299': 2023-07-15 03:12:13,074 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39199,1689390651299' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 0 more 2023-07-15 03:12:13,074 INFO [(jenkins-hbase4.apache.org,41669,1689390649760)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' execution completed 2023-07-15 03:12:13,074 DEBUG [(jenkins-hbase4.apache.org,41669,1689390649760)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-15 03:12:13,074 DEBUG [(jenkins-hbase4.apache.org,41669,1689390649760)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-15 03:12:13,074 DEBUG [(jenkins-hbase4.apache.org,41669,1689390649760)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 03:12:13,074 INFO [(jenkins-hbase4.apache.org,41669,1689390649760)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportFileSystemStateWithMergeRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-15 03:12:13,074 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41669] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-15 03:12:13,074 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41669] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-07-15 03:12:13,074 DEBUG [Listener at jenkins-hbase4.apache.org/44817] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-15 03:12:13,076 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): regionserver:43199-0x10166f610e80001, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 03:12:13,076 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): regionserver:43199-0x10166f610e80001, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 03:12:13,076 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): regionserver:38367-0x10166f610e80003, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 03:12:13,076 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 03:12:13,076 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 03:12:13,076 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 03:12:13,076 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): regionserver:38367-0x10166f610e80003, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 03:12:13,076 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): master:41669-0x10166f610e80000, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 03:12:13,076 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 03:12:13,077 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): regionserver:39199-0x10166f610e80002, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 03:12:13,077 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 03:12:13,077 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 03:12:13,077 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 03:12:13,077 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): regionserver:39199-0x10166f610e80002, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 03:12:13,077 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 03:12:13,077 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 03:12:13,077 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 03:12:13,077 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 03:12:13,077 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 03:12:13,077 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 03:12:13,079 DEBUG [(jenkins-hbase4.apache.org,41669,1689390649760)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41669-0x10166f610e80000, quorum=127.0.0.1:62663, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43199,1689390651225 2023-07-15 03:12:13,084 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 03:12:13,084 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 03:12:13,084 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 03:12:13,084 DEBUG [(jenkins-hbase4.apache.org,41669,1689390649760)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41669-0x10166f610e80000, quorum=127.0.0.1:62663, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39199,1689390651299 2023-07-15 03:12:13,084 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 03:12:13,084 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 03:12:13,084 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 03:12:13,085 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 03:12:13,085 DEBUG [(jenkins-hbase4.apache.org,41669,1689390649760)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41669-0x10166f610e80000, quorum=127.0.0.1:62663, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,38367,1689390651355 2023-07-15 03:12:13,085 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 03:12:13,086 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 03:12:13,086 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43199,1689390651225 2023-07-15 03:12:13,087 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39199,1689390651299 2023-07-15 03:12:13,087 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38367,1689390651355 2023-07-15 03:12:13,087 DEBUG [(jenkins-hbase4.apache.org,41669,1689390649760)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41669-0x10166f610e80000, quorum=127.0.0.1:62663, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43199,1689390651225 2023-07-15 03:12:13,088 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 03:12:13,088 DEBUG [(jenkins-hbase4.apache.org,41669,1689390649760)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41669-0x10166f610e80000, quorum=127.0.0.1:62663, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39199,1689390651299 2023-07-15 03:12:13,089 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 03:12:13,089 DEBUG [(jenkins-hbase4.apache.org,41669,1689390649760)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41669-0x10166f610e80000, quorum=127.0.0.1:62663, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,38367,1689390651355 2023-07-15 03:12:13,089 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43199,1689390651225 2023-07-15 03:12:13,089 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39199,1689390651299 2023-07-15 03:12:13,090 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38367,1689390651355 2023-07-15 03:12:13,093 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): regionserver:43199-0x10166f610e80001, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 03:12:13,093 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): regionserver:43199-0x10166f610e80001, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 03:12:13,093 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): regionserver:38367-0x10166f610e80003, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 03:12:13,093 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 03:12:13,093 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 03:12:13,093 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): regionserver:38367-0x10166f610e80003, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 03:12:13,093 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 03:12:13,093 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 03:12:13,093 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): regionserver:39199-0x10166f610e80002, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 03:12:13,093 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): master:41669-0x10166f610e80000, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,38367,1689390651355 2023-07-15 03:12:13,093 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 03:12:13,093 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): master:41669-0x10166f610e80000, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 03:12:13,093 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): regionserver:39199-0x10166f610e80002, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 03:12:13,094 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 03:12:13,094 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 03:12:13,094 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 03:12:13,094 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): master:41669-0x10166f610e80000, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39199,1689390651299 2023-07-15 03:12:13,093 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 03:12:13,094 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): master:41669-0x10166f610e80000, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43199,1689390651225 2023-07-15 03:12:13,094 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): master:41669-0x10166f610e80000, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 03:12:13,094 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): master:41669-0x10166f610e80000, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,38367,1689390651355 2023-07-15 03:12:13,094 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): master:41669-0x10166f610e80000, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 03:12:13,094 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): master:41669-0x10166f610e80000, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39199,1689390651299 2023-07-15 03:12:13,094 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): master:41669-0x10166f610e80000, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43199,1689390651225 2023-07-15 03:12:13,094 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): master:41669-0x10166f610e80000, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 03:12:13,094 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 03:12:13,094 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 03:12:13,094 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 03:12:13,096 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): master:41669-0x10166f610e80000, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 03:12:13,096 DEBUG [(jenkins-hbase4.apache.org,41669,1689390649760)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-15 03:12:13,096 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 03:12:13,096 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 03:12:13,103 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 03:12:13,165 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion to hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/.hbase-snapshot/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 03:12:13,226 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed 2023-07-15 03:12:13,227 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 03:12:13,227 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 03:12:13,227 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion at 1689390732970Consolidate snapshot: emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1689390733096 (+126 ms)Loading Region manifests for emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1689390733096Writing data manifest for emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1689390733114 (+18 ms)Verifying snapshot: emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1689390733136 (+22 ms)Snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed at 1689390733226 (+90 ms) 2023-07-15 03:12:13,231 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=63, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-15 03:12:13,234 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=63, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED in 260 msec 2023-07-15 03:12:13,274 DEBUG [Listener at jenkins-hbase4.apache.org/44817] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-15 03:12:13,279 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41669] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-15 03:12:13,279 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41669] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-15 03:12:13,298 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39199] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithMergeRegion,,1689390732199.e2d26928a79bc451f2d14aec9f529adf. with WAL disabled. Data may be lost in the event of a crash. 2023-07-15 03:12:13,302 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38367] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithMergeRegion,1,1689390732199.69b083820c2a58813f79ecd7d05b8ee7. with WAL disabled. Data may be lost in the event of a crash. 2023-07-15 03:12:13,307 DEBUG [Listener at jenkins-hbase4.apache.org/44817] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithMergeRegion 2023-07-15 03:12:13,307 DEBUG [Listener at jenkins-hbase4.apache.org/44817] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithMergeRegion,,1689390732199.e2d26928a79bc451f2d14aec9f529adf. 2023-07-15 03:12:13,307 INFO [Listener at jenkins-hbase4.apache.org/44817] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-15 03:12:13,323 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41669] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-15 03:12:13,323 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41669] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689390733323 (current time:1689390733323). 2023-07-15 03:12:13,323 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41669] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-15 03:12:13,324 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41669] zookeeper.ReadOnlyZKClient(139): Connect 0x08bd75a3 to 127.0.0.1:62663 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-15 03:12:13,344 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41669] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@416325d0, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-15 03:12:13,345 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41669] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-15 03:12:13,349 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:60126, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-15 03:12:13,350 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41669] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x08bd75a3 to 127.0.0.1:62663 2023-07-15 03:12:13,350 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41669] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-15 03:12:13,350 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41669] zookeeper.ReadOnlyZKClient(139): Connect 0x4423a4aa to 127.0.0.1:62663 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-15 03:12:13,358 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41669] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2750c1e0, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-15 03:12:13,359 DEBUG [hconnection-0x7fc53d7f-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-15 03:12:13,363 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:60140, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-15 03:12:13,367 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41669] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-15 03:12:13,370 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:53230, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-15 03:12:13,371 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41669] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4423a4aa to 127.0.0.1:62663 2023-07-15 03:12:13,371 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41669] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-15 03:12:13,372 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41669] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion], kv [jenkins: RWXCA] 2023-07-15 03:12:13,372 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41669] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-15 03:12:13,373 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41669] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-15 03:12:13,376 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41669] procedure2.ProcedureExecutor(1029): Stored pid=64, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-15 03:12:13,377 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=64, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-15 03:12:13,377 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=64, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE; timeout=600000, timestamp=1689391333377 2023-07-15 03:12:13,378 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41669] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-15 03:12:13,378 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion 2023-07-15 03:12:13,379 DEBUG [Listener at jenkins-hbase4.apache.org/44817] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-15 03:12:13,380 DEBUG [Listener at jenkins-hbase4.apache.org/44817] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-15 03:12:13,383 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=64, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-15 03:12:13,383 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=65, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-15 03:12:13,384 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=64, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE in 9 msec 2023-07-15 03:12:13,385 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=65, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-15 03:12:13,386 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=65, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED; timeout=600000, timestamp=1689391333386 2023-07-15 03:12:13,418 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 03:12:13,418 INFO [(jenkins-hbase4.apache.org,41669,1689390649760)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' 2023-07-15 03:12:13,418 DEBUG [(jenkins-hbase4.apache.org,41669,1689390649760)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-15 03:12:13,420 DEBUG [(jenkins-hbase4.apache.org,41669,1689390649760)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' 2023-07-15 03:12:13,420 DEBUG [(jenkins-hbase4.apache.org,41669,1689390649760)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion', kicking off acquire phase on members. 2023-07-15 03:12:13,421 DEBUG [(jenkins-hbase4.apache.org,41669,1689390649760)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41669-0x10166f610e80000, quorum=127.0.0.1:62663, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 03:12:13,421 DEBUG [(jenkins-hbase4.apache.org,41669,1689390649760)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 03:12:13,422 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): regionserver:38367-0x10166f610e80003, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 03:12:13,422 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 03:12:13,423 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): regionserver:39199-0x10166f610e80002, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 03:12:13,423 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): regionserver:43199-0x10166f610e80001, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 03:12:13,423 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 03:12:13,423 DEBUG [(jenkins-hbase4.apache.org,41669,1689390649760)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,38367,1689390651355 2023-07-15 03:12:13,423 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 03:12:13,423 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 03:12:13,423 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 03:12:13,423 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 03:12:13,423 DEBUG [(jenkins-hbase4.apache.org,41669,1689390649760)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41669-0x10166f610e80000, quorum=127.0.0.1:62663, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,38367,1689390651355 2023-07-15 03:12:13,423 DEBUG [(jenkins-hbase4.apache.org,41669,1689390649760)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39199,1689390651299 2023-07-15 03:12:13,423 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 03:12:13,423 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 03:12:13,423 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 03:12:13,424 DEBUG [(jenkins-hbase4.apache.org,41669,1689390649760)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41669-0x10166f610e80000, quorum=127.0.0.1:62663, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39199,1689390651299 2023-07-15 03:12:13,424 DEBUG [(jenkins-hbase4.apache.org,41669,1689390649760)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-15 03:12:13,424 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39199-0x10166f610e80002, quorum=127.0.0.1:62663, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 03:12:13,424 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38367-0x10166f610e80003, quorum=127.0.0.1:62663, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 03:12:13,424 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43199-0x10166f610e80001, quorum=127.0.0.1:62663, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 03:12:13,424 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 214 2023-07-15 03:12:13,424 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 03:12:13,424 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 214 2023-07-15 03:12:13,424 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 03:12:13,424 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 214 2023-07-15 03:12:13,425 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-15 03:12:13,425 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 03:12:13,425 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-15 03:12:13,425 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-15 03:12:13,425 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 03:12:13,425 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 03:12:13,425 DEBUG [member: 'jenkins-hbase4.apache.org,39199,1689390651299' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-15 03:12:13,425 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 03:12:13,425 DEBUG [member: 'jenkins-hbase4.apache.org,43199,1689390651225' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-15 03:12:13,425 DEBUG [member: 'jenkins-hbase4.apache.org,38367,1689390651355' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-15 03:12:13,425 DEBUG [member: 'jenkins-hbase4.apache.org,39199,1689390651299' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-15 03:12:13,425 DEBUG [member: 'jenkins-hbase4.apache.org,38367,1689390651355' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-15 03:12:13,427 DEBUG [member: 'jenkins-hbase4.apache.org,39199,1689390651299' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-15 03:12:13,428 DEBUG [member: 'jenkins-hbase4.apache.org,39199,1689390651299' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-15 03:12:13,429 DEBUG [member: 'jenkins-hbase4.apache.org,39199,1689390651299' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39199,1689390651299' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-15 03:12:13,425 DEBUG [member: 'jenkins-hbase4.apache.org,43199,1689390651225' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-15 03:12:13,428 DEBUG [member: 'jenkins-hbase4.apache.org,38367,1689390651355' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-15 03:12:13,430 DEBUG [member: 'jenkins-hbase4.apache.org,43199,1689390651225' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-15 03:12:13,430 DEBUG [member: 'jenkins-hbase4.apache.org,43199,1689390651225' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-15 03:12:13,430 DEBUG [member: 'jenkins-hbase4.apache.org,38367,1689390651355' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-15 03:12:13,430 DEBUG [member: 'jenkins-hbase4.apache.org,43199,1689390651225' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43199,1689390651225' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-15 03:12:13,430 DEBUG [member: 'jenkins-hbase4.apache.org,38367,1689390651355' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38367,1689390651355' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-15 03:12:13,436 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): master:41669-0x10166f610e80000, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39199,1689390651299 2023-07-15 03:12:13,436 DEBUG [member: 'jenkins-hbase4.apache.org,39199,1689390651299' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 03:12:13,436 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): master:41669-0x10166f610e80000, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,38367,1689390651355 2023-07-15 03:12:13,436 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39199,1689390651299 2023-07-15 03:12:13,436 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 03:12:13,436 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 03:12:13,436 DEBUG [member: 'jenkins-hbase4.apache.org,38367,1689390651355' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 03:12:13,438 DEBUG [member: 'jenkins-hbase4.apache.org,43199,1689390651225' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 03:12:13,438 DEBUG [member: 'jenkins-hbase4.apache.org,38367,1689390651355' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38367-0x10166f610e80003, quorum=127.0.0.1:62663, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 03:12:13,438 DEBUG [member: 'jenkins-hbase4.apache.org,39199,1689390651299' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39199-0x10166f610e80002, quorum=127.0.0.1:62663, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 03:12:13,438 DEBUG [member: 'jenkins-hbase4.apache.org,39199,1689390651299' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-15 03:12:13,438 DEBUG [member: 'jenkins-hbase4.apache.org,38367,1689390651355' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-15 03:12:13,438 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 03:12:13,438 DEBUG [member: 'jenkins-hbase4.apache.org,43199,1689390651225' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43199-0x10166f610e80001, quorum=127.0.0.1:62663, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 03:12:13,438 DEBUG [member: 'jenkins-hbase4.apache.org,43199,1689390651225' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-15 03:12:13,438 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 03:12:13,439 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 03:12:13,439 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43199,1689390651225 2023-07-15 03:12:13,439 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39199,1689390651299 2023-07-15 03:12:13,439 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38367,1689390651355 2023-07-15 03:12:13,440 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 03:12:13,440 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39199,1689390651299' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-07-15 03:12:13,440 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@52a772[Count = 1] remaining members to acquire global barrier 2023-07-15 03:12:13,440 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,38367,1689390651355 2023-07-15 03:12:13,440 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 03:12:13,440 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 03:12:13,442 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 03:12:13,442 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 03:12:13,443 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 03:12:13,443 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43199,1689390651225 2023-07-15 03:12:13,443 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39199,1689390651299 2023-07-15 03:12:13,444 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38367,1689390651355 2023-07-15 03:12:13,444 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 03:12:13,444 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,38367,1689390651355' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-07-15 03:12:13,445 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@52a772[Count = 0] remaining members to acquire global barrier 2023-07-15 03:12:13,445 DEBUG [(jenkins-hbase4.apache.org,41669,1689390649760)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'in-barrier' execution. 2023-07-15 03:12:13,445 DEBUG [(jenkins-hbase4.apache.org,41669,1689390649760)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 03:12:13,446 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): regionserver:39199-0x10166f610e80002, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 03:12:13,446 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): regionserver:43199-0x10166f610e80001, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 03:12:13,446 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 03:12:13,446 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): regionserver:38367-0x10166f610e80003, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 03:12:13,446 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 03:12:13,446 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 03:12:13,446 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 03:12:13,446 DEBUG [(jenkins-hbase4.apache.org,41669,1689390649760)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41669-0x10166f610e80000, quorum=127.0.0.1:62663, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39199,1689390651299 2023-07-15 03:12:13,446 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 03:12:13,446 DEBUG [member: 'jenkins-hbase4.apache.org,38367,1689390651355' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-15 03:12:13,446 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 03:12:13,447 DEBUG [member: 'jenkins-hbase4.apache.org,38367,1689390651355' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-15 03:12:13,447 DEBUG [member: 'jenkins-hbase4.apache.org,43199,1689390651225' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-15 03:12:13,447 DEBUG [(jenkins-hbase4.apache.org,41669,1689390649760)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41669-0x10166f610e80000, quorum=127.0.0.1:62663, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,38367,1689390651355 2023-07-15 03:12:13,447 DEBUG [(jenkins-hbase4.apache.org,41669,1689390649760)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-15 03:12:13,447 DEBUG [member: 'jenkins-hbase4.apache.org,39199,1689390651299' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-15 03:12:13,447 DEBUG [member: 'jenkins-hbase4.apache.org,43199,1689390651225' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-15 03:12:13,447 DEBUG [member: 'jenkins-hbase4.apache.org,38367,1689390651355' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-15 03:12:13,447 DEBUG [member: 'jenkins-hbase4.apache.org,39199,1689390651299' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-15 03:12:13,448 DEBUG [member: 'jenkins-hbase4.apache.org,39199,1689390651299' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-15 03:12:13,448 DEBUG [rs(jenkins-hbase4.apache.org,39199,1689390651299)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1689390732199.e2d26928a79bc451f2d14aec9f529adf. 2023-07-15 03:12:13,447 DEBUG [rs(jenkins-hbase4.apache.org,38367,1689390651355)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1689390732199.69b083820c2a58813f79ecd7d05b8ee7. 2023-07-15 03:12:13,448 DEBUG [rs(jenkins-hbase4.apache.org,39199,1689390651299)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1689390732199.e2d26928a79bc451f2d14aec9f529adf. started... 2023-07-15 03:12:13,447 DEBUG [member: 'jenkins-hbase4.apache.org,43199,1689390651225' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,43199,1689390651225' in zk 2023-07-15 03:12:13,448 DEBUG [rs(jenkins-hbase4.apache.org,38367,1689390651355)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1689390732199.69b083820c2a58813f79ecd7d05b8ee7. started... 2023-07-15 03:12:13,448 INFO [rs(jenkins-hbase4.apache.org,39199,1689390651299)-snapshot-pool-0] regionserver.HRegion(2745): Flushing e2d26928a79bc451f2d14aec9f529adf 1/1 column families, dataSize=132 B heapSize=544 B 2023-07-15 03:12:13,448 INFO [rs(jenkins-hbase4.apache.org,38367,1689390651355)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 69b083820c2a58813f79ecd7d05b8ee7 1/1 column families, dataSize=3.13 KB heapSize=7 KB 2023-07-15 03:12:13,449 DEBUG [member: 'jenkins-hbase4.apache.org,43199,1689390651225' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-15 03:12:13,450 DEBUG [member: 'jenkins-hbase4.apache.org,43199,1689390651225' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-15 03:12:13,450 DEBUG [member: 'jenkins-hbase4.apache.org,43199,1689390651225' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-15 03:12:13,480 DEBUG [Listener at jenkins-hbase4.apache.org/44817] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-15 03:12:13,481 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41669] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-15 03:12:13,481 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41669] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-07-15 03:12:13,481 DEBUG [Listener at jenkins-hbase4.apache.org/44817] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-15 03:12:13,489 INFO [rs(jenkins-hbase4.apache.org,38367,1689390651355)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.13 KB at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/data/default/testtb-testExportFileSystemStateWithMergeRegion/69b083820c2a58813f79ecd7d05b8ee7/.tmp/cf/6d964e333b864c3db35342ff0be57959 2023-07-15 03:12:13,497 DEBUG [rs(jenkins-hbase4.apache.org,38367,1689390651355)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/data/default/testtb-testExportFileSystemStateWithMergeRegion/69b083820c2a58813f79ecd7d05b8ee7/.tmp/cf/6d964e333b864c3db35342ff0be57959 as hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/data/default/testtb-testExportFileSystemStateWithMergeRegion/69b083820c2a58813f79ecd7d05b8ee7/cf/6d964e333b864c3db35342ff0be57959 2023-07-15 03:12:13,504 INFO [rs(jenkins-hbase4.apache.org,38367,1689390651355)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/data/default/testtb-testExportFileSystemStateWithMergeRegion/69b083820c2a58813f79ecd7d05b8ee7/cf/6d964e333b864c3db35342ff0be57959, entries=48, sequenceid=6, filesize=8.1 K 2023-07-15 03:12:13,505 INFO [rs(jenkins-hbase4.apache.org,38367,1689390651355)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.13 KB/3204, heapSize ~6.98 KB/7152, currentSize=0 B/0 for 69b083820c2a58813f79ecd7d05b8ee7 in 57ms, sequenceid=6, compaction requested=false 2023-07-15 03:12:13,505 DEBUG [rs(jenkins-hbase4.apache.org,38367,1689390651355)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithMergeRegion' 2023-07-15 03:12:13,507 DEBUG [rs(jenkins-hbase4.apache.org,38367,1689390651355)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 69b083820c2a58813f79ecd7d05b8ee7: 2023-07-15 03:12:13,508 DEBUG [rs(jenkins-hbase4.apache.org,38367,1689390651355)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,1,1689390732199.69b083820c2a58813f79ecd7d05b8ee7.' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 03:12:13,508 DEBUG [rs(jenkins-hbase4.apache.org,38367,1689390651355)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-15 03:12:13,508 DEBUG [rs(jenkins-hbase4.apache.org,38367,1689390651355)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/data/default/testtb-testExportFileSystemStateWithMergeRegion/69b083820c2a58813f79ecd7d05b8ee7/cf/6d964e333b864c3db35342ff0be57959] hfiles 2023-07-15 03:12:13,508 DEBUG [rs(jenkins-hbase4.apache.org,38367,1689390651355)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/data/default/testtb-testExportFileSystemStateWithMergeRegion/69b083820c2a58813f79ecd7d05b8ee7/cf/6d964e333b864c3db35342ff0be57959 for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 03:12:13,510 INFO [rs(jenkins-hbase4.apache.org,39199,1689390651299)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=132 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/data/default/testtb-testExportFileSystemStateWithMergeRegion/e2d26928a79bc451f2d14aec9f529adf/.tmp/cf/ddded7429ca8444492e2fd26aa66be49 2023-07-15 03:12:13,520 DEBUG [rs(jenkins-hbase4.apache.org,39199,1689390651299)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/data/default/testtb-testExportFileSystemStateWithMergeRegion/e2d26928a79bc451f2d14aec9f529adf/.tmp/cf/ddded7429ca8444492e2fd26aa66be49 as hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/data/default/testtb-testExportFileSystemStateWithMergeRegion/e2d26928a79bc451f2d14aec9f529adf/cf/ddded7429ca8444492e2fd26aa66be49 2023-07-15 03:12:13,528 INFO [rs(jenkins-hbase4.apache.org,39199,1689390651299)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/data/default/testtb-testExportFileSystemStateWithMergeRegion/e2d26928a79bc451f2d14aec9f529adf/cf/ddded7429ca8444492e2fd26aa66be49, entries=2, sequenceid=6, filesize=5.0 K 2023-07-15 03:12:13,529 INFO [rs(jenkins-hbase4.apache.org,39199,1689390651299)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~132 B/132, heapSize ~528 B/528, currentSize=0 B/0 for e2d26928a79bc451f2d14aec9f529adf in 81ms, sequenceid=6, compaction requested=false 2023-07-15 03:12:13,538 DEBUG [rs(jenkins-hbase4.apache.org,39199,1689390651299)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for e2d26928a79bc451f2d14aec9f529adf: 2023-07-15 03:12:13,538 DEBUG [rs(jenkins-hbase4.apache.org,39199,1689390651299)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,,1689390732199.e2d26928a79bc451f2d14aec9f529adf.' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 03:12:13,538 DEBUG [rs(jenkins-hbase4.apache.org,39199,1689390651299)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-15 03:12:13,538 DEBUG [rs(jenkins-hbase4.apache.org,39199,1689390651299)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/data/default/testtb-testExportFileSystemStateWithMergeRegion/e2d26928a79bc451f2d14aec9f529adf/cf/ddded7429ca8444492e2fd26aa66be49] hfiles 2023-07-15 03:12:13,538 DEBUG [rs(jenkins-hbase4.apache.org,39199,1689390651299)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/data/default/testtb-testExportFileSystemStateWithMergeRegion/e2d26928a79bc451f2d14aec9f529adf/cf/ddded7429ca8444492e2fd26aa66be49 for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 03:12:13,548 DEBUG [rs(jenkins-hbase4.apache.org,38367,1689390651355)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1689390732199.69b083820c2a58813f79ecd7d05b8ee7. completed. 2023-07-15 03:12:13,548 DEBUG [rs(jenkins-hbase4.apache.org,38367,1689390651355)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1689390732199.69b083820c2a58813f79ecd7d05b8ee7. 2023-07-15 03:12:13,548 DEBUG [member: 'jenkins-hbase4.apache.org,38367,1689390651355' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-15 03:12:13,548 DEBUG [member: 'jenkins-hbase4.apache.org,38367,1689390651355' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-15 03:12:13,548 DEBUG [member: 'jenkins-hbase4.apache.org,38367,1689390651355' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,38367,1689390651355 2023-07-15 03:12:13,548 DEBUG [member: 'jenkins-hbase4.apache.org,38367,1689390651355' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-15 03:12:13,548 DEBUG [member: 'jenkins-hbase4.apache.org,38367,1689390651355' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,38367,1689390651355' in zk 2023-07-15 03:12:13,550 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): master:41669-0x10166f610e80000, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,38367,1689390651355 2023-07-15 03:12:13,550 DEBUG [member: 'jenkins-hbase4.apache.org,38367,1689390651355' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-15 03:12:13,550 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,38367,1689390651355 2023-07-15 03:12:13,550 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 03:12:13,550 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 03:12:13,550 DEBUG [member: 'jenkins-hbase4.apache.org,38367,1689390651355' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-15 03:12:13,550 DEBUG [member: 'jenkins-hbase4.apache.org,38367,1689390651355' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-15 03:12:13,553 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 03:12:13,555 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 03:12:13,555 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 03:12:13,555 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43199,1689390651225 2023-07-15 03:12:13,556 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39199,1689390651299 2023-07-15 03:12:13,556 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38367,1689390651355 2023-07-15 03:12:13,556 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 03:12:13,557 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 03:12:13,557 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43199,1689390651225 2023-07-15 03:12:13,557 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38367,1689390651355 2023-07-15 03:12:13,560 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,38367,1689390651355': 2023-07-15 03:12:13,560 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,38367,1689390651355' released barrier for procedure'snaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 1 more 2023-07-15 03:12:13,563 DEBUG [rs(jenkins-hbase4.apache.org,39199,1689390651299)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1689390732199.e2d26928a79bc451f2d14aec9f529adf. completed. 2023-07-15 03:12:13,563 DEBUG [rs(jenkins-hbase4.apache.org,39199,1689390651299)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1689390732199.e2d26928a79bc451f2d14aec9f529adf. 2023-07-15 03:12:13,563 DEBUG [member: 'jenkins-hbase4.apache.org,39199,1689390651299' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-15 03:12:13,563 DEBUG [member: 'jenkins-hbase4.apache.org,39199,1689390651299' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-15 03:12:13,563 DEBUG [member: 'jenkins-hbase4.apache.org,39199,1689390651299' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,39199,1689390651299 2023-07-15 03:12:13,563 DEBUG [member: 'jenkins-hbase4.apache.org,39199,1689390651299' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-15 03:12:13,563 DEBUG [member: 'jenkins-hbase4.apache.org,39199,1689390651299' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,39199,1689390651299' in zk 2023-07-15 03:12:13,565 DEBUG [member: 'jenkins-hbase4.apache.org,39199,1689390651299' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-15 03:12:13,565 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): master:41669-0x10166f610e80000, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39199,1689390651299 2023-07-15 03:12:13,565 DEBUG [member: 'jenkins-hbase4.apache.org,39199,1689390651299' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-15 03:12:13,565 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39199,1689390651299 2023-07-15 03:12:13,566 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 03:12:13,567 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 03:12:13,565 DEBUG [member: 'jenkins-hbase4.apache.org,39199,1689390651299' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-15 03:12:13,569 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 03:12:13,570 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 03:12:13,570 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 03:12:13,570 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43199,1689390651225 2023-07-15 03:12:13,571 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39199,1689390651299 2023-07-15 03:12:13,571 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38367,1689390651355 2023-07-15 03:12:13,572 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 03:12:13,572 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 03:12:13,573 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43199,1689390651225 2023-07-15 03:12:13,573 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39199,1689390651299 2023-07-15 03:12:13,574 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38367,1689390651355 2023-07-15 03:12:13,574 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,39199,1689390651299': 2023-07-15 03:12:13,574 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39199,1689390651299' released barrier for procedure'snaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 0 more 2023-07-15 03:12:13,574 INFO [(jenkins-hbase4.apache.org,41669,1689390649760)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' execution completed 2023-07-15 03:12:13,575 DEBUG [(jenkins-hbase4.apache.org,41669,1689390649760)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-15 03:12:13,575 DEBUG [(jenkins-hbase4.apache.org,41669,1689390649760)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-15 03:12:13,575 DEBUG [(jenkins-hbase4.apache.org,41669,1689390649760)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 03:12:13,575 INFO [(jenkins-hbase4.apache.org,41669,1689390649760)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateWithMergeRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-15 03:12:13,589 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): master:41669-0x10166f610e80000, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 03:12:13,589 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): regionserver:38367-0x10166f610e80003, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 03:12:13,589 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): regionserver:39199-0x10166f610e80002, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 03:12:13,589 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 03:12:13,589 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): regionserver:43199-0x10166f610e80001, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 03:12:13,589 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 03:12:13,589 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 03:12:13,589 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 03:12:13,589 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): regionserver:43199-0x10166f610e80001, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 03:12:13,589 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 03:12:13,589 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 03:12:13,589 DEBUG [(jenkins-hbase4.apache.org,41669,1689390649760)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41669-0x10166f610e80000, quorum=127.0.0.1:62663, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43199,1689390651225 2023-07-15 03:12:13,589 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): regionserver:39199-0x10166f610e80002, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 03:12:13,589 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 03:12:13,590 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 03:12:13,589 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): regionserver:38367-0x10166f610e80003, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 03:12:13,589 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 03:12:13,590 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 03:12:13,590 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 03:12:13,590 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 03:12:13,590 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 03:12:13,590 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 03:12:13,590 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 03:12:13,590 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 03:12:13,590 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 03:12:13,590 DEBUG [(jenkins-hbase4.apache.org,41669,1689390649760)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41669-0x10166f610e80000, quorum=127.0.0.1:62663, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39199,1689390651299 2023-07-15 03:12:13,591 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 03:12:13,591 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 03:12:13,591 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 03:12:13,591 DEBUG [(jenkins-hbase4.apache.org,41669,1689390649760)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41669-0x10166f610e80000, quorum=127.0.0.1:62663, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,38367,1689390651355 2023-07-15 03:12:13,591 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 03:12:13,592 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 03:12:13,592 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43199,1689390651225 2023-07-15 03:12:13,592 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39199,1689390651299 2023-07-15 03:12:13,593 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38367,1689390651355 2023-07-15 03:12:13,593 DEBUG [(jenkins-hbase4.apache.org,41669,1689390649760)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41669-0x10166f610e80000, quorum=127.0.0.1:62663, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43199,1689390651225 2023-07-15 03:12:13,593 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 03:12:13,593 DEBUG [(jenkins-hbase4.apache.org,41669,1689390649760)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41669-0x10166f610e80000, quorum=127.0.0.1:62663, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39199,1689390651299 2023-07-15 03:12:13,593 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 03:12:13,594 DEBUG [(jenkins-hbase4.apache.org,41669,1689390649760)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41669-0x10166f610e80000, quorum=127.0.0.1:62663, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,38367,1689390651355 2023-07-15 03:12:13,594 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43199,1689390651225 2023-07-15 03:12:13,594 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39199,1689390651299 2023-07-15 03:12:13,594 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38367,1689390651355 2023-07-15 03:12:13,601 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): regionserver:43199-0x10166f610e80001, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 03:12:13,601 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): regionserver:43199-0x10166f610e80001, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 03:12:13,601 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): regionserver:38367-0x10166f610e80003, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 03:12:13,601 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 03:12:13,601 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 03:12:13,601 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): master:41669-0x10166f610e80000, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,38367,1689390651355 2023-07-15 03:12:13,601 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 03:12:13,601 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 03:12:13,601 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): regionserver:39199-0x10166f610e80002, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 03:12:13,601 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): regionserver:39199-0x10166f610e80002, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 03:12:13,601 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): master:41669-0x10166f610e80000, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 03:12:13,601 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): master:41669-0x10166f610e80000, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39199,1689390651299 2023-07-15 03:12:13,601 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): master:41669-0x10166f610e80000, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43199,1689390651225 2023-07-15 03:12:13,601 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): master:41669-0x10166f610e80000, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 03:12:13,602 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): master:41669-0x10166f610e80000, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,38367,1689390651355 2023-07-15 03:12:13,602 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): master:41669-0x10166f610e80000, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 03:12:13,602 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 03:12:13,602 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 03:12:13,601 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): regionserver:38367-0x10166f610e80003, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 03:12:13,602 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 03:12:13,602 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 03:12:13,602 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 03:12:13,602 DEBUG [(jenkins-hbase4.apache.org,41669,1689390649760)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-15 03:12:13,602 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 03:12:13,602 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): master:41669-0x10166f610e80000, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39199,1689390651299 2023-07-15 03:12:13,601 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 03:12:13,605 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 03:12:13,604 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): master:41669-0x10166f610e80000, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43199,1689390651225 2023-07-15 03:12:13,605 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): master:41669-0x10166f610e80000, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 03:12:13,605 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): master:41669-0x10166f610e80000, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 03:12:13,605 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 03:12:13,605 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 03:12:13,605 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 03:12:13,682 DEBUG [Listener at jenkins-hbase4.apache.org/44817] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-15 03:12:13,684 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41669] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-15 03:12:13,684 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41669] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-07-15 03:12:13,684 DEBUG [Listener at jenkins-hbase4.apache.org/44817] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-15 03:12:13,711 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion to hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 03:12:13,785 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed 2023-07-15 03:12:13,785 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 03:12:13,786 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 03:12:13,786 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion at 1689390733378Consolidate snapshot: snaptb0-testExportFileSystemStateWithMergeRegion at 1689390733602 (+224 ms)Loading Region manifests for snaptb0-testExportFileSystemStateWithMergeRegion at 1689390733604 (+2 ms)Writing data manifest for snaptb0-testExportFileSystemStateWithMergeRegion at 1689390733618 (+14 ms)Verifying snapshot: snaptb0-testExportFileSystemStateWithMergeRegion at 1689390733692 (+74 ms)Snapshot snaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed at 1689390733785 (+93 ms) 2023-07-15 03:12:13,790 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=65, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-15 03:12:13,798 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=65, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED in 411 msec 2023-07-15 03:12:13,984 DEBUG [Listener at jenkins-hbase4.apache.org/44817] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-15 03:12:13,986 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41669] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-15 03:12:13,986 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41669] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-15 03:12:14,031 DEBUG [Listener at jenkins-hbase4.apache.org/44817] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-15 03:12:14,039 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:60150, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-15 03:12:14,041 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38367] regionserver.CompactSplit(310): Interrupting running compactions because user switched off compactions 2023-07-15 03:12:14,043 DEBUG [Listener at jenkins-hbase4.apache.org/44817] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-15 03:12:14,058 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:53246, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-15 03:12:14,058 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39199] regionserver.CompactSplit(310): Interrupting running compactions because user switched off compactions 2023-07-15 03:12:14,059 DEBUG [Listener at jenkins-hbase4.apache.org/44817] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-15 03:12:14,066 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:40646, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-15 03:12:14,066 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43199] regionserver.CompactSplit(310): Interrupting running compactions because user switched off compactions 2023-07-15 03:12:14,070 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41669] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemStateWithMergeRegion-1', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-15 03:12:14,079 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41669] procedure2.ProcedureExecutor(1029): Stored pid=66, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-15 03:12:14,083 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_PRE_OPERATION 2023-07-15 03:12:14,084 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-15 03:12:14,085 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41669] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemStateWithMergeRegion-1" procId is: 66 2023-07-15 03:12:14,088 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41669] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-07-15 03:12:14,089 DEBUG [HFileArchiver-17] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/2e6bb2b51350dee20b65bd01e72f9814 2023-07-15 03:12:14,090 DEBUG [HFileArchiver-17] backup.HFileArchiver(153): Directory hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/2e6bb2b51350dee20b65bd01e72f9814 empty. 2023-07-15 03:12:14,090 DEBUG [HFileArchiver-18] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ea51b99bc24e6d3186aba3a9f59e829b 2023-07-15 03:12:14,091 DEBUG [HFileArchiver-17] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/2e6bb2b51350dee20b65bd01e72f9814 2023-07-15 03:12:14,091 DEBUG [HFileArchiver-18] backup.HFileArchiver(153): Directory hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ea51b99bc24e6d3186aba3a9f59e829b empty. 2023-07-15 03:12:14,091 DEBUG [HFileArchiver-18] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ea51b99bc24e6d3186aba3a9f59e829b 2023-07-15 03:12:14,092 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion-1 regions 2023-07-15 03:12:14,129 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/.tabledesc/.tableinfo.0000000001 2023-07-15 03:12:14,131 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(7675): creating {ENCODED => 2e6bb2b51350dee20b65bd01e72f9814, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1689390734070.2e6bb2b51350dee20b65bd01e72f9814.', STARTKEY => '', ENDKEY => '2'}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion-1', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/.tmp 2023-07-15 03:12:14,135 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(7675): creating {ENCODED => ea51b99bc24e6d3186aba3a9f59e829b, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,2,1689390734070.ea51b99bc24e6d3186aba3a9f59e829b.', STARTKEY => '2', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion-1', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/.tmp 2023-07-15 03:12:14,189 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41669] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-07-15 03:12:14,216 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,,1689390734070.2e6bb2b51350dee20b65bd01e72f9814.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-15 03:12:14,216 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1604): Closing 2e6bb2b51350dee20b65bd01e72f9814, disabling compactions & flushes 2023-07-15 03:12:14,216 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,,1689390734070.2e6bb2b51350dee20b65bd01e72f9814. 2023-07-15 03:12:14,216 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1689390734070.2e6bb2b51350dee20b65bd01e72f9814. 2023-07-15 03:12:14,216 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1689390734070.2e6bb2b51350dee20b65bd01e72f9814. after waiting 0 ms 2023-07-15 03:12:14,216 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,,1689390734070.2e6bb2b51350dee20b65bd01e72f9814. 2023-07-15 03:12:14,216 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,,1689390734070.2e6bb2b51350dee20b65bd01e72f9814. 2023-07-15 03:12:14,216 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1558): Region close journal for 2e6bb2b51350dee20b65bd01e72f9814: 2023-07-15 03:12:14,220 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,2,1689390734070.ea51b99bc24e6d3186aba3a9f59e829b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-15 03:12:14,220 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1604): Closing ea51b99bc24e6d3186aba3a9f59e829b, disabling compactions & flushes 2023-07-15 03:12:14,221 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,2,1689390734070.ea51b99bc24e6d3186aba3a9f59e829b. 2023-07-15 03:12:14,221 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1689390734070.ea51b99bc24e6d3186aba3a9f59e829b. 2023-07-15 03:12:14,221 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1689390734070.ea51b99bc24e6d3186aba3a9f59e829b. after waiting 0 ms 2023-07-15 03:12:14,221 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,2,1689390734070.ea51b99bc24e6d3186aba3a9f59e829b. 2023-07-15 03:12:14,221 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,2,1689390734070.ea51b99bc24e6d3186aba3a9f59e829b. 2023-07-15 03:12:14,221 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1558): Region close journal for ea51b99bc24e6d3186aba3a9f59e829b: 2023-07-15 03:12:14,224 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_ADD_TO_META 2023-07-15 03:12:14,225 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689390734070.2e6bb2b51350dee20b65bd01e72f9814.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689390734225"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689390734225"}]},"ts":"1689390734225"} 2023-07-15 03:12:14,225 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1689390734070.ea51b99bc24e6d3186aba3a9f59e829b.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689390734225"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689390734225"}]},"ts":"1689390734225"} 2023-07-15 03:12:14,229 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-15 03:12:14,231 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-15 03:12:14,231 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689390734231"}]},"ts":"1689390734231"} 2023-07-15 03:12:14,234 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=ENABLING in hbase:meta 2023-07-15 03:12:14,237 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-15 03:12:14,239 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-15 03:12:14,239 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-15 03:12:14,239 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-15 03:12:14,239 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-15 03:12:14,239 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=2e6bb2b51350dee20b65bd01e72f9814, ASSIGN}, {pid=68, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=ea51b99bc24e6d3186aba3a9f59e829b, ASSIGN}] 2023-07-15 03:12:14,242 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=2e6bb2b51350dee20b65bd01e72f9814, ASSIGN 2023-07-15 03:12:14,243 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=68, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=ea51b99bc24e6d3186aba3a9f59e829b, ASSIGN 2023-07-15 03:12:14,244 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=2e6bb2b51350dee20b65bd01e72f9814, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,43199,1689390651225; forceNewPlan=false, retain=false 2023-07-15 03:12:14,244 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=68, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=ea51b99bc24e6d3186aba3a9f59e829b, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,38367,1689390651355; forceNewPlan=false, retain=false 2023-07-15 03:12:14,390 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41669] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-07-15 03:12:14,394 INFO [jenkins-hbase4:41669] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-15 03:12:14,397 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=2e6bb2b51350dee20b65bd01e72f9814, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,43199,1689390651225 2023-07-15 03:12:14,397 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=68 updating hbase:meta row=ea51b99bc24e6d3186aba3a9f59e829b, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,38367,1689390651355 2023-07-15 03:12:14,397 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689390734070.2e6bb2b51350dee20b65bd01e72f9814.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689390734397"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689390734397"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689390734397"}]},"ts":"1689390734397"} 2023-07-15 03:12:14,397 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1689390734070.ea51b99bc24e6d3186aba3a9f59e829b.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689390734397"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689390734397"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689390734397"}]},"ts":"1689390734397"} 2023-07-15 03:12:14,399 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=69, ppid=67, state=RUNNABLE; OpenRegionProcedure 2e6bb2b51350dee20b65bd01e72f9814, server=jenkins-hbase4.apache.org,43199,1689390651225}] 2023-07-15 03:12:14,400 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=70, ppid=68, state=RUNNABLE; OpenRegionProcedure ea51b99bc24e6d3186aba3a9f59e829b, server=jenkins-hbase4.apache.org,38367,1689390651355}] 2023-07-15 03:12:14,559 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion-1,2,1689390734070.ea51b99bc24e6d3186aba3a9f59e829b. 2023-07-15 03:12:14,560 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => ea51b99bc24e6d3186aba3a9f59e829b, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,2,1689390734070.ea51b99bc24e6d3186aba3a9f59e829b.', STARTKEY => '2', ENDKEY => ''} 2023-07-15 03:12:14,560 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion-1,2,1689390734070.ea51b99bc24e6d3186aba3a9f59e829b. service=AccessControlService 2023-07-15 03:12:14,561 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-15 03:12:14,561 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion-1 ea51b99bc24e6d3186aba3a9f59e829b 2023-07-15 03:12:14,561 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,2,1689390734070.ea51b99bc24e6d3186aba3a9f59e829b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-15 03:12:14,561 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for ea51b99bc24e6d3186aba3a9f59e829b 2023-07-15 03:12:14,561 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for ea51b99bc24e6d3186aba3a9f59e829b 2023-07-15 03:12:14,565 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion-1,,1689390734070.2e6bb2b51350dee20b65bd01e72f9814. 2023-07-15 03:12:14,565 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 2e6bb2b51350dee20b65bd01e72f9814, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1689390734070.2e6bb2b51350dee20b65bd01e72f9814.', STARTKEY => '', ENDKEY => '2'} 2023-07-15 03:12:14,565 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion-1,,1689390734070.2e6bb2b51350dee20b65bd01e72f9814. service=AccessControlService 2023-07-15 03:12:14,565 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-15 03:12:14,566 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion-1 2e6bb2b51350dee20b65bd01e72f9814 2023-07-15 03:12:14,566 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,,1689390734070.2e6bb2b51350dee20b65bd01e72f9814.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-15 03:12:14,566 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 2e6bb2b51350dee20b65bd01e72f9814 2023-07-15 03:12:14,566 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 2e6bb2b51350dee20b65bd01e72f9814 2023-07-15 03:12:14,569 INFO [StoreOpener-ea51b99bc24e6d3186aba3a9f59e829b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region ea51b99bc24e6d3186aba3a9f59e829b 2023-07-15 03:12:14,571 DEBUG [StoreOpener-ea51b99bc24e6d3186aba3a9f59e829b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ea51b99bc24e6d3186aba3a9f59e829b/cf 2023-07-15 03:12:14,571 DEBUG [StoreOpener-ea51b99bc24e6d3186aba3a9f59e829b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ea51b99bc24e6d3186aba3a9f59e829b/cf 2023-07-15 03:12:14,572 INFO [StoreOpener-ea51b99bc24e6d3186aba3a9f59e829b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region ea51b99bc24e6d3186aba3a9f59e829b columnFamilyName cf 2023-07-15 03:12:14,573 INFO [StoreOpener-ea51b99bc24e6d3186aba3a9f59e829b-1] regionserver.HStore(310): Store=ea51b99bc24e6d3186aba3a9f59e829b/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-15 03:12:14,580 INFO [StoreOpener-2e6bb2b51350dee20b65bd01e72f9814-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 2e6bb2b51350dee20b65bd01e72f9814 2023-07-15 03:12:14,581 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ea51b99bc24e6d3186aba3a9f59e829b 2023-07-15 03:12:14,581 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ea51b99bc24e6d3186aba3a9f59e829b 2023-07-15 03:12:14,582 DEBUG [StoreOpener-2e6bb2b51350dee20b65bd01e72f9814-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/2e6bb2b51350dee20b65bd01e72f9814/cf 2023-07-15 03:12:14,582 DEBUG [StoreOpener-2e6bb2b51350dee20b65bd01e72f9814-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/2e6bb2b51350dee20b65bd01e72f9814/cf 2023-07-15 03:12:14,583 INFO [StoreOpener-2e6bb2b51350dee20b65bd01e72f9814-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 2e6bb2b51350dee20b65bd01e72f9814 columnFamilyName cf 2023-07-15 03:12:14,583 INFO [StoreOpener-2e6bb2b51350dee20b65bd01e72f9814-1] regionserver.HStore(310): Store=2e6bb2b51350dee20b65bd01e72f9814/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-15 03:12:14,584 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/2e6bb2b51350dee20b65bd01e72f9814 2023-07-15 03:12:14,584 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for ea51b99bc24e6d3186aba3a9f59e829b 2023-07-15 03:12:14,585 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/2e6bb2b51350dee20b65bd01e72f9814 2023-07-15 03:12:14,587 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ea51b99bc24e6d3186aba3a9f59e829b/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-15 03:12:14,587 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened ea51b99bc24e6d3186aba3a9f59e829b; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69437412, jitterRate=0.03469806909561157}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-15 03:12:14,587 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for ea51b99bc24e6d3186aba3a9f59e829b: 2023-07-15 03:12:14,588 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 2e6bb2b51350dee20b65bd01e72f9814 2023-07-15 03:12:14,589 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion-1,2,1689390734070.ea51b99bc24e6d3186aba3a9f59e829b., pid=70, masterSystemTime=1689390734554 2023-07-15 03:12:14,590 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion-1,2,1689390734070.ea51b99bc24e6d3186aba3a9f59e829b. 2023-07-15 03:12:14,590 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion-1,2,1689390734070.ea51b99bc24e6d3186aba3a9f59e829b. 2023-07-15 03:12:14,591 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/2e6bb2b51350dee20b65bd01e72f9814/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-15 03:12:14,591 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=68 updating hbase:meta row=ea51b99bc24e6d3186aba3a9f59e829b, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,38367,1689390651355 2023-07-15 03:12:14,591 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1689390734070.ea51b99bc24e6d3186aba3a9f59e829b.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689390734591"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689390734591"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689390734591"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689390734591"}]},"ts":"1689390734591"} 2023-07-15 03:12:14,591 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 2e6bb2b51350dee20b65bd01e72f9814; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62570023, jitterRate=-0.06763400137424469}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-15 03:12:14,592 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 2e6bb2b51350dee20b65bd01e72f9814: 2023-07-15 03:12:14,593 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion-1,,1689390734070.2e6bb2b51350dee20b65bd01e72f9814., pid=69, masterSystemTime=1689390734554 2023-07-15 03:12:14,598 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion-1,,1689390734070.2e6bb2b51350dee20b65bd01e72f9814. 2023-07-15 03:12:14,598 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion-1,,1689390734070.2e6bb2b51350dee20b65bd01e72f9814. 2023-07-15 03:12:14,598 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=2e6bb2b51350dee20b65bd01e72f9814, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,43199,1689390651225 2023-07-15 03:12:14,599 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689390734070.2e6bb2b51350dee20b65bd01e72f9814.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689390734598"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689390734598"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689390734598"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689390734598"}]},"ts":"1689390734598"} 2023-07-15 03:12:14,599 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=70, resume processing ppid=68 2023-07-15 03:12:14,599 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=70, ppid=68, state=SUCCESS; OpenRegionProcedure ea51b99bc24e6d3186aba3a9f59e829b, server=jenkins-hbase4.apache.org,38367,1689390651355 in 193 msec 2023-07-15 03:12:14,600 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=68, ppid=66, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=ea51b99bc24e6d3186aba3a9f59e829b, ASSIGN in 360 msec 2023-07-15 03:12:14,602 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=69, resume processing ppid=67 2023-07-15 03:12:14,602 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=69, ppid=67, state=SUCCESS; OpenRegionProcedure 2e6bb2b51350dee20b65bd01e72f9814, server=jenkins-hbase4.apache.org,43199,1689390651225 in 201 msec 2023-07-15 03:12:14,605 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=67, resume processing ppid=66 2023-07-15 03:12:14,605 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=67, ppid=66, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=2e6bb2b51350dee20b65bd01e72f9814, ASSIGN in 363 msec 2023-07-15 03:12:14,611 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-15 03:12:14,611 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689390734611"}]},"ts":"1689390734611"} 2023-07-15 03:12:14,612 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=ENABLED in hbase:meta 2023-07-15 03:12:14,615 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_POST_OPERATION 2023-07-15 03:12:14,615 DEBUG [PEWorker-5] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemStateWithMergeRegion-1 jenkins: RWXCA 2023-07-15 03:12:14,617 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=39199] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion-1], kv [jenkins: RWXCA] 2023-07-15 03:12:14,618 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): regionserver:43199-0x10166f610e80001, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-15 03:12:14,618 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): regionserver:38367-0x10166f610e80003, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-15 03:12:14,618 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): master:41669-0x10166f610e80000, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-15 03:12:14,618 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): regionserver:39199-0x10166f610e80002, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-15 03:12:14,621 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-15 03:12:14,621 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-15 03:12:14,622 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-07-15 03:12:14,622 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-07-15 03:12:14,621 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-15 03:12:14,622 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-15 03:12:14,622 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-07-15 03:12:14,622 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-07-15 03:12:14,624 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=66, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 in 551 msec 2023-07-15 03:12:14,692 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41669] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-07-15 03:12:14,692 INFO [Listener at jenkins-hbase4.apache.org/44817] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 66 completed 2023-07-15 03:12:14,719 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41669] master.HMaster$2(1952): Client=jenkins//172.31.14.131 merge regions 2e6bb2b51350dee20b65bd01e72f9814, ea51b99bc24e6d3186aba3a9f59e829b 2023-07-15 03:12:14,732 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41669] procedure2.ProcedureExecutor(1029): Stored pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[2e6bb2b51350dee20b65bd01e72f9814, ea51b99bc24e6d3186aba3a9f59e829b], force=true 2023-07-15 03:12:14,734 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[2e6bb2b51350dee20b65bd01e72f9814, ea51b99bc24e6d3186aba3a9f59e829b], force=true 2023-07-15 03:12:14,734 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[2e6bb2b51350dee20b65bd01e72f9814, ea51b99bc24e6d3186aba3a9f59e829b], force=true 2023-07-15 03:12:14,734 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[2e6bb2b51350dee20b65bd01e72f9814, ea51b99bc24e6d3186aba3a9f59e829b], force=true 2023-07-15 03:12:14,740 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41669] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-15 03:12:14,765 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=72, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=2e6bb2b51350dee20b65bd01e72f9814, UNASSIGN}, {pid=73, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=ea51b99bc24e6d3186aba3a9f59e829b, UNASSIGN}] 2023-07-15 03:12:14,767 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=73, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=ea51b99bc24e6d3186aba3a9f59e829b, UNASSIGN 2023-07-15 03:12:14,769 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=72, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=2e6bb2b51350dee20b65bd01e72f9814, UNASSIGN 2023-07-15 03:12:14,770 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=73 updating hbase:meta row=ea51b99bc24e6d3186aba3a9f59e829b, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,38367,1689390651355 2023-07-15 03:12:14,770 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1689390734070.ea51b99bc24e6d3186aba3a9f59e829b.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689390734770"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689390734770"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689390734770"}]},"ts":"1689390734770"} 2023-07-15 03:12:14,770 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=72 updating hbase:meta row=2e6bb2b51350dee20b65bd01e72f9814, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,43199,1689390651225 2023-07-15 03:12:14,770 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689390734070.2e6bb2b51350dee20b65bd01e72f9814.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689390734770"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689390734770"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689390734770"}]},"ts":"1689390734770"} 2023-07-15 03:12:14,772 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=74, ppid=73, state=RUNNABLE; CloseRegionProcedure ea51b99bc24e6d3186aba3a9f59e829b, server=jenkins-hbase4.apache.org,38367,1689390651355}] 2023-07-15 03:12:14,773 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=75, ppid=72, state=RUNNABLE; CloseRegionProcedure 2e6bb2b51350dee20b65bd01e72f9814, server=jenkins-hbase4.apache.org,43199,1689390651225}] 2023-07-15 03:12:14,842 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41669] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-15 03:12:14,925 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close ea51b99bc24e6d3186aba3a9f59e829b 2023-07-15 03:12:14,927 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing ea51b99bc24e6d3186aba3a9f59e829b, disabling compactions & flushes 2023-07-15 03:12:14,928 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,2,1689390734070.ea51b99bc24e6d3186aba3a9f59e829b. 2023-07-15 03:12:14,928 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1689390734070.ea51b99bc24e6d3186aba3a9f59e829b. 2023-07-15 03:12:14,928 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1689390734070.ea51b99bc24e6d3186aba3a9f59e829b. after waiting 0 ms 2023-07-15 03:12:14,928 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,2,1689390734070.ea51b99bc24e6d3186aba3a9f59e829b. 2023-07-15 03:12:14,928 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing ea51b99bc24e6d3186aba3a9f59e829b 1/1 column families, dataSize=24 B heapSize=352 B 2023-07-15 03:12:14,929 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 2e6bb2b51350dee20b65bd01e72f9814 2023-07-15 03:12:14,931 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 2e6bb2b51350dee20b65bd01e72f9814, disabling compactions & flushes 2023-07-15 03:12:14,932 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,,1689390734070.2e6bb2b51350dee20b65bd01e72f9814. 2023-07-15 03:12:14,932 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1689390734070.2e6bb2b51350dee20b65bd01e72f9814. 2023-07-15 03:12:14,932 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1689390734070.2e6bb2b51350dee20b65bd01e72f9814. after waiting 0 ms 2023-07-15 03:12:14,932 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,,1689390734070.2e6bb2b51350dee20b65bd01e72f9814. 2023-07-15 03:12:14,932 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 2e6bb2b51350dee20b65bd01e72f9814 1/1 column families, dataSize=24 B heapSize=352 B 2023-07-15 03:12:14,979 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=24 B at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/2e6bb2b51350dee20b65bd01e72f9814/.tmp/cf/071f5037683647c2a3111d781e0bcfa3 2023-07-15 03:12:14,989 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/2e6bb2b51350dee20b65bd01e72f9814/.tmp/cf/071f5037683647c2a3111d781e0bcfa3 as hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/2e6bb2b51350dee20b65bd01e72f9814/cf/071f5037683647c2a3111d781e0bcfa3 2023-07-15 03:12:14,989 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=24 B at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ea51b99bc24e6d3186aba3a9f59e829b/.tmp/cf/b09aedebb38b408e989e2bdfeec1f083 2023-07-15 03:12:14,997 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ea51b99bc24e6d3186aba3a9f59e829b/.tmp/cf/b09aedebb38b408e989e2bdfeec1f083 as hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ea51b99bc24e6d3186aba3a9f59e829b/cf/b09aedebb38b408e989e2bdfeec1f083 2023-07-15 03:12:15,003 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/2e6bb2b51350dee20b65bd01e72f9814/cf/071f5037683647c2a3111d781e0bcfa3, entries=1, sequenceid=5, filesize=4.7 K 2023-07-15 03:12:15,005 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~24 B/24, heapSize ~336 B/336, currentSize=0 B/0 for 2e6bb2b51350dee20b65bd01e72f9814 in 73ms, sequenceid=5, compaction requested=false 2023-07-15 03:12:15,005 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithMergeRegion-1' 2023-07-15 03:12:15,010 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ea51b99bc24e6d3186aba3a9f59e829b/cf/b09aedebb38b408e989e2bdfeec1f083, entries=1, sequenceid=5, filesize=4.7 K 2023-07-15 03:12:15,012 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~24 B/24, heapSize ~336 B/336, currentSize=0 B/0 for ea51b99bc24e6d3186aba3a9f59e829b in 84ms, sequenceid=5, compaction requested=false 2023-07-15 03:12:15,036 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/2e6bb2b51350dee20b65bd01e72f9814/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=1 2023-07-15 03:12:15,036 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ea51b99bc24e6d3186aba3a9f59e829b/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=1 2023-07-15 03:12:15,037 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-15 03:12:15,037 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,,1689390734070.2e6bb2b51350dee20b65bd01e72f9814. 2023-07-15 03:12:15,037 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 2e6bb2b51350dee20b65bd01e72f9814: 2023-07-15 03:12:15,040 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-15 03:12:15,040 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,2,1689390734070.ea51b99bc24e6d3186aba3a9f59e829b. 2023-07-15 03:12:15,040 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for ea51b99bc24e6d3186aba3a9f59e829b: 2023-07-15 03:12:15,040 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=72 updating hbase:meta row=2e6bb2b51350dee20b65bd01e72f9814, regionState=CLOSED 2023-07-15 03:12:15,041 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689390734070.2e6bb2b51350dee20b65bd01e72f9814.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689390735040"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689390735040"}]},"ts":"1689390735040"} 2023-07-15 03:12:15,042 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed ea51b99bc24e6d3186aba3a9f59e829b 2023-07-15 03:12:15,043 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=73 updating hbase:meta row=ea51b99bc24e6d3186aba3a9f59e829b, regionState=CLOSED 2023-07-15 03:12:15,043 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1689390734070.ea51b99bc24e6d3186aba3a9f59e829b.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689390735043"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689390735043"}]},"ts":"1689390735043"} 2023-07-15 03:12:15,043 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41669] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-15 03:12:15,048 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=75, resume processing ppid=72 2023-07-15 03:12:15,048 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=75, ppid=72, state=SUCCESS; CloseRegionProcedure 2e6bb2b51350dee20b65bd01e72f9814, server=jenkins-hbase4.apache.org,43199,1689390651225 in 271 msec 2023-07-15 03:12:15,050 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 2e6bb2b51350dee20b65bd01e72f9814 2023-07-15 03:12:15,052 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=72, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=2e6bb2b51350dee20b65bd01e72f9814, UNASSIGN in 288 msec 2023-07-15 03:12:15,053 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=74, resume processing ppid=73 2023-07-15 03:12:15,053 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=74, ppid=73, state=SUCCESS; CloseRegionProcedure ea51b99bc24e6d3186aba3a9f59e829b, server=jenkins-hbase4.apache.org,38367,1689390651355 in 275 msec 2023-07-15 03:12:15,057 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=73, resume processing ppid=71 2023-07-15 03:12:15,057 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=73, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=ea51b99bc24e6d3186aba3a9f59e829b, UNASSIGN in 288 msec 2023-07-15 03:12:15,208 DEBUG [PEWorker-5] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/5f450e46f060c4ca3839a2371410ba09/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=-1 2023-07-15 03:12:15,210 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689390734070.2e6bb2b51350dee20b65bd01e72f9814.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"9223372036854775807"}]},"ts":"9223372036854775807"} 2023-07-15 03:12:15,210 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1689390734070.ea51b99bc24e6d3186aba3a9f59e829b.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"9223372036854775807"}]},"ts":"9223372036854775807"} 2023-07-15 03:12:15,211 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":7,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689390734071.5f450e46f060c4ca3839a2371410ba09.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"9223372036854775807"},{"qualifier":"merge0000","vlen":84,"tag":[],"timestamp":"9223372036854775807"},{"qualifier":"merge0001","vlen":84,"tag":[],"timestamp":"9223372036854775807"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"9223372036854775807"}]},"ts":"9223372036854775807"} 2023-07-15 03:12:15,276 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=76, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=5f450e46f060c4ca3839a2371410ba09, ASSIGN}] 2023-07-15 03:12:15,279 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=76, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=5f450e46f060c4ca3839a2371410ba09, ASSIGN 2023-07-15 03:12:15,280 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=76, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=5f450e46f060c4ca3839a2371410ba09, ASSIGN; state=MERGED, location=jenkins-hbase4.apache.org,43199,1689390651225; forceNewPlan=false, retain=false 2023-07-15 03:12:15,345 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41669] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-15 03:12:15,430 INFO [jenkins-hbase4:41669] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-07-15 03:12:15,432 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=76 updating hbase:meta row=5f450e46f060c4ca3839a2371410ba09, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,43199,1689390651225 2023-07-15 03:12:15,432 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689390734071.5f450e46f060c4ca3839a2371410ba09.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1689390735432"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689390735432"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689390735432"}]},"ts":"1689390735432"} 2023-07-15 03:12:15,434 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=77, ppid=76, state=RUNNABLE; OpenRegionProcedure 5f450e46f060c4ca3839a2371410ba09, server=jenkins-hbase4.apache.org,43199,1689390651225}] 2023-07-15 03:12:15,597 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion-1,,1689390734071.5f450e46f060c4ca3839a2371410ba09. 2023-07-15 03:12:15,597 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 5f450e46f060c4ca3839a2371410ba09, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1689390734071.5f450e46f060c4ca3839a2371410ba09.', STARTKEY => '', ENDKEY => ''} 2023-07-15 03:12:15,597 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion-1,,1689390734071.5f450e46f060c4ca3839a2371410ba09. service=AccessControlService 2023-07-15 03:12:15,598 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-15 03:12:15,598 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion-1 5f450e46f060c4ca3839a2371410ba09 2023-07-15 03:12:15,598 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,,1689390734071.5f450e46f060c4ca3839a2371410ba09.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-15 03:12:15,598 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 5f450e46f060c4ca3839a2371410ba09 2023-07-15 03:12:15,598 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 5f450e46f060c4ca3839a2371410ba09 2023-07-15 03:12:15,599 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(950): Rewriting .regioninfo file at: hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/5f450e46f060c4ca3839a2371410ba09/.regioninfo 2023-07-15 03:12:15,618 INFO [StoreOpener-5f450e46f060c4ca3839a2371410ba09-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 5f450e46f060c4ca3839a2371410ba09 2023-07-15 03:12:15,619 DEBUG [StoreOpener-5f450e46f060c4ca3839a2371410ba09-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/5f450e46f060c4ca3839a2371410ba09/cf 2023-07-15 03:12:15,619 DEBUG [StoreOpener-5f450e46f060c4ca3839a2371410ba09-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/5f450e46f060c4ca3839a2371410ba09/cf 2023-07-15 03:12:15,620 INFO [StoreOpener-5f450e46f060c4ca3839a2371410ba09-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 5f450e46f060c4ca3839a2371410ba09 columnFamilyName cf 2023-07-15 03:12:15,659 DEBUG [StoreOpener-5f450e46f060c4ca3839a2371410ba09-1] regionserver.HStore(539): loaded hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/5f450e46f060c4ca3839a2371410ba09/cf/071f5037683647c2a3111d781e0bcfa3.2e6bb2b51350dee20b65bd01e72f9814->hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/2e6bb2b51350dee20b65bd01e72f9814/cf/071f5037683647c2a3111d781e0bcfa3-top 2023-07-15 03:12:15,666 DEBUG [StoreOpener-5f450e46f060c4ca3839a2371410ba09-1] regionserver.HStore(539): loaded hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/5f450e46f060c4ca3839a2371410ba09/cf/b09aedebb38b408e989e2bdfeec1f083.ea51b99bc24e6d3186aba3a9f59e829b->hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ea51b99bc24e6d3186aba3a9f59e829b/cf/b09aedebb38b408e989e2bdfeec1f083-top 2023-07-15 03:12:15,667 INFO [StoreOpener-5f450e46f060c4ca3839a2371410ba09-1] regionserver.HStore(310): Store=5f450e46f060c4ca3839a2371410ba09/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-15 03:12:15,668 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/5f450e46f060c4ca3839a2371410ba09 2023-07-15 03:12:15,669 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/5f450e46f060c4ca3839a2371410ba09 2023-07-15 03:12:15,672 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 5f450e46f060c4ca3839a2371410ba09 2023-07-15 03:12:15,673 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 5f450e46f060c4ca3839a2371410ba09; next sequenceid=9; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66476125, jitterRate=-0.009428545832633972}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-15 03:12:15,673 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 5f450e46f060c4ca3839a2371410ba09: 2023-07-15 03:12:15,674 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion-1,,1689390734071.5f450e46f060c4ca3839a2371410ba09., pid=77, masterSystemTime=1689390735592 2023-07-15 03:12:15,675 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.CompactSplit(328): Ignoring compaction request for testtb-testExportFileSystemStateWithMergeRegion-1,,1689390734071.5f450e46f060c4ca3839a2371410ba09.,because compaction is disabled. 2023-07-15 03:12:15,677 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion-1,,1689390734071.5f450e46f060c4ca3839a2371410ba09. 2023-07-15 03:12:15,677 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion-1,,1689390734071.5f450e46f060c4ca3839a2371410ba09. 2023-07-15 03:12:15,677 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=76 updating hbase:meta row=5f450e46f060c4ca3839a2371410ba09, regionState=OPEN, openSeqNum=9, regionLocation=jenkins-hbase4.apache.org,43199,1689390651225 2023-07-15 03:12:15,677 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689390734071.5f450e46f060c4ca3839a2371410ba09.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1689390735677"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689390735677"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689390735677"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689390735677"}]},"ts":"1689390735677"} 2023-07-15 03:12:15,681 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=77, resume processing ppid=76 2023-07-15 03:12:15,681 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=77, ppid=76, state=SUCCESS; OpenRegionProcedure 5f450e46f060c4ca3839a2371410ba09, server=jenkins-hbase4.apache.org,43199,1689390651225 in 245 msec 2023-07-15 03:12:15,682 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=76, resume processing ppid=71 2023-07-15 03:12:15,682 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=76, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=5f450e46f060c4ca3839a2371410ba09, ASSIGN in 405 msec 2023-07-15 03:12:15,684 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=71, state=SUCCESS; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[2e6bb2b51350dee20b65bd01e72f9814, ea51b99bc24e6d3186aba3a9f59e829b], force=true in 958 msec 2023-07-15 03:12:15,847 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41669] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-15 03:12:15,847 INFO [Listener at jenkins-hbase4.apache.org/44817] client.HBaseAdmin$TableFuture(3541): Operation: MERGE_REGIONS, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 71 completed 2023-07-15 03:12:15,848 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41669] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } 2023-07-15 03:12:15,848 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41669] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689390735848 (current time:1689390735848). 2023-07-15 03:12:15,848 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41669] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-15 03:12:15,848 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41669] zookeeper.ReadOnlyZKClient(139): Connect 0x56f4c71d to 127.0.0.1:62663 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-15 03:12:15,860 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41669] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@e7b31c4, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-15 03:12:15,862 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41669] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-15 03:12:15,866 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:60166, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-15 03:12:15,867 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41669] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x56f4c71d to 127.0.0.1:62663 2023-07-15 03:12:15,867 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41669] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-15 03:12:15,868 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41669] zookeeper.ReadOnlyZKClient(139): Connect 0x4f6b6a59 to 127.0.0.1:62663 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-15 03:12:15,885 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41669] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3f578086, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-15 03:12:15,889 DEBUG [hconnection-0x68f573b9-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-15 03:12:15,894 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:60172, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-15 03:12:15,899 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41669] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-15 03:12:15,902 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:53248, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-15 03:12:15,903 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41669] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4f6b6a59 to 127.0.0.1:62663 2023-07-15 03:12:15,903 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41669] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-15 03:12:15,903 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41669] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion-1], kv [jenkins: RWXCA] 2023-07-15 03:12:15,908 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41669] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-15 03:12:15,909 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41669] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } 2023-07-15 03:12:15,915 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41669] procedure2.ProcedureExecutor(1029): Stored pid=78, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE 2023-07-15 03:12:15,917 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=78, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE 2023-07-15 03:12:15,917 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=78, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE; timeout=600000, timestamp=1689391335917 2023-07-15 03:12:15,918 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41669] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } 2023-07-15 03:12:15,918 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-15 03:12:15,923 DEBUG [Listener at jenkins-hbase4.apache.org/44817] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-15 03:12:15,923 DEBUG [Listener at jenkins-hbase4.apache.org/44817] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-15 03:12:15,925 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=79, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED 2023-07-15 03:12:15,926 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=78, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE 2023-07-15 03:12:15,928 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=78, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE in 16 msec 2023-07-15 03:12:15,929 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=79, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED 2023-07-15 03:12:15,930 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=79, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED; timeout=600000, timestamp=1689391335930 2023-07-15 03:12:15,944 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 03:12:15,944 INFO [(jenkins-hbase4.apache.org,41669,1689390649760)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' 2023-07-15 03:12:15,944 DEBUG [(jenkins-hbase4.apache.org,41669,1689390649760)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-15 03:12:15,946 DEBUG [(jenkins-hbase4.apache.org,41669,1689390649760)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' 2023-07-15 03:12:15,946 DEBUG [(jenkins-hbase4.apache.org,41669,1689390649760)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1', kicking off acquire phase on members. 2023-07-15 03:12:15,947 DEBUG [(jenkins-hbase4.apache.org,41669,1689390649760)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41669-0x10166f610e80000, quorum=127.0.0.1:62663, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 03:12:15,947 DEBUG [(jenkins-hbase4.apache.org,41669,1689390649760)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 03:12:15,948 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): regionserver:43199-0x10166f610e80001, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 03:12:15,948 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): regionserver:38367-0x10166f610e80003, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 03:12:15,949 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 03:12:15,949 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 03:12:15,949 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 03:12:15,949 DEBUG [(jenkins-hbase4.apache.org,41669,1689390649760)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,43199,1689390651225 2023-07-15 03:12:15,949 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 03:12:15,954 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): regionserver:39199-0x10166f610e80002, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 03:12:15,955 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 03:12:15,955 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 03:12:15,949 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 03:12:15,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 03:12:15,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 03:12:15,963 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38367-0x10166f610e80003, quorum=127.0.0.1:62663, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 03:12:15,964 DEBUG [(jenkins-hbase4.apache.org,41669,1689390649760)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41669-0x10166f610e80000, quorum=127.0.0.1:62663, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,43199,1689390651225 2023-07-15 03:12:15,964 DEBUG [(jenkins-hbase4.apache.org,41669,1689390649760)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-15 03:12:15,967 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43199-0x10166f610e80001, quorum=127.0.0.1:62663, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 03:12:15,967 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 220 2023-07-15 03:12:15,967 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 03:12:15,967 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 from table testtb-testExportFileSystemStateWithMergeRegion-1 type FLUSH 2023-07-15 03:12:15,967 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 03:12:15,967 DEBUG [member: 'jenkins-hbase4.apache.org,38367,1689390651355' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' with timeout 300000ms 2023-07-15 03:12:15,967 DEBUG [member: 'jenkins-hbase4.apache.org,38367,1689390651355' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-15 03:12:15,970 DEBUG [member: 'jenkins-hbase4.apache.org,38367,1689390651355' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' stage 2023-07-15 03:12:15,970 DEBUG [member: 'jenkins-hbase4.apache.org,38367,1689390651355' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally acquired 2023-07-15 03:12:15,970 DEBUG [member: 'jenkins-hbase4.apache.org,38367,1689390651355' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38367,1689390651355' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion-1) in zk 2023-07-15 03:12:15,971 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39199-0x10166f610e80002, quorum=127.0.0.1:62663, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 03:12:15,973 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 220 2023-07-15 03:12:15,973 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 03:12:15,973 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 220 2023-07-15 03:12:15,973 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 03:12:15,973 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 from table testtb-testExportFileSystemStateWithMergeRegion-1 type FLUSH 2023-07-15 03:12:15,973 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 from table testtb-testExportFileSystemStateWithMergeRegion-1 type FLUSH 2023-07-15 03:12:15,976 DEBUG [member: 'jenkins-hbase4.apache.org,38367,1689390651355' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 03:12:15,976 DEBUG [member: 'jenkins-hbase4.apache.org,38367,1689390651355' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38367-0x10166f610e80003, quorum=127.0.0.1:62663, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 03:12:15,976 DEBUG [member: 'jenkins-hbase4.apache.org,38367,1689390651355' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-15 03:12:15,982 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 03:12:15,983 DEBUG [member: 'jenkins-hbase4.apache.org,43199,1689390651225' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' with timeout 300000ms 2023-07-15 03:12:15,983 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 03:12:15,983 DEBUG [member: 'jenkins-hbase4.apache.org,43199,1689390651225' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-15 03:12:15,983 DEBUG [member: 'jenkins-hbase4.apache.org,39199,1689390651299' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' with timeout 300000ms 2023-07-15 03:12:15,984 DEBUG [member: 'jenkins-hbase4.apache.org,43199,1689390651225' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' stage 2023-07-15 03:12:15,984 DEBUG [member: 'jenkins-hbase4.apache.org,43199,1689390651225' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally acquired 2023-07-15 03:12:15,984 DEBUG [member: 'jenkins-hbase4.apache.org,39199,1689390651299' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-15 03:12:15,984 DEBUG [member: 'jenkins-hbase4.apache.org,43199,1689390651225' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43199,1689390651225' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion-1) in zk 2023-07-15 03:12:15,985 DEBUG [member: 'jenkins-hbase4.apache.org,39199,1689390651299' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' stage 2023-07-15 03:12:15,985 DEBUG [member: 'jenkins-hbase4.apache.org,39199,1689390651299' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally acquired 2023-07-15 03:12:15,985 DEBUG [member: 'jenkins-hbase4.apache.org,39199,1689390651299' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39199,1689390651299' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion-1) in zk 2023-07-15 03:12:15,987 DEBUG [member: 'jenkins-hbase4.apache.org,43199,1689390651225' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 03:12:15,987 DEBUG [member: 'jenkins-hbase4.apache.org,39199,1689390651299' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 03:12:15,987 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): master:41669-0x10166f610e80000, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,43199,1689390651225 2023-07-15 03:12:15,987 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,43199,1689390651225 2023-07-15 03:12:15,987 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 03:12:15,987 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 03:12:15,987 DEBUG [member: 'jenkins-hbase4.apache.org,39199,1689390651299' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39199-0x10166f610e80002, quorum=127.0.0.1:62663, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 03:12:15,987 DEBUG [member: 'jenkins-hbase4.apache.org,39199,1689390651299' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-15 03:12:15,987 DEBUG [member: 'jenkins-hbase4.apache.org,43199,1689390651225' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43199-0x10166f610e80001, quorum=127.0.0.1:62663, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 03:12:15,988 DEBUG [member: 'jenkins-hbase4.apache.org,43199,1689390651225' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-15 03:12:15,988 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 03:12:15,988 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 03:12:15,988 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 03:12:15,989 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43199,1689390651225 2023-07-15 03:12:15,989 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39199,1689390651299 2023-07-15 03:12:15,989 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38367,1689390651355 2023-07-15 03:12:15,989 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 03:12:15,990 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43199,1689390651225' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' on coordinator 2023-07-15 03:12:15,990 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@47640e2f[Count = 0] remaining members to acquire global barrier 2023-07-15 03:12:15,990 DEBUG [(jenkins-hbase4.apache.org,41669,1689390649760)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'in-barrier' execution. 2023-07-15 03:12:15,990 DEBUG [(jenkins-hbase4.apache.org,41669,1689390649760)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 03:12:15,991 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): regionserver:43199-0x10166f610e80001, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 03:12:15,991 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): regionserver:38367-0x10166f610e80003, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 03:12:15,991 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 03:12:15,991 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 03:12:15,991 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): regionserver:39199-0x10166f610e80002, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 03:12:15,991 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 03:12:15,991 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 03:12:15,991 DEBUG [member: 'jenkins-hbase4.apache.org,38367,1689390651355' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' received 'reached' from coordinator. 2023-07-15 03:12:15,992 DEBUG [(jenkins-hbase4.apache.org,41669,1689390649760)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41669-0x10166f610e80000, quorum=127.0.0.1:62663, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,43199,1689390651225 2023-07-15 03:12:15,992 DEBUG [(jenkins-hbase4.apache.org,41669,1689390649760)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-15 03:12:15,991 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 03:12:15,992 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 03:12:15,992 DEBUG [member: 'jenkins-hbase4.apache.org,38367,1689390651355' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally completed 2023-07-15 03:12:15,992 DEBUG [member: 'jenkins-hbase4.apache.org,43199,1689390651225' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' received 'reached' from coordinator. 2023-07-15 03:12:15,992 DEBUG [member: 'jenkins-hbase4.apache.org,38367,1689390651355' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed for member 'jenkins-hbase4.apache.org,38367,1689390651355' in zk 2023-07-15 03:12:15,992 DEBUG [member: 'jenkins-hbase4.apache.org,39199,1689390651299' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' received 'reached' from coordinator. 2023-07-15 03:12:15,992 DEBUG [member: 'jenkins-hbase4.apache.org,39199,1689390651299' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally completed 2023-07-15 03:12:15,992 DEBUG [member: 'jenkins-hbase4.apache.org,39199,1689390651299' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed for member 'jenkins-hbase4.apache.org,39199,1689390651299' in zk 2023-07-15 03:12:15,992 DEBUG [member: 'jenkins-hbase4.apache.org,43199,1689390651225' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-15 03:12:15,992 DEBUG [member: 'jenkins-hbase4.apache.org,43199,1689390651225' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-15 03:12:15,992 DEBUG [rs(jenkins-hbase4.apache.org,43199,1689390651225)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion-1,,1689390734071.5f450e46f060c4ca3839a2371410ba09. 2023-07-15 03:12:15,992 DEBUG [rs(jenkins-hbase4.apache.org,43199,1689390651225)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion-1,,1689390734071.5f450e46f060c4ca3839a2371410ba09. started... 2023-07-15 03:12:15,994 DEBUG [rs(jenkins-hbase4.apache.org,43199,1689390651225)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 5f450e46f060c4ca3839a2371410ba09: 2023-07-15 03:12:15,994 DEBUG [rs(jenkins-hbase4.apache.org,43199,1689390651225)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion-1,,1689390734071.5f450e46f060c4ca3839a2371410ba09.' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 03:12:15,994 DEBUG [rs(jenkins-hbase4.apache.org,43199,1689390651225)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-15 03:12:15,994 DEBUG [rs(jenkins-hbase4.apache.org,43199,1689390651225)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/5f450e46f060c4ca3839a2371410ba09/cf/071f5037683647c2a3111d781e0bcfa3.2e6bb2b51350dee20b65bd01e72f9814->hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/2e6bb2b51350dee20b65bd01e72f9814/cf/071f5037683647c2a3111d781e0bcfa3-top, hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/5f450e46f060c4ca3839a2371410ba09/cf/b09aedebb38b408e989e2bdfeec1f083.ea51b99bc24e6d3186aba3a9f59e829b->hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ea51b99bc24e6d3186aba3a9f59e829b/cf/b09aedebb38b408e989e2bdfeec1f083-top] hfiles 2023-07-15 03:12:15,994 DEBUG [rs(jenkins-hbase4.apache.org,43199,1689390651225)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/2): hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/5f450e46f060c4ca3839a2371410ba09/cf/071f5037683647c2a3111d781e0bcfa3.2e6bb2b51350dee20b65bd01e72f9814 for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 03:12:15,995 DEBUG [member: 'jenkins-hbase4.apache.org,39199,1689390651299' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' has notified controller of completion 2023-07-15 03:12:15,995 DEBUG [member: 'jenkins-hbase4.apache.org,39199,1689390651299' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-15 03:12:15,995 DEBUG [member: 'jenkins-hbase4.apache.org,39199,1689390651299' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed. 2023-07-15 03:12:15,995 DEBUG [rs(jenkins-hbase4.apache.org,43199,1689390651225)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (2/2): hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/5f450e46f060c4ca3839a2371410ba09/cf/b09aedebb38b408e989e2bdfeec1f083.ea51b99bc24e6d3186aba3a9f59e829b for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 03:12:16,006 DEBUG [member: 'jenkins-hbase4.apache.org,38367,1689390651355' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' has notified controller of completion 2023-07-15 03:12:16,007 DEBUG [member: 'jenkins-hbase4.apache.org,38367,1689390651355' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-15 03:12:16,007 DEBUG [member: 'jenkins-hbase4.apache.org,38367,1689390651355' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed. 2023-07-15 03:12:16,015 DEBUG [rs(jenkins-hbase4.apache.org,43199,1689390651225)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion-1,,1689390734071.5f450e46f060c4ca3839a2371410ba09. completed. 2023-07-15 03:12:16,015 DEBUG [rs(jenkins-hbase4.apache.org,43199,1689390651225)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion-1,,1689390734071.5f450e46f060c4ca3839a2371410ba09. 2023-07-15 03:12:16,015 DEBUG [member: 'jenkins-hbase4.apache.org,43199,1689390651225' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-15 03:12:16,015 DEBUG [member: 'jenkins-hbase4.apache.org,43199,1689390651225' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-15 03:12:16,015 DEBUG [member: 'jenkins-hbase4.apache.org,43199,1689390651225' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,43199,1689390651225 2023-07-15 03:12:16,015 DEBUG [member: 'jenkins-hbase4.apache.org,43199,1689390651225' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally completed 2023-07-15 03:12:16,015 DEBUG [member: 'jenkins-hbase4.apache.org,43199,1689390651225' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed for member 'jenkins-hbase4.apache.org,43199,1689390651225' in zk 2023-07-15 03:12:16,021 DEBUG [member: 'jenkins-hbase4.apache.org,43199,1689390651225' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' has notified controller of completion 2023-07-15 03:12:16,021 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): master:41669-0x10166f610e80000, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,43199,1689390651225 2023-07-15 03:12:16,021 DEBUG [member: 'jenkins-hbase4.apache.org,43199,1689390651225' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-15 03:12:16,021 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,43199,1689390651225 2023-07-15 03:12:16,021 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 03:12:16,021 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 03:12:16,021 DEBUG [member: 'jenkins-hbase4.apache.org,43199,1689390651225' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed. 2023-07-15 03:12:16,022 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 03:12:16,022 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 03:12:16,022 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 03:12:16,022 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43199,1689390651225 2023-07-15 03:12:16,023 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39199,1689390651299 2023-07-15 03:12:16,023 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38367,1689390651355 2023-07-15 03:12:16,023 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 03:12:16,023 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 03:12:16,024 DEBUG [Listener at jenkins-hbase4.apache.org/44817] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-15 03:12:16,024 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43199,1689390651225 2023-07-15 03:12:16,024 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39199,1689390651299 2023-07-15 03:12:16,025 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41669] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } is done 2023-07-15 03:12:16,025 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41669] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }' is still in progress! 2023-07-15 03:12:16,025 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38367,1689390651355 2023-07-15 03:12:16,025 DEBUG [Listener at jenkins-hbase4.apache.org/44817] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-15 03:12:16,025 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' member 'jenkins-hbase4.apache.org,43199,1689390651225': 2023-07-15 03:12:16,026 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43199,1689390651225' released barrier for procedure'snaptb0-testExportFileSystemStateWithMergeRegion-1', counting down latch. Waiting for 0 more 2023-07-15 03:12:16,026 INFO [(jenkins-hbase4.apache.org,41669,1689390649760)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' execution completed 2023-07-15 03:12:16,026 DEBUG [(jenkins-hbase4.apache.org,41669,1689390649760)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-15 03:12:16,026 DEBUG [(jenkins-hbase4.apache.org,41669,1689390649760)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-15 03:12:16,026 DEBUG [(jenkins-hbase4.apache.org,41669,1689390649760)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 03:12:16,026 INFO [(jenkins-hbase4.apache.org,41669,1689390649760)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateWithMergeRegion-1including nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-15 03:12:16,028 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): regionserver:43199-0x10166f610e80001, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 03:12:16,028 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): regionserver:38367-0x10166f610e80003, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 03:12:16,028 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 03:12:16,028 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 03:12:16,028 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 03:12:16,028 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): regionserver:43199-0x10166f610e80001, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 03:12:16,028 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): master:41669-0x10166f610e80000, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 03:12:16,028 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 03:12:16,028 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): regionserver:39199-0x10166f610e80002, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 03:12:16,028 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): regionserver:38367-0x10166f610e80003, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 03:12:16,028 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 03:12:16,028 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 03:12:16,028 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 03:12:16,028 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 03:12:16,028 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 03:12:16,028 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): regionserver:39199-0x10166f610e80002, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 03:12:16,029 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 03:12:16,029 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 03:12:16,029 DEBUG [(jenkins-hbase4.apache.org,41669,1689390649760)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41669-0x10166f610e80000, quorum=127.0.0.1:62663, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,43199,1689390651225 2023-07-15 03:12:16,029 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 03:12:16,028 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 03:12:16,028 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 03:12:16,029 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 03:12:16,030 DEBUG [(jenkins-hbase4.apache.org,41669,1689390649760)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41669-0x10166f610e80000, quorum=127.0.0.1:62663, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,39199,1689390651299 2023-07-15 03:12:16,030 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 03:12:16,030 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 03:12:16,030 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 03:12:16,030 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 03:12:16,030 DEBUG [(jenkins-hbase4.apache.org,41669,1689390649760)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41669-0x10166f610e80000, quorum=127.0.0.1:62663, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,38367,1689390651355 2023-07-15 03:12:16,030 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 03:12:16,030 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 03:12:16,031 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 03:12:16,031 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43199,1689390651225 2023-07-15 03:12:16,031 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39199,1689390651299 2023-07-15 03:12:16,032 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38367,1689390651355 2023-07-15 03:12:16,032 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 03:12:16,032 DEBUG [(jenkins-hbase4.apache.org,41669,1689390649760)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41669-0x10166f610e80000, quorum=127.0.0.1:62663, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,43199,1689390651225 2023-07-15 03:12:16,032 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 03:12:16,032 DEBUG [(jenkins-hbase4.apache.org,41669,1689390649760)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41669-0x10166f610e80000, quorum=127.0.0.1:62663, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,39199,1689390651299 2023-07-15 03:12:16,033 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43199,1689390651225 2023-07-15 03:12:16,033 DEBUG [(jenkins-hbase4.apache.org,41669,1689390649760)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41669-0x10166f610e80000, quorum=127.0.0.1:62663, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,38367,1689390651355 2023-07-15 03:12:16,033 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39199,1689390651299 2023-07-15 03:12:16,034 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38367,1689390651355 2023-07-15 03:12:16,040 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): regionserver:43199-0x10166f610e80001, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 03:12:16,040 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): regionserver:43199-0x10166f610e80001, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 03:12:16,040 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 03:12:16,040 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 03:12:16,040 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): regionserver:38367-0x10166f610e80003, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 03:12:16,040 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): regionserver:38367-0x10166f610e80003, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 03:12:16,040 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 03:12:16,040 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 03:12:16,040 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 03:12:16,040 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): regionserver:39199-0x10166f610e80002, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 03:12:16,040 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 03:12:16,041 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 03:12:16,041 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 03:12:16,041 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 03:12:16,041 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 03:12:16,041 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 03:12:16,040 DEBUG [(jenkins-hbase4.apache.org,41669,1689390649760)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-15 03:12:16,040 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 03:12:16,042 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 03:12:16,040 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): regionserver:39199-0x10166f610e80002, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 03:12:16,042 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 03:12:16,042 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 03:12:16,042 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): master:41669-0x10166f610e80000, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,38367,1689390651355 2023-07-15 03:12:16,042 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): master:41669-0x10166f610e80000, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 03:12:16,042 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): master:41669-0x10166f610e80000, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,39199,1689390651299 2023-07-15 03:12:16,043 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): master:41669-0x10166f610e80000, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,43199,1689390651225 2023-07-15 03:12:16,043 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): master:41669-0x10166f610e80000, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 03:12:16,043 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): master:41669-0x10166f610e80000, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,38367,1689390651355 2023-07-15 03:12:16,043 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): master:41669-0x10166f610e80000, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 03:12:16,043 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): master:41669-0x10166f610e80000, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,39199,1689390651299 2023-07-15 03:12:16,043 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): master:41669-0x10166f610e80000, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,43199,1689390651225 2023-07-15 03:12:16,043 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): master:41669-0x10166f610e80000, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 03:12:16,043 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): master:41669-0x10166f610e80000, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 03:12:16,079 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 to hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 03:12:16,144 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 of table testtb-testExportFileSystemStateWithMergeRegion-1 completed 2023-07-15 03:12:16,145 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 03:12:16,145 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 03:12:16,145 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion-1 at 1689390735918Consolidate snapshot: snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1689390736040 (+122 ms)Loading Region manifests for snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1689390736040Writing data manifest for snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1689390736049 (+9 ms)Verifying snapshot: snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1689390736067 (+18 ms)Snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 of table testtb-testExportFileSystemStateWithMergeRegion-1 completed at 1689390736144 (+77 ms) 2023-07-15 03:12:16,149 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=79, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED 2023-07-15 03:12:16,151 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=79, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED in 226 msec 2023-07-15 03:12:16,225 DEBUG [Listener at jenkins-hbase4.apache.org/44817] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-15 03:12:16,226 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41669] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } is done 2023-07-15 03:12:16,227 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41669] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-15 03:12:16,227 INFO [Listener at jenkins-hbase4.apache.org/44817] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/export-test/export-1689390736227 2023-07-15 03:12:16,227 INFO [Listener at jenkins-hbase4.apache.org/44817] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:37513, tgtDir=hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/export-test/export-1689390736227, rawTgtDir=hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/export-test/export-1689390736227, srcFsUri=hdfs://localhost:37513, srcDir=hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280 2023-07-15 03:12:16,254 DEBUG [Listener at jenkins-hbase4.apache.org/44817] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:37513, inputRoot=hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280 2023-07-15 03:12:16,254 DEBUG [Listener at jenkins-hbase4.apache.org/44817] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_2004763734_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/export-test/export-1689390736227, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/export-test/export-1689390736227/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 03:12:16,254 INFO [Listener at jenkins-hbase4.apache.org/44817] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:37513, inputRoot=hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280, snapshotDir=hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1. 2023-07-15 03:12:16,263 INFO [Listener at jenkins-hbase4.apache.org/44817] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 to hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/export-test/export-1689390736227/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 03:12:16,299 DEBUG [Listener at jenkins-hbase4.apache.org/44817] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-15 03:12:16,300 DEBUG [Listener at jenkins-hbase4.apache.org/44817] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-15 03:12:16,300 DEBUG [Listener at jenkins-hbase4.apache.org/44817] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-15 03:12:16,301 DEBUG [Listener at jenkins-hbase4.apache.org/44817] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-15 03:12:16,453 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689390660463_0004_000001 (auth:SIMPLE) 2023-07-15 03:12:17,237 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-15 03:12:17,454 DEBUG [Listener at jenkins-hbase4.apache.org/44817] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6bc8dbaf-aac0-03cf-90d4-be6af049f709/hadoop-3365404356656338172.jar 2023-07-15 03:12:17,455 DEBUG [Listener at jenkins-hbase4.apache.org/44817] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-15 03:12:17,455 DEBUG [Listener at jenkins-hbase4.apache.org/44817] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-15 03:12:17,554 DEBUG [Listener at jenkins-hbase4.apache.org/44817] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6bc8dbaf-aac0-03cf-90d4-be6af049f709/hadoop-158930462185655277.jar 2023-07-15 03:12:17,555 DEBUG [Listener at jenkins-hbase4.apache.org/44817] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-15 03:12:17,556 DEBUG [Listener at jenkins-hbase4.apache.org/44817] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-15 03:12:17,556 DEBUG [Listener at jenkins-hbase4.apache.org/44817] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-15 03:12:17,557 DEBUG [Listener at jenkins-hbase4.apache.org/44817] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-15 03:12:17,557 DEBUG [Listener at jenkins-hbase4.apache.org/44817] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-15 03:12:17,558 DEBUG [Listener at jenkins-hbase4.apache.org/44817] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-15 03:12:17,558 DEBUG [Listener at jenkins-hbase4.apache.org/44817] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-15 03:12:17,559 DEBUG [Listener at jenkins-hbase4.apache.org/44817] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-15 03:12:17,560 DEBUG [Listener at jenkins-hbase4.apache.org/44817] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-15 03:12:17,560 DEBUG [Listener at jenkins-hbase4.apache.org/44817] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-15 03:12:17,561 DEBUG [Listener at jenkins-hbase4.apache.org/44817] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-15 03:12:17,562 DEBUG [Listener at jenkins-hbase4.apache.org/44817] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-15 03:12:17,562 DEBUG [Listener at jenkins-hbase4.apache.org/44817] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-15 03:12:17,562 DEBUG [Listener at jenkins-hbase4.apache.org/44817] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-15 03:12:17,563 DEBUG [Listener at jenkins-hbase4.apache.org/44817] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-15 03:12:17,564 DEBUG [Listener at jenkins-hbase4.apache.org/44817] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-15 03:12:17,564 DEBUG [Listener at jenkins-hbase4.apache.org/44817] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-15 03:12:17,565 DEBUG [Listener at jenkins-hbase4.apache.org/44817] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-15 03:12:17,566 DEBUG [Listener at jenkins-hbase4.apache.org/44817] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-15 03:12:17,566 DEBUG [Listener at jenkins-hbase4.apache.org/44817] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-15 03:12:17,567 DEBUG [Listener at jenkins-hbase4.apache.org/44817] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-15 03:12:17,567 DEBUG [Listener at jenkins-hbase4.apache.org/44817] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-15 03:12:17,568 DEBUG [Listener at jenkins-hbase4.apache.org/44817] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-15 03:12:18,725 WARN [Listener at jenkins-hbase4.apache.org/44817] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-15 03:12:18,727 INFO [Listener at jenkins-hbase4.apache.org/44817] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportFileSystemStateWithMergeRegion-1' hfile list 2023-07-15 03:12:18,730 DEBUG [Listener at jenkins-hbase4.apache.org/44817] snapshot.ExportSnapshot(671): export split=0 size=9.5 K 2023-07-15 03:12:18,821 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-15 03:12:18,822 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-15 03:12:19,464 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689390660463_0005_000001 (auth:SIMPLE) 2023-07-15 03:12:25,859 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689390660463_0005_000001 (auth:SIMPLE) 2023-07-15 03:12:28,187 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689390660463_0005_000001 (auth:SIMPLE) 2023-07-15 03:12:31,835 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689390660463_0005_000001 (auth:SIMPLE) 2023-07-15 03:12:33,192 INFO [Listener at jenkins-hbase4.apache.org/44817] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-15 03:12:33,200 INFO [Listener at jenkins-hbase4.apache.org/44817] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-15 03:12:33,241 INFO [Listener at jenkins-hbase4.apache.org/44817] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 03:12:33,241 INFO [Listener at jenkins-hbase4.apache.org/44817] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-15 03:12:33,243 INFO [Listener at jenkins-hbase4.apache.org/44817] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-15 03:12:33,243 DEBUG [Listener at jenkins-hbase4.apache.org/44817] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-924468511_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 at hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 03:12:33,244 DEBUG [Listener at jenkins-hbase4.apache.org/44817] snapshot.TestExportSnapshot(367): hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/.snapshotinfo 2023-07-15 03:12:33,244 DEBUG [Listener at jenkins-hbase4.apache.org/44817] snapshot.TestExportSnapshot(367): hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/data.manifest 2023-07-15 03:12:33,244 DEBUG [Listener at jenkins-hbase4.apache.org/44817] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-924468511_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/export-test/export-1689390736227/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 at hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/export-test/export-1689390736227/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 03:12:33,245 DEBUG [Listener at jenkins-hbase4.apache.org/44817] snapshot.TestExportSnapshot(367): hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/export-test/export-1689390736227/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/.snapshotinfo 2023-07-15 03:12:33,246 DEBUG [Listener at jenkins-hbase4.apache.org/44817] snapshot.TestExportSnapshot(367): hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/export-test/export-1689390736227/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/data.manifest 2023-07-15 03:12:33,263 INFO [Listener at jenkins-hbase4.apache.org/44817] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-15 03:12:33,263 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41669] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-15 03:12:33,265 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41669] procedure2.ProcedureExecutor(1029): Stored pid=80, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-15 03:12:33,269 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689390753269"}]},"ts":"1689390753269"} 2023-07-15 03:12:33,269 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41669] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-07-15 03:12:33,271 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=DISABLING in hbase:meta 2023-07-15 03:12:33,273 INFO [PEWorker-4] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemStateWithMergeRegion-1 to state=DISABLING 2023-07-15 03:12:33,274 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=81, ppid=80, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=5f450e46f060c4ca3839a2371410ba09, UNASSIGN}] 2023-07-15 03:12:33,277 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=81, ppid=80, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=5f450e46f060c4ca3839a2371410ba09, UNASSIGN 2023-07-15 03:12:33,282 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=81 updating hbase:meta row=5f450e46f060c4ca3839a2371410ba09, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,43199,1689390651225 2023-07-15 03:12:33,282 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689390734071.5f450e46f060c4ca3839a2371410ba09.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1689390753282"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689390753282"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689390753282"}]},"ts":"1689390753282"} 2023-07-15 03:12:33,289 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=82, ppid=81, state=RUNNABLE; CloseRegionProcedure 5f450e46f060c4ca3839a2371410ba09, server=jenkins-hbase4.apache.org,43199,1689390651225}] 2023-07-15 03:12:33,371 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41669] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-07-15 03:12:33,444 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 5f450e46f060c4ca3839a2371410ba09 2023-07-15 03:12:33,444 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 5f450e46f060c4ca3839a2371410ba09, disabling compactions & flushes 2023-07-15 03:12:33,444 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,,1689390734071.5f450e46f060c4ca3839a2371410ba09. 2023-07-15 03:12:33,444 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1689390734071.5f450e46f060c4ca3839a2371410ba09. 2023-07-15 03:12:33,444 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1689390734071.5f450e46f060c4ca3839a2371410ba09. after waiting 0 ms 2023-07-15 03:12:33,444 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,,1689390734071.5f450e46f060c4ca3839a2371410ba09. 2023-07-15 03:12:33,454 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/5f450e46f060c4ca3839a2371410ba09/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=8 2023-07-15 03:12:33,454 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-15 03:12:33,455 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,,1689390734071.5f450e46f060c4ca3839a2371410ba09. 2023-07-15 03:12:33,455 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 5f450e46f060c4ca3839a2371410ba09: 2023-07-15 03:12:33,457 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 5f450e46f060c4ca3839a2371410ba09 2023-07-15 03:12:33,457 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=81 updating hbase:meta row=5f450e46f060c4ca3839a2371410ba09, regionState=CLOSED 2023-07-15 03:12:33,458 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689390734071.5f450e46f060c4ca3839a2371410ba09.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1689390753457"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689390753457"}]},"ts":"1689390753457"} 2023-07-15 03:12:33,461 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=82, resume processing ppid=81 2023-07-15 03:12:33,461 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=82, ppid=81, state=SUCCESS; CloseRegionProcedure 5f450e46f060c4ca3839a2371410ba09, server=jenkins-hbase4.apache.org,43199,1689390651225 in 170 msec 2023-07-15 03:12:33,462 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=81, resume processing ppid=80 2023-07-15 03:12:33,463 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=81, ppid=80, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=5f450e46f060c4ca3839a2371410ba09, UNASSIGN in 187 msec 2023-07-15 03:12:33,463 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689390753463"}]},"ts":"1689390753463"} 2023-07-15 03:12:33,464 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=DISABLED in hbase:meta 2023-07-15 03:12:33,484 INFO [PEWorker-4] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemStateWithMergeRegion-1 to state=DISABLED 2023-07-15 03:12:33,486 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=80, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 in 221 msec 2023-07-15 03:12:33,572 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41669] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-07-15 03:12:33,572 INFO [Listener at jenkins-hbase4.apache.org/44817] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 80 completed 2023-07-15 03:12:33,573 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41669] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-15 03:12:33,574 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41669] procedure2.ProcedureExecutor(1029): Stored pid=83, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-15 03:12:33,590 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=83, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-15 03:12:33,590 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41669] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-15 03:12:33,591 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=83, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-15 03:12:33,593 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=39199] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-15 03:12:33,605 DEBUG [HFileArchiver-19] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/5f450e46f060c4ca3839a2371410ba09 2023-07-15 03:12:33,605 DEBUG [HFileArchiver-14] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ea51b99bc24e6d3186aba3a9f59e829b 2023-07-15 03:12:33,606 DEBUG [HFileArchiver-20] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/2e6bb2b51350dee20b65bd01e72f9814 2023-07-15 03:12:33,609 DEBUG [HFileArchiver-14] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ea51b99bc24e6d3186aba3a9f59e829b/cf, FileablePath, hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ea51b99bc24e6d3186aba3a9f59e829b/recovered.edits] 2023-07-15 03:12:33,611 DEBUG [HFileArchiver-19] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/5f450e46f060c4ca3839a2371410ba09/cf, FileablePath, hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/5f450e46f060c4ca3839a2371410ba09/recovered.edits] 2023-07-15 03:12:33,612 DEBUG [HFileArchiver-20] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/2e6bb2b51350dee20b65bd01e72f9814/cf, FileablePath, hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/2e6bb2b51350dee20b65bd01e72f9814/recovered.edits] 2023-07-15 03:12:33,620 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ea51b99bc24e6d3186aba3a9f59e829b/cf/b09aedebb38b408e989e2bdfeec1f083 to hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ea51b99bc24e6d3186aba3a9f59e829b/cf/b09aedebb38b408e989e2bdfeec1f083 2023-07-15 03:12:33,623 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): regionserver:39199-0x10166f610e80002, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-15 03:12:33,623 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): regionserver:38367-0x10166f610e80003, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-15 03:12:33,623 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): regionserver:43199-0x10166f610e80001, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-15 03:12:33,623 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): master:41669-0x10166f610e80000, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-15 03:12:33,624 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-07-15 03:12:33,624 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-07-15 03:12:33,624 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-07-15 03:12:33,624 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-07-15 03:12:33,627 DEBUG [HFileArchiver-20] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/2e6bb2b51350dee20b65bd01e72f9814/cf/071f5037683647c2a3111d781e0bcfa3 to hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/2e6bb2b51350dee20b65bd01e72f9814/cf/071f5037683647c2a3111d781e0bcfa3 2023-07-15 03:12:33,628 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/5f450e46f060c4ca3839a2371410ba09/cf/071f5037683647c2a3111d781e0bcfa3.2e6bb2b51350dee20b65bd01e72f9814 to hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/5f450e46f060c4ca3839a2371410ba09/cf/071f5037683647c2a3111d781e0bcfa3.2e6bb2b51350dee20b65bd01e72f9814 2023-07-15 03:12:33,630 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): regionserver:43199-0x10166f610e80001, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-15 03:12:33,630 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): regionserver:38367-0x10166f610e80003, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-15 03:12:33,630 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): regionserver:38367-0x10166f610e80003, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-15 03:12:33,630 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): regionserver:39199-0x10166f610e80002, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-15 03:12:33,630 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): regionserver:39199-0x10166f610e80002, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-15 03:12:33,630 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): master:41669-0x10166f610e80000, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-15 03:12:33,630 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): master:41669-0x10166f610e80000, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-15 03:12:33,630 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): regionserver:43199-0x10166f610e80001, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-15 03:12:33,631 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41669] master.MasterRpcServices(1230): Checking to see if procedure is done pid=83 2023-07-15 03:12:33,631 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ea51b99bc24e6d3186aba3a9f59e829b/recovered.edits/8.seqid to hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ea51b99bc24e6d3186aba3a9f59e829b/recovered.edits/8.seqid 2023-07-15 03:12:33,633 DEBUG [HFileArchiver-14] backup.HFileArchiver(596): Deleted hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ea51b99bc24e6d3186aba3a9f59e829b 2023-07-15 03:12:33,633 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/5f450e46f060c4ca3839a2371410ba09/cf/b09aedebb38b408e989e2bdfeec1f083.ea51b99bc24e6d3186aba3a9f59e829b to hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/5f450e46f060c4ca3839a2371410ba09/cf/b09aedebb38b408e989e2bdfeec1f083.ea51b99bc24e6d3186aba3a9f59e829b 2023-07-15 03:12:33,634 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-15 03:12:33,634 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-15 03:12:33,634 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-15 03:12:33,634 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-15 03:12:33,637 DEBUG [HFileArchiver-20] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/2e6bb2b51350dee20b65bd01e72f9814/recovered.edits/8.seqid to hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/2e6bb2b51350dee20b65bd01e72f9814/recovered.edits/8.seqid 2023-07-15 03:12:33,640 DEBUG [HFileArchiver-20] backup.HFileArchiver(596): Deleted hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/2e6bb2b51350dee20b65bd01e72f9814 2023-07-15 03:12:33,642 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/5f450e46f060c4ca3839a2371410ba09/recovered.edits/12.seqid to hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/5f450e46f060c4ca3839a2371410ba09/recovered.edits/12.seqid 2023-07-15 03:12:33,652 DEBUG [HFileArchiver-19] backup.HFileArchiver(596): Deleted hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/5f450e46f060c4ca3839a2371410ba09 2023-07-15 03:12:33,652 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion-1 regions 2023-07-15 03:12:33,655 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=83, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-15 03:12:33,662 WARN [PEWorker-3] procedure.DeleteTableProcedure(384): Deleting some vestigial 1 rows of testtb-testExportFileSystemStateWithMergeRegion-1 from hbase:meta 2023-07-15 03:12:33,673 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemStateWithMergeRegion-1' descriptor. 2023-07-15 03:12:33,683 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=83, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-15 03:12:33,683 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemStateWithMergeRegion-1' from region states. 2023-07-15 03:12:33,684 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689390734071.5f450e46f060c4ca3839a2371410ba09.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689390753683"}]},"ts":"9223372036854775807"} 2023-07-15 03:12:33,686 INFO [PEWorker-3] hbase.MetaTableAccessor(1788): Deleted 1 regions from META 2023-07-15 03:12:33,687 DEBUG [PEWorker-3] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 5f450e46f060c4ca3839a2371410ba09, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1689390734071.5f450e46f060c4ca3839a2371410ba09.', STARTKEY => '', ENDKEY => ''}] 2023-07-15 03:12:33,687 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemStateWithMergeRegion-1' as deleted. 2023-07-15 03:12:33,687 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689390753687"}]},"ts":"9223372036854775807"} 2023-07-15 03:12:33,689 INFO [PEWorker-3] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemStateWithMergeRegion-1 state from META 2023-07-15 03:12:33,691 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(130): Finished pid=83, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-15 03:12:33,693 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=83, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 in 118 msec 2023-07-15 03:12:33,733 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41669] master.MasterRpcServices(1230): Checking to see if procedure is done pid=83 2023-07-15 03:12:33,733 INFO [Listener at jenkins-hbase4.apache.org/44817] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 83 completed 2023-07-15 03:12:33,734 INFO [Listener at jenkins-hbase4.apache.org/44817] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemStateWithMergeRegion 2023-07-15 03:12:33,734 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41669] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemStateWithMergeRegion 2023-07-15 03:12:33,735 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41669] procedure2.ProcedureExecutor(1029): Stored pid=84, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-15 03:12:33,739 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41669] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-07-15 03:12:33,739 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689390753739"}]},"ts":"1689390753739"} 2023-07-15 03:12:33,740 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=DISABLING in hbase:meta 2023-07-15 03:12:33,742 INFO [PEWorker-2] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemStateWithMergeRegion to state=DISABLING 2023-07-15 03:12:33,743 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=85, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=e2d26928a79bc451f2d14aec9f529adf, UNASSIGN}, {pid=86, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=69b083820c2a58813f79ecd7d05b8ee7, UNASSIGN}] 2023-07-15 03:12:33,746 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=85, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=e2d26928a79bc451f2d14aec9f529adf, UNASSIGN 2023-07-15 03:12:33,746 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=86, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=69b083820c2a58813f79ecd7d05b8ee7, UNASSIGN 2023-07-15 03:12:33,746 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=85 updating hbase:meta row=e2d26928a79bc451f2d14aec9f529adf, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,39199,1689390651299 2023-07-15 03:12:33,746 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=86 updating hbase:meta row=69b083820c2a58813f79ecd7d05b8ee7, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,38367,1689390651355 2023-07-15 03:12:33,747 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1689390732199.69b083820c2a58813f79ecd7d05b8ee7.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689390753746"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689390753746"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689390753746"}]},"ts":"1689390753746"} 2023-07-15 03:12:33,747 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1689390732199.e2d26928a79bc451f2d14aec9f529adf.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689390753746"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689390753746"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689390753746"}]},"ts":"1689390753746"} 2023-07-15 03:12:33,752 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=87, ppid=86, state=RUNNABLE; CloseRegionProcedure 69b083820c2a58813f79ecd7d05b8ee7, server=jenkins-hbase4.apache.org,38367,1689390651355}] 2023-07-15 03:12:33,753 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=88, ppid=85, state=RUNNABLE; CloseRegionProcedure e2d26928a79bc451f2d14aec9f529adf, server=jenkins-hbase4.apache.org,39199,1689390651299}] 2023-07-15 03:12:33,844 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41669] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-07-15 03:12:33,913 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 69b083820c2a58813f79ecd7d05b8ee7 2023-07-15 03:12:33,913 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close e2d26928a79bc451f2d14aec9f529adf 2023-07-15 03:12:33,913 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 69b083820c2a58813f79ecd7d05b8ee7, disabling compactions & flushes 2023-07-15 03:12:33,913 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,1,1689390732199.69b083820c2a58813f79ecd7d05b8ee7. 2023-07-15 03:12:33,913 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing e2d26928a79bc451f2d14aec9f529adf, disabling compactions & flushes 2023-07-15 03:12:33,913 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1689390732199.69b083820c2a58813f79ecd7d05b8ee7. 2023-07-15 03:12:33,913 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,,1689390732199.e2d26928a79bc451f2d14aec9f529adf. 2023-07-15 03:12:33,913 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1689390732199.69b083820c2a58813f79ecd7d05b8ee7. after waiting 0 ms 2023-07-15 03:12:33,913 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,,1689390732199.e2d26928a79bc451f2d14aec9f529adf. 2023-07-15 03:12:33,913 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,,1689390732199.e2d26928a79bc451f2d14aec9f529adf. after waiting 0 ms 2023-07-15 03:12:33,913 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,,1689390732199.e2d26928a79bc451f2d14aec9f529adf. 2023-07-15 03:12:33,913 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,1,1689390732199.69b083820c2a58813f79ecd7d05b8ee7. 2023-07-15 03:12:33,940 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/data/default/testtb-testExportFileSystemStateWithMergeRegion/e2d26928a79bc451f2d14aec9f529adf/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-15 03:12:33,941 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-15 03:12:33,942 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,,1689390732199.e2d26928a79bc451f2d14aec9f529adf. 2023-07-15 03:12:33,942 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for e2d26928a79bc451f2d14aec9f529adf: 2023-07-15 03:12:33,942 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/data/default/testtb-testExportFileSystemStateWithMergeRegion/69b083820c2a58813f79ecd7d05b8ee7/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-15 03:12:33,943 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-15 03:12:33,944 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,1,1689390732199.69b083820c2a58813f79ecd7d05b8ee7. 2023-07-15 03:12:33,944 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 69b083820c2a58813f79ecd7d05b8ee7: 2023-07-15 03:12:33,944 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed e2d26928a79bc451f2d14aec9f529adf 2023-07-15 03:12:33,945 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=85 updating hbase:meta row=e2d26928a79bc451f2d14aec9f529adf, regionState=CLOSED 2023-07-15 03:12:33,945 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1689390732199.e2d26928a79bc451f2d14aec9f529adf.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689390753945"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689390753945"}]},"ts":"1689390753945"} 2023-07-15 03:12:33,947 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 69b083820c2a58813f79ecd7d05b8ee7 2023-07-15 03:12:33,947 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=86 updating hbase:meta row=69b083820c2a58813f79ecd7d05b8ee7, regionState=CLOSED 2023-07-15 03:12:33,947 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1689390732199.69b083820c2a58813f79ecd7d05b8ee7.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689390753947"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689390753947"}]},"ts":"1689390753947"} 2023-07-15 03:12:33,949 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=88, resume processing ppid=85 2023-07-15 03:12:33,949 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=88, ppid=85, state=SUCCESS; CloseRegionProcedure e2d26928a79bc451f2d14aec9f529adf, server=jenkins-hbase4.apache.org,39199,1689390651299 in 194 msec 2023-07-15 03:12:33,950 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=85, ppid=84, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=e2d26928a79bc451f2d14aec9f529adf, UNASSIGN in 206 msec 2023-07-15 03:12:33,952 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=87, resume processing ppid=86 2023-07-15 03:12:33,952 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=87, ppid=86, state=SUCCESS; CloseRegionProcedure 69b083820c2a58813f79ecd7d05b8ee7, server=jenkins-hbase4.apache.org,38367,1689390651355 in 197 msec 2023-07-15 03:12:33,957 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=86, resume processing ppid=84 2023-07-15 03:12:33,957 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=86, ppid=84, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=69b083820c2a58813f79ecd7d05b8ee7, UNASSIGN in 209 msec 2023-07-15 03:12:33,959 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689390753959"}]},"ts":"1689390753959"} 2023-07-15 03:12:33,961 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=DISABLED in hbase:meta 2023-07-15 03:12:33,963 INFO [PEWorker-2] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemStateWithMergeRegion to state=DISABLED 2023-07-15 03:12:33,984 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=84, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion in 234 msec 2023-07-15 03:12:34,046 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41669] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-07-15 03:12:34,046 INFO [Listener at jenkins-hbase4.apache.org/44817] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion, procId: 84 completed 2023-07-15 03:12:34,047 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41669] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemStateWithMergeRegion 2023-07-15 03:12:34,051 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41669] procedure2.ProcedureExecutor(1029): Stored pid=89, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-15 03:12:34,054 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=89, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-15 03:12:34,056 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41669] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemStateWithMergeRegion 2023-07-15 03:12:34,058 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=89, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-15 03:12:34,058 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=39199] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemStateWithMergeRegion 2023-07-15 03:12:34,062 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): regionserver:43199-0x10166f610e80001, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-15 03:12:34,062 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): regionserver:38367-0x10166f610e80003, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-15 03:12:34,062 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): master:41669-0x10166f610e80000, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-15 03:12:34,062 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): regionserver:39199-0x10166f610e80002, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-15 03:12:34,062 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-07-15 03:12:34,063 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-07-15 03:12:34,063 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-07-15 03:12:34,063 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-07-15 03:12:34,065 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/e2d26928a79bc451f2d14aec9f529adf 2023-07-15 03:12:34,065 DEBUG [HFileArchiver-16] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/69b083820c2a58813f79ecd7d05b8ee7 2023-07-15 03:12:34,065 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): regionserver:38367-0x10166f610e80003, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-15 03:12:34,065 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): regionserver:38367-0x10166f610e80003, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-15 03:12:34,065 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): master:41669-0x10166f610e80000, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-15 03:12:34,065 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): regionserver:39199-0x10166f610e80002, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-15 03:12:34,065 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): regionserver:39199-0x10166f610e80002, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-15 03:12:34,065 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): regionserver:43199-0x10166f610e80001, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-15 03:12:34,066 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): regionserver:43199-0x10166f610e80001, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-15 03:12:34,065 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): master:41669-0x10166f610e80000, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-15 03:12:34,067 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41669] master.MasterRpcServices(1230): Checking to see if procedure is done pid=89 2023-07-15 03:12:34,068 DEBUG [HFileArchiver-13] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/e2d26928a79bc451f2d14aec9f529adf/cf, FileablePath, hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/e2d26928a79bc451f2d14aec9f529adf/recovered.edits] 2023-07-15 03:12:34,069 DEBUG [HFileArchiver-16] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/69b083820c2a58813f79ecd7d05b8ee7/cf, FileablePath, hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/69b083820c2a58813f79ecd7d05b8ee7/recovered.edits] 2023-07-15 03:12:34,074 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/e2d26928a79bc451f2d14aec9f529adf/cf/ddded7429ca8444492e2fd26aa66be49 to hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/e2d26928a79bc451f2d14aec9f529adf/cf/ddded7429ca8444492e2fd26aa66be49 2023-07-15 03:12:34,075 DEBUG [HFileArchiver-16] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/69b083820c2a58813f79ecd7d05b8ee7/cf/6d964e333b864c3db35342ff0be57959 to hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/69b083820c2a58813f79ecd7d05b8ee7/cf/6d964e333b864c3db35342ff0be57959 2023-07-15 03:12:34,086 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/e2d26928a79bc451f2d14aec9f529adf/recovered.edits/9.seqid to hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/e2d26928a79bc451f2d14aec9f529adf/recovered.edits/9.seqid 2023-07-15 03:12:34,087 DEBUG [HFileArchiver-13] backup.HFileArchiver(596): Deleted hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/e2d26928a79bc451f2d14aec9f529adf 2023-07-15 03:12:34,088 DEBUG [HFileArchiver-16] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/69b083820c2a58813f79ecd7d05b8ee7/recovered.edits/9.seqid to hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/69b083820c2a58813f79ecd7d05b8ee7/recovered.edits/9.seqid 2023-07-15 03:12:34,088 DEBUG [HFileArchiver-16] backup.HFileArchiver(596): Deleted hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/69b083820c2a58813f79ecd7d05b8ee7 2023-07-15 03:12:34,088 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion regions 2023-07-15 03:12:34,091 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=89, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-15 03:12:34,093 WARN [PEWorker-5] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportFileSystemStateWithMergeRegion from hbase:meta 2023-07-15 03:12:34,095 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemStateWithMergeRegion' descriptor. 2023-07-15 03:12:34,096 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=89, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-15 03:12:34,096 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemStateWithMergeRegion' from region states. 2023-07-15 03:12:34,096 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1689390732199.e2d26928a79bc451f2d14aec9f529adf.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689390754096"}]},"ts":"9223372036854775807"} 2023-07-15 03:12:34,097 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1689390732199.69b083820c2a58813f79ecd7d05b8ee7.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689390754096"}]},"ts":"9223372036854775807"} 2023-07-15 03:12:34,102 INFO [PEWorker-5] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-15 03:12:34,103 DEBUG [PEWorker-5] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => e2d26928a79bc451f2d14aec9f529adf, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,,1689390732199.e2d26928a79bc451f2d14aec9f529adf.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 69b083820c2a58813f79ecd7d05b8ee7, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,1,1689390732199.69b083820c2a58813f79ecd7d05b8ee7.', STARTKEY => '1', ENDKEY => ''}] 2023-07-15 03:12:34,103 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemStateWithMergeRegion' as deleted. 2023-07-15 03:12:34,103 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689390754103"}]},"ts":"9223372036854775807"} 2023-07-15 03:12:34,105 INFO [PEWorker-5] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemStateWithMergeRegion state from META 2023-07-15 03:12:34,107 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(130): Finished pid=89, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-15 03:12:34,108 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=89, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion in 60 msec 2023-07-15 03:12:34,168 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41669] master.MasterRpcServices(1230): Checking to see if procedure is done pid=89 2023-07-15 03:12:34,168 INFO [Listener at jenkins-hbase4.apache.org/44817] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion, procId: 89 completed 2023-07-15 03:12:34,182 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41669] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportFileSystemStateWithMergeRegion" 2023-07-15 03:12:34,184 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41669] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 03:12:34,186 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41669] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemStateWithMergeRegion" 2023-07-15 03:12:34,188 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41669] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 03:12:34,189 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41669] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemStateWithMergeRegion-1" 2023-07-15 03:12:34,191 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41669] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 03:12:34,232 INFO [Listener at jenkins-hbase4.apache.org/44817] hbase.ResourceChecker(175): after: snapshot.TestSecureExportSnapshot#testExportFileSystemStateWithMergeRegion Thread=759 (was 747) Potentially hanging thread: HFileArchiver-19 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-7 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-924468511_17 at /127.0.0.1:45012 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x337e74cd-shared-pool-31 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LogDeleter #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1088) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x337e74cd-shared-pool-28 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-20 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-16 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1782932622_1 at /127.0.0.1:43824 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x337e74cd-shared-pool-30 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x337e74cd-shared-pool-32 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-17 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x337e74cd-shared-pool-29 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-924468511_17 at /127.0.0.1:43862 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #8 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-18 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1988502388) connection to jenkins-hbase4.apache.org/172.31.14.131:43695 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: ApplicationMasterLauncher #7 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-6 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-5 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-3829 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-924468511_17 at /127.0.0.1:44998 [Waiting for operation #6] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x337e74cd-shared-pool-27 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-15 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_236459409_17 at /127.0.0.1:51716 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=900 (was 893) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=600 (was 360) - SystemLoadAverage LEAK? -, ProcessCount=186 (was 183) - ProcessCount LEAK? -, AvailableMemoryMB=2022 (was 2573) 2023-07-15 03:12:34,233 WARN [Listener at jenkins-hbase4.apache.org/44817] hbase.ResourceChecker(130): Thread=759 is superior to 500 2023-07-15 03:12:34,257 INFO [Listener at jenkins-hbase4.apache.org/44817] hbase.ResourceChecker(147): before: snapshot.TestSecureExportSnapshot#testEmptyExportFileSystemState Thread=759, OpenFileDescriptor=900, MaxFileDescriptor=60000, SystemLoadAverage=600, ProcessCount=186, AvailableMemoryMB=2021 2023-07-15 03:12:34,257 WARN [Listener at jenkins-hbase4.apache.org/44817] hbase.ResourceChecker(130): Thread=759 is superior to 500 2023-07-15 03:12:34,259 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41669] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testEmptyExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-15 03:12:34,260 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41669] procedure2.ProcedureExecutor(1029): Stored pid=90, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-15 03:12:34,262 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_PRE_OPERATION 2023-07-15 03:12:34,262 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41669] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testEmptyExportFileSystemState" procId is: 90 2023-07-15 03:12:34,267 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41669] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-07-15 03:12:34,268 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-15 03:12:34,270 DEBUG [HFileArchiver-15] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/.tmp/data/default/testtb-testEmptyExportFileSystemState/1e28f8f1fb6dda10f23d6d6d9fc3565a 2023-07-15 03:12:34,270 DEBUG [HFileArchiver-17] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/.tmp/data/default/testtb-testEmptyExportFileSystemState/0d3dafb4371d91b47676a6fb9ea4c421 2023-07-15 03:12:34,271 DEBUG [HFileArchiver-15] backup.HFileArchiver(153): Directory hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/.tmp/data/default/testtb-testEmptyExportFileSystemState/1e28f8f1fb6dda10f23d6d6d9fc3565a empty. 2023-07-15 03:12:34,271 DEBUG [HFileArchiver-17] backup.HFileArchiver(153): Directory hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/.tmp/data/default/testtb-testEmptyExportFileSystemState/0d3dafb4371d91b47676a6fb9ea4c421 empty. 2023-07-15 03:12:34,271 DEBUG [HFileArchiver-15] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/.tmp/data/default/testtb-testEmptyExportFileSystemState/1e28f8f1fb6dda10f23d6d6d9fc3565a 2023-07-15 03:12:34,271 DEBUG [HFileArchiver-17] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/.tmp/data/default/testtb-testEmptyExportFileSystemState/0d3dafb4371d91b47676a6fb9ea4c421 2023-07-15 03:12:34,272 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testtb-testEmptyExportFileSystemState regions 2023-07-15 03:12:34,295 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/.tmp/data/default/testtb-testEmptyExportFileSystemState/.tabledesc/.tableinfo.0000000001 2023-07-15 03:12:34,297 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(7675): creating {ENCODED => 0d3dafb4371d91b47676a6fb9ea4c421, NAME => 'testtb-testEmptyExportFileSystemState,1,1689390754258.0d3dafb4371d91b47676a6fb9ea4c421.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testEmptyExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/.tmp 2023-07-15 03:12:34,297 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(7675): creating {ENCODED => 1e28f8f1fb6dda10f23d6d6d9fc3565a, NAME => 'testtb-testEmptyExportFileSystemState,,1689390754258.1e28f8f1fb6dda10f23d6d6d9fc3565a.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testEmptyExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/.tmp 2023-07-15 03:12:34,346 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,1,1689390754258.0d3dafb4371d91b47676a6fb9ea4c421.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-15 03:12:34,346 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1604): Closing 0d3dafb4371d91b47676a6fb9ea4c421, disabling compactions & flushes 2023-07-15 03:12:34,346 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,1,1689390754258.0d3dafb4371d91b47676a6fb9ea4c421. 2023-07-15 03:12:34,346 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,1,1689390754258.0d3dafb4371d91b47676a6fb9ea4c421. 2023-07-15 03:12:34,347 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,1,1689390754258.0d3dafb4371d91b47676a6fb9ea4c421. after waiting 0 ms 2023-07-15 03:12:34,347 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,1,1689390754258.0d3dafb4371d91b47676a6fb9ea4c421. 2023-07-15 03:12:34,347 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,1,1689390754258.0d3dafb4371d91b47676a6fb9ea4c421. 2023-07-15 03:12:34,347 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1558): Region close journal for 0d3dafb4371d91b47676a6fb9ea4c421: 2023-07-15 03:12:34,347 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,,1689390754258.1e28f8f1fb6dda10f23d6d6d9fc3565a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-15 03:12:34,348 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1604): Closing 1e28f8f1fb6dda10f23d6d6d9fc3565a, disabling compactions & flushes 2023-07-15 03:12:34,348 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,,1689390754258.1e28f8f1fb6dda10f23d6d6d9fc3565a. 2023-07-15 03:12:34,348 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,,1689390754258.1e28f8f1fb6dda10f23d6d6d9fc3565a. 2023-07-15 03:12:34,348 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,,1689390754258.1e28f8f1fb6dda10f23d6d6d9fc3565a. after waiting 0 ms 2023-07-15 03:12:34,348 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,,1689390754258.1e28f8f1fb6dda10f23d6d6d9fc3565a. 2023-07-15 03:12:34,348 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,,1689390754258.1e28f8f1fb6dda10f23d6d6d9fc3565a. 2023-07-15 03:12:34,348 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1558): Region close journal for 1e28f8f1fb6dda10f23d6d6d9fc3565a: 2023-07-15 03:12:34,351 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_ADD_TO_META 2023-07-15 03:12:34,351 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,1,1689390754258.0d3dafb4371d91b47676a6fb9ea4c421.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689390754351"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689390754351"}]},"ts":"1689390754351"} 2023-07-15 03:12:34,352 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,,1689390754258.1e28f8f1fb6dda10f23d6d6d9fc3565a.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689390754351"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689390754351"}]},"ts":"1689390754351"} 2023-07-15 03:12:34,353 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-15 03:12:34,361 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-15 03:12:34,362 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689390754361"}]},"ts":"1689390754361"} 2023-07-15 03:12:34,363 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=ENABLING in hbase:meta 2023-07-15 03:12:34,367 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-15 03:12:34,368 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41669] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-07-15 03:12:34,369 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-15 03:12:34,369 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-15 03:12:34,369 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-15 03:12:34,369 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-15 03:12:34,369 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=91, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=1e28f8f1fb6dda10f23d6d6d9fc3565a, ASSIGN}, {pid=92, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=0d3dafb4371d91b47676a6fb9ea4c421, ASSIGN}] 2023-07-15 03:12:34,382 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=91, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=1e28f8f1fb6dda10f23d6d6d9fc3565a, ASSIGN 2023-07-15 03:12:34,382 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=92, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=0d3dafb4371d91b47676a6fb9ea4c421, ASSIGN 2023-07-15 03:12:34,383 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=91, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=1e28f8f1fb6dda10f23d6d6d9fc3565a, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,38367,1689390651355; forceNewPlan=false, retain=false 2023-07-15 03:12:34,384 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=92, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=0d3dafb4371d91b47676a6fb9ea4c421, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,43199,1689390651225; forceNewPlan=false, retain=false 2023-07-15 03:12:34,534 INFO [jenkins-hbase4:41669] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-15 03:12:34,536 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=91 updating hbase:meta row=1e28f8f1fb6dda10f23d6d6d9fc3565a, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,38367,1689390651355 2023-07-15 03:12:34,536 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=92 updating hbase:meta row=0d3dafb4371d91b47676a6fb9ea4c421, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,43199,1689390651225 2023-07-15 03:12:34,537 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,,1689390754258.1e28f8f1fb6dda10f23d6d6d9fc3565a.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689390754536"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689390754536"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689390754536"}]},"ts":"1689390754536"} 2023-07-15 03:12:34,537 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,1,1689390754258.0d3dafb4371d91b47676a6fb9ea4c421.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689390754536"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689390754536"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689390754536"}]},"ts":"1689390754536"} 2023-07-15 03:12:34,538 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=93, ppid=91, state=RUNNABLE; OpenRegionProcedure 1e28f8f1fb6dda10f23d6d6d9fc3565a, server=jenkins-hbase4.apache.org,38367,1689390651355}] 2023-07-15 03:12:34,539 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=94, ppid=92, state=RUNNABLE; OpenRegionProcedure 0d3dafb4371d91b47676a6fb9ea4c421, server=jenkins-hbase4.apache.org,43199,1689390651225}] 2023-07-15 03:12:34,569 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41669] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-07-15 03:12:34,694 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testEmptyExportFileSystemState,,1689390754258.1e28f8f1fb6dda10f23d6d6d9fc3565a. 2023-07-15 03:12:34,694 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 1e28f8f1fb6dda10f23d6d6d9fc3565a, NAME => 'testtb-testEmptyExportFileSystemState,,1689390754258.1e28f8f1fb6dda10f23d6d6d9fc3565a.', STARTKEY => '', ENDKEY => '1'} 2023-07-15 03:12:34,694 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testEmptyExportFileSystemState,1,1689390754258.0d3dafb4371d91b47676a6fb9ea4c421. 2023-07-15 03:12:34,694 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testEmptyExportFileSystemState,,1689390754258.1e28f8f1fb6dda10f23d6d6d9fc3565a. service=AccessControlService 2023-07-15 03:12:34,694 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 0d3dafb4371d91b47676a6fb9ea4c421, NAME => 'testtb-testEmptyExportFileSystemState,1,1689390754258.0d3dafb4371d91b47676a6fb9ea4c421.', STARTKEY => '1', ENDKEY => ''} 2023-07-15 03:12:34,694 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-15 03:12:34,694 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testEmptyExportFileSystemState,1,1689390754258.0d3dafb4371d91b47676a6fb9ea4c421. service=AccessControlService 2023-07-15 03:12:34,695 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testEmptyExportFileSystemState 1e28f8f1fb6dda10f23d6d6d9fc3565a 2023-07-15 03:12:34,695 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,,1689390754258.1e28f8f1fb6dda10f23d6d6d9fc3565a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-15 03:12:34,695 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-15 03:12:34,695 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 1e28f8f1fb6dda10f23d6d6d9fc3565a 2023-07-15 03:12:34,695 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 1e28f8f1fb6dda10f23d6d6d9fc3565a 2023-07-15 03:12:34,695 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testEmptyExportFileSystemState 0d3dafb4371d91b47676a6fb9ea4c421 2023-07-15 03:12:34,695 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,1,1689390754258.0d3dafb4371d91b47676a6fb9ea4c421.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-15 03:12:34,695 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 0d3dafb4371d91b47676a6fb9ea4c421 2023-07-15 03:12:34,695 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 0d3dafb4371d91b47676a6fb9ea4c421 2023-07-15 03:12:34,696 INFO [StoreOpener-0d3dafb4371d91b47676a6fb9ea4c421-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 0d3dafb4371d91b47676a6fb9ea4c421 2023-07-15 03:12:34,702 INFO [StoreOpener-1e28f8f1fb6dda10f23d6d6d9fc3565a-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 1e28f8f1fb6dda10f23d6d6d9fc3565a 2023-07-15 03:12:34,706 DEBUG [StoreOpener-1e28f8f1fb6dda10f23d6d6d9fc3565a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/data/default/testtb-testEmptyExportFileSystemState/1e28f8f1fb6dda10f23d6d6d9fc3565a/cf 2023-07-15 03:12:34,706 DEBUG [StoreOpener-1e28f8f1fb6dda10f23d6d6d9fc3565a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/data/default/testtb-testEmptyExportFileSystemState/1e28f8f1fb6dda10f23d6d6d9fc3565a/cf 2023-07-15 03:12:34,706 DEBUG [StoreOpener-0d3dafb4371d91b47676a6fb9ea4c421-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/data/default/testtb-testEmptyExportFileSystemState/0d3dafb4371d91b47676a6fb9ea4c421/cf 2023-07-15 03:12:34,707 DEBUG [StoreOpener-0d3dafb4371d91b47676a6fb9ea4c421-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/data/default/testtb-testEmptyExportFileSystemState/0d3dafb4371d91b47676a6fb9ea4c421/cf 2023-07-15 03:12:34,707 INFO [StoreOpener-1e28f8f1fb6dda10f23d6d6d9fc3565a-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1e28f8f1fb6dda10f23d6d6d9fc3565a columnFamilyName cf 2023-07-15 03:12:34,707 INFO [StoreOpener-0d3dafb4371d91b47676a6fb9ea4c421-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 0d3dafb4371d91b47676a6fb9ea4c421 columnFamilyName cf 2023-07-15 03:12:34,708 INFO [StoreOpener-1e28f8f1fb6dda10f23d6d6d9fc3565a-1] regionserver.HStore(310): Store=1e28f8f1fb6dda10f23d6d6d9fc3565a/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-15 03:12:34,708 INFO [StoreOpener-0d3dafb4371d91b47676a6fb9ea4c421-1] regionserver.HStore(310): Store=0d3dafb4371d91b47676a6fb9ea4c421/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-15 03:12:34,709 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/data/default/testtb-testEmptyExportFileSystemState/1e28f8f1fb6dda10f23d6d6d9fc3565a 2023-07-15 03:12:34,709 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/data/default/testtb-testEmptyExportFileSystemState/1e28f8f1fb6dda10f23d6d6d9fc3565a 2023-07-15 03:12:34,709 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/data/default/testtb-testEmptyExportFileSystemState/0d3dafb4371d91b47676a6fb9ea4c421 2023-07-15 03:12:34,710 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/data/default/testtb-testEmptyExportFileSystemState/0d3dafb4371d91b47676a6fb9ea4c421 2023-07-15 03:12:34,713 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 0d3dafb4371d91b47676a6fb9ea4c421 2023-07-15 03:12:34,714 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 1e28f8f1fb6dda10f23d6d6d9fc3565a 2023-07-15 03:12:34,718 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/data/default/testtb-testEmptyExportFileSystemState/0d3dafb4371d91b47676a6fb9ea4c421/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-15 03:12:34,719 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 0d3dafb4371d91b47676a6fb9ea4c421; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64879790, jitterRate=-0.03321579098701477}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-15 03:12:34,719 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 0d3dafb4371d91b47676a6fb9ea4c421: 2023-07-15 03:12:34,721 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testEmptyExportFileSystemState,1,1689390754258.0d3dafb4371d91b47676a6fb9ea4c421., pid=94, masterSystemTime=1689390754691 2023-07-15 03:12:34,725 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=92 updating hbase:meta row=0d3dafb4371d91b47676a6fb9ea4c421, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,43199,1689390651225 2023-07-15 03:12:34,725 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testEmptyExportFileSystemState,1,1689390754258.0d3dafb4371d91b47676a6fb9ea4c421.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689390754724"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689390754724"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689390754724"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689390754724"}]},"ts":"1689390754724"} 2023-07-15 03:12:34,725 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testEmptyExportFileSystemState,1,1689390754258.0d3dafb4371d91b47676a6fb9ea4c421. 2023-07-15 03:12:34,725 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testEmptyExportFileSystemState,1,1689390754258.0d3dafb4371d91b47676a6fb9ea4c421. 2023-07-15 03:12:34,726 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/data/default/testtb-testEmptyExportFileSystemState/1e28f8f1fb6dda10f23d6d6d9fc3565a/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-15 03:12:34,727 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 1e28f8f1fb6dda10f23d6d6d9fc3565a; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66920712, jitterRate=-0.0028036832809448242}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-15 03:12:34,727 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 1e28f8f1fb6dda10f23d6d6d9fc3565a: 2023-07-15 03:12:34,727 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testEmptyExportFileSystemState,,1689390754258.1e28f8f1fb6dda10f23d6d6d9fc3565a., pid=93, masterSystemTime=1689390754690 2023-07-15 03:12:34,729 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testEmptyExportFileSystemState,,1689390754258.1e28f8f1fb6dda10f23d6d6d9fc3565a. 2023-07-15 03:12:34,729 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testEmptyExportFileSystemState,,1689390754258.1e28f8f1fb6dda10f23d6d6d9fc3565a. 2023-07-15 03:12:34,729 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=94, resume processing ppid=92 2023-07-15 03:12:34,729 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=94, ppid=92, state=SUCCESS; OpenRegionProcedure 0d3dafb4371d91b47676a6fb9ea4c421, server=jenkins-hbase4.apache.org,43199,1689390651225 in 188 msec 2023-07-15 03:12:34,729 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=91 updating hbase:meta row=1e28f8f1fb6dda10f23d6d6d9fc3565a, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,38367,1689390651355 2023-07-15 03:12:34,729 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testEmptyExportFileSystemState,,1689390754258.1e28f8f1fb6dda10f23d6d6d9fc3565a.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689390754729"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689390754729"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689390754729"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689390754729"}]},"ts":"1689390754729"} 2023-07-15 03:12:34,732 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=92, ppid=90, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=0d3dafb4371d91b47676a6fb9ea4c421, ASSIGN in 360 msec 2023-07-15 03:12:34,735 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=93, resume processing ppid=91 2023-07-15 03:12:34,735 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=93, ppid=91, state=SUCCESS; OpenRegionProcedure 1e28f8f1fb6dda10f23d6d6d9fc3565a, server=jenkins-hbase4.apache.org,38367,1689390651355 in 193 msec 2023-07-15 03:12:34,737 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=91, resume processing ppid=90 2023-07-15 03:12:34,737 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=91, ppid=90, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=1e28f8f1fb6dda10f23d6d6d9fc3565a, ASSIGN in 366 msec 2023-07-15 03:12:34,738 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-15 03:12:34,738 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689390754738"}]},"ts":"1689390754738"} 2023-07-15 03:12:34,741 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=ENABLED in hbase:meta 2023-07-15 03:12:34,748 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_POST_OPERATION 2023-07-15 03:12:34,749 DEBUG [PEWorker-4] access.PermissionStorage(175): Writing permission with rowKey testtb-testEmptyExportFileSystemState jenkins: RWXCA 2023-07-15 03:12:34,751 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=39199] access.PermissionStorage(611): Read acl: entry[testtb-testEmptyExportFileSystemState], kv [jenkins: RWXCA] 2023-07-15 03:12:34,753 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): regionserver:38367-0x10166f610e80003, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-15 03:12:34,753 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): master:41669-0x10166f610e80000, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-15 03:12:34,753 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): regionserver:43199-0x10166f610e80001, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-15 03:12:34,753 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): regionserver:39199-0x10166f610e80002, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-15 03:12:34,755 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-15 03:12:34,755 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-15 03:12:34,755 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-15 03:12:34,755 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-15 03:12:34,757 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=90, state=SUCCESS; CreateTableProcedure table=testtb-testEmptyExportFileSystemState in 496 msec 2023-07-15 03:12:34,871 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41669] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-07-15 03:12:34,871 INFO [Listener at jenkins-hbase4.apache.org/44817] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testEmptyExportFileSystemState, procId: 90 completed 2023-07-15 03:12:34,871 DEBUG [Listener at jenkins-hbase4.apache.org/44817] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testtb-testEmptyExportFileSystemState get assigned. Timeout = 60000ms 2023-07-15 03:12:34,872 INFO [Listener at jenkins-hbase4.apache.org/44817] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-15 03:12:34,882 INFO [Listener at jenkins-hbase4.apache.org/44817] hbase.HBaseTestingUtility(3484): All regions for table testtb-testEmptyExportFileSystemState assigned to meta. Checking AM states. 2023-07-15 03:12:34,882 INFO [Listener at jenkins-hbase4.apache.org/44817] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-15 03:12:34,883 INFO [Listener at jenkins-hbase4.apache.org/44817] hbase.HBaseTestingUtility(3504): All regions for table testtb-testEmptyExportFileSystemState assigned. 2023-07-15 03:12:34,886 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41669] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-15 03:12:34,886 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41669] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689390754886 (current time:1689390754886). 2023-07-15 03:12:34,886 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41669] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-15 03:12:34,886 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41669] zookeeper.ReadOnlyZKClient(139): Connect 0x4ea0dc76 to 127.0.0.1:62663 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-15 03:12:34,900 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41669] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1ebea6a4, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-15 03:12:34,907 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41669] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-15 03:12:34,912 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:51674, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-15 03:12:34,913 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41669] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4ea0dc76 to 127.0.0.1:62663 2023-07-15 03:12:34,913 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41669] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-15 03:12:34,914 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41669] zookeeper.ReadOnlyZKClient(139): Connect 0x5e02ea6c to 127.0.0.1:62663 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-15 03:12:34,924 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41669] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1689deb6, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-15 03:12:34,927 DEBUG [hconnection-0x7de9d145-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-15 03:12:34,928 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:51686, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-15 03:12:34,934 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41669] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-15 03:12:34,937 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:37412, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-15 03:12:34,938 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41669] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x5e02ea6c to 127.0.0.1:62663 2023-07-15 03:12:34,939 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41669] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-15 03:12:34,939 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41669] access.PermissionStorage(611): Read acl: entry[testtb-testEmptyExportFileSystemState], kv [jenkins: RWXCA] 2023-07-15 03:12:34,940 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41669] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-15 03:12:34,940 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41669] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-15 03:12:34,946 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41669] procedure2.ProcedureExecutor(1029): Stored pid=95, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-15 03:12:34,947 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=95, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-15 03:12:34,948 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=95, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1689391354948 2023-07-15 03:12:34,948 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41669] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-15 03:12:34,948 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState 2023-07-15 03:12:34,950 DEBUG [Listener at jenkins-hbase4.apache.org/44817] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-15 03:12:34,950 DEBUG [Listener at jenkins-hbase4.apache.org/44817] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-15 03:12:34,952 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=95, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-15 03:12:34,953 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=96, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-15 03:12:34,954 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=95, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE in 8 msec 2023-07-15 03:12:34,957 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=96, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-15 03:12:34,957 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=96, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED; timeout=600000, timestamp=1689391354957 2023-07-15 03:12:35,006 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 03:12:35,007 INFO [(jenkins-hbase4.apache.org,41669,1689390649760)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testEmptyExportFileSystemState' 2023-07-15 03:12:35,007 DEBUG [(jenkins-hbase4.apache.org,41669,1689390649760)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-15 03:12:35,008 DEBUG [(jenkins-hbase4.apache.org,41669,1689390649760)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' 2023-07-15 03:12:35,008 DEBUG [(jenkins-hbase4.apache.org,41669,1689390649760)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testEmptyExportFileSystemState', kicking off acquire phase on members. 2023-07-15 03:12:35,009 DEBUG [(jenkins-hbase4.apache.org,41669,1689390649760)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41669-0x10166f610e80000, quorum=127.0.0.1:62663, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 03:12:35,009 DEBUG [(jenkins-hbase4.apache.org,41669,1689390649760)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 03:12:35,014 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): regionserver:43199-0x10166f610e80001, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 03:12:35,014 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): regionserver:39199-0x10166f610e80002, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 03:12:35,014 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 03:12:35,014 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 03:12:35,014 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 03:12:35,014 DEBUG [(jenkins-hbase4.apache.org,41669,1689390649760)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,38367,1689390651355 2023-07-15 03:12:35,014 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): regionserver:38367-0x10166f610e80003, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 03:12:35,014 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 03:12:35,014 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 03:12:35,014 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 03:12:35,014 DEBUG [(jenkins-hbase4.apache.org,41669,1689390649760)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41669-0x10166f610e80000, quorum=127.0.0.1:62663, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,38367,1689390651355 2023-07-15 03:12:35,015 DEBUG [(jenkins-hbase4.apache.org,41669,1689390649760)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43199,1689390651225 2023-07-15 03:12:35,015 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 03:12:35,015 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 03:12:35,015 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 03:12:35,015 DEBUG [(jenkins-hbase4.apache.org,41669,1689390649760)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41669-0x10166f610e80000, quorum=127.0.0.1:62663, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43199,1689390651225 2023-07-15 03:12:35,015 DEBUG [(jenkins-hbase4.apache.org,41669,1689390649760)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-15 03:12:35,015 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39199-0x10166f610e80002, quorum=127.0.0.1:62663, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 03:12:35,015 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38367-0x10166f610e80003, quorum=127.0.0.1:62663, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 03:12:35,015 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43199-0x10166f610e80001, quorum=127.0.0.1:62663, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 03:12:35,016 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 189 2023-07-15 03:12:35,016 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 03:12:35,016 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-15 03:12:35,016 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 03:12:35,016 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 189 2023-07-15 03:12:35,016 DEBUG [member: 'jenkins-hbase4.apache.org,39199,1689390651299' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-15 03:12:35,016 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 03:12:35,016 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 189 2023-07-15 03:12:35,016 DEBUG [member: 'jenkins-hbase4.apache.org,39199,1689390651299' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-15 03:12:35,016 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-15 03:12:35,018 DEBUG [member: 'jenkins-hbase4.apache.org,39199,1689390651299' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-15 03:12:35,018 DEBUG [member: 'jenkins-hbase4.apache.org,39199,1689390651299' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-15 03:12:35,018 DEBUG [member: 'jenkins-hbase4.apache.org,39199,1689390651299' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39199,1689390651299' joining acquired barrier for procedure (emptySnaptb0-testEmptyExportFileSystemState) in zk 2023-07-15 03:12:35,016 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 03:12:35,018 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 03:12:35,018 DEBUG [member: 'jenkins-hbase4.apache.org,43199,1689390651225' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-15 03:12:35,018 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-15 03:12:35,018 DEBUG [member: 'jenkins-hbase4.apache.org,43199,1689390651225' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-15 03:12:35,020 DEBUG [member: 'jenkins-hbase4.apache.org,39199,1689390651299' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 03:12:35,020 DEBUG [member: 'jenkins-hbase4.apache.org,39199,1689390651299' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39199-0x10166f610e80002, quorum=127.0.0.1:62663, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 03:12:35,020 DEBUG [member: 'jenkins-hbase4.apache.org,39199,1689390651299' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-15 03:12:35,026 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 03:12:35,028 DEBUG [member: 'jenkins-hbase4.apache.org,38367,1689390651355' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-15 03:12:35,028 DEBUG [member: 'jenkins-hbase4.apache.org,43199,1689390651225' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-15 03:12:35,028 DEBUG [member: 'jenkins-hbase4.apache.org,43199,1689390651225' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-15 03:12:35,028 DEBUG [member: 'jenkins-hbase4.apache.org,38367,1689390651355' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-15 03:12:35,028 DEBUG [member: 'jenkins-hbase4.apache.org,43199,1689390651225' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43199,1689390651225' joining acquired barrier for procedure (emptySnaptb0-testEmptyExportFileSystemState) in zk 2023-07-15 03:12:35,029 DEBUG [member: 'jenkins-hbase4.apache.org,38367,1689390651355' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-15 03:12:35,030 DEBUG [member: 'jenkins-hbase4.apache.org,38367,1689390651355' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-15 03:12:35,030 DEBUG [member: 'jenkins-hbase4.apache.org,38367,1689390651355' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38367,1689390651355' joining acquired barrier for procedure (emptySnaptb0-testEmptyExportFileSystemState) in zk 2023-07-15 03:12:35,031 DEBUG [member: 'jenkins-hbase4.apache.org,38367,1689390651355' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 03:12:35,035 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): master:41669-0x10166f610e80000, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,38367,1689390651355 2023-07-15 03:12:35,036 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,38367,1689390651355 2023-07-15 03:12:35,036 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 03:12:35,036 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): master:41669-0x10166f610e80000, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43199,1689390651225 2023-07-15 03:12:35,036 DEBUG [member: 'jenkins-hbase4.apache.org,43199,1689390651225' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 03:12:35,036 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 03:12:35,036 DEBUG [member: 'jenkins-hbase4.apache.org,38367,1689390651355' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38367-0x10166f610e80003, quorum=127.0.0.1:62663, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 03:12:35,036 DEBUG [member: 'jenkins-hbase4.apache.org,38367,1689390651355' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-15 03:12:35,036 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 03:12:35,036 DEBUG [member: 'jenkins-hbase4.apache.org,43199,1689390651225' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43199-0x10166f610e80001, quorum=127.0.0.1:62663, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 03:12:35,036 DEBUG [member: 'jenkins-hbase4.apache.org,43199,1689390651225' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-15 03:12:35,037 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 03:12:35,037 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 03:12:35,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43199,1689390651225 2023-07-15 03:12:35,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39199,1689390651299 2023-07-15 03:12:35,039 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38367,1689390651355 2023-07-15 03:12:35,039 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 03:12:35,039 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,38367,1689390651355' joining acquired barrier for procedure 'emptySnaptb0-testEmptyExportFileSystemState' on coordinator 2023-07-15 03:12:35,039 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2d283655[Count = 1] remaining members to acquire global barrier 2023-07-15 03:12:35,039 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43199,1689390651225 2023-07-15 03:12:35,039 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 03:12:35,040 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 03:12:35,040 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 03:12:35,040 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 03:12:35,041 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 03:12:35,041 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43199,1689390651225 2023-07-15 03:12:35,043 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39199,1689390651299 2023-07-15 03:12:35,044 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38367,1689390651355 2023-07-15 03:12:35,044 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 03:12:35,044 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43199,1689390651225' joining acquired barrier for procedure 'emptySnaptb0-testEmptyExportFileSystemState' on coordinator 2023-07-15 03:12:35,044 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2d283655[Count = 0] remaining members to acquire global barrier 2023-07-15 03:12:35,044 DEBUG [(jenkins-hbase4.apache.org,41669,1689390649760)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'in-barrier' execution. 2023-07-15 03:12:35,045 DEBUG [(jenkins-hbase4.apache.org,41669,1689390649760)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 03:12:35,047 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): regionserver:43199-0x10166f610e80001, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 03:12:35,047 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): regionserver:38367-0x10166f610e80003, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 03:12:35,047 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 03:12:35,047 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 03:12:35,047 DEBUG [member: 'jenkins-hbase4.apache.org,38367,1689390651355' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-15 03:12:35,048 DEBUG [(jenkins-hbase4.apache.org,41669,1689390649760)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41669-0x10166f610e80000, quorum=127.0.0.1:62663, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,38367,1689390651355 2023-07-15 03:12:35,048 DEBUG [(jenkins-hbase4.apache.org,41669,1689390649760)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41669-0x10166f610e80000, quorum=127.0.0.1:62663, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43199,1689390651225 2023-07-15 03:12:35,048 DEBUG [(jenkins-hbase4.apache.org,41669,1689390649760)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-15 03:12:35,049 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): regionserver:39199-0x10166f610e80002, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 03:12:35,049 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 03:12:35,049 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 03:12:35,049 DEBUG [member: 'jenkins-hbase4.apache.org,39199,1689390651299' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-15 03:12:35,049 DEBUG [member: 'jenkins-hbase4.apache.org,39199,1689390651299' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally completed 2023-07-15 03:12:35,049 DEBUG [member: 'jenkins-hbase4.apache.org,39199,1689390651299' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,39199,1689390651299' in zk 2023-07-15 03:12:35,050 DEBUG [Listener at jenkins-hbase4.apache.org/44817] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-15 03:12:35,051 DEBUG [member: 'jenkins-hbase4.apache.org,39199,1689390651299' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-15 03:12:35,051 DEBUG [member: 'jenkins-hbase4.apache.org,39199,1689390651299' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-15 03:12:35,051 DEBUG [member: 'jenkins-hbase4.apache.org,39199,1689390651299' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' completed. 2023-07-15 03:12:35,051 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41669] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-15 03:12:35,051 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41669] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-15 03:12:35,051 DEBUG [Listener at jenkins-hbase4.apache.org/44817] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-15 03:12:35,047 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 03:12:35,055 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 03:12:35,055 DEBUG [member: 'jenkins-hbase4.apache.org,43199,1689390651225' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-15 03:12:35,058 DEBUG [member: 'jenkins-hbase4.apache.org,38367,1689390651355' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-15 03:12:35,058 DEBUG [member: 'jenkins-hbase4.apache.org,38367,1689390651355' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-15 03:12:35,062 DEBUG [member: 'jenkins-hbase4.apache.org,43199,1689390651225' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-15 03:12:35,062 DEBUG [member: 'jenkins-hbase4.apache.org,43199,1689390651225' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-15 03:12:35,062 DEBUG [rs(jenkins-hbase4.apache.org,43199,1689390651225)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,1,1689390754258.0d3dafb4371d91b47676a6fb9ea4c421. 2023-07-15 03:12:35,062 DEBUG [rs(jenkins-hbase4.apache.org,43199,1689390651225)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1689390754258.0d3dafb4371d91b47676a6fb9ea4c421. started... 2023-07-15 03:12:35,068 DEBUG [rs(jenkins-hbase4.apache.org,38367,1689390651355)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,,1689390754258.1e28f8f1fb6dda10f23d6d6d9fc3565a. 2023-07-15 03:12:35,068 DEBUG [rs(jenkins-hbase4.apache.org,43199,1689390651225)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 0d3dafb4371d91b47676a6fb9ea4c421: 2023-07-15 03:12:35,068 DEBUG [rs(jenkins-hbase4.apache.org,38367,1689390651355)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1689390754258.1e28f8f1fb6dda10f23d6d6d9fc3565a. started... 2023-07-15 03:12:35,068 DEBUG [rs(jenkins-hbase4.apache.org,43199,1689390651225)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,1,1689390754258.0d3dafb4371d91b47676a6fb9ea4c421.' region-info for snapshot=emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 03:12:35,070 DEBUG [rs(jenkins-hbase4.apache.org,38367,1689390651355)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 1e28f8f1fb6dda10f23d6d6d9fc3565a: 2023-07-15 03:12:35,070 DEBUG [rs(jenkins-hbase4.apache.org,43199,1689390651225)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-15 03:12:35,070 DEBUG [rs(jenkins-hbase4.apache.org,43199,1689390651225)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-15 03:12:35,070 DEBUG [rs(jenkins-hbase4.apache.org,38367,1689390651355)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,,1689390754258.1e28f8f1fb6dda10f23d6d6d9fc3565a.' region-info for snapshot=emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 03:12:35,070 DEBUG [rs(jenkins-hbase4.apache.org,38367,1689390651355)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-15 03:12:35,070 DEBUG [rs(jenkins-hbase4.apache.org,38367,1689390651355)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-15 03:12:35,107 DEBUG [rs(jenkins-hbase4.apache.org,43199,1689390651225)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1689390754258.0d3dafb4371d91b47676a6fb9ea4c421. completed. 2023-07-15 03:12:35,107 DEBUG [rs(jenkins-hbase4.apache.org,43199,1689390651225)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,1,1689390754258.0d3dafb4371d91b47676a6fb9ea4c421. 2023-07-15 03:12:35,107 DEBUG [member: 'jenkins-hbase4.apache.org,43199,1689390651225' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-15 03:12:35,107 DEBUG [member: 'jenkins-hbase4.apache.org,43199,1689390651225' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-15 03:12:35,107 DEBUG [member: 'jenkins-hbase4.apache.org,43199,1689390651225' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,43199,1689390651225 2023-07-15 03:12:35,107 DEBUG [member: 'jenkins-hbase4.apache.org,43199,1689390651225' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally completed 2023-07-15 03:12:35,107 DEBUG [member: 'jenkins-hbase4.apache.org,43199,1689390651225' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,43199,1689390651225' in zk 2023-07-15 03:12:35,109 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): master:41669-0x10166f610e80000, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43199,1689390651225 2023-07-15 03:12:35,109 DEBUG [member: 'jenkins-hbase4.apache.org,43199,1689390651225' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-15 03:12:35,109 DEBUG [member: 'jenkins-hbase4.apache.org,43199,1689390651225' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-15 03:12:35,109 DEBUG [member: 'jenkins-hbase4.apache.org,43199,1689390651225' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' completed. 2023-07-15 03:12:35,111 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43199,1689390651225 2023-07-15 03:12:35,111 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 03:12:35,111 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 03:12:35,113 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 03:12:35,113 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 03:12:35,114 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 03:12:35,114 DEBUG [rs(jenkins-hbase4.apache.org,38367,1689390651355)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1689390754258.1e28f8f1fb6dda10f23d6d6d9fc3565a. completed. 2023-07-15 03:12:35,114 DEBUG [rs(jenkins-hbase4.apache.org,38367,1689390651355)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,,1689390754258.1e28f8f1fb6dda10f23d6d6d9fc3565a. 2023-07-15 03:12:35,114 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43199,1689390651225 2023-07-15 03:12:35,114 DEBUG [member: 'jenkins-hbase4.apache.org,38367,1689390651355' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-15 03:12:35,114 DEBUG [member: 'jenkins-hbase4.apache.org,38367,1689390651355' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-15 03:12:35,114 DEBUG [member: 'jenkins-hbase4.apache.org,38367,1689390651355' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,38367,1689390651355 2023-07-15 03:12:35,115 DEBUG [member: 'jenkins-hbase4.apache.org,38367,1689390651355' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally completed 2023-07-15 03:12:35,115 DEBUG [member: 'jenkins-hbase4.apache.org,38367,1689390651355' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,38367,1689390651355' in zk 2023-07-15 03:12:35,115 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39199,1689390651299 2023-07-15 03:12:35,116 DEBUG [member: 'jenkins-hbase4.apache.org,38367,1689390651355' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-15 03:12:35,117 DEBUG [member: 'jenkins-hbase4.apache.org,38367,1689390651355' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-15 03:12:35,117 DEBUG [member: 'jenkins-hbase4.apache.org,38367,1689390651355' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' completed. 2023-07-15 03:12:35,120 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): master:41669-0x10166f610e80000, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,38367,1689390651355 2023-07-15 03:12:35,120 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38367,1689390651355 2023-07-15 03:12:35,120 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 03:12:35,121 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 03:12:35,122 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43199,1689390651225 2023-07-15 03:12:35,123 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39199,1689390651299 2023-07-15 03:12:35,123 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38367,1689390651355 2023-07-15 03:12:35,124 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,43199,1689390651225': 2023-07-15 03:12:35,124 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43199,1689390651225' released barrier for procedure'emptySnaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 1 more 2023-07-15 03:12:35,124 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,38367,1689390651355 2023-07-15 03:12:35,124 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 03:12:35,124 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 03:12:35,125 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 03:12:35,125 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 03:12:35,125 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 03:12:35,125 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43199,1689390651225 2023-07-15 03:12:35,127 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39199,1689390651299 2023-07-15 03:12:35,127 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38367,1689390651355 2023-07-15 03:12:35,128 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 03:12:35,128 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 03:12:35,128 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43199,1689390651225 2023-07-15 03:12:35,129 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39199,1689390651299 2023-07-15 03:12:35,129 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38367,1689390651355 2023-07-15 03:12:35,129 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,38367,1689390651355': 2023-07-15 03:12:35,129 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,38367,1689390651355' released barrier for procedure'emptySnaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 0 more 2023-07-15 03:12:35,129 INFO [(jenkins-hbase4.apache.org,41669,1689390649760)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testEmptyExportFileSystemState' execution completed 2023-07-15 03:12:35,130 DEBUG [(jenkins-hbase4.apache.org,41669,1689390649760)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-15 03:12:35,130 DEBUG [(jenkins-hbase4.apache.org,41669,1689390649760)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-15 03:12:35,130 DEBUG [(jenkins-hbase4.apache.org,41669,1689390649760)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 03:12:35,130 INFO [(jenkins-hbase4.apache.org,41669,1689390649760)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testEmptyExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-15 03:12:35,133 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): regionserver:39199-0x10166f610e80002, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 03:12:35,133 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): regionserver:43199-0x10166f610e80001, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 03:12:35,133 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 03:12:35,133 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 03:12:35,133 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 03:12:35,133 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): regionserver:43199-0x10166f610e80001, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 03:12:35,133 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): regionserver:38367-0x10166f610e80003, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 03:12:35,133 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): regionserver:39199-0x10166f610e80002, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 03:12:35,133 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 03:12:35,133 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 03:12:35,133 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): master:41669-0x10166f610e80000, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 03:12:35,133 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 03:12:35,133 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 03:12:35,133 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 03:12:35,133 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 03:12:35,133 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 03:12:35,133 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): regionserver:38367-0x10166f610e80003, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 03:12:35,133 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 03:12:35,134 DEBUG [(jenkins-hbase4.apache.org,41669,1689390649760)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41669-0x10166f610e80000, quorum=127.0.0.1:62663, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43199,1689390651225 2023-07-15 03:12:35,134 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 03:12:35,134 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 03:12:35,134 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 03:12:35,134 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 03:12:35,134 DEBUG [(jenkins-hbase4.apache.org,41669,1689390649760)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41669-0x10166f610e80000, quorum=127.0.0.1:62663, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39199,1689390651299 2023-07-15 03:12:35,134 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 03:12:35,134 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 03:12:35,134 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 03:12:35,135 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 03:12:35,135 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 03:12:35,135 DEBUG [(jenkins-hbase4.apache.org,41669,1689390649760)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41669-0x10166f610e80000, quorum=127.0.0.1:62663, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,38367,1689390651355 2023-07-15 03:12:35,135 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 03:12:35,135 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 03:12:35,136 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43199,1689390651225 2023-07-15 03:12:35,136 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39199,1689390651299 2023-07-15 03:12:35,136 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38367,1689390651355 2023-07-15 03:12:35,137 DEBUG [(jenkins-hbase4.apache.org,41669,1689390649760)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41669-0x10166f610e80000, quorum=127.0.0.1:62663, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43199,1689390651225 2023-07-15 03:12:35,137 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 03:12:35,137 DEBUG [(jenkins-hbase4.apache.org,41669,1689390649760)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41669-0x10166f610e80000, quorum=127.0.0.1:62663, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39199,1689390651299 2023-07-15 03:12:35,137 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 03:12:35,137 DEBUG [(jenkins-hbase4.apache.org,41669,1689390649760)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41669-0x10166f610e80000, quorum=127.0.0.1:62663, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,38367,1689390651355 2023-07-15 03:12:35,137 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43199,1689390651225 2023-07-15 03:12:35,138 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39199,1689390651299 2023-07-15 03:12:35,138 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38367,1689390651355 2023-07-15 03:12:35,140 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): regionserver:39199-0x10166f610e80002, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 03:12:35,140 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): regionserver:43199-0x10166f610e80001, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 03:12:35,140 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 03:12:35,141 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 03:12:35,141 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): master:41669-0x10166f610e80000, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,38367,1689390651355 2023-07-15 03:12:35,141 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): regionserver:39199-0x10166f610e80002, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 03:12:35,140 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 03:12:35,141 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 03:12:35,141 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): regionserver:43199-0x10166f610e80001, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 03:12:35,141 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): master:41669-0x10166f610e80000, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 03:12:35,141 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): master:41669-0x10166f610e80000, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39199,1689390651299 2023-07-15 03:12:35,141 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): master:41669-0x10166f610e80000, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43199,1689390651225 2023-07-15 03:12:35,141 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): master:41669-0x10166f610e80000, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 03:12:35,141 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): master:41669-0x10166f610e80000, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,38367,1689390651355 2023-07-15 03:12:35,141 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 03:12:35,141 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 03:12:35,141 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 03:12:35,141 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 03:12:35,141 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 03:12:35,141 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): master:41669-0x10166f610e80000, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 03:12:35,141 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): master:41669-0x10166f610e80000, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39199,1689390651299 2023-07-15 03:12:35,141 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): master:41669-0x10166f610e80000, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43199,1689390651225 2023-07-15 03:12:35,141 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): master:41669-0x10166f610e80000, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 03:12:35,141 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): master:41669-0x10166f610e80000, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 03:12:35,141 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 03:12:35,141 DEBUG [(jenkins-hbase4.apache.org,41669,1689390649760)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-15 03:12:35,144 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 03:12:35,144 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): regionserver:38367-0x10166f610e80003, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 03:12:35,145 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): regionserver:38367-0x10166f610e80003, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 03:12:35,145 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 03:12:35,145 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 03:12:35,145 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 03:12:35,145 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 03:12:35,183 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState to hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 03:12:35,239 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed 2023-07-15 03:12:35,239 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 03:12:35,239 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 03:12:35,240 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState at 1689390754948Consolidate snapshot: emptySnaptb0-testEmptyExportFileSystemState at 1689390755141 (+193 ms)Loading Region manifests for emptySnaptb0-testEmptyExportFileSystemState at 1689390755142 (+1 ms)Writing data manifest for emptySnaptb0-testEmptyExportFileSystemState at 1689390755147 (+5 ms)Verifying snapshot: emptySnaptb0-testEmptyExportFileSystemState at 1689390755171 (+24 ms)Snapshot emptySnaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed at 1689390755239 (+68 ms) 2023-07-15 03:12:35,243 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=96, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-15 03:12:35,244 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=96, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED in 293 msec 2023-07-15 03:12:35,252 DEBUG [Listener at jenkins-hbase4.apache.org/44817] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-15 03:12:35,253 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41669] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-15 03:12:35,253 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41669] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-15 03:12:35,260 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38367] regionserver.HRegion(8805): writing data to region testtb-testEmptyExportFileSystemState,,1689390754258.1e28f8f1fb6dda10f23d6d6d9fc3565a. with WAL disabled. Data may be lost in the event of a crash. 2023-07-15 03:12:35,260 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43199] regionserver.HRegion(8805): writing data to region testtb-testEmptyExportFileSystemState,1,1689390754258.0d3dafb4371d91b47676a6fb9ea4c421. with WAL disabled. Data may be lost in the event of a crash. 2023-07-15 03:12:35,263 DEBUG [Listener at jenkins-hbase4.apache.org/44817] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testEmptyExportFileSystemState 2023-07-15 03:12:35,264 DEBUG [Listener at jenkins-hbase4.apache.org/44817] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testEmptyExportFileSystemState,,1689390754258.1e28f8f1fb6dda10f23d6d6d9fc3565a. 2023-07-15 03:12:35,266 INFO [Listener at jenkins-hbase4.apache.org/44817] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-15 03:12:35,275 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41669] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-15 03:12:35,275 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41669] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689390755275 (current time:1689390755275). 2023-07-15 03:12:35,275 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41669] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-15 03:12:35,276 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41669] zookeeper.ReadOnlyZKClient(139): Connect 0x122cba8c to 127.0.0.1:62663 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-15 03:12:35,283 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41669] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@21fc3275, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-15 03:12:35,284 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41669] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-15 03:12:35,285 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:51702, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-15 03:12:35,286 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41669] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x122cba8c to 127.0.0.1:62663 2023-07-15 03:12:35,286 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41669] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-15 03:12:35,286 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41669] zookeeper.ReadOnlyZKClient(139): Connect 0x2eb71d92 to 127.0.0.1:62663 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-15 03:12:35,292 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41669] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@59b83a12, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-15 03:12:35,295 DEBUG [hconnection-0x1917d4ca-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-15 03:12:35,302 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:51718, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-15 03:12:35,305 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41669] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-15 03:12:35,306 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:37418, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-15 03:12:35,307 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41669] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x2eb71d92 to 127.0.0.1:62663 2023-07-15 03:12:35,307 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41669] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-15 03:12:35,307 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41669] access.PermissionStorage(611): Read acl: entry[testtb-testEmptyExportFileSystemState], kv [jenkins: RWXCA] 2023-07-15 03:12:35,308 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41669] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-15 03:12:35,308 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41669] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-15 03:12:35,310 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41669] procedure2.ProcedureExecutor(1029): Stored pid=97, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-15 03:12:35,311 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=97, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-15 03:12:35,312 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=97, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1689391355312 2023-07-15 03:12:35,312 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState 2023-07-15 03:12:35,312 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41669] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-15 03:12:35,313 DEBUG [Listener at jenkins-hbase4.apache.org/44817] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-15 03:12:35,313 DEBUG [Listener at jenkins-hbase4.apache.org/44817] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-15 03:12:35,313 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=98, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-15 03:12:35,314 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=97, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-15 03:12:35,315 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=97, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE in 5 msec 2023-07-15 03:12:35,316 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=98, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-15 03:12:35,316 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=98, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED; timeout=600000, timestamp=1689391355316 2023-07-15 03:12:35,328 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testEmptyExportFileSystemState 2023-07-15 03:12:35,328 INFO [(jenkins-hbase4.apache.org,41669,1689390649760)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testEmptyExportFileSystemState' 2023-07-15 03:12:35,328 DEBUG [(jenkins-hbase4.apache.org,41669,1689390649760)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-15 03:12:35,329 DEBUG [(jenkins-hbase4.apache.org,41669,1689390649760)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' 2023-07-15 03:12:35,329 DEBUG [(jenkins-hbase4.apache.org,41669,1689390649760)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testEmptyExportFileSystemState', kicking off acquire phase on members. 2023-07-15 03:12:35,330 DEBUG [(jenkins-hbase4.apache.org,41669,1689390649760)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41669-0x10166f610e80000, quorum=127.0.0.1:62663, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-15 03:12:35,330 DEBUG [(jenkins-hbase4.apache.org,41669,1689390649760)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-15 03:12:35,331 DEBUG [(jenkins-hbase4.apache.org,41669,1689390649760)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,38367,1689390651355 2023-07-15 03:12:35,331 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): regionserver:39199-0x10166f610e80002, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 03:12:35,331 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): regionserver:43199-0x10166f610e80001, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 03:12:35,331 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 03:12:35,331 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 03:12:35,331 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): regionserver:38367-0x10166f610e80003, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 03:12:35,331 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 03:12:35,331 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 03:12:35,331 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 03:12:35,331 DEBUG [(jenkins-hbase4.apache.org,41669,1689390649760)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41669-0x10166f610e80000, quorum=127.0.0.1:62663, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,38367,1689390651355 2023-07-15 03:12:35,332 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-15 03:12:35,332 DEBUG [(jenkins-hbase4.apache.org,41669,1689390649760)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43199,1689390651225 2023-07-15 03:12:35,331 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 03:12:35,332 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-15 03:12:35,332 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39199-0x10166f610e80002, quorum=127.0.0.1:62663, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-15 03:12:35,332 DEBUG [(jenkins-hbase4.apache.org,41669,1689390649760)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41669-0x10166f610e80000, quorum=127.0.0.1:62663, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43199,1689390651225 2023-07-15 03:12:35,332 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-15 03:12:35,332 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38367-0x10166f610e80003, quorum=127.0.0.1:62663, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-15 03:12:35,332 DEBUG [(jenkins-hbase4.apache.org,41669,1689390649760)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-15 03:12:35,332 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 184 2023-07-15 03:12:35,332 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-15 03:12:35,332 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43199-0x10166f610e80001, quorum=127.0.0.1:62663, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-15 03:12:35,333 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-15 03:12:35,332 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 184 2023-07-15 03:12:35,333 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-15 03:12:35,333 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testEmptyExportFileSystemState 2023-07-15 03:12:35,333 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 184 2023-07-15 03:12:35,333 DEBUG [member: 'jenkins-hbase4.apache.org,39199,1689390651299' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-15 03:12:35,333 DEBUG [member: 'jenkins-hbase4.apache.org,39199,1689390651299' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-15 03:12:35,333 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-15 03:12:35,334 DEBUG [member: 'jenkins-hbase4.apache.org,39199,1689390651299' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-15 03:12:35,334 DEBUG [member: 'jenkins-hbase4.apache.org,39199,1689390651299' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-15 03:12:35,334 DEBUG [member: 'jenkins-hbase4.apache.org,39199,1689390651299' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39199,1689390651299' joining acquired barrier for procedure (snaptb0-testEmptyExportFileSystemState) in zk 2023-07-15 03:12:35,333 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-15 03:12:35,334 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testEmptyExportFileSystemState 2023-07-15 03:12:35,334 DEBUG [member: 'jenkins-hbase4.apache.org,38367,1689390651355' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-15 03:12:35,334 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-15 03:12:35,334 DEBUG [member: 'jenkins-hbase4.apache.org,38367,1689390651355' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-15 03:12:35,335 DEBUG [member: 'jenkins-hbase4.apache.org,38367,1689390651355' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-15 03:12:35,335 DEBUG [member: 'jenkins-hbase4.apache.org,38367,1689390651355' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-15 03:12:35,335 DEBUG [member: 'jenkins-hbase4.apache.org,38367,1689390651355' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38367,1689390651355' joining acquired barrier for procedure (snaptb0-testEmptyExportFileSystemState) in zk 2023-07-15 03:12:35,335 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testEmptyExportFileSystemState 2023-07-15 03:12:35,336 DEBUG [member: 'jenkins-hbase4.apache.org,43199,1689390651225' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-15 03:12:35,336 DEBUG [member: 'jenkins-hbase4.apache.org,43199,1689390651225' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-15 03:12:35,338 DEBUG [member: 'jenkins-hbase4.apache.org,43199,1689390651225' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-15 03:12:35,338 DEBUG [member: 'jenkins-hbase4.apache.org,43199,1689390651225' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-15 03:12:35,338 DEBUG [member: 'jenkins-hbase4.apache.org,43199,1689390651225' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43199,1689390651225' joining acquired barrier for procedure (snaptb0-testEmptyExportFileSystemState) in zk 2023-07-15 03:12:35,338 DEBUG [member: 'jenkins-hbase4.apache.org,39199,1689390651299' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-15 03:12:35,339 DEBUG [member: 'jenkins-hbase4.apache.org,39199,1689390651299' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39199-0x10166f610e80002, quorum=127.0.0.1:62663, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-15 03:12:35,339 DEBUG [member: 'jenkins-hbase4.apache.org,39199,1689390651299' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-15 03:12:35,340 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): master:41669-0x10166f610e80000, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,38367,1689390651355 2023-07-15 03:12:35,341 DEBUG [member: 'jenkins-hbase4.apache.org,38367,1689390651355' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-15 03:12:35,341 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,38367,1689390651355 2023-07-15 03:12:35,341 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 03:12:35,341 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 03:12:35,341 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): master:41669-0x10166f610e80000, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43199,1689390651225 2023-07-15 03:12:35,341 DEBUG [member: 'jenkins-hbase4.apache.org,43199,1689390651225' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-15 03:12:35,341 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 03:12:35,341 DEBUG [member: 'jenkins-hbase4.apache.org,38367,1689390651355' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38367-0x10166f610e80003, quorum=127.0.0.1:62663, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-15 03:12:35,341 DEBUG [member: 'jenkins-hbase4.apache.org,38367,1689390651355' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-15 03:12:35,342 DEBUG [member: 'jenkins-hbase4.apache.org,43199,1689390651225' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43199-0x10166f610e80001, quorum=127.0.0.1:62663, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-15 03:12:35,342 DEBUG [member: 'jenkins-hbase4.apache.org,43199,1689390651225' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-15 03:12:35,342 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 03:12:35,342 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-15 03:12:35,342 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43199,1689390651225 2023-07-15 03:12:35,342 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39199,1689390651299 2023-07-15 03:12:35,343 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38367,1689390651355 2023-07-15 03:12:35,343 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 03:12:35,343 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,38367,1689390651355' joining acquired barrier for procedure 'snaptb0-testEmptyExportFileSystemState' on coordinator 2023-07-15 03:12:35,343 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@781c82ac[Count = 1] remaining members to acquire global barrier 2023-07-15 03:12:35,343 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43199,1689390651225 2023-07-15 03:12:35,343 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 03:12:35,343 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 03:12:35,343 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 03:12:35,344 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 03:12:35,344 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-15 03:12:35,344 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43199,1689390651225 2023-07-15 03:12:35,344 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39199,1689390651299 2023-07-15 03:12:35,344 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38367,1689390651355 2023-07-15 03:12:35,345 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 03:12:35,345 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43199,1689390651225' joining acquired barrier for procedure 'snaptb0-testEmptyExportFileSystemState' on coordinator 2023-07-15 03:12:35,345 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@781c82ac[Count = 0] remaining members to acquire global barrier 2023-07-15 03:12:35,345 DEBUG [(jenkins-hbase4.apache.org,41669,1689390649760)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testEmptyExportFileSystemState' starting 'in-barrier' execution. 2023-07-15 03:12:35,345 DEBUG [(jenkins-hbase4.apache.org,41669,1689390649760)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-15 03:12:35,350 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): regionserver:43199-0x10166f610e80001, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-15 03:12:35,350 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): regionserver:38367-0x10166f610e80003, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-15 03:12:35,350 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): regionserver:39199-0x10166f610e80002, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-15 03:12:35,350 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-15 03:12:35,350 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-15 03:12:35,350 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-15 03:12:35,350 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-15 03:12:35,350 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-15 03:12:35,350 DEBUG [(jenkins-hbase4.apache.org,41669,1689390649760)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41669-0x10166f610e80000, quorum=127.0.0.1:62663, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,38367,1689390651355 2023-07-15 03:12:35,350 DEBUG [member: 'jenkins-hbase4.apache.org,38367,1689390651355' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-15 03:12:35,350 DEBUG [member: 'jenkins-hbase4.apache.org,39199,1689390651299' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-15 03:12:35,350 DEBUG [member: 'jenkins-hbase4.apache.org,39199,1689390651299' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally completed 2023-07-15 03:12:35,350 DEBUG [member: 'jenkins-hbase4.apache.org,39199,1689390651299' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,39199,1689390651299' in zk 2023-07-15 03:12:35,350 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-15 03:12:35,351 DEBUG [member: 'jenkins-hbase4.apache.org,38367,1689390651355' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-15 03:12:35,351 DEBUG [member: 'jenkins-hbase4.apache.org,38367,1689390651355' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-15 03:12:35,351 DEBUG [rs(jenkins-hbase4.apache.org,38367,1689390651355)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,,1689390754258.1e28f8f1fb6dda10f23d6d6d9fc3565a. 2023-07-15 03:12:35,351 DEBUG [member: 'jenkins-hbase4.apache.org,43199,1689390651225' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-15 03:12:35,351 DEBUG [rs(jenkins-hbase4.apache.org,38367,1689390651355)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1689390754258.1e28f8f1fb6dda10f23d6d6d9fc3565a. started... 2023-07-15 03:12:35,351 DEBUG [(jenkins-hbase4.apache.org,41669,1689390649760)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41669-0x10166f610e80000, quorum=127.0.0.1:62663, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43199,1689390651225 2023-07-15 03:12:35,351 DEBUG [member: 'jenkins-hbase4.apache.org,43199,1689390651225' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-15 03:12:35,351 DEBUG [member: 'jenkins-hbase4.apache.org,43199,1689390651225' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-15 03:12:35,351 DEBUG [rs(jenkins-hbase4.apache.org,43199,1689390651225)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,1,1689390754258.0d3dafb4371d91b47676a6fb9ea4c421. 2023-07-15 03:12:35,351 INFO [rs(jenkins-hbase4.apache.org,38367,1689390651355)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 1e28f8f1fb6dda10f23d6d6d9fc3565a 1/1 column families, dataSize=333 B heapSize=976 B 2023-07-15 03:12:35,351 DEBUG [(jenkins-hbase4.apache.org,41669,1689390649760)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-15 03:12:35,351 DEBUG [rs(jenkins-hbase4.apache.org,43199,1689390651225)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1689390754258.0d3dafb4371d91b47676a6fb9ea4c421. started... 2023-07-15 03:12:35,351 INFO [rs(jenkins-hbase4.apache.org,43199,1689390651225)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 0d3dafb4371d91b47676a6fb9ea4c421 1/1 column families, dataSize=2.93 KB heapSize=6.58 KB 2023-07-15 03:12:35,352 DEBUG [member: 'jenkins-hbase4.apache.org,39199,1689390651299' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-15 03:12:35,352 DEBUG [member: 'jenkins-hbase4.apache.org,39199,1689390651299' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-15 03:12:35,352 DEBUG [member: 'jenkins-hbase4.apache.org,39199,1689390651299' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testEmptyExportFileSystemState' completed. 2023-07-15 03:12:35,367 INFO [rs(jenkins-hbase4.apache.org,38367,1689390651355)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=333 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/data/default/testtb-testEmptyExportFileSystemState/1e28f8f1fb6dda10f23d6d6d9fc3565a/.tmp/cf/2de8495495f0453c9ee157a0d5675396 2023-07-15 03:12:35,372 INFO [rs(jenkins-hbase4.apache.org,43199,1689390651225)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=2.93 KB at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/data/default/testtb-testEmptyExportFileSystemState/0d3dafb4371d91b47676a6fb9ea4c421/.tmp/cf/e74646e9c0ff48b9a93836babbff2fe5 2023-07-15 03:12:35,376 DEBUG [rs(jenkins-hbase4.apache.org,38367,1689390651355)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/data/default/testtb-testEmptyExportFileSystemState/1e28f8f1fb6dda10f23d6d6d9fc3565a/.tmp/cf/2de8495495f0453c9ee157a0d5675396 as hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/data/default/testtb-testEmptyExportFileSystemState/1e28f8f1fb6dda10f23d6d6d9fc3565a/cf/2de8495495f0453c9ee157a0d5675396 2023-07-15 03:12:35,378 DEBUG [rs(jenkins-hbase4.apache.org,43199,1689390651225)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/data/default/testtb-testEmptyExportFileSystemState/0d3dafb4371d91b47676a6fb9ea4c421/.tmp/cf/e74646e9c0ff48b9a93836babbff2fe5 as hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/data/default/testtb-testEmptyExportFileSystemState/0d3dafb4371d91b47676a6fb9ea4c421/cf/e74646e9c0ff48b9a93836babbff2fe5 2023-07-15 03:12:35,381 INFO [rs(jenkins-hbase4.apache.org,38367,1689390651355)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/data/default/testtb-testEmptyExportFileSystemState/1e28f8f1fb6dda10f23d6d6d9fc3565a/cf/2de8495495f0453c9ee157a0d5675396, entries=5, sequenceid=6, filesize=5.2 K 2023-07-15 03:12:35,383 INFO [rs(jenkins-hbase4.apache.org,38367,1689390651355)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~333 B/333, heapSize ~960 B/960, currentSize=0 B/0 for 1e28f8f1fb6dda10f23d6d6d9fc3565a in 32ms, sequenceid=6, compaction requested=false 2023-07-15 03:12:35,383 DEBUG [rs(jenkins-hbase4.apache.org,38367,1689390651355)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testEmptyExportFileSystemState' 2023-07-15 03:12:35,383 DEBUG [rs(jenkins-hbase4.apache.org,38367,1689390651355)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 1e28f8f1fb6dda10f23d6d6d9fc3565a: 2023-07-15 03:12:35,383 DEBUG [rs(jenkins-hbase4.apache.org,38367,1689390651355)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,,1689390754258.1e28f8f1fb6dda10f23d6d6d9fc3565a.' region-info for snapshot=snaptb0-testEmptyExportFileSystemState 2023-07-15 03:12:35,383 DEBUG [rs(jenkins-hbase4.apache.org,38367,1689390651355)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-15 03:12:35,384 DEBUG [rs(jenkins-hbase4.apache.org,38367,1689390651355)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/data/default/testtb-testEmptyExportFileSystemState/1e28f8f1fb6dda10f23d6d6d9fc3565a/cf/2de8495495f0453c9ee157a0d5675396] hfiles 2023-07-15 03:12:35,384 DEBUG [rs(jenkins-hbase4.apache.org,38367,1689390651355)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/data/default/testtb-testEmptyExportFileSystemState/1e28f8f1fb6dda10f23d6d6d9fc3565a/cf/2de8495495f0453c9ee157a0d5675396 for snapshot=snaptb0-testEmptyExportFileSystemState 2023-07-15 03:12:35,384 INFO [rs(jenkins-hbase4.apache.org,43199,1689390651225)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/data/default/testtb-testEmptyExportFileSystemState/0d3dafb4371d91b47676a6fb9ea4c421/cf/e74646e9c0ff48b9a93836babbff2fe5, entries=45, sequenceid=6, filesize=7.9 K 2023-07-15 03:12:35,385 INFO [rs(jenkins-hbase4.apache.org,43199,1689390651225)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~2.93 KB/3003, heapSize ~6.56 KB/6720, currentSize=0 B/0 for 0d3dafb4371d91b47676a6fb9ea4c421 in 34ms, sequenceid=6, compaction requested=false 2023-07-15 03:12:35,387 DEBUG [rs(jenkins-hbase4.apache.org,43199,1689390651225)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 0d3dafb4371d91b47676a6fb9ea4c421: 2023-07-15 03:12:35,387 DEBUG [rs(jenkins-hbase4.apache.org,43199,1689390651225)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,1,1689390754258.0d3dafb4371d91b47676a6fb9ea4c421.' region-info for snapshot=snaptb0-testEmptyExportFileSystemState 2023-07-15 03:12:35,388 DEBUG [rs(jenkins-hbase4.apache.org,43199,1689390651225)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-15 03:12:35,388 DEBUG [rs(jenkins-hbase4.apache.org,43199,1689390651225)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/data/default/testtb-testEmptyExportFileSystemState/0d3dafb4371d91b47676a6fb9ea4c421/cf/e74646e9c0ff48b9a93836babbff2fe5] hfiles 2023-07-15 03:12:35,388 DEBUG [rs(jenkins-hbase4.apache.org,43199,1689390651225)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/data/default/testtb-testEmptyExportFileSystemState/0d3dafb4371d91b47676a6fb9ea4c421/cf/e74646e9c0ff48b9a93836babbff2fe5 for snapshot=snaptb0-testEmptyExportFileSystemState 2023-07-15 03:12:35,399 DEBUG [rs(jenkins-hbase4.apache.org,38367,1689390651355)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1689390754258.1e28f8f1fb6dda10f23d6d6d9fc3565a. completed. 2023-07-15 03:12:35,399 DEBUG [rs(jenkins-hbase4.apache.org,38367,1689390651355)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,,1689390754258.1e28f8f1fb6dda10f23d6d6d9fc3565a. 2023-07-15 03:12:35,399 DEBUG [member: 'jenkins-hbase4.apache.org,38367,1689390651355' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-15 03:12:35,399 DEBUG [member: 'jenkins-hbase4.apache.org,38367,1689390651355' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-15 03:12:35,399 DEBUG [member: 'jenkins-hbase4.apache.org,38367,1689390651355' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,38367,1689390651355 2023-07-15 03:12:35,399 DEBUG [member: 'jenkins-hbase4.apache.org,38367,1689390651355' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally completed 2023-07-15 03:12:35,399 DEBUG [member: 'jenkins-hbase4.apache.org,38367,1689390651355' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,38367,1689390651355' in zk 2023-07-15 03:12:35,401 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): master:41669-0x10166f610e80000, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,38367,1689390651355 2023-07-15 03:12:35,401 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,38367,1689390651355 2023-07-15 03:12:35,401 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 03:12:35,401 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 03:12:35,402 DEBUG [rs(jenkins-hbase4.apache.org,43199,1689390651225)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1689390754258.0d3dafb4371d91b47676a6fb9ea4c421. completed. 2023-07-15 03:12:35,402 DEBUG [rs(jenkins-hbase4.apache.org,43199,1689390651225)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,1,1689390754258.0d3dafb4371d91b47676a6fb9ea4c421. 2023-07-15 03:12:35,402 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 03:12:35,402 DEBUG [member: 'jenkins-hbase4.apache.org,43199,1689390651225' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-15 03:12:35,402 DEBUG [member: 'jenkins-hbase4.apache.org,43199,1689390651225' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-15 03:12:35,402 DEBUG [member: 'jenkins-hbase4.apache.org,43199,1689390651225' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,43199,1689390651225 2023-07-15 03:12:35,402 DEBUG [member: 'jenkins-hbase4.apache.org,43199,1689390651225' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally completed 2023-07-15 03:12:35,402 DEBUG [member: 'jenkins-hbase4.apache.org,43199,1689390651225' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,43199,1689390651225' in zk 2023-07-15 03:12:35,402 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 03:12:35,402 DEBUG [member: 'jenkins-hbase4.apache.org,38367,1689390651355' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-15 03:12:35,402 DEBUG [member: 'jenkins-hbase4.apache.org,38367,1689390651355' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-15 03:12:35,402 DEBUG [member: 'jenkins-hbase4.apache.org,38367,1689390651355' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testEmptyExportFileSystemState' completed. 2023-07-15 03:12:35,404 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-15 03:12:35,405 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): master:41669-0x10166f610e80000, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43199,1689390651225 2023-07-15 03:12:35,405 DEBUG [member: 'jenkins-hbase4.apache.org,43199,1689390651225' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-15 03:12:35,405 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43199,1689390651225 2023-07-15 03:12:35,406 DEBUG [member: 'jenkins-hbase4.apache.org,43199,1689390651225' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-15 03:12:35,406 DEBUG [member: 'jenkins-hbase4.apache.org,43199,1689390651225' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testEmptyExportFileSystemState' completed. 2023-07-15 03:12:35,407 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39199,1689390651299 2023-07-15 03:12:35,407 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38367,1689390651355 2023-07-15 03:12:35,407 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 03:12:35,407 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-15 03:12:35,408 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43199,1689390651225 2023-07-15 03:12:35,408 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39199,1689390651299 2023-07-15 03:12:35,408 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38367,1689390651355 2023-07-15 03:12:35,409 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,38367,1689390651355': 2023-07-15 03:12:35,409 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,38367,1689390651355' released barrier for procedure'snaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 1 more 2023-07-15 03:12:35,409 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43199,1689390651225 2023-07-15 03:12:35,409 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 03:12:35,409 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 03:12:35,409 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 03:12:35,409 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 03:12:35,409 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-15 03:12:35,409 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43199,1689390651225 2023-07-15 03:12:35,410 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39199,1689390651299 2023-07-15 03:12:35,410 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38367,1689390651355 2023-07-15 03:12:35,410 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 03:12:35,410 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-15 03:12:35,410 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43199,1689390651225 2023-07-15 03:12:35,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39199,1689390651299 2023-07-15 03:12:35,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38367,1689390651355 2023-07-15 03:12:35,412 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,43199,1689390651225': 2023-07-15 03:12:35,412 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43199,1689390651225' released barrier for procedure'snaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 0 more 2023-07-15 03:12:35,412 INFO [(jenkins-hbase4.apache.org,41669,1689390649760)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testEmptyExportFileSystemState' execution completed 2023-07-15 03:12:35,412 DEBUG [(jenkins-hbase4.apache.org,41669,1689390649760)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-15 03:12:35,412 DEBUG [(jenkins-hbase4.apache.org,41669,1689390649760)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-15 03:12:35,412 DEBUG [(jenkins-hbase4.apache.org,41669,1689390649760)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testEmptyExportFileSystemState 2023-07-15 03:12:35,412 INFO [(jenkins-hbase4.apache.org,41669,1689390649760)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testEmptyExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-15 03:12:35,413 DEBUG [Listener at jenkins-hbase4.apache.org/44817] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-15 03:12:35,414 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41669] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-15 03:12:35,414 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): regionserver:38367-0x10166f610e80003, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-15 03:12:35,415 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): regionserver:38367-0x10166f610e80003, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 03:12:35,415 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): regionserver:43199-0x10166f610e80001, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-15 03:12:35,414 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41669] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-15 03:12:35,415 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-15 03:12:35,415 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-15 03:12:35,415 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): regionserver:43199-0x10166f610e80001, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 03:12:35,415 DEBUG [Listener at jenkins-hbase4.apache.org/44817] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-15 03:12:35,415 DEBUG [(jenkins-hbase4.apache.org,41669,1689390649760)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41669-0x10166f610e80000, quorum=127.0.0.1:62663, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43199,1689390651225 2023-07-15 03:12:35,415 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 03:12:35,415 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 03:12:35,416 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-15 03:12:35,416 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-15 03:12:35,416 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): regionserver:39199-0x10166f610e80002, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-15 03:12:35,416 DEBUG [(jenkins-hbase4.apache.org,41669,1689390649760)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41669-0x10166f610e80000, quorum=127.0.0.1:62663, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39199,1689390651299 2023-07-15 03:12:35,416 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-15 03:12:35,416 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-15 03:12:35,416 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): regionserver:39199-0x10166f610e80002, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 03:12:35,416 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 03:12:35,416 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 03:12:35,416 DEBUG [(jenkins-hbase4.apache.org,41669,1689390649760)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41669-0x10166f610e80000, quorum=127.0.0.1:62663, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,38367,1689390651355 2023-07-15 03:12:35,417 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-15 03:12:35,417 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-15 03:12:35,417 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 03:12:35,417 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 03:12:35,418 DEBUG [(jenkins-hbase4.apache.org,41669,1689390649760)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41669-0x10166f610e80000, quorum=127.0.0.1:62663, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43199,1689390651225 2023-07-15 03:12:35,418 DEBUG [(jenkins-hbase4.apache.org,41669,1689390649760)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41669-0x10166f610e80000, quorum=127.0.0.1:62663, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39199,1689390651299 2023-07-15 03:12:35,418 DEBUG [(jenkins-hbase4.apache.org,41669,1689390649760)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41669-0x10166f610e80000, quorum=127.0.0.1:62663, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,38367,1689390651355 2023-07-15 03:12:35,421 DEBUG [(jenkins-hbase4.apache.org,41669,1689390649760)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-15 03:12:35,421 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testEmptyExportFileSystemState 2023-07-15 03:12:35,421 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testEmptyExportFileSystemState 2023-07-15 03:12:35,423 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState 2023-07-15 03:12:35,424 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-15 03:12:35,424 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): regionserver:38367-0x10166f610e80003, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 03:12:35,424 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): regionserver:38367-0x10166f610e80003, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 03:12:35,424 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): regionserver:39199-0x10166f610e80002, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 03:12:35,424 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): regionserver:39199-0x10166f610e80002, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 03:12:35,424 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 03:12:35,424 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): regionserver:43199-0x10166f610e80001, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 03:12:35,424 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 03:12:35,424 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 03:12:35,424 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 03:12:35,424 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): regionserver:43199-0x10166f610e80001, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 03:12:35,424 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): master:41669-0x10166f610e80000, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-15 03:12:35,424 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): regionserver:38367-0x10166f610e80003, quorum=127.0.0.1:62663, baseZNode=/hbase Unable to get data of znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState because node does not exist (not an error) 2023-07-15 03:12:35,424 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-15 03:12:35,424 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 03:12:35,424 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 03:12:35,424 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): master:41669-0x10166f610e80000, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,38367,1689390651355 2023-07-15 03:12:35,424 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 03:12:35,424 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 03:12:35,425 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 03:12:35,424 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 03:12:35,424 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 03:12:35,425 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 03:12:35,424 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): master:41669-0x10166f610e80000, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-15 03:12:35,425 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): master:41669-0x10166f610e80000, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39199,1689390651299 2023-07-15 03:12:35,425 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): master:41669-0x10166f610e80000, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43199,1689390651225 2023-07-15 03:12:35,425 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): master:41669-0x10166f610e80000, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-15 03:12:35,425 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): master:41669-0x10166f610e80000, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,38367,1689390651355 2023-07-15 03:12:35,425 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): master:41669-0x10166f610e80000, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-15 03:12:35,425 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): master:41669-0x10166f610e80000, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39199,1689390651299 2023-07-15 03:12:35,425 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): master:41669-0x10166f610e80000, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43199,1689390651225 2023-07-15 03:12:35,425 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): master:41669-0x10166f610e80000, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-15 03:12:35,425 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): master:41669-0x10166f610e80000, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-15 03:12:35,425 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 03:12:35,425 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 03:12:35,425 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 03:12:35,425 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 03:12:35,426 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 03:12:35,426 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:41669-0x10166f610e80000, quorum=127.0.0.1:62663, baseZNode=/hbase Unable to get data of znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState because node does not exist (not an error) 2023-07-15 03:12:35,471 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState to hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/.hbase-snapshot/snaptb0-testEmptyExportFileSystemState 2023-07-15 03:12:35,503 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed 2023-07-15 03:12:35,503 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState 2023-07-15 03:12:35,503 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState 2023-07-15 03:12:35,503 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState at 1689390755312Consolidate snapshot: snaptb0-testEmptyExportFileSystemState at 1689390755421 (+109 ms)Loading Region manifests for snaptb0-testEmptyExportFileSystemState at 1689390755421Writing data manifest for snaptb0-testEmptyExportFileSystemState at 1689390755441 (+20 ms)Verifying snapshot: snaptb0-testEmptyExportFileSystemState at 1689390755455 (+14 ms)Snapshot snaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed at 1689390755503 (+48 ms) 2023-07-15 03:12:35,506 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=98, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-15 03:12:35,508 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=98, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED in 193 msec 2023-07-15 03:12:35,615 DEBUG [Listener at jenkins-hbase4.apache.org/44817] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-15 03:12:35,616 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41669] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-15 03:12:35,616 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41669] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-15 03:12:35,617 INFO [Listener at jenkins-hbase4.apache.org/44817] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/export-test/export-1689390755617 2023-07-15 03:12:35,617 INFO [Listener at jenkins-hbase4.apache.org/44817] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:37513, tgtDir=hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/export-test/export-1689390755617, rawTgtDir=hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/export-test/export-1689390755617, srcFsUri=hdfs://localhost:37513, srcDir=hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280 2023-07-15 03:12:35,652 DEBUG [Listener at jenkins-hbase4.apache.org/44817] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:37513, inputRoot=hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280 2023-07-15 03:12:35,652 DEBUG [Listener at jenkins-hbase4.apache.org/44817] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1319063316_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/export-test/export-1689390755617, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/export-test/export-1689390755617/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 03:12:35,652 INFO [Listener at jenkins-hbase4.apache.org/44817] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:37513, inputRoot=hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280, snapshotDir=hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState. 2023-07-15 03:12:35,658 INFO [Listener at jenkins-hbase4.apache.org/44817] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState to hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/export-test/export-1689390755617/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 03:12:35,694 DEBUG [Listener at jenkins-hbase4.apache.org/44817] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-15 03:12:35,695 DEBUG [Listener at jenkins-hbase4.apache.org/44817] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-15 03:12:35,695 DEBUG [Listener at jenkins-hbase4.apache.org/44817] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-15 03:12:35,695 DEBUG [Listener at jenkins-hbase4.apache.org/44817] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-15 03:12:36,853 DEBUG [Listener at jenkins-hbase4.apache.org/44817] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6bc8dbaf-aac0-03cf-90d4-be6af049f709/hadoop-8447777561903332559.jar 2023-07-15 03:12:36,854 DEBUG [Listener at jenkins-hbase4.apache.org/44817] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-15 03:12:36,854 DEBUG [Listener at jenkins-hbase4.apache.org/44817] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-15 03:12:36,939 DEBUG [Listener at jenkins-hbase4.apache.org/44817] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6bc8dbaf-aac0-03cf-90d4-be6af049f709/hadoop-4396704821635084723.jar 2023-07-15 03:12:36,940 DEBUG [Listener at jenkins-hbase4.apache.org/44817] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-15 03:12:36,940 DEBUG [Listener at jenkins-hbase4.apache.org/44817] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-15 03:12:36,941 DEBUG [Listener at jenkins-hbase4.apache.org/44817] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-15 03:12:36,941 DEBUG [Listener at jenkins-hbase4.apache.org/44817] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-15 03:12:36,941 DEBUG [Listener at jenkins-hbase4.apache.org/44817] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-15 03:12:36,942 DEBUG [Listener at jenkins-hbase4.apache.org/44817] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-15 03:12:36,942 DEBUG [Listener at jenkins-hbase4.apache.org/44817] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-15 03:12:36,942 DEBUG [Listener at jenkins-hbase4.apache.org/44817] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-15 03:12:36,943 DEBUG [Listener at jenkins-hbase4.apache.org/44817] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-15 03:12:36,943 DEBUG [Listener at jenkins-hbase4.apache.org/44817] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-15 03:12:36,943 DEBUG [Listener at jenkins-hbase4.apache.org/44817] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-15 03:12:36,944 DEBUG [Listener at jenkins-hbase4.apache.org/44817] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-15 03:12:36,944 DEBUG [Listener at jenkins-hbase4.apache.org/44817] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-15 03:12:36,944 DEBUG [Listener at jenkins-hbase4.apache.org/44817] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-15 03:12:36,945 DEBUG [Listener at jenkins-hbase4.apache.org/44817] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-15 03:12:36,945 DEBUG [Listener at jenkins-hbase4.apache.org/44817] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-15 03:12:36,946 DEBUG [Listener at jenkins-hbase4.apache.org/44817] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-15 03:12:36,946 DEBUG [Listener at jenkins-hbase4.apache.org/44817] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-15 03:12:36,947 DEBUG [Listener at jenkins-hbase4.apache.org/44817] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-15 03:12:36,947 DEBUG [Listener at jenkins-hbase4.apache.org/44817] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-15 03:12:36,947 DEBUG [Listener at jenkins-hbase4.apache.org/44817] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-15 03:12:36,948 DEBUG [Listener at jenkins-hbase4.apache.org/44817] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-15 03:12:36,948 DEBUG [Listener at jenkins-hbase4.apache.org/44817] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-15 03:12:37,437 WARN [Listener at jenkins-hbase4.apache.org/44817] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-15 03:12:37,440 INFO [Listener at jenkins-hbase4.apache.org/44817] snapshot.ExportSnapshot(578): Loading Snapshot 'emptySnaptb0-testEmptyExportFileSystemState' hfile list 2023-07-15 03:12:37,963 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-15 03:12:37,963 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-15 03:12:37,967 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689390660463_0005_000001 (auth:SIMPLE) 2023-07-15 03:12:38,531 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689390660463_0006_000001 (auth:SIMPLE) 2023-07-15 03:12:39,078 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-15 03:12:44,818 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689390660463_0006_000001 (auth:SIMPLE) 2023-07-15 03:12:47,866 INFO [Listener at jenkins-hbase4.apache.org/44817] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-15 03:12:47,893 INFO [Listener at jenkins-hbase4.apache.org/44817] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-15 03:12:47,902 INFO [Listener at jenkins-hbase4.apache.org/44817] snapshot.ExportSnapshot(1127): Export Completed: emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 03:12:47,902 INFO [Listener at jenkins-hbase4.apache.org/44817] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-15 03:12:47,904 INFO [Listener at jenkins-hbase4.apache.org/44817] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-15 03:12:47,904 DEBUG [Listener at jenkins-hbase4.apache.org/44817] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-924468511_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState at hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 03:12:47,904 DEBUG [Listener at jenkins-hbase4.apache.org/44817] snapshot.TestExportSnapshot(367): hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/.snapshotinfo 2023-07-15 03:12:47,905 DEBUG [Listener at jenkins-hbase4.apache.org/44817] snapshot.TestExportSnapshot(367): hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/data.manifest 2023-07-15 03:12:47,905 DEBUG [Listener at jenkins-hbase4.apache.org/44817] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-924468511_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/export-test/export-1689390755617/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState at hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/export-test/export-1689390755617/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 03:12:47,907 DEBUG [Listener at jenkins-hbase4.apache.org/44817] snapshot.TestExportSnapshot(367): hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/export-test/export-1689390755617/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/.snapshotinfo 2023-07-15 03:12:47,907 DEBUG [Listener at jenkins-hbase4.apache.org/44817] snapshot.TestExportSnapshot(367): hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/export-test/export-1689390755617/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/data.manifest 2023-07-15 03:12:47,918 INFO [Listener at jenkins-hbase4.apache.org/44817] client.HBaseAdmin$15(890): Started disable of testtb-testEmptyExportFileSystemState 2023-07-15 03:12:47,918 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41669] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testEmptyExportFileSystemState 2023-07-15 03:12:47,919 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41669] procedure2.ProcedureExecutor(1029): Stored pid=99, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-15 03:12:47,923 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41669] master.MasterRpcServices(1230): Checking to see if procedure is done pid=99 2023-07-15 03:12:47,924 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689390767923"}]},"ts":"1689390767923"} 2023-07-15 03:12:47,926 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=DISABLING in hbase:meta 2023-07-15 03:12:47,928 INFO [PEWorker-3] procedure.DisableTableProcedure(293): Set testtb-testEmptyExportFileSystemState to state=DISABLING 2023-07-15 03:12:47,929 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=100, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=1e28f8f1fb6dda10f23d6d6d9fc3565a, UNASSIGN}, {pid=101, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=0d3dafb4371d91b47676a6fb9ea4c421, UNASSIGN}] 2023-07-15 03:12:47,935 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=100, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=1e28f8f1fb6dda10f23d6d6d9fc3565a, UNASSIGN 2023-07-15 03:12:47,935 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=101, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=0d3dafb4371d91b47676a6fb9ea4c421, UNASSIGN 2023-07-15 03:12:47,936 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=100 updating hbase:meta row=1e28f8f1fb6dda10f23d6d6d9fc3565a, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,38367,1689390651355 2023-07-15 03:12:47,936 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,,1689390754258.1e28f8f1fb6dda10f23d6d6d9fc3565a.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689390767936"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689390767936"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689390767936"}]},"ts":"1689390767936"} 2023-07-15 03:12:47,937 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=101 updating hbase:meta row=0d3dafb4371d91b47676a6fb9ea4c421, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,43199,1689390651225 2023-07-15 03:12:47,937 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,1,1689390754258.0d3dafb4371d91b47676a6fb9ea4c421.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689390767937"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689390767937"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689390767937"}]},"ts":"1689390767937"} 2023-07-15 03:12:47,941 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=102, ppid=100, state=RUNNABLE; CloseRegionProcedure 1e28f8f1fb6dda10f23d6d6d9fc3565a, server=jenkins-hbase4.apache.org,38367,1689390651355}] 2023-07-15 03:12:47,942 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=103, ppid=101, state=RUNNABLE; CloseRegionProcedure 0d3dafb4371d91b47676a6fb9ea4c421, server=jenkins-hbase4.apache.org,43199,1689390651225}] 2023-07-15 03:12:48,026 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41669] master.MasterRpcServices(1230): Checking to see if procedure is done pid=99 2023-07-15 03:12:48,095 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 1e28f8f1fb6dda10f23d6d6d9fc3565a 2023-07-15 03:12:48,095 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 1e28f8f1fb6dda10f23d6d6d9fc3565a, disabling compactions & flushes 2023-07-15 03:12:48,095 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,,1689390754258.1e28f8f1fb6dda10f23d6d6d9fc3565a. 2023-07-15 03:12:48,095 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,,1689390754258.1e28f8f1fb6dda10f23d6d6d9fc3565a. 2023-07-15 03:12:48,095 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,,1689390754258.1e28f8f1fb6dda10f23d6d6d9fc3565a. after waiting 0 ms 2023-07-15 03:12:48,095 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,,1689390754258.1e28f8f1fb6dda10f23d6d6d9fc3565a. 2023-07-15 03:12:48,097 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 0d3dafb4371d91b47676a6fb9ea4c421 2023-07-15 03:12:48,097 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 0d3dafb4371d91b47676a6fb9ea4c421, disabling compactions & flushes 2023-07-15 03:12:48,097 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,1,1689390754258.0d3dafb4371d91b47676a6fb9ea4c421. 2023-07-15 03:12:48,097 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,1,1689390754258.0d3dafb4371d91b47676a6fb9ea4c421. 2023-07-15 03:12:48,097 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,1,1689390754258.0d3dafb4371d91b47676a6fb9ea4c421. after waiting 0 ms 2023-07-15 03:12:48,097 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,1,1689390754258.0d3dafb4371d91b47676a6fb9ea4c421. 2023-07-15 03:12:48,171 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/data/default/testtb-testEmptyExportFileSystemState/0d3dafb4371d91b47676a6fb9ea4c421/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-15 03:12:48,171 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/data/default/testtb-testEmptyExportFileSystemState/1e28f8f1fb6dda10f23d6d6d9fc3565a/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-15 03:12:48,171 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-15 03:12:48,178 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,1,1689390754258.0d3dafb4371d91b47676a6fb9ea4c421. 2023-07-15 03:12:48,178 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 0d3dafb4371d91b47676a6fb9ea4c421: 2023-07-15 03:12:48,178 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-15 03:12:48,180 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,,1689390754258.1e28f8f1fb6dda10f23d6d6d9fc3565a. 2023-07-15 03:12:48,180 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 1e28f8f1fb6dda10f23d6d6d9fc3565a: 2023-07-15 03:12:48,181 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 0d3dafb4371d91b47676a6fb9ea4c421 2023-07-15 03:12:48,182 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=101 updating hbase:meta row=0d3dafb4371d91b47676a6fb9ea4c421, regionState=CLOSED 2023-07-15 03:12:48,182 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,1,1689390754258.0d3dafb4371d91b47676a6fb9ea4c421.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689390768182"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689390768182"}]},"ts":"1689390768182"} 2023-07-15 03:12:48,183 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 1e28f8f1fb6dda10f23d6d6d9fc3565a 2023-07-15 03:12:48,183 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=100 updating hbase:meta row=1e28f8f1fb6dda10f23d6d6d9fc3565a, regionState=CLOSED 2023-07-15 03:12:48,183 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,,1689390754258.1e28f8f1fb6dda10f23d6d6d9fc3565a.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689390768183"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689390768183"}]},"ts":"1689390768183"} 2023-07-15 03:12:48,186 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=103, resume processing ppid=101 2023-07-15 03:12:48,186 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=103, ppid=101, state=SUCCESS; CloseRegionProcedure 0d3dafb4371d91b47676a6fb9ea4c421, server=jenkins-hbase4.apache.org,43199,1689390651225 in 242 msec 2023-07-15 03:12:48,190 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=102, resume processing ppid=100 2023-07-15 03:12:48,190 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=101, ppid=99, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=0d3dafb4371d91b47676a6fb9ea4c421, UNASSIGN in 257 msec 2023-07-15 03:12:48,190 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=102, ppid=100, state=SUCCESS; CloseRegionProcedure 1e28f8f1fb6dda10f23d6d6d9fc3565a, server=jenkins-hbase4.apache.org,38367,1689390651355 in 246 msec 2023-07-15 03:12:48,192 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=100, resume processing ppid=99 2023-07-15 03:12:48,192 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=100, ppid=99, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=1e28f8f1fb6dda10f23d6d6d9fc3565a, UNASSIGN in 261 msec 2023-07-15 03:12:48,193 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689390768193"}]},"ts":"1689390768193"} 2023-07-15 03:12:48,194 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=DISABLED in hbase:meta 2023-07-15 03:12:48,197 INFO [PEWorker-4] procedure.DisableTableProcedure(305): Set testtb-testEmptyExportFileSystemState to state=DISABLED 2023-07-15 03:12:48,200 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=99, state=SUCCESS; DisableTableProcedure table=testtb-testEmptyExportFileSystemState in 281 msec 2023-07-15 03:12:48,228 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41669] master.MasterRpcServices(1230): Checking to see if procedure is done pid=99 2023-07-15 03:12:48,228 INFO [Listener at jenkins-hbase4.apache.org/44817] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testEmptyExportFileSystemState, procId: 99 completed 2023-07-15 03:12:48,229 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41669] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testEmptyExportFileSystemState 2023-07-15 03:12:48,231 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41669] procedure2.ProcedureExecutor(1029): Stored pid=104, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-15 03:12:48,235 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=104, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-15 03:12:48,235 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41669] access.PermissionStorage(259): Removing permissions of removed table testtb-testEmptyExportFileSystemState 2023-07-15 03:12:48,237 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=104, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-15 03:12:48,238 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=39199] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testEmptyExportFileSystemState 2023-07-15 03:12:48,242 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): regionserver:43199-0x10166f610e80001, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-15 03:12:48,242 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): regionserver:38367-0x10166f610e80003, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-15 03:12:48,242 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): master:41669-0x10166f610e80000, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-15 03:12:48,242 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): regionserver:39199-0x10166f610e80002, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-15 03:12:48,243 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-07-15 03:12:48,243 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-07-15 03:12:48,243 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-07-15 03:12:48,245 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): regionserver:38367-0x10166f610e80003, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-15 03:12:48,245 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): regionserver:43199-0x10166f610e80001, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-15 03:12:48,245 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): regionserver:39199-0x10166f610e80002, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-15 03:12:48,245 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data null 2023-07-15 03:12:48,245 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): regionserver:43199-0x10166f610e80001, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-15 03:12:48,245 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): regionserver:38367-0x10166f610e80003, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-15 03:12:48,245 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): master:41669-0x10166f610e80000, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-15 03:12:48,245 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): master:41669-0x10166f610e80000, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-15 03:12:48,245 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-15 03:12:48,247 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41669] master.MasterRpcServices(1230): Checking to see if procedure is done pid=104 2023-07-15 03:12:48,250 DEBUG [HFileArchiver-14] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/.tmp/data/default/testtb-testEmptyExportFileSystemState/0d3dafb4371d91b47676a6fb9ea4c421 2023-07-15 03:12:48,251 DEBUG [HFileArchiver-21] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/.tmp/data/default/testtb-testEmptyExportFileSystemState/1e28f8f1fb6dda10f23d6d6d9fc3565a 2023-07-15 03:12:48,253 DEBUG [HFileArchiver-14] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/.tmp/data/default/testtb-testEmptyExportFileSystemState/0d3dafb4371d91b47676a6fb9ea4c421/cf, FileablePath, hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/.tmp/data/default/testtb-testEmptyExportFileSystemState/0d3dafb4371d91b47676a6fb9ea4c421/recovered.edits] 2023-07-15 03:12:48,263 DEBUG [HFileArchiver-21] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/.tmp/data/default/testtb-testEmptyExportFileSystemState/1e28f8f1fb6dda10f23d6d6d9fc3565a/cf, FileablePath, hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/.tmp/data/default/testtb-testEmptyExportFileSystemState/1e28f8f1fb6dda10f23d6d6d9fc3565a/recovered.edits] 2023-07-15 03:12:48,265 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/.tmp/data/default/testtb-testEmptyExportFileSystemState/0d3dafb4371d91b47676a6fb9ea4c421/cf/e74646e9c0ff48b9a93836babbff2fe5 to hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/archive/data/default/testtb-testEmptyExportFileSystemState/0d3dafb4371d91b47676a6fb9ea4c421/cf/e74646e9c0ff48b9a93836babbff2fe5 2023-07-15 03:12:48,269 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/.tmp/data/default/testtb-testEmptyExportFileSystemState/0d3dafb4371d91b47676a6fb9ea4c421/recovered.edits/9.seqid to hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/archive/data/default/testtb-testEmptyExportFileSystemState/0d3dafb4371d91b47676a6fb9ea4c421/recovered.edits/9.seqid 2023-07-15 03:12:48,270 DEBUG [HFileArchiver-14] backup.HFileArchiver(596): Deleted hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/.tmp/data/default/testtb-testEmptyExportFileSystemState/0d3dafb4371d91b47676a6fb9ea4c421 2023-07-15 03:12:48,275 DEBUG [HFileArchiver-21] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/.tmp/data/default/testtb-testEmptyExportFileSystemState/1e28f8f1fb6dda10f23d6d6d9fc3565a/cf/2de8495495f0453c9ee157a0d5675396 to hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/archive/data/default/testtb-testEmptyExportFileSystemState/1e28f8f1fb6dda10f23d6d6d9fc3565a/cf/2de8495495f0453c9ee157a0d5675396 2023-07-15 03:12:48,295 DEBUG [HFileArchiver-21] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/.tmp/data/default/testtb-testEmptyExportFileSystemState/1e28f8f1fb6dda10f23d6d6d9fc3565a/recovered.edits/9.seqid to hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/archive/data/default/testtb-testEmptyExportFileSystemState/1e28f8f1fb6dda10f23d6d6d9fc3565a/recovered.edits/9.seqid 2023-07-15 03:12:48,296 DEBUG [HFileArchiver-21] backup.HFileArchiver(596): Deleted hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/.tmp/data/default/testtb-testEmptyExportFileSystemState/1e28f8f1fb6dda10f23d6d6d9fc3565a 2023-07-15 03:12:48,296 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testtb-testEmptyExportFileSystemState regions 2023-07-15 03:12:48,299 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=104, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-15 03:12:48,308 WARN [PEWorker-5] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testEmptyExportFileSystemState from hbase:meta 2023-07-15 03:12:48,310 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(421): Removing 'testtb-testEmptyExportFileSystemState' descriptor. 2023-07-15 03:12:48,311 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=104, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-15 03:12:48,312 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(411): Removing 'testtb-testEmptyExportFileSystemState' from region states. 2023-07-15 03:12:48,312 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState,,1689390754258.1e28f8f1fb6dda10f23d6d6d9fc3565a.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689390768312"}]},"ts":"9223372036854775807"} 2023-07-15 03:12:48,312 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState,1,1689390754258.0d3dafb4371d91b47676a6fb9ea4c421.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689390768312"}]},"ts":"9223372036854775807"} 2023-07-15 03:12:48,318 INFO [PEWorker-5] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-15 03:12:48,318 DEBUG [PEWorker-5] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 1e28f8f1fb6dda10f23d6d6d9fc3565a, NAME => 'testtb-testEmptyExportFileSystemState,,1689390754258.1e28f8f1fb6dda10f23d6d6d9fc3565a.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 0d3dafb4371d91b47676a6fb9ea4c421, NAME => 'testtb-testEmptyExportFileSystemState,1,1689390754258.0d3dafb4371d91b47676a6fb9ea4c421.', STARTKEY => '1', ENDKEY => ''}] 2023-07-15 03:12:48,318 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(415): Marking 'testtb-testEmptyExportFileSystemState' as deleted. 2023-07-15 03:12:48,318 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689390768318"}]},"ts":"9223372036854775807"} 2023-07-15 03:12:48,321 INFO [PEWorker-5] hbase.MetaTableAccessor(1658): Deleted table testtb-testEmptyExportFileSystemState state from META 2023-07-15 03:12:48,323 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(130): Finished pid=104, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-15 03:12:48,325 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=104, state=SUCCESS; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState in 94 msec 2023-07-15 03:12:48,348 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41669] master.MasterRpcServices(1230): Checking to see if procedure is done pid=104 2023-07-15 03:12:48,348 INFO [Listener at jenkins-hbase4.apache.org/44817] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testEmptyExportFileSystemState, procId: 104 completed 2023-07-15 03:12:48,359 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41669] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testEmptyExportFileSystemState" 2023-07-15 03:12:48,362 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41669] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 03:12:48,365 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41669] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testEmptyExportFileSystemState" 2023-07-15 03:12:48,367 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41669] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testEmptyExportFileSystemState 2023-07-15 03:12:48,411 INFO [Listener at jenkins-hbase4.apache.org/44817] hbase.ResourceChecker(175): after: snapshot.TestSecureExportSnapshot#testEmptyExportFileSystemState Thread=761 (was 759) Potentially hanging thread: hconnection-0x337e74cd-shared-pool-33 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x337e74cd-shared-pool-36 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-924468511_17 at /127.0.0.1:56618 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LogDeleter #3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1088) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x337e74cd-shared-pool-34 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1988502388) connection to jenkins-hbase4.apache.org/172.31.14.131:39503 from appattempt_1689390660463_0006_000001 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: hconnection-0x337e74cd-shared-pool-35 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-4481 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: IPC Client (1988502388) connection to jenkins-hbase4.apache.org/172.31.14.131:39679 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: IPC Client (1988502388) connection to jenkins-hbase4.apache.org/172.31.14.131:44817 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: ApplicationMasterLauncher #9 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #10 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_135406581_1 at /127.0.0.1:56598 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-924468511_17 at /127.0.0.1:54140 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-21 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-924468511_17 at /127.0.0.1:43376 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=904 (was 900) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=649 (was 600) - SystemLoadAverage LEAK? -, ProcessCount=186 (was 186), AvailableMemoryMB=1010 (was 2021) 2023-07-15 03:12:48,411 WARN [Listener at jenkins-hbase4.apache.org/44817] hbase.ResourceChecker(130): Thread=761 is superior to 500 2023-07-15 03:12:48,441 INFO [Listener at jenkins-hbase4.apache.org/44817] hbase.ResourceChecker(147): before: snapshot.TestSecureExportSnapshot#testExportFileSystemStateWithSkipTmp Thread=761, OpenFileDescriptor=904, MaxFileDescriptor=60000, SystemLoadAverage=649, ProcessCount=186, AvailableMemoryMB=1009 2023-07-15 03:12:48,442 WARN [Listener at jenkins-hbase4.apache.org/44817] hbase.ResourceChecker(130): Thread=761 is superior to 500 2023-07-15 03:12:48,444 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41669] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemStateWithSkipTmp', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-15 03:12:48,451 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41669] procedure2.ProcedureExecutor(1029): Stored pid=105, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-15 03:12:48,456 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_PRE_OPERATION 2023-07-15 03:12:48,457 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41669] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemStateWithSkipTmp" procId is: 105 2023-07-15 03:12:48,457 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-15 03:12:48,459 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41669] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-07-15 03:12:48,460 DEBUG [HFileArchiver-20] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/8752d3577665c05dc0a1bdd8ba794efa 2023-07-15 03:12:48,460 DEBUG [HFileArchiver-19] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/34763e35142c67bdf675b1ddfdc28fea 2023-07-15 03:12:48,461 DEBUG [HFileArchiver-20] backup.HFileArchiver(153): Directory hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/8752d3577665c05dc0a1bdd8ba794efa empty. 2023-07-15 03:12:48,461 DEBUG [HFileArchiver-19] backup.HFileArchiver(153): Directory hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/34763e35142c67bdf675b1ddfdc28fea empty. 2023-07-15 03:12:48,461 DEBUG [HFileArchiver-20] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/8752d3577665c05dc0a1bdd8ba794efa 2023-07-15 03:12:48,461 DEBUG [HFileArchiver-19] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/34763e35142c67bdf675b1ddfdc28fea 2023-07-15 03:12:48,461 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithSkipTmp regions 2023-07-15 03:12:48,520 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/.tabledesc/.tableinfo.0000000001 2023-07-15 03:12:48,521 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(7675): creating {ENCODED => 8752d3577665c05dc0a1bdd8ba794efa, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,,1689390768444.8752d3577665c05dc0a1bdd8ba794efa.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportFileSystemStateWithSkipTmp', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/.tmp 2023-07-15 03:12:48,524 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(7675): creating {ENCODED => 34763e35142c67bdf675b1ddfdc28fea, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,1,1689390768444.34763e35142c67bdf675b1ddfdc28fea.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemStateWithSkipTmp', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/.tmp 2023-07-15 03:12:48,556 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,,1689390768444.8752d3577665c05dc0a1bdd8ba794efa.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-15 03:12:48,556 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1604): Closing 8752d3577665c05dc0a1bdd8ba794efa, disabling compactions & flushes 2023-07-15 03:12:48,556 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,,1689390768444.8752d3577665c05dc0a1bdd8ba794efa. 2023-07-15 03:12:48,556 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,,1689390768444.8752d3577665c05dc0a1bdd8ba794efa. 2023-07-15 03:12:48,556 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,,1689390768444.8752d3577665c05dc0a1bdd8ba794efa. after waiting 0 ms 2023-07-15 03:12:48,556 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,,1689390768444.8752d3577665c05dc0a1bdd8ba794efa. 2023-07-15 03:12:48,557 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,,1689390768444.8752d3577665c05dc0a1bdd8ba794efa. 2023-07-15 03:12:48,557 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1558): Region close journal for 8752d3577665c05dc0a1bdd8ba794efa: 2023-07-15 03:12:48,562 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41669] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-07-15 03:12:48,584 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,1,1689390768444.34763e35142c67bdf675b1ddfdc28fea.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-15 03:12:48,584 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1604): Closing 34763e35142c67bdf675b1ddfdc28fea, disabling compactions & flushes 2023-07-15 03:12:48,584 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,1,1689390768444.34763e35142c67bdf675b1ddfdc28fea. 2023-07-15 03:12:48,584 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1689390768444.34763e35142c67bdf675b1ddfdc28fea. 2023-07-15 03:12:48,584 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1689390768444.34763e35142c67bdf675b1ddfdc28fea. after waiting 0 ms 2023-07-15 03:12:48,584 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,1,1689390768444.34763e35142c67bdf675b1ddfdc28fea. 2023-07-15 03:12:48,584 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,1,1689390768444.34763e35142c67bdf675b1ddfdc28fea. 2023-07-15 03:12:48,584 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1558): Region close journal for 34763e35142c67bdf675b1ddfdc28fea: 2023-07-15 03:12:48,587 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_ADD_TO_META 2023-07-15 03:12:48,589 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1689390768444.8752d3577665c05dc0a1bdd8ba794efa.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689390768588"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689390768588"}]},"ts":"1689390768588"} 2023-07-15 03:12:48,589 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1689390768444.34763e35142c67bdf675b1ddfdc28fea.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689390768588"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689390768588"}]},"ts":"1689390768588"} 2023-07-15 03:12:48,594 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-15 03:12:48,595 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-15 03:12:48,596 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689390768596"}]},"ts":"1689390768596"} 2023-07-15 03:12:48,597 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=ENABLING in hbase:meta 2023-07-15 03:12:48,601 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-15 03:12:48,603 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-15 03:12:48,603 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-15 03:12:48,603 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-15 03:12:48,603 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-15 03:12:48,603 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=8752d3577665c05dc0a1bdd8ba794efa, ASSIGN}, {pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=34763e35142c67bdf675b1ddfdc28fea, ASSIGN}] 2023-07-15 03:12:48,616 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=34763e35142c67bdf675b1ddfdc28fea, ASSIGN 2023-07-15 03:12:48,616 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=8752d3577665c05dc0a1bdd8ba794efa, ASSIGN 2023-07-15 03:12:48,617 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=34763e35142c67bdf675b1ddfdc28fea, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,39199,1689390651299; forceNewPlan=false, retain=false 2023-07-15 03:12:48,617 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=8752d3577665c05dc0a1bdd8ba794efa, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,38367,1689390651355; forceNewPlan=false, retain=false 2023-07-15 03:12:48,764 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41669] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-07-15 03:12:48,767 INFO [jenkins-hbase4:41669] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-15 03:12:48,771 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=107 updating hbase:meta row=34763e35142c67bdf675b1ddfdc28fea, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,39199,1689390651299 2023-07-15 03:12:48,771 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=106 updating hbase:meta row=8752d3577665c05dc0a1bdd8ba794efa, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,38367,1689390651355 2023-07-15 03:12:48,771 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1689390768444.34763e35142c67bdf675b1ddfdc28fea.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689390768771"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689390768771"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689390768771"}]},"ts":"1689390768771"} 2023-07-15 03:12:48,771 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1689390768444.8752d3577665c05dc0a1bdd8ba794efa.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689390768771"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689390768771"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689390768771"}]},"ts":"1689390768771"} 2023-07-15 03:12:48,773 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=108, ppid=107, state=RUNNABLE; OpenRegionProcedure 34763e35142c67bdf675b1ddfdc28fea, server=jenkins-hbase4.apache.org,39199,1689390651299}] 2023-07-15 03:12:48,774 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=109, ppid=106, state=RUNNABLE; OpenRegionProcedure 8752d3577665c05dc0a1bdd8ba794efa, server=jenkins-hbase4.apache.org,38367,1689390651355}] 2023-07-15 03:12:48,937 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithSkipTmp,,1689390768444.8752d3577665c05dc0a1bdd8ba794efa. 2023-07-15 03:12:48,937 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 8752d3577665c05dc0a1bdd8ba794efa, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,,1689390768444.8752d3577665c05dc0a1bdd8ba794efa.', STARTKEY => '', ENDKEY => '1'} 2023-07-15 03:12:48,937 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithSkipTmp,,1689390768444.8752d3577665c05dc0a1bdd8ba794efa. service=AccessControlService 2023-07-15 03:12:48,938 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-15 03:12:48,938 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithSkipTmp 8752d3577665c05dc0a1bdd8ba794efa 2023-07-15 03:12:48,938 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,,1689390768444.8752d3577665c05dc0a1bdd8ba794efa.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-15 03:12:48,938 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 8752d3577665c05dc0a1bdd8ba794efa 2023-07-15 03:12:48,938 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 8752d3577665c05dc0a1bdd8ba794efa 2023-07-15 03:12:48,938 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithSkipTmp,1,1689390768444.34763e35142c67bdf675b1ddfdc28fea. 2023-07-15 03:12:48,938 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 34763e35142c67bdf675b1ddfdc28fea, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,1,1689390768444.34763e35142c67bdf675b1ddfdc28fea.', STARTKEY => '1', ENDKEY => ''} 2023-07-15 03:12:48,939 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithSkipTmp,1,1689390768444.34763e35142c67bdf675b1ddfdc28fea. service=AccessControlService 2023-07-15 03:12:48,939 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-15 03:12:48,939 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithSkipTmp 34763e35142c67bdf675b1ddfdc28fea 2023-07-15 03:12:48,939 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,1,1689390768444.34763e35142c67bdf675b1ddfdc28fea.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-15 03:12:48,939 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 34763e35142c67bdf675b1ddfdc28fea 2023-07-15 03:12:48,939 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 34763e35142c67bdf675b1ddfdc28fea 2023-07-15 03:12:48,941 INFO [StoreOpener-34763e35142c67bdf675b1ddfdc28fea-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 34763e35142c67bdf675b1ddfdc28fea 2023-07-15 03:12:48,943 INFO [StoreOpener-8752d3577665c05dc0a1bdd8ba794efa-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 8752d3577665c05dc0a1bdd8ba794efa 2023-07-15 03:12:48,944 DEBUG [StoreOpener-34763e35142c67bdf675b1ddfdc28fea-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/data/default/testtb-testExportFileSystemStateWithSkipTmp/34763e35142c67bdf675b1ddfdc28fea/cf 2023-07-15 03:12:48,944 DEBUG [StoreOpener-34763e35142c67bdf675b1ddfdc28fea-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/data/default/testtb-testExportFileSystemStateWithSkipTmp/34763e35142c67bdf675b1ddfdc28fea/cf 2023-07-15 03:12:48,945 INFO [StoreOpener-34763e35142c67bdf675b1ddfdc28fea-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 34763e35142c67bdf675b1ddfdc28fea columnFamilyName cf 2023-07-15 03:12:48,945 INFO [StoreOpener-34763e35142c67bdf675b1ddfdc28fea-1] regionserver.HStore(310): Store=34763e35142c67bdf675b1ddfdc28fea/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-15 03:12:48,947 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/data/default/testtb-testExportFileSystemStateWithSkipTmp/34763e35142c67bdf675b1ddfdc28fea 2023-07-15 03:12:48,948 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/data/default/testtb-testExportFileSystemStateWithSkipTmp/34763e35142c67bdf675b1ddfdc28fea 2023-07-15 03:12:48,951 DEBUG [StoreOpener-8752d3577665c05dc0a1bdd8ba794efa-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/data/default/testtb-testExportFileSystemStateWithSkipTmp/8752d3577665c05dc0a1bdd8ba794efa/cf 2023-07-15 03:12:48,951 DEBUG [StoreOpener-8752d3577665c05dc0a1bdd8ba794efa-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/data/default/testtb-testExportFileSystemStateWithSkipTmp/8752d3577665c05dc0a1bdd8ba794efa/cf 2023-07-15 03:12:48,952 INFO [StoreOpener-8752d3577665c05dc0a1bdd8ba794efa-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 8752d3577665c05dc0a1bdd8ba794efa columnFamilyName cf 2023-07-15 03:12:48,952 INFO [StoreOpener-8752d3577665c05dc0a1bdd8ba794efa-1] regionserver.HStore(310): Store=8752d3577665c05dc0a1bdd8ba794efa/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-15 03:12:48,953 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/data/default/testtb-testExportFileSystemStateWithSkipTmp/8752d3577665c05dc0a1bdd8ba794efa 2023-07-15 03:12:48,959 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 34763e35142c67bdf675b1ddfdc28fea 2023-07-15 03:12:48,959 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/data/default/testtb-testExportFileSystemStateWithSkipTmp/8752d3577665c05dc0a1bdd8ba794efa 2023-07-15 03:12:48,966 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/data/default/testtb-testExportFileSystemStateWithSkipTmp/34763e35142c67bdf675b1ddfdc28fea/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-15 03:12:48,967 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 8752d3577665c05dc0a1bdd8ba794efa 2023-07-15 03:12:48,967 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 34763e35142c67bdf675b1ddfdc28fea; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69168702, jitterRate=0.03069397807121277}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-15 03:12:48,967 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 34763e35142c67bdf675b1ddfdc28fea: 2023-07-15 03:12:48,968 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithSkipTmp,1,1689390768444.34763e35142c67bdf675b1ddfdc28fea., pid=108, masterSystemTime=1689390768925 2023-07-15 03:12:48,970 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithSkipTmp,1,1689390768444.34763e35142c67bdf675b1ddfdc28fea. 2023-07-15 03:12:48,970 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithSkipTmp,1,1689390768444.34763e35142c67bdf675b1ddfdc28fea. 2023-07-15 03:12:48,970 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=107 updating hbase:meta row=34763e35142c67bdf675b1ddfdc28fea, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,39199,1689390651299 2023-07-15 03:12:48,971 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1689390768444.34763e35142c67bdf675b1ddfdc28fea.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689390768970"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689390768970"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689390768970"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689390768970"}]},"ts":"1689390768970"} 2023-07-15 03:12:48,972 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/data/default/testtb-testExportFileSystemStateWithSkipTmp/8752d3577665c05dc0a1bdd8ba794efa/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-15 03:12:48,973 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 8752d3577665c05dc0a1bdd8ba794efa; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68402864, jitterRate=0.019282102584838867}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-15 03:12:48,973 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 8752d3577665c05dc0a1bdd8ba794efa: 2023-07-15 03:12:48,974 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithSkipTmp,,1689390768444.8752d3577665c05dc0a1bdd8ba794efa., pid=109, masterSystemTime=1689390768926 2023-07-15 03:12:48,975 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=108, resume processing ppid=107 2023-07-15 03:12:48,975 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=108, ppid=107, state=SUCCESS; OpenRegionProcedure 34763e35142c67bdf675b1ddfdc28fea, server=jenkins-hbase4.apache.org,39199,1689390651299 in 200 msec 2023-07-15 03:12:48,976 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithSkipTmp,,1689390768444.8752d3577665c05dc0a1bdd8ba794efa. 2023-07-15 03:12:48,976 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithSkipTmp,,1689390768444.8752d3577665c05dc0a1bdd8ba794efa. 2023-07-15 03:12:48,977 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=107, ppid=105, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=34763e35142c67bdf675b1ddfdc28fea, ASSIGN in 372 msec 2023-07-15 03:12:48,977 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=106 updating hbase:meta row=8752d3577665c05dc0a1bdd8ba794efa, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,38367,1689390651355 2023-07-15 03:12:48,977 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1689390768444.8752d3577665c05dc0a1bdd8ba794efa.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689390768977"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689390768977"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689390768977"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689390768977"}]},"ts":"1689390768977"} 2023-07-15 03:12:48,981 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=109, resume processing ppid=106 2023-07-15 03:12:48,981 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=109, ppid=106, state=SUCCESS; OpenRegionProcedure 8752d3577665c05dc0a1bdd8ba794efa, server=jenkins-hbase4.apache.org,38367,1689390651355 in 205 msec 2023-07-15 03:12:48,982 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=106, resume processing ppid=105 2023-07-15 03:12:48,983 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=106, ppid=105, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=8752d3577665c05dc0a1bdd8ba794efa, ASSIGN in 378 msec 2023-07-15 03:12:48,983 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-15 03:12:48,983 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689390768983"}]},"ts":"1689390768983"} 2023-07-15 03:12:48,991 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=ENABLED in hbase:meta 2023-07-15 03:12:48,994 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_POST_OPERATION 2023-07-15 03:12:48,994 DEBUG [PEWorker-1] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemStateWithSkipTmp jenkins: RWXCA 2023-07-15 03:12:48,996 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=39199] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithSkipTmp], kv [jenkins: RWXCA] 2023-07-15 03:12:48,998 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): regionserver:43199-0x10166f610e80001, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-15 03:12:48,998 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): regionserver:38367-0x10166f610e80003, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-15 03:12:48,998 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): master:41669-0x10166f610e80000, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-15 03:12:48,998 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): regionserver:39199-0x10166f610e80002, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-15 03:12:49,000 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): regionserver:38367-0x10166f610e80003, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-15 03:12:49,001 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): master:41669-0x10166f610e80000, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-15 03:12:49,000 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): regionserver:43199-0x10166f610e80001, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-15 03:12:49,001 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-07-15 03:12:49,001 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-07-15 03:12:49,001 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-07-15 03:12:49,001 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-07-15 03:12:49,005 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=105, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp in 559 msec 2023-07-15 03:12:49,066 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41669] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-07-15 03:12:49,066 INFO [Listener at jenkins-hbase4.apache.org/44817] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemStateWithSkipTmp, procId: 105 completed 2023-07-15 03:12:49,066 DEBUG [Listener at jenkins-hbase4.apache.org/44817] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testtb-testExportFileSystemStateWithSkipTmp get assigned. Timeout = 60000ms 2023-07-15 03:12:49,067 INFO [Listener at jenkins-hbase4.apache.org/44817] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-15 03:12:49,086 INFO [Listener at jenkins-hbase4.apache.org/44817] hbase.HBaseTestingUtility(3484): All regions for table testtb-testExportFileSystemStateWithSkipTmp assigned to meta. Checking AM states. 2023-07-15 03:12:49,087 INFO [Listener at jenkins-hbase4.apache.org/44817] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-15 03:12:49,087 INFO [Listener at jenkins-hbase4.apache.org/44817] hbase.HBaseTestingUtility(3504): All regions for table testtb-testExportFileSystemStateWithSkipTmp assigned. 2023-07-15 03:12:49,093 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41669] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-15 03:12:49,094 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41669] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689390769094 (current time:1689390769094). 2023-07-15 03:12:49,094 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41669] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-15 03:12:49,094 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41669] zookeeper.ReadOnlyZKClient(139): Connect 0x069a5212 to 127.0.0.1:62663 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-15 03:12:49,118 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41669] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@61698553, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-15 03:12:49,119 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41669] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-15 03:12:49,123 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:49644, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-15 03:12:49,124 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41669] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x069a5212 to 127.0.0.1:62663 2023-07-15 03:12:49,124 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41669] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-15 03:12:49,125 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41669] zookeeper.ReadOnlyZKClient(139): Connect 0x30dc2e35 to 127.0.0.1:62663 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-15 03:12:49,156 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41669] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6482e0fe, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-15 03:12:49,178 DEBUG [hconnection-0x49ecb220-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-15 03:12:49,184 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:49650, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-15 03:12:49,189 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41669] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-15 03:12:49,194 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:47118, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-15 03:12:49,196 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41669] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x30dc2e35 to 127.0.0.1:62663 2023-07-15 03:12:49,196 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41669] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-15 03:12:49,196 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41669] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithSkipTmp], kv [jenkins: RWXCA] 2023-07-15 03:12:49,198 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41669] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-15 03:12:49,198 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41669] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-15 03:12:49,201 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41669] procedure2.ProcedureExecutor(1029): Stored pid=110, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-15 03:12:49,203 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=110, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-15 03:12:49,204 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=110, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE; timeout=600000, timestamp=1689391369204 2023-07-15 03:12:49,204 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41669] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-15 03:12:49,204 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp 2023-07-15 03:12:49,207 DEBUG [Listener at jenkins-hbase4.apache.org/44817] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-15 03:12:49,207 DEBUG [Listener at jenkins-hbase4.apache.org/44817] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-15 03:12:49,209 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=110, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-15 03:12:49,210 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=111, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-15 03:12:49,211 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=110, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE in 9 msec 2023-07-15 03:12:49,213 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=111, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-15 03:12:49,214 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=111, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED; timeout=600000, timestamp=1689391369214 2023-07-15 03:12:49,282 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 03:12:49,282 INFO [(jenkins-hbase4.apache.org,41669,1689390649760)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' 2023-07-15 03:12:49,282 DEBUG [(jenkins-hbase4.apache.org,41669,1689390649760)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-15 03:12:49,284 DEBUG [(jenkins-hbase4.apache.org,41669,1689390649760)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' 2023-07-15 03:12:49,284 DEBUG [(jenkins-hbase4.apache.org,41669,1689390649760)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp', kicking off acquire phase on members. 2023-07-15 03:12:49,285 DEBUG [(jenkins-hbase4.apache.org,41669,1689390649760)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41669-0x10166f610e80000, quorum=127.0.0.1:62663, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 03:12:49,285 DEBUG [(jenkins-hbase4.apache.org,41669,1689390649760)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 03:12:49,286 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): regionserver:38367-0x10166f610e80003, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 03:12:49,286 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): regionserver:43199-0x10166f610e80001, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 03:12:49,286 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 03:12:49,286 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 03:12:49,287 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 03:12:49,287 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 03:12:49,287 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): regionserver:39199-0x10166f610e80002, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 03:12:49,287 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 03:12:49,287 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 03:12:49,287 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 03:12:49,287 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 03:12:49,287 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38367-0x10166f610e80003, quorum=127.0.0.1:62663, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 03:12:49,287 DEBUG [(jenkins-hbase4.apache.org,41669,1689390649760)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,38367,1689390651355 2023-07-15 03:12:49,287 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 03:12:49,288 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43199-0x10166f610e80001, quorum=127.0.0.1:62663, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 03:12:49,289 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 207 2023-07-15 03:12:49,290 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 03:12:49,290 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-15 03:12:49,290 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 207 2023-07-15 03:12:49,291 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 03:12:49,291 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-15 03:12:49,291 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39199-0x10166f610e80002, quorum=127.0.0.1:62663, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 03:12:49,291 DEBUG [(jenkins-hbase4.apache.org,41669,1689390649760)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41669-0x10166f610e80000, quorum=127.0.0.1:62663, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,38367,1689390651355 2023-07-15 03:12:49,291 DEBUG [(jenkins-hbase4.apache.org,41669,1689390649760)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39199,1689390651299 2023-07-15 03:12:49,292 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 207 2023-07-15 03:12:49,292 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 03:12:49,292 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-15 03:12:49,292 DEBUG [(jenkins-hbase4.apache.org,41669,1689390649760)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41669-0x10166f610e80000, quorum=127.0.0.1:62663, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39199,1689390651299 2023-07-15 03:12:49,292 DEBUG [(jenkins-hbase4.apache.org,41669,1689390649760)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-15 03:12:49,294 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 03:12:49,294 DEBUG [member: 'jenkins-hbase4.apache.org,38367,1689390651355' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-15 03:12:49,294 DEBUG [member: 'jenkins-hbase4.apache.org,38367,1689390651355' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-15 03:12:49,294 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 03:12:49,295 DEBUG [member: 'jenkins-hbase4.apache.org,39199,1689390651299' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-15 03:12:49,295 DEBUG [member: 'jenkins-hbase4.apache.org,39199,1689390651299' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-15 03:12:49,295 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 03:12:49,297 DEBUG [member: 'jenkins-hbase4.apache.org,39199,1689390651299' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-15 03:12:49,297 DEBUG [member: 'jenkins-hbase4.apache.org,39199,1689390651299' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-15 03:12:49,297 DEBUG [member: 'jenkins-hbase4.apache.org,39199,1689390651299' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39199,1689390651299' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-15 03:12:49,297 DEBUG [member: 'jenkins-hbase4.apache.org,38367,1689390651355' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-15 03:12:49,297 DEBUG [member: 'jenkins-hbase4.apache.org,38367,1689390651355' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-15 03:12:49,297 DEBUG [member: 'jenkins-hbase4.apache.org,43199,1689390651225' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-15 03:12:49,297 DEBUG [member: 'jenkins-hbase4.apache.org,43199,1689390651225' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-15 03:12:49,297 DEBUG [member: 'jenkins-hbase4.apache.org,38367,1689390651355' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38367,1689390651355' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-15 03:12:49,299 DEBUG [member: 'jenkins-hbase4.apache.org,43199,1689390651225' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-15 03:12:49,299 DEBUG [member: 'jenkins-hbase4.apache.org,43199,1689390651225' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-15 03:12:49,299 DEBUG [member: 'jenkins-hbase4.apache.org,43199,1689390651225' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43199,1689390651225' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-15 03:12:49,307 DEBUG [member: 'jenkins-hbase4.apache.org,39199,1689390651299' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 03:12:49,307 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): master:41669-0x10166f610e80000, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39199,1689390651299 2023-07-15 03:12:49,307 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39199,1689390651299 2023-07-15 03:12:49,307 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 03:12:49,307 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 03:12:49,307 DEBUG [Listener at jenkins-hbase4.apache.org/44817] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-15 03:12:49,308 DEBUG [member: 'jenkins-hbase4.apache.org,43199,1689390651225' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 03:12:49,308 DEBUG [member: 'jenkins-hbase4.apache.org,39199,1689390651299' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39199-0x10166f610e80002, quorum=127.0.0.1:62663, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 03:12:49,308 DEBUG [member: 'jenkins-hbase4.apache.org,39199,1689390651299' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-15 03:12:49,308 DEBUG [member: 'jenkins-hbase4.apache.org,38367,1689390651355' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 03:12:49,308 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 03:12:49,308 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): master:41669-0x10166f610e80000, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,38367,1689390651355 2023-07-15 03:12:49,308 DEBUG [member: 'jenkins-hbase4.apache.org,43199,1689390651225' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43199-0x10166f610e80001, quorum=127.0.0.1:62663, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 03:12:49,308 DEBUG [member: 'jenkins-hbase4.apache.org,43199,1689390651225' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-15 03:12:49,309 DEBUG [member: 'jenkins-hbase4.apache.org,38367,1689390651355' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38367-0x10166f610e80003, quorum=127.0.0.1:62663, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 03:12:49,309 DEBUG [member: 'jenkins-hbase4.apache.org,38367,1689390651355' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-15 03:12:49,309 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41669] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-15 03:12:49,309 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 03:12:49,309 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41669] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-07-15 03:12:49,310 DEBUG [Listener at jenkins-hbase4.apache.org/44817] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-15 03:12:49,310 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 03:12:49,310 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43199,1689390651225 2023-07-15 03:12:49,311 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39199,1689390651299 2023-07-15 03:12:49,311 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38367,1689390651355 2023-07-15 03:12:49,312 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 03:12:49,312 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39199,1689390651299' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-07-15 03:12:49,312 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6de0c3ea[Count = 1] remaining members to acquire global barrier 2023-07-15 03:12:49,312 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,38367,1689390651355 2023-07-15 03:12:49,312 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 03:12:49,312 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 03:12:49,313 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 03:12:49,313 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 03:12:49,314 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 03:12:49,314 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43199,1689390651225 2023-07-15 03:12:49,316 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39199,1689390651299 2023-07-15 03:12:49,316 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38367,1689390651355 2023-07-15 03:12:49,318 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 03:12:49,318 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,38367,1689390651355' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-07-15 03:12:49,318 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6de0c3ea[Count = 0] remaining members to acquire global barrier 2023-07-15 03:12:49,318 DEBUG [(jenkins-hbase4.apache.org,41669,1689390649760)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'in-barrier' execution. 2023-07-15 03:12:49,318 DEBUG [(jenkins-hbase4.apache.org,41669,1689390649760)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 03:12:49,320 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): regionserver:38367-0x10166f610e80003, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 03:12:49,320 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 03:12:49,320 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 03:12:49,320 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): regionserver:43199-0x10166f610e80001, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 03:12:49,320 DEBUG [member: 'jenkins-hbase4.apache.org,38367,1689390651355' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-15 03:12:49,320 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 03:12:49,320 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 03:12:49,320 DEBUG [member: 'jenkins-hbase4.apache.org,43199,1689390651225' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-15 03:12:49,320 DEBUG [member: 'jenkins-hbase4.apache.org,43199,1689390651225' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-15 03:12:49,320 DEBUG [member: 'jenkins-hbase4.apache.org,43199,1689390651225' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,43199,1689390651225' in zk 2023-07-15 03:12:49,320 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): regionserver:39199-0x10166f610e80002, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 03:12:49,320 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 03:12:49,320 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 03:12:49,321 DEBUG [member: 'jenkins-hbase4.apache.org,39199,1689390651299' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-15 03:12:49,321 DEBUG [(jenkins-hbase4.apache.org,41669,1689390649760)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41669-0x10166f610e80000, quorum=127.0.0.1:62663, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39199,1689390651299 2023-07-15 03:12:49,322 DEBUG [member: 'jenkins-hbase4.apache.org,38367,1689390651355' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-15 03:12:49,322 DEBUG [member: 'jenkins-hbase4.apache.org,38367,1689390651355' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-15 03:12:49,322 DEBUG [rs(jenkins-hbase4.apache.org,38367,1689390651355)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1689390768444.8752d3577665c05dc0a1bdd8ba794efa. 2023-07-15 03:12:49,322 DEBUG [rs(jenkins-hbase4.apache.org,38367,1689390651355)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1689390768444.8752d3577665c05dc0a1bdd8ba794efa. started... 2023-07-15 03:12:49,322 DEBUG [member: 'jenkins-hbase4.apache.org,43199,1689390651225' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-15 03:12:49,322 DEBUG [member: 'jenkins-hbase4.apache.org,43199,1689390651225' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-15 03:12:49,322 DEBUG [member: 'jenkins-hbase4.apache.org,43199,1689390651225' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-15 03:12:49,322 DEBUG [(jenkins-hbase4.apache.org,41669,1689390649760)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41669-0x10166f610e80000, quorum=127.0.0.1:62663, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,38367,1689390651355 2023-07-15 03:12:49,322 DEBUG [(jenkins-hbase4.apache.org,41669,1689390649760)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-15 03:12:49,330 DEBUG [member: 'jenkins-hbase4.apache.org,39199,1689390651299' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-15 03:12:49,330 DEBUG [member: 'jenkins-hbase4.apache.org,39199,1689390651299' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-15 03:12:49,333 DEBUG [rs(jenkins-hbase4.apache.org,38367,1689390651355)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 8752d3577665c05dc0a1bdd8ba794efa: 2023-07-15 03:12:49,333 DEBUG [rs(jenkins-hbase4.apache.org,38367,1689390651355)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,,1689390768444.8752d3577665c05dc0a1bdd8ba794efa.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 03:12:49,333 DEBUG [rs(jenkins-hbase4.apache.org,38367,1689390651355)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-15 03:12:49,333 DEBUG [rs(jenkins-hbase4.apache.org,38367,1689390651355)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-15 03:12:49,334 DEBUG [rs(jenkins-hbase4.apache.org,39199,1689390651299)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1689390768444.34763e35142c67bdf675b1ddfdc28fea. 2023-07-15 03:12:49,334 DEBUG [rs(jenkins-hbase4.apache.org,39199,1689390651299)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1689390768444.34763e35142c67bdf675b1ddfdc28fea. started... 2023-07-15 03:12:49,336 DEBUG [rs(jenkins-hbase4.apache.org,39199,1689390651299)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 34763e35142c67bdf675b1ddfdc28fea: 2023-07-15 03:12:49,336 DEBUG [rs(jenkins-hbase4.apache.org,39199,1689390651299)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,1,1689390768444.34763e35142c67bdf675b1ddfdc28fea.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 03:12:49,336 DEBUG [rs(jenkins-hbase4.apache.org,39199,1689390651299)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-15 03:12:49,336 DEBUG [rs(jenkins-hbase4.apache.org,39199,1689390651299)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-15 03:12:49,467 DEBUG [rs(jenkins-hbase4.apache.org,39199,1689390651299)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1689390768444.34763e35142c67bdf675b1ddfdc28fea. completed. 2023-07-15 03:12:49,467 DEBUG [rs(jenkins-hbase4.apache.org,39199,1689390651299)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1689390768444.34763e35142c67bdf675b1ddfdc28fea. 2023-07-15 03:12:49,467 DEBUG [member: 'jenkins-hbase4.apache.org,39199,1689390651299' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-15 03:12:49,467 DEBUG [member: 'jenkins-hbase4.apache.org,39199,1689390651299' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-15 03:12:49,467 DEBUG [member: 'jenkins-hbase4.apache.org,39199,1689390651299' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,39199,1689390651299 2023-07-15 03:12:49,483 DEBUG [member: 'jenkins-hbase4.apache.org,39199,1689390651299' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-15 03:12:49,483 DEBUG [member: 'jenkins-hbase4.apache.org,39199,1689390651299' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,39199,1689390651299' in zk 2023-07-15 03:12:49,485 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): master:41669-0x10166f610e80000, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39199,1689390651299 2023-07-15 03:12:49,486 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39199,1689390651299 2023-07-15 03:12:49,486 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 03:12:49,486 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 03:12:49,486 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 03:12:49,487 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 03:12:49,487 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 03:12:49,489 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43199,1689390651225 2023-07-15 03:12:49,490 DEBUG [member: 'jenkins-hbase4.apache.org,39199,1689390651299' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-15 03:12:49,490 DEBUG [member: 'jenkins-hbase4.apache.org,39199,1689390651299' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-15 03:12:49,490 DEBUG [member: 'jenkins-hbase4.apache.org,39199,1689390651299' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-15 03:12:49,494 DEBUG [rs(jenkins-hbase4.apache.org,38367,1689390651355)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1689390768444.8752d3577665c05dc0a1bdd8ba794efa. completed. 2023-07-15 03:12:49,494 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39199,1689390651299 2023-07-15 03:12:49,494 DEBUG [rs(jenkins-hbase4.apache.org,38367,1689390651355)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1689390768444.8752d3577665c05dc0a1bdd8ba794efa. 2023-07-15 03:12:49,494 DEBUG [member: 'jenkins-hbase4.apache.org,38367,1689390651355' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-15 03:12:49,494 DEBUG [member: 'jenkins-hbase4.apache.org,38367,1689390651355' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-15 03:12:49,494 DEBUG [member: 'jenkins-hbase4.apache.org,38367,1689390651355' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,38367,1689390651355 2023-07-15 03:12:49,494 DEBUG [member: 'jenkins-hbase4.apache.org,38367,1689390651355' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-15 03:12:49,494 DEBUG [member: 'jenkins-hbase4.apache.org,38367,1689390651355' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,38367,1689390651355' in zk 2023-07-15 03:12:49,497 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): master:41669-0x10166f610e80000, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,38367,1689390651355 2023-07-15 03:12:49,497 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38367,1689390651355 2023-07-15 03:12:49,497 DEBUG [member: 'jenkins-hbase4.apache.org,38367,1689390651355' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-15 03:12:49,497 DEBUG [member: 'jenkins-hbase4.apache.org,38367,1689390651355' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-15 03:12:49,497 DEBUG [member: 'jenkins-hbase4.apache.org,38367,1689390651355' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-15 03:12:49,499 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 03:12:49,505 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 03:12:49,506 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43199,1689390651225 2023-07-15 03:12:49,506 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39199,1689390651299 2023-07-15 03:12:49,506 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38367,1689390651355 2023-07-15 03:12:49,507 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,39199,1689390651299': 2023-07-15 03:12:49,507 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39199,1689390651299' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 1 more 2023-07-15 03:12:49,508 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,38367,1689390651355 2023-07-15 03:12:49,508 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 03:12:49,508 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 03:12:49,508 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 03:12:49,508 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 03:12:49,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 03:12:49,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43199,1689390651225 2023-07-15 03:12:49,510 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39199,1689390651299 2023-07-15 03:12:49,510 DEBUG [Listener at jenkins-hbase4.apache.org/44817] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-15 03:12:49,510 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38367,1689390651355 2023-07-15 03:12:49,511 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 03:12:49,511 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41669] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-15 03:12:49,511 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41669] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-07-15 03:12:49,511 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 03:12:49,511 DEBUG [Listener at jenkins-hbase4.apache.org/44817] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-15 03:12:49,512 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43199,1689390651225 2023-07-15 03:12:49,512 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39199,1689390651299 2023-07-15 03:12:49,514 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38367,1689390651355 2023-07-15 03:12:49,516 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,38367,1689390651355': 2023-07-15 03:12:49,516 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,38367,1689390651355' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 0 more 2023-07-15 03:12:49,516 INFO [(jenkins-hbase4.apache.org,41669,1689390649760)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' execution completed 2023-07-15 03:12:49,516 DEBUG [(jenkins-hbase4.apache.org,41669,1689390649760)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-15 03:12:49,516 DEBUG [(jenkins-hbase4.apache.org,41669,1689390649760)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-15 03:12:49,516 DEBUG [(jenkins-hbase4.apache.org,41669,1689390649760)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 03:12:49,516 INFO [(jenkins-hbase4.apache.org,41669,1689390649760)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportFileSystemStateWithSkipTmpincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-15 03:12:49,520 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): regionserver:43199-0x10166f610e80001, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 03:12:49,520 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): regionserver:43199-0x10166f610e80001, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 03:12:49,520 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 03:12:49,520 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 03:12:49,520 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): regionserver:38367-0x10166f610e80003, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 03:12:49,520 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): regionserver:38367-0x10166f610e80003, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 03:12:49,520 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 03:12:49,520 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): regionserver:39199-0x10166f610e80002, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 03:12:49,520 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 03:12:49,520 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 03:12:49,520 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 03:12:49,520 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): regionserver:39199-0x10166f610e80002, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 03:12:49,520 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 03:12:49,520 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 03:12:49,520 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 03:12:49,521 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 03:12:49,521 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 03:12:49,521 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 03:12:49,521 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 03:12:49,521 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 03:12:49,521 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 03:12:49,525 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): master:41669-0x10166f610e80000, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 03:12:49,525 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 03:12:49,525 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 03:12:49,525 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 03:12:49,526 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 03:12:49,526 DEBUG [(jenkins-hbase4.apache.org,41669,1689390649760)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41669-0x10166f610e80000, quorum=127.0.0.1:62663, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43199,1689390651225 2023-07-15 03:12:49,526 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 03:12:49,526 DEBUG [(jenkins-hbase4.apache.org,41669,1689390649760)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41669-0x10166f610e80000, quorum=127.0.0.1:62663, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39199,1689390651299 2023-07-15 03:12:49,527 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 03:12:49,527 DEBUG [(jenkins-hbase4.apache.org,41669,1689390649760)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41669-0x10166f610e80000, quorum=127.0.0.1:62663, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,38367,1689390651355 2023-07-15 03:12:49,527 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 03:12:49,528 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43199,1689390651225 2023-07-15 03:12:49,528 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39199,1689390651299 2023-07-15 03:12:49,529 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38367,1689390651355 2023-07-15 03:12:49,529 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 03:12:49,529 DEBUG [(jenkins-hbase4.apache.org,41669,1689390649760)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41669-0x10166f610e80000, quorum=127.0.0.1:62663, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43199,1689390651225 2023-07-15 03:12:49,530 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 03:12:49,530 DEBUG [(jenkins-hbase4.apache.org,41669,1689390649760)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41669-0x10166f610e80000, quorum=127.0.0.1:62663, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39199,1689390651299 2023-07-15 03:12:49,530 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43199,1689390651225 2023-07-15 03:12:49,530 DEBUG [(jenkins-hbase4.apache.org,41669,1689390649760)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41669-0x10166f610e80000, quorum=127.0.0.1:62663, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,38367,1689390651355 2023-07-15 03:12:49,531 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39199,1689390651299 2023-07-15 03:12:49,531 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38367,1689390651355 2023-07-15 03:12:49,534 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): regionserver:43199-0x10166f610e80001, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 03:12:49,534 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): master:41669-0x10166f610e80000, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,38367,1689390651355 2023-07-15 03:12:49,534 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 03:12:49,534 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 03:12:49,534 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): regionserver:38367-0x10166f610e80003, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 03:12:49,535 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): regionserver:38367-0x10166f610e80003, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 03:12:49,535 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 03:12:49,535 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 03:12:49,535 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): regionserver:43199-0x10166f610e80001, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 03:12:49,534 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): master:41669-0x10166f610e80000, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 03:12:49,535 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 03:12:49,535 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 03:12:49,535 DEBUG [(jenkins-hbase4.apache.org,41669,1689390649760)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-15 03:12:49,534 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): regionserver:39199-0x10166f610e80002, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 03:12:49,537 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): regionserver:39199-0x10166f610e80002, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 03:12:49,535 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 03:12:49,535 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 03:12:49,535 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): master:41669-0x10166f610e80000, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39199,1689390651299 2023-07-15 03:12:49,537 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): master:41669-0x10166f610e80000, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43199,1689390651225 2023-07-15 03:12:49,537 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): master:41669-0x10166f610e80000, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 03:12:49,537 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): master:41669-0x10166f610e80000, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,38367,1689390651355 2023-07-15 03:12:49,537 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): master:41669-0x10166f610e80000, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 03:12:49,537 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): master:41669-0x10166f610e80000, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39199,1689390651299 2023-07-15 03:12:49,537 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): master:41669-0x10166f610e80000, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43199,1689390651225 2023-07-15 03:12:49,537 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): master:41669-0x10166f610e80000, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 03:12:49,537 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): master:41669-0x10166f610e80000, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 03:12:49,537 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 03:12:49,537 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 03:12:49,537 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 03:12:49,538 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 03:12:49,538 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 03:12:49,538 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 03:12:49,538 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 03:12:49,627 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp to hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/.hbase-snapshot/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 03:12:49,712 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed 2023-07-15 03:12:49,712 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 03:12:49,717 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 03:12:49,717 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp at 1689390769204Consolidate snapshot: emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1689390769535 (+331 ms)Loading Region manifests for emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1689390769537 (+2 ms)Writing data manifest for emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1689390769563 (+26 ms)Verifying snapshot: emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1689390769615 (+52 ms)Snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed at 1689390769712 (+97 ms) 2023-07-15 03:12:49,721 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=111, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-15 03:12:49,723 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=111, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED in 514 msec 2023-07-15 03:12:49,812 DEBUG [Listener at jenkins-hbase4.apache.org/44817] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-15 03:12:49,813 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41669] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-15 03:12:49,813 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41669] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-15 03:12:49,830 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38367] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithSkipTmp,,1689390768444.8752d3577665c05dc0a1bdd8ba794efa. with WAL disabled. Data may be lost in the event of a crash. 2023-07-15 03:12:49,831 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39199] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithSkipTmp,1,1689390768444.34763e35142c67bdf675b1ddfdc28fea. with WAL disabled. Data may be lost in the event of a crash. 2023-07-15 03:12:49,835 DEBUG [Listener at jenkins-hbase4.apache.org/44817] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithSkipTmp 2023-07-15 03:12:49,835 DEBUG [Listener at jenkins-hbase4.apache.org/44817] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithSkipTmp,,1689390768444.8752d3577665c05dc0a1bdd8ba794efa. 2023-07-15 03:12:49,835 INFO [Listener at jenkins-hbase4.apache.org/44817] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-15 03:12:49,846 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41669] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-15 03:12:49,846 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41669] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689390769846 (current time:1689390769846). 2023-07-15 03:12:49,846 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41669] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-15 03:12:49,846 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41669] zookeeper.ReadOnlyZKClient(139): Connect 0x4764f13c to 127.0.0.1:62663 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-15 03:12:49,874 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41669] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6b352642, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-15 03:12:49,875 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41669] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-15 03:12:49,879 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:49662, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-15 03:12:49,880 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41669] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4764f13c to 127.0.0.1:62663 2023-07-15 03:12:49,880 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41669] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-15 03:12:49,880 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41669] zookeeper.ReadOnlyZKClient(139): Connect 0x5b4137f1 to 127.0.0.1:62663 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-15 03:12:49,909 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41669] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3b4cd0b4, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-15 03:12:49,916 DEBUG [hconnection-0x7909e6a9-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-15 03:12:49,917 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:49668, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-15 03:12:49,933 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41669] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-15 03:12:49,936 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:47126, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-15 03:12:49,937 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41669] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x5b4137f1 to 127.0.0.1:62663 2023-07-15 03:12:49,937 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41669] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-15 03:12:49,937 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41669] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithSkipTmp], kv [jenkins: RWXCA] 2023-07-15 03:12:49,938 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41669] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-15 03:12:49,938 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41669] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-15 03:12:49,940 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41669] procedure2.ProcedureExecutor(1029): Stored pid=112, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-15 03:12:49,941 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=112, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-15 03:12:49,943 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=112, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE; timeout=600000, timestamp=1689391369943 2023-07-15 03:12:49,943 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp 2023-07-15 03:12:49,943 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41669] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-15 03:12:49,944 DEBUG [Listener at jenkins-hbase4.apache.org/44817] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-15 03:12:49,944 DEBUG [Listener at jenkins-hbase4.apache.org/44817] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-15 03:12:49,945 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=112, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-15 03:12:49,946 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=113, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-15 03:12:49,947 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=112, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE in 6 msec 2023-07-15 03:12:49,948 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=113, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-15 03:12:49,948 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=113, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED; timeout=600000, timestamp=1689391369948 2023-07-15 03:12:49,990 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 03:12:49,992 INFO [(jenkins-hbase4.apache.org,41669,1689390649760)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' 2023-07-15 03:12:49,992 DEBUG [(jenkins-hbase4.apache.org,41669,1689390649760)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-15 03:12:49,993 DEBUG [(jenkins-hbase4.apache.org,41669,1689390649760)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' 2023-07-15 03:12:49,993 DEBUG [(jenkins-hbase4.apache.org,41669,1689390649760)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemStateWithSkipTmp', kicking off acquire phase on members. 2023-07-15 03:12:49,994 DEBUG [(jenkins-hbase4.apache.org,41669,1689390649760)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41669-0x10166f610e80000, quorum=127.0.0.1:62663, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 03:12:49,994 DEBUG [(jenkins-hbase4.apache.org,41669,1689390649760)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 03:12:49,995 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): regionserver:38367-0x10166f610e80003, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 03:12:49,995 DEBUG [(jenkins-hbase4.apache.org,41669,1689390649760)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,38367,1689390651355 2023-07-15 03:12:49,995 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): regionserver:43199-0x10166f610e80001, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 03:12:49,995 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 03:12:49,995 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 03:12:49,995 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 03:12:49,995 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): regionserver:39199-0x10166f610e80002, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 03:12:49,995 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 03:12:49,996 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 03:12:49,996 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 03:12:49,996 DEBUG [(jenkins-hbase4.apache.org,41669,1689390649760)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41669-0x10166f610e80000, quorum=127.0.0.1:62663, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,38367,1689390651355 2023-07-15 03:12:49,996 DEBUG [(jenkins-hbase4.apache.org,41669,1689390649760)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39199,1689390651299 2023-07-15 03:12:49,996 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 03:12:49,996 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 03:12:49,996 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 03:12:49,996 DEBUG [(jenkins-hbase4.apache.org,41669,1689390649760)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41669-0x10166f610e80000, quorum=127.0.0.1:62663, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39199,1689390651299 2023-07-15 03:12:49,996 DEBUG [(jenkins-hbase4.apache.org,41669,1689390649760)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-15 03:12:49,996 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43199-0x10166f610e80001, quorum=127.0.0.1:62663, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 03:12:49,996 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39199-0x10166f610e80002, quorum=127.0.0.1:62663, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 03:12:49,997 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38367-0x10166f610e80003, quorum=127.0.0.1:62663, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 03:12:49,997 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 202 2023-07-15 03:12:49,997 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 03:12:49,997 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 202 2023-07-15 03:12:49,997 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 03:12:49,997 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-15 03:12:49,997 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-15 03:12:49,997 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 202 2023-07-15 03:12:49,997 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 03:12:49,997 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-15 03:12:50,001 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 03:12:50,002 DEBUG [member: 'jenkins-hbase4.apache.org,39199,1689390651299' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-15 03:12:50,002 DEBUG [member: 'jenkins-hbase4.apache.org,39199,1689390651299' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-15 03:12:50,002 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 03:12:50,002 DEBUG [member: 'jenkins-hbase4.apache.org,38367,1689390651355' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-15 03:12:50,002 DEBUG [member: 'jenkins-hbase4.apache.org,38367,1689390651355' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-15 03:12:50,006 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 03:12:50,006 DEBUG [member: 'jenkins-hbase4.apache.org,38367,1689390651355' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-15 03:12:50,006 DEBUG [member: 'jenkins-hbase4.apache.org,43199,1689390651225' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-15 03:12:50,006 DEBUG [member: 'jenkins-hbase4.apache.org,43199,1689390651225' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-15 03:12:50,006 DEBUG [member: 'jenkins-hbase4.apache.org,38367,1689390651355' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-15 03:12:50,007 DEBUG [member: 'jenkins-hbase4.apache.org,38367,1689390651355' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38367,1689390651355' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-15 03:12:50,006 DEBUG [member: 'jenkins-hbase4.apache.org,39199,1689390651299' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-15 03:12:50,007 DEBUG [member: 'jenkins-hbase4.apache.org,39199,1689390651299' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-15 03:12:50,007 DEBUG [member: 'jenkins-hbase4.apache.org,43199,1689390651225' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-15 03:12:50,008 DEBUG [member: 'jenkins-hbase4.apache.org,43199,1689390651225' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-15 03:12:50,008 DEBUG [member: 'jenkins-hbase4.apache.org,43199,1689390651225' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43199,1689390651225' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-15 03:12:50,007 DEBUG [member: 'jenkins-hbase4.apache.org,39199,1689390651299' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39199,1689390651299' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-15 03:12:50,010 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): master:41669-0x10166f610e80000, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,38367,1689390651355 2023-07-15 03:12:50,010 DEBUG [member: 'jenkins-hbase4.apache.org,38367,1689390651355' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 03:12:50,010 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,38367,1689390651355 2023-07-15 03:12:50,010 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 03:12:50,010 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 03:12:50,010 DEBUG [member: 'jenkins-hbase4.apache.org,43199,1689390651225' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 03:12:50,010 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): master:41669-0x10166f610e80000, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39199,1689390651299 2023-07-15 03:12:50,010 DEBUG [member: 'jenkins-hbase4.apache.org,39199,1689390651299' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 03:12:50,010 DEBUG [member: 'jenkins-hbase4.apache.org,38367,1689390651355' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38367-0x10166f610e80003, quorum=127.0.0.1:62663, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 03:12:50,010 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 03:12:50,010 DEBUG [member: 'jenkins-hbase4.apache.org,38367,1689390651355' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-15 03:12:50,011 DEBUG [member: 'jenkins-hbase4.apache.org,43199,1689390651225' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43199-0x10166f610e80001, quorum=127.0.0.1:62663, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 03:12:50,011 DEBUG [member: 'jenkins-hbase4.apache.org,39199,1689390651299' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39199-0x10166f610e80002, quorum=127.0.0.1:62663, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 03:12:50,011 DEBUG [member: 'jenkins-hbase4.apache.org,43199,1689390651225' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-15 03:12:50,011 DEBUG [member: 'jenkins-hbase4.apache.org,39199,1689390651299' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-15 03:12:50,012 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 03:12:50,012 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 03:12:50,013 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43199,1689390651225 2023-07-15 03:12:50,013 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39199,1689390651299 2023-07-15 03:12:50,013 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38367,1689390651355 2023-07-15 03:12:50,014 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 03:12:50,015 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,38367,1689390651355' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-07-15 03:12:50,015 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@a92ad0f[Count = 1] remaining members to acquire global barrier 2023-07-15 03:12:50,015 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39199,1689390651299 2023-07-15 03:12:50,015 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 03:12:50,015 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 03:12:50,015 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 03:12:50,016 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 03:12:50,016 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 03:12:50,016 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43199,1689390651225 2023-07-15 03:12:50,017 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39199,1689390651299 2023-07-15 03:12:50,020 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38367,1689390651355 2023-07-15 03:12:50,021 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 03:12:50,022 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39199,1689390651299' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-07-15 03:12:50,022 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@a92ad0f[Count = 0] remaining members to acquire global barrier 2023-07-15 03:12:50,022 DEBUG [(jenkins-hbase4.apache.org,41669,1689390649760)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'in-barrier' execution. 2023-07-15 03:12:50,022 DEBUG [(jenkins-hbase4.apache.org,41669,1689390649760)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 03:12:50,027 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): regionserver:39199-0x10166f610e80002, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 03:12:50,027 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): regionserver:43199-0x10166f610e80001, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 03:12:50,027 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 03:12:50,027 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 03:12:50,027 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 03:12:50,027 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): regionserver:38367-0x10166f610e80003, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 03:12:50,028 DEBUG [member: 'jenkins-hbase4.apache.org,43199,1689390651225' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-15 03:12:50,028 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 03:12:50,028 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 03:12:50,028 DEBUG [member: 'jenkins-hbase4.apache.org,43199,1689390651225' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-15 03:12:50,028 DEBUG [member: 'jenkins-hbase4.apache.org,43199,1689390651225' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,43199,1689390651225' in zk 2023-07-15 03:12:50,028 DEBUG [(jenkins-hbase4.apache.org,41669,1689390649760)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41669-0x10166f610e80000, quorum=127.0.0.1:62663, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,38367,1689390651355 2023-07-15 03:12:50,027 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 03:12:50,028 DEBUG [member: 'jenkins-hbase4.apache.org,39199,1689390651299' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-15 03:12:50,028 DEBUG [member: 'jenkins-hbase4.apache.org,38367,1689390651355' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-15 03:12:50,029 DEBUG [(jenkins-hbase4.apache.org,41669,1689390649760)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41669-0x10166f610e80000, quorum=127.0.0.1:62663, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39199,1689390651299 2023-07-15 03:12:50,029 DEBUG [(jenkins-hbase4.apache.org,41669,1689390649760)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-15 03:12:50,030 DEBUG [member: 'jenkins-hbase4.apache.org,43199,1689390651225' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-15 03:12:50,030 DEBUG [member: 'jenkins-hbase4.apache.org,43199,1689390651225' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-15 03:12:50,030 DEBUG [member: 'jenkins-hbase4.apache.org,43199,1689390651225' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-15 03:12:50,032 DEBUG [member: 'jenkins-hbase4.apache.org,39199,1689390651299' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-15 03:12:50,032 DEBUG [member: 'jenkins-hbase4.apache.org,39199,1689390651299' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-15 03:12:50,032 DEBUG [rs(jenkins-hbase4.apache.org,39199,1689390651299)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1689390768444.34763e35142c67bdf675b1ddfdc28fea. 2023-07-15 03:12:50,032 DEBUG [rs(jenkins-hbase4.apache.org,38367,1689390651355)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1689390768444.8752d3577665c05dc0a1bdd8ba794efa. 2023-07-15 03:12:50,032 DEBUG [member: 'jenkins-hbase4.apache.org,38367,1689390651355' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-15 03:12:50,032 DEBUG [member: 'jenkins-hbase4.apache.org,38367,1689390651355' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-15 03:12:50,032 DEBUG [rs(jenkins-hbase4.apache.org,38367,1689390651355)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1689390768444.8752d3577665c05dc0a1bdd8ba794efa. started... 2023-07-15 03:12:50,032 DEBUG [rs(jenkins-hbase4.apache.org,39199,1689390651299)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1689390768444.34763e35142c67bdf675b1ddfdc28fea. started... 2023-07-15 03:12:50,033 INFO [rs(jenkins-hbase4.apache.org,38367,1689390651355)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 8752d3577665c05dc0a1bdd8ba794efa 1/1 column families, dataSize=266 B heapSize=832 B 2023-07-15 03:12:50,033 INFO [rs(jenkins-hbase4.apache.org,39199,1689390651299)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 34763e35142c67bdf675b1ddfdc28fea 1/1 column families, dataSize=3.00 KB heapSize=6.72 KB 2023-07-15 03:12:50,044 DEBUG [Listener at jenkins-hbase4.apache.org/44817] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-15 03:12:50,046 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41669] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-15 03:12:50,046 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41669] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-07-15 03:12:50,046 DEBUG [Listener at jenkins-hbase4.apache.org/44817] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-15 03:12:50,138 INFO [rs(jenkins-hbase4.apache.org,38367,1689390651355)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=266 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/data/default/testtb-testExportFileSystemStateWithSkipTmp/8752d3577665c05dc0a1bdd8ba794efa/.tmp/cf/87879b943638435c83e1276ad20a52d9 2023-07-15 03:12:50,150 DEBUG [rs(jenkins-hbase4.apache.org,38367,1689390651355)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/data/default/testtb-testExportFileSystemStateWithSkipTmp/8752d3577665c05dc0a1bdd8ba794efa/.tmp/cf/87879b943638435c83e1276ad20a52d9 as hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/data/default/testtb-testExportFileSystemStateWithSkipTmp/8752d3577665c05dc0a1bdd8ba794efa/cf/87879b943638435c83e1276ad20a52d9 2023-07-15 03:12:50,153 INFO [rs(jenkins-hbase4.apache.org,39199,1689390651299)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.00 KB at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/data/default/testtb-testExportFileSystemStateWithSkipTmp/34763e35142c67bdf675b1ddfdc28fea/.tmp/cf/02f52554eec74224b6a45a393a0f5a70 2023-07-15 03:12:50,159 INFO [rs(jenkins-hbase4.apache.org,38367,1689390651355)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/data/default/testtb-testExportFileSystemStateWithSkipTmp/8752d3577665c05dc0a1bdd8ba794efa/cf/87879b943638435c83e1276ad20a52d9, entries=4, sequenceid=6, filesize=5.1 K 2023-07-15 03:12:50,160 DEBUG [rs(jenkins-hbase4.apache.org,39199,1689390651299)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/data/default/testtb-testExportFileSystemStateWithSkipTmp/34763e35142c67bdf675b1ddfdc28fea/.tmp/cf/02f52554eec74224b6a45a393a0f5a70 as hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/data/default/testtb-testExportFileSystemStateWithSkipTmp/34763e35142c67bdf675b1ddfdc28fea/cf/02f52554eec74224b6a45a393a0f5a70 2023-07-15 03:12:50,162 INFO [rs(jenkins-hbase4.apache.org,38367,1689390651355)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~266 B/266, heapSize ~816 B/816, currentSize=0 B/0 for 8752d3577665c05dc0a1bdd8ba794efa in 129ms, sequenceid=6, compaction requested=false 2023-07-15 03:12:50,162 DEBUG [rs(jenkins-hbase4.apache.org,38367,1689390651355)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithSkipTmp' 2023-07-15 03:12:50,166 DEBUG [rs(jenkins-hbase4.apache.org,38367,1689390651355)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 8752d3577665c05dc0a1bdd8ba794efa: 2023-07-15 03:12:50,167 DEBUG [rs(jenkins-hbase4.apache.org,38367,1689390651355)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,,1689390768444.8752d3577665c05dc0a1bdd8ba794efa.' region-info for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 03:12:50,167 DEBUG [rs(jenkins-hbase4.apache.org,38367,1689390651355)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-15 03:12:50,167 DEBUG [rs(jenkins-hbase4.apache.org,38367,1689390651355)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/data/default/testtb-testExportFileSystemStateWithSkipTmp/8752d3577665c05dc0a1bdd8ba794efa/cf/87879b943638435c83e1276ad20a52d9] hfiles 2023-07-15 03:12:50,167 DEBUG [rs(jenkins-hbase4.apache.org,38367,1689390651355)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/data/default/testtb-testExportFileSystemStateWithSkipTmp/8752d3577665c05dc0a1bdd8ba794efa/cf/87879b943638435c83e1276ad20a52d9 for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 03:12:50,169 INFO [rs(jenkins-hbase4.apache.org,39199,1689390651299)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/data/default/testtb-testExportFileSystemStateWithSkipTmp/34763e35142c67bdf675b1ddfdc28fea/cf/02f52554eec74224b6a45a393a0f5a70, entries=46, sequenceid=6, filesize=7.9 K 2023-07-15 03:12:50,171 INFO [rs(jenkins-hbase4.apache.org,39199,1689390651299)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.00 KB/3070, heapSize ~6.70 KB/6864, currentSize=0 B/0 for 34763e35142c67bdf675b1ddfdc28fea in 137ms, sequenceid=6, compaction requested=false 2023-07-15 03:12:50,180 DEBUG [rs(jenkins-hbase4.apache.org,39199,1689390651299)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 34763e35142c67bdf675b1ddfdc28fea: 2023-07-15 03:12:50,181 DEBUG [rs(jenkins-hbase4.apache.org,39199,1689390651299)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,1,1689390768444.34763e35142c67bdf675b1ddfdc28fea.' region-info for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 03:12:50,181 DEBUG [rs(jenkins-hbase4.apache.org,39199,1689390651299)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-15 03:12:50,181 DEBUG [rs(jenkins-hbase4.apache.org,39199,1689390651299)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/data/default/testtb-testExportFileSystemStateWithSkipTmp/34763e35142c67bdf675b1ddfdc28fea/cf/02f52554eec74224b6a45a393a0f5a70] hfiles 2023-07-15 03:12:50,181 DEBUG [rs(jenkins-hbase4.apache.org,39199,1689390651299)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/data/default/testtb-testExportFileSystemStateWithSkipTmp/34763e35142c67bdf675b1ddfdc28fea/cf/02f52554eec74224b6a45a393a0f5a70 for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 03:12:50,215 DEBUG [rs(jenkins-hbase4.apache.org,38367,1689390651355)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1689390768444.8752d3577665c05dc0a1bdd8ba794efa. completed. 2023-07-15 03:12:50,215 DEBUG [rs(jenkins-hbase4.apache.org,38367,1689390651355)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1689390768444.8752d3577665c05dc0a1bdd8ba794efa. 2023-07-15 03:12:50,215 DEBUG [member: 'jenkins-hbase4.apache.org,38367,1689390651355' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-15 03:12:50,215 DEBUG [member: 'jenkins-hbase4.apache.org,38367,1689390651355' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-15 03:12:50,215 DEBUG [member: 'jenkins-hbase4.apache.org,38367,1689390651355' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,38367,1689390651355 2023-07-15 03:12:50,215 DEBUG [member: 'jenkins-hbase4.apache.org,38367,1689390651355' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-15 03:12:50,215 DEBUG [member: 'jenkins-hbase4.apache.org,38367,1689390651355' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,38367,1689390651355' in zk 2023-07-15 03:12:50,217 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): master:41669-0x10166f610e80000, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,38367,1689390651355 2023-07-15 03:12:50,217 DEBUG [member: 'jenkins-hbase4.apache.org,38367,1689390651355' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-15 03:12:50,217 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,38367,1689390651355 2023-07-15 03:12:50,217 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 03:12:50,217 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 03:12:50,217 DEBUG [member: 'jenkins-hbase4.apache.org,38367,1689390651355' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-15 03:12:50,218 DEBUG [member: 'jenkins-hbase4.apache.org,38367,1689390651355' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-15 03:12:50,218 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 03:12:50,219 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 03:12:50,220 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 03:12:50,220 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43199,1689390651225 2023-07-15 03:12:50,220 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39199,1689390651299 2023-07-15 03:12:50,221 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38367,1689390651355 2023-07-15 03:12:50,221 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 03:12:50,222 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 03:12:50,222 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43199,1689390651225 2023-07-15 03:12:50,222 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38367,1689390651355 2023-07-15 03:12:50,223 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,38367,1689390651355': 2023-07-15 03:12:50,223 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,38367,1689390651355' released barrier for procedure'snaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 1 more 2023-07-15 03:12:50,237 DEBUG [rs(jenkins-hbase4.apache.org,39199,1689390651299)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1689390768444.34763e35142c67bdf675b1ddfdc28fea. completed. 2023-07-15 03:12:50,237 DEBUG [rs(jenkins-hbase4.apache.org,39199,1689390651299)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1689390768444.34763e35142c67bdf675b1ddfdc28fea. 2023-07-15 03:12:50,237 DEBUG [member: 'jenkins-hbase4.apache.org,39199,1689390651299' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-15 03:12:50,237 DEBUG [member: 'jenkins-hbase4.apache.org,39199,1689390651299' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-15 03:12:50,237 DEBUG [member: 'jenkins-hbase4.apache.org,39199,1689390651299' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,39199,1689390651299 2023-07-15 03:12:50,238 DEBUG [member: 'jenkins-hbase4.apache.org,39199,1689390651299' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-15 03:12:50,238 DEBUG [member: 'jenkins-hbase4.apache.org,39199,1689390651299' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,39199,1689390651299' in zk 2023-07-15 03:12:50,240 DEBUG [member: 'jenkins-hbase4.apache.org,39199,1689390651299' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-15 03:12:50,240 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): master:41669-0x10166f610e80000, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39199,1689390651299 2023-07-15 03:12:50,240 DEBUG [member: 'jenkins-hbase4.apache.org,39199,1689390651299' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-15 03:12:50,240 DEBUG [member: 'jenkins-hbase4.apache.org,39199,1689390651299' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-15 03:12:50,240 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39199,1689390651299 2023-07-15 03:12:50,242 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 03:12:50,242 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 03:12:50,242 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 03:12:50,242 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 03:12:50,243 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 03:12:50,243 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43199,1689390651225 2023-07-15 03:12:50,244 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39199,1689390651299 2023-07-15 03:12:50,244 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38367,1689390651355 2023-07-15 03:12:50,244 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 03:12:50,245 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 03:12:50,245 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43199,1689390651225 2023-07-15 03:12:50,245 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39199,1689390651299 2023-07-15 03:12:50,245 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38367,1689390651355 2023-07-15 03:12:50,246 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,39199,1689390651299': 2023-07-15 03:12:50,246 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39199,1689390651299' released barrier for procedure'snaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 0 more 2023-07-15 03:12:50,246 INFO [(jenkins-hbase4.apache.org,41669,1689390649760)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' execution completed 2023-07-15 03:12:50,246 DEBUG [(jenkins-hbase4.apache.org,41669,1689390649760)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-15 03:12:50,246 DEBUG [(jenkins-hbase4.apache.org,41669,1689390649760)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-15 03:12:50,246 DEBUG [Listener at jenkins-hbase4.apache.org/44817] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-15 03:12:50,246 DEBUG [(jenkins-hbase4.apache.org,41669,1689390649760)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 03:12:50,247 INFO [(jenkins-hbase4.apache.org,41669,1689390649760)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateWithSkipTmpincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-15 03:12:50,247 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41669] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-15 03:12:50,248 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41669] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-07-15 03:12:50,248 DEBUG [Listener at jenkins-hbase4.apache.org/44817] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-15 03:12:50,248 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): regionserver:43199-0x10166f610e80001, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 03:12:50,249 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): regionserver:43199-0x10166f610e80001, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 03:12:50,249 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 03:12:50,249 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 03:12:50,249 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): master:41669-0x10166f610e80000, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 03:12:50,249 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): regionserver:38367-0x10166f610e80003, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 03:12:50,249 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 03:12:50,249 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 03:12:50,249 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): regionserver:38367-0x10166f610e80003, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 03:12:50,249 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 03:12:50,249 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 03:12:50,249 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 03:12:50,249 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 03:12:50,249 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 03:12:50,250 DEBUG [(jenkins-hbase4.apache.org,41669,1689390649760)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41669-0x10166f610e80000, quorum=127.0.0.1:62663, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43199,1689390651225 2023-07-15 03:12:50,250 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 03:12:50,250 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 03:12:50,250 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 03:12:50,250 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 03:12:50,251 DEBUG [(jenkins-hbase4.apache.org,41669,1689390649760)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41669-0x10166f610e80000, quorum=127.0.0.1:62663, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39199,1689390651299 2023-07-15 03:12:50,251 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): regionserver:39199-0x10166f610e80002, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 03:12:50,251 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): regionserver:39199-0x10166f610e80002, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 03:12:50,251 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 03:12:50,251 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 03:12:50,252 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 03:12:50,252 DEBUG [(jenkins-hbase4.apache.org,41669,1689390649760)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41669-0x10166f610e80000, quorum=127.0.0.1:62663, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,38367,1689390651355 2023-07-15 03:12:50,252 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 03:12:50,252 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 03:12:50,252 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 03:12:50,253 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 03:12:50,253 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 03:12:50,254 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 03:12:50,257 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43199,1689390651225 2023-07-15 03:12:50,258 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39199,1689390651299 2023-07-15 03:12:50,258 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38367,1689390651355 2023-07-15 03:12:50,258 DEBUG [(jenkins-hbase4.apache.org,41669,1689390649760)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41669-0x10166f610e80000, quorum=127.0.0.1:62663, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43199,1689390651225 2023-07-15 03:12:50,259 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 03:12:50,259 DEBUG [(jenkins-hbase4.apache.org,41669,1689390649760)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41669-0x10166f610e80000, quorum=127.0.0.1:62663, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39199,1689390651299 2023-07-15 03:12:50,259 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 03:12:50,260 DEBUG [(jenkins-hbase4.apache.org,41669,1689390649760)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41669-0x10166f610e80000, quorum=127.0.0.1:62663, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,38367,1689390651355 2023-07-15 03:12:50,260 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43199,1689390651225 2023-07-15 03:12:50,260 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39199,1689390651299 2023-07-15 03:12:50,260 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38367,1689390651355 2023-07-15 03:12:50,263 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): master:41669-0x10166f610e80000, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,38367,1689390651355 2023-07-15 03:12:50,263 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): regionserver:38367-0x10166f610e80003, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 03:12:50,263 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): regionserver:43199-0x10166f610e80001, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 03:12:50,263 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): regionserver:39199-0x10166f610e80002, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 03:12:50,263 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): master:41669-0x10166f610e80000, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 03:12:50,263 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 03:12:50,263 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 03:12:50,263 DEBUG [(jenkins-hbase4.apache.org,41669,1689390649760)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-15 03:12:50,263 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): regionserver:39199-0x10166f610e80002, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 03:12:50,263 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 03:12:50,265 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): regionserver:38367-0x10166f610e80003, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 03:12:50,263 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 03:12:50,263 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 03:12:50,266 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 03:12:50,266 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 03:12:50,266 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 03:12:50,263 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): master:41669-0x10166f610e80000, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39199,1689390651299 2023-07-15 03:12:50,266 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): master:41669-0x10166f610e80000, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43199,1689390651225 2023-07-15 03:12:50,266 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): master:41669-0x10166f610e80000, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 03:12:50,266 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): master:41669-0x10166f610e80000, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,38367,1689390651355 2023-07-15 03:12:50,266 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): master:41669-0x10166f610e80000, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 03:12:50,266 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): master:41669-0x10166f610e80000, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39199,1689390651299 2023-07-15 03:12:50,266 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): master:41669-0x10166f610e80000, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43199,1689390651225 2023-07-15 03:12:50,266 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): master:41669-0x10166f610e80000, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 03:12:50,266 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): master:41669-0x10166f610e80000, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 03:12:50,266 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 03:12:50,265 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): regionserver:43199-0x10166f610e80001, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 03:12:50,265 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 03:12:50,268 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 03:12:50,269 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 03:12:50,269 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 03:12:50,269 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 03:12:50,269 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 03:12:50,299 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp to hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 03:12:50,333 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed 2023-07-15 03:12:50,334 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 03:12:50,334 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 03:12:50,334 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp at 1689390769943Consolidate snapshot: snaptb0-testExportFileSystemStateWithSkipTmp at 1689390770266 (+323 ms)Loading Region manifests for snaptb0-testExportFileSystemStateWithSkipTmp at 1689390770266Writing data manifest for snaptb0-testExportFileSystemStateWithSkipTmp at 1689390770272 (+6 ms)Verifying snapshot: snaptb0-testExportFileSystemStateWithSkipTmp at 1689390770291 (+19 ms)Snapshot snaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed at 1689390770333 (+42 ms) 2023-07-15 03:12:50,337 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=113, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-15 03:12:50,339 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=113, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED in 393 msec 2023-07-15 03:12:50,548 DEBUG [Listener at jenkins-hbase4.apache.org/44817] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-15 03:12:50,549 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41669] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-15 03:12:50,549 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41669] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-15 03:12:50,549 INFO [Listener at jenkins-hbase4.apache.org/44817] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/export-test/export-1689390770549 2023-07-15 03:12:50,549 INFO [Listener at jenkins-hbase4.apache.org/44817] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:37513, tgtDir=hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/export-test/export-1689390770549, rawTgtDir=hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/export-test/export-1689390770549, srcFsUri=hdfs://localhost:37513, srcDir=hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280 2023-07-15 03:12:50,572 DEBUG [Listener at jenkins-hbase4.apache.org/44817] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:37513, inputRoot=hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280 2023-07-15 03:12:50,572 DEBUG [Listener at jenkins-hbase4.apache.org/44817] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1639130807_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/export-test/export-1689390770549, skipTmp=true, initialOutputSnapshotDir=hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/export-test/export-1689390770549/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 03:12:50,572 INFO [Listener at jenkins-hbase4.apache.org/44817] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:37513, inputRoot=hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280, snapshotDir=hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp. 2023-07-15 03:12:50,581 INFO [Listener at jenkins-hbase4.apache.org/44817] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp to hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/export-test/export-1689390770549/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 03:12:50,599 DEBUG [Listener at jenkins-hbase4.apache.org/44817] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-15 03:12:50,599 DEBUG [Listener at jenkins-hbase4.apache.org/44817] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-15 03:12:50,600 DEBUG [Listener at jenkins-hbase4.apache.org/44817] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-15 03:12:50,600 DEBUG [Listener at jenkins-hbase4.apache.org/44817] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-15 03:12:51,613 DEBUG [Listener at jenkins-hbase4.apache.org/44817] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6bc8dbaf-aac0-03cf-90d4-be6af049f709/hadoop-6918790076260748505.jar 2023-07-15 03:12:51,614 DEBUG [Listener at jenkins-hbase4.apache.org/44817] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-15 03:12:51,615 DEBUG [Listener at jenkins-hbase4.apache.org/44817] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-15 03:12:51,688 DEBUG [Listener at jenkins-hbase4.apache.org/44817] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6bc8dbaf-aac0-03cf-90d4-be6af049f709/hadoop-7684756437543077552.jar 2023-07-15 03:12:51,688 DEBUG [Listener at jenkins-hbase4.apache.org/44817] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-15 03:12:51,689 DEBUG [Listener at jenkins-hbase4.apache.org/44817] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-15 03:12:51,689 DEBUG [Listener at jenkins-hbase4.apache.org/44817] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-15 03:12:51,690 DEBUG [Listener at jenkins-hbase4.apache.org/44817] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-15 03:12:51,690 DEBUG [Listener at jenkins-hbase4.apache.org/44817] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-15 03:12:51,690 DEBUG [Listener at jenkins-hbase4.apache.org/44817] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-15 03:12:51,691 DEBUG [Listener at jenkins-hbase4.apache.org/44817] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-15 03:12:51,691 DEBUG [Listener at jenkins-hbase4.apache.org/44817] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-15 03:12:51,692 DEBUG [Listener at jenkins-hbase4.apache.org/44817] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-15 03:12:51,692 DEBUG [Listener at jenkins-hbase4.apache.org/44817] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-15 03:12:51,693 DEBUG [Listener at jenkins-hbase4.apache.org/44817] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-15 03:12:51,693 DEBUG [Listener at jenkins-hbase4.apache.org/44817] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-15 03:12:51,694 DEBUG [Listener at jenkins-hbase4.apache.org/44817] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-15 03:12:51,694 DEBUG [Listener at jenkins-hbase4.apache.org/44817] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-15 03:12:51,695 DEBUG [Listener at jenkins-hbase4.apache.org/44817] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-15 03:12:51,695 DEBUG [Listener at jenkins-hbase4.apache.org/44817] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-15 03:12:51,696 DEBUG [Listener at jenkins-hbase4.apache.org/44817] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-15 03:12:51,696 DEBUG [Listener at jenkins-hbase4.apache.org/44817] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-15 03:12:51,697 DEBUG [Listener at jenkins-hbase4.apache.org/44817] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-15 03:12:51,697 DEBUG [Listener at jenkins-hbase4.apache.org/44817] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-15 03:12:51,698 DEBUG [Listener at jenkins-hbase4.apache.org/44817] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-15 03:12:51,698 DEBUG [Listener at jenkins-hbase4.apache.org/44817] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-15 03:12:51,699 DEBUG [Listener at jenkins-hbase4.apache.org/44817] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-15 03:12:52,363 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689390660463_0006_000001 (auth:SIMPLE) 2023-07-15 03:12:52,379 WARN [Listener at jenkins-hbase4.apache.org/44817] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-15 03:12:52,382 INFO [Listener at jenkins-hbase4.apache.org/44817] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportFileSystemStateWithSkipTmp' hfile list 2023-07-15 03:12:52,384 DEBUG [Listener at jenkins-hbase4.apache.org/44817] snapshot.ExportSnapshot(671): export split=0 size=13.0 K 2023-07-15 03:12:52,528 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-15 03:12:52,528 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-15 03:12:52,979 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689390660463_0007_000001 (auth:SIMPLE) 2023-07-15 03:12:53,774 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-15 03:12:58,934 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689390660463_0007_000001 (auth:SIMPLE) 2023-07-15 03:13:01,321 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689390660463_0007_000001 (auth:SIMPLE) 2023-07-15 03:13:06,371 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689390660463_0007_000001 (auth:SIMPLE) 2023-07-15 03:13:07,727 INFO [Listener at jenkins-hbase4.apache.org/44817] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-15 03:13:07,727 INFO [Listener at jenkins-hbase4.apache.org/44817] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-15 03:13:07,780 INFO [Listener at jenkins-hbase4.apache.org/44817] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 03:13:07,780 INFO [Listener at jenkins-hbase4.apache.org/44817] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-15 03:13:07,781 INFO [Listener at jenkins-hbase4.apache.org/44817] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-15 03:13:07,781 DEBUG [Listener at jenkins-hbase4.apache.org/44817] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-924468511_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp at hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 03:13:07,782 DEBUG [Listener at jenkins-hbase4.apache.org/44817] snapshot.TestExportSnapshot(367): hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/.snapshotinfo 2023-07-15 03:13:07,782 DEBUG [Listener at jenkins-hbase4.apache.org/44817] snapshot.TestExportSnapshot(367): hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/data.manifest 2023-07-15 03:13:07,782 DEBUG [Listener at jenkins-hbase4.apache.org/44817] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-924468511_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/export-test/export-1689390770549/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp at hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/export-test/export-1689390770549/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 03:13:07,783 DEBUG [Listener at jenkins-hbase4.apache.org/44817] snapshot.TestExportSnapshot(367): hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/export-test/export-1689390770549/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/.snapshotinfo 2023-07-15 03:13:07,783 DEBUG [Listener at jenkins-hbase4.apache.org/44817] snapshot.TestExportSnapshot(367): hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/export-test/export-1689390770549/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/data.manifest 2023-07-15 03:13:07,806 INFO [Listener at jenkins-hbase4.apache.org/44817] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemStateWithSkipTmp 2023-07-15 03:13:07,806 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41669] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemStateWithSkipTmp 2023-07-15 03:13:07,808 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41669] procedure2.ProcedureExecutor(1029): Stored pid=114, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-15 03:13:07,812 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41669] master.MasterRpcServices(1230): Checking to see if procedure is done pid=114 2023-07-15 03:13:07,812 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689390787812"}]},"ts":"1689390787812"} 2023-07-15 03:13:07,814 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=DISABLING in hbase:meta 2023-07-15 03:13:07,816 INFO [PEWorker-5] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemStateWithSkipTmp to state=DISABLING 2023-07-15 03:13:07,818 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=115, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=8752d3577665c05dc0a1bdd8ba794efa, UNASSIGN}, {pid=116, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=34763e35142c67bdf675b1ddfdc28fea, UNASSIGN}] 2023-07-15 03:13:07,819 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=115, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=8752d3577665c05dc0a1bdd8ba794efa, UNASSIGN 2023-07-15 03:13:07,822 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=116, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=34763e35142c67bdf675b1ddfdc28fea, UNASSIGN 2023-07-15 03:13:07,822 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=115 updating hbase:meta row=8752d3577665c05dc0a1bdd8ba794efa, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,38367,1689390651355 2023-07-15 03:13:07,822 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1689390768444.8752d3577665c05dc0a1bdd8ba794efa.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689390787822"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689390787822"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689390787822"}]},"ts":"1689390787822"} 2023-07-15 03:13:07,824 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=116 updating hbase:meta row=34763e35142c67bdf675b1ddfdc28fea, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,39199,1689390651299 2023-07-15 03:13:07,824 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1689390768444.34763e35142c67bdf675b1ddfdc28fea.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689390787823"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689390787823"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689390787823"}]},"ts":"1689390787823"} 2023-07-15 03:13:07,825 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=117, ppid=115, state=RUNNABLE; CloseRegionProcedure 8752d3577665c05dc0a1bdd8ba794efa, server=jenkins-hbase4.apache.org,38367,1689390651355}] 2023-07-15 03:13:07,826 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=118, ppid=116, state=RUNNABLE; CloseRegionProcedure 34763e35142c67bdf675b1ddfdc28fea, server=jenkins-hbase4.apache.org,39199,1689390651299}] 2023-07-15 03:13:07,913 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41669] master.MasterRpcServices(1230): Checking to see if procedure is done pid=114 2023-07-15 03:13:07,979 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 34763e35142c67bdf675b1ddfdc28fea 2023-07-15 03:13:07,979 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 8752d3577665c05dc0a1bdd8ba794efa 2023-07-15 03:13:07,979 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 34763e35142c67bdf675b1ddfdc28fea, disabling compactions & flushes 2023-07-15 03:13:07,979 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 8752d3577665c05dc0a1bdd8ba794efa, disabling compactions & flushes 2023-07-15 03:13:07,979 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,1,1689390768444.34763e35142c67bdf675b1ddfdc28fea. 2023-07-15 03:13:07,979 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,,1689390768444.8752d3577665c05dc0a1bdd8ba794efa. 2023-07-15 03:13:07,979 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1689390768444.34763e35142c67bdf675b1ddfdc28fea. 2023-07-15 03:13:07,979 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,,1689390768444.8752d3577665c05dc0a1bdd8ba794efa. 2023-07-15 03:13:07,980 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1689390768444.34763e35142c67bdf675b1ddfdc28fea. after waiting 0 ms 2023-07-15 03:13:07,980 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,1,1689390768444.34763e35142c67bdf675b1ddfdc28fea. 2023-07-15 03:13:07,980 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,,1689390768444.8752d3577665c05dc0a1bdd8ba794efa. after waiting 0 ms 2023-07-15 03:13:07,980 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,,1689390768444.8752d3577665c05dc0a1bdd8ba794efa. 2023-07-15 03:13:08,001 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/data/default/testtb-testExportFileSystemStateWithSkipTmp/34763e35142c67bdf675b1ddfdc28fea/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-15 03:13:08,002 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/data/default/testtb-testExportFileSystemStateWithSkipTmp/8752d3577665c05dc0a1bdd8ba794efa/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-15 03:13:08,002 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-15 03:13:08,002 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-15 03:13:08,007 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,,1689390768444.8752d3577665c05dc0a1bdd8ba794efa. 2023-07-15 03:13:08,007 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 8752d3577665c05dc0a1bdd8ba794efa: 2023-07-15 03:13:08,008 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,1,1689390768444.34763e35142c67bdf675b1ddfdc28fea. 2023-07-15 03:13:08,008 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 34763e35142c67bdf675b1ddfdc28fea: 2023-07-15 03:13:08,008 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 8752d3577665c05dc0a1bdd8ba794efa 2023-07-15 03:13:08,009 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=115 updating hbase:meta row=8752d3577665c05dc0a1bdd8ba794efa, regionState=CLOSED 2023-07-15 03:13:08,009 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 34763e35142c67bdf675b1ddfdc28fea 2023-07-15 03:13:08,009 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1689390768444.8752d3577665c05dc0a1bdd8ba794efa.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689390788009"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689390788009"}]},"ts":"1689390788009"} 2023-07-15 03:13:08,010 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=116 updating hbase:meta row=34763e35142c67bdf675b1ddfdc28fea, regionState=CLOSED 2023-07-15 03:13:08,010 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1689390768444.34763e35142c67bdf675b1ddfdc28fea.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689390788010"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689390788010"}]},"ts":"1689390788010"} 2023-07-15 03:13:08,015 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=117, resume processing ppid=115 2023-07-15 03:13:08,015 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=117, ppid=115, state=SUCCESS; CloseRegionProcedure 8752d3577665c05dc0a1bdd8ba794efa, server=jenkins-hbase4.apache.org,38367,1689390651355 in 186 msec 2023-07-15 03:13:08,017 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=118, resume processing ppid=116 2023-07-15 03:13:08,017 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=118, ppid=116, state=SUCCESS; CloseRegionProcedure 34763e35142c67bdf675b1ddfdc28fea, server=jenkins-hbase4.apache.org,39199,1689390651299 in 186 msec 2023-07-15 03:13:08,017 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=115, ppid=114, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=8752d3577665c05dc0a1bdd8ba794efa, UNASSIGN in 197 msec 2023-07-15 03:13:08,019 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=116, resume processing ppid=114 2023-07-15 03:13:08,019 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=116, ppid=114, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=34763e35142c67bdf675b1ddfdc28fea, UNASSIGN in 199 msec 2023-07-15 03:13:08,020 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689390788019"}]},"ts":"1689390788019"} 2023-07-15 03:13:08,021 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=DISABLED in hbase:meta 2023-07-15 03:13:08,023 INFO [PEWorker-4] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemStateWithSkipTmp to state=DISABLED 2023-07-15 03:13:08,026 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=114, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp in 217 msec 2023-07-15 03:13:08,115 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41669] master.MasterRpcServices(1230): Checking to see if procedure is done pid=114 2023-07-15 03:13:08,115 INFO [Listener at jenkins-hbase4.apache.org/44817] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemStateWithSkipTmp, procId: 114 completed 2023-07-15 03:13:08,116 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41669] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemStateWithSkipTmp 2023-07-15 03:13:08,117 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41669] procedure2.ProcedureExecutor(1029): Stored pid=119, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-15 03:13:08,132 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=119, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-15 03:13:08,133 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41669] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemStateWithSkipTmp 2023-07-15 03:13:08,136 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=39199] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemStateWithSkipTmp 2023-07-15 03:13:08,137 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=119, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-15 03:13:08,143 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): regionserver:38367-0x10166f610e80003, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-15 03:13:08,143 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): regionserver:39199-0x10166f610e80002, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-15 03:13:08,144 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): regionserver:43199-0x10166f610e80001, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-15 03:13:08,144 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-07-15 03:13:08,144 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-07-15 03:13:08,144 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-07-15 03:13:08,146 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): master:41669-0x10166f610e80000, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-15 03:13:08,147 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): regionserver:38367-0x10166f610e80003, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-15 03:13:08,147 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): regionserver:38367-0x10166f610e80003, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-15 03:13:08,147 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): master:41669-0x10166f610e80000, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-15 03:13:08,147 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data null 2023-07-15 03:13:08,147 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-15 03:13:08,147 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): regionserver:43199-0x10166f610e80001, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-15 03:13:08,147 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): regionserver:43199-0x10166f610e80001, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-15 03:13:08,147 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): regionserver:39199-0x10166f610e80002, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-15 03:13:08,147 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): regionserver:39199-0x10166f610e80002, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-15 03:13:08,151 DEBUG [HFileArchiver-22] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/8752d3577665c05dc0a1bdd8ba794efa 2023-07-15 03:13:08,152 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41669] master.MasterRpcServices(1230): Checking to see if procedure is done pid=119 2023-07-15 03:13:08,155 DEBUG [HFileArchiver-22] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/8752d3577665c05dc0a1bdd8ba794efa/cf, FileablePath, hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/8752d3577665c05dc0a1bdd8ba794efa/recovered.edits] 2023-07-15 03:13:08,162 DEBUG [HFileArchiver-22] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/8752d3577665c05dc0a1bdd8ba794efa/cf/87879b943638435c83e1276ad20a52d9 to hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/8752d3577665c05dc0a1bdd8ba794efa/cf/87879b943638435c83e1276ad20a52d9 2023-07-15 03:13:08,164 DEBUG [HFileArchiver-23] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/34763e35142c67bdf675b1ddfdc28fea 2023-07-15 03:13:08,166 DEBUG [HFileArchiver-23] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/34763e35142c67bdf675b1ddfdc28fea/cf, FileablePath, hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/34763e35142c67bdf675b1ddfdc28fea/recovered.edits] 2023-07-15 03:13:08,167 DEBUG [HFileArchiver-22] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/8752d3577665c05dc0a1bdd8ba794efa/recovered.edits/9.seqid to hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/8752d3577665c05dc0a1bdd8ba794efa/recovered.edits/9.seqid 2023-07-15 03:13:08,169 DEBUG [HFileArchiver-22] backup.HFileArchiver(596): Deleted hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/8752d3577665c05dc0a1bdd8ba794efa 2023-07-15 03:13:08,171 DEBUG [HFileArchiver-23] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/34763e35142c67bdf675b1ddfdc28fea/cf/02f52554eec74224b6a45a393a0f5a70 to hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/34763e35142c67bdf675b1ddfdc28fea/cf/02f52554eec74224b6a45a393a0f5a70 2023-07-15 03:13:08,174 DEBUG [HFileArchiver-23] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/34763e35142c67bdf675b1ddfdc28fea/recovered.edits/9.seqid to hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/34763e35142c67bdf675b1ddfdc28fea/recovered.edits/9.seqid 2023-07-15 03:13:08,175 DEBUG [HFileArchiver-23] backup.HFileArchiver(596): Deleted hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/34763e35142c67bdf675b1ddfdc28fea 2023-07-15 03:13:08,175 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithSkipTmp regions 2023-07-15 03:13:08,178 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=119, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-15 03:13:08,181 WARN [PEWorker-2] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportFileSystemStateWithSkipTmp from hbase:meta 2023-07-15 03:13:08,199 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemStateWithSkipTmp' descriptor. 2023-07-15 03:13:08,206 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=119, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-15 03:13:08,206 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemStateWithSkipTmp' from region states. 2023-07-15 03:13:08,207 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1689390768444.8752d3577665c05dc0a1bdd8ba794efa.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689390788206"}]},"ts":"9223372036854775807"} 2023-07-15 03:13:08,207 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1689390768444.34763e35142c67bdf675b1ddfdc28fea.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689390788206"}]},"ts":"9223372036854775807"} 2023-07-15 03:13:08,222 INFO [PEWorker-2] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-15 03:13:08,222 DEBUG [PEWorker-2] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 8752d3577665c05dc0a1bdd8ba794efa, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,,1689390768444.8752d3577665c05dc0a1bdd8ba794efa.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 34763e35142c67bdf675b1ddfdc28fea, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,1,1689390768444.34763e35142c67bdf675b1ddfdc28fea.', STARTKEY => '1', ENDKEY => ''}] 2023-07-15 03:13:08,222 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemStateWithSkipTmp' as deleted. 2023-07-15 03:13:08,223 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689390788222"}]},"ts":"9223372036854775807"} 2023-07-15 03:13:08,225 INFO [PEWorker-2] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemStateWithSkipTmp state from META 2023-07-15 03:13:08,229 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(130): Finished pid=119, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-15 03:13:08,232 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=119, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp in 113 msec 2023-07-15 03:13:08,253 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41669] master.MasterRpcServices(1230): Checking to see if procedure is done pid=119 2023-07-15 03:13:08,253 INFO [Listener at jenkins-hbase4.apache.org/44817] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemStateWithSkipTmp, procId: 119 completed 2023-07-15 03:13:08,273 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41669] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportFileSystemStateWithSkipTmp" 2023-07-15 03:13:08,277 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41669] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 03:13:08,279 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41669] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemStateWithSkipTmp" 2023-07-15 03:13:08,281 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41669] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 03:13:08,320 INFO [Listener at jenkins-hbase4.apache.org/44817] hbase.ResourceChecker(175): after: snapshot.TestSecureExportSnapshot#testExportFileSystemStateWithSkipTmp Thread=764 (was 761) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-924468511_17 at /127.0.0.1:37048 [Waiting for operation #7] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #11 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-23 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x337e74cd-shared-pool-39 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Parameter Sending Thread #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1849284300_1 at /127.0.0.1:35508 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1988502388) connection to jenkins-hbase4.apache.org/172.31.14.131:43025 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: ApplicationMasterLauncher #12 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x337e74cd-shared-pool-41 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-924468511_17 at /127.0.0.1:35530 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x337e74cd-shared-pool-42 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-22 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-924468511_17 at /127.0.0.1:50274 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x337e74cd-shared-pool-40 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-5088 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) - Thread LEAK? -, OpenFileDescriptor=909 (was 904) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=674 (was 649) - SystemLoadAverage LEAK? -, ProcessCount=189 (was 186) - ProcessCount LEAK? -, AvailableMemoryMB=482 (was 1009) 2023-07-15 03:13:08,320 WARN [Listener at jenkins-hbase4.apache.org/44817] hbase.ResourceChecker(130): Thread=764 is superior to 500 2023-07-15 03:13:08,320 INFO [Listener at jenkins-hbase4.apache.org/44817] hbase.HBaseTestingUtility(2762): Stopping mini mapreduce cluster... 2023-07-15 03:13:08,358 INFO [Listener at jenkins-hbase4.apache.org/44817] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-07-15 03:13:12,590 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689390660463_0007_000001 (auth:SIMPLE) 2023-07-15 03:13:13,576 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-15 03:13:22,388 INFO [Listener at jenkins-hbase4.apache.org/44817] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-07-15 03:13:36,513 ERROR [Thread[Thread-410,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager$ExpiredTokenRemover(696): ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted 2023-07-15 03:13:36,514 INFO [Listener at jenkins-hbase4.apache.org/44817] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-07-15 03:13:36,624 WARN [ApplicationMaster Launcher] amlauncher.ApplicationMasterLauncher$LauncherThread(122): org.apache.hadoop.yarn.server.resourcemanager.amlauncher.ApplicationMasterLauncher$LauncherThread interrupted. Returning. 2023-07-15 03:13:36,633 ERROR [SchedulerEventDispatcher:Event Processor] event.EventDispatcher$EventProcessor(61): Returning, interrupted : java.lang.InterruptedException 2023-07-15 03:13:36,634 ERROR [Thread[Thread-420,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager$ExpiredTokenRemover(696): ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted 2023-07-15 03:13:36,653 INFO [Listener at jenkins-hbase4.apache.org/44817] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-07-15 03:13:36,757 ERROR [Thread[Thread-384,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager$ExpiredTokenRemover(696): ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted 2023-07-15 03:13:36,757 INFO [Listener at jenkins-hbase4.apache.org/44817] hbase.HBaseTestingUtility(2765): Mini mapreduce cluster stopped 2023-07-15 03:13:36,758 INFO [Listener at jenkins-hbase4.apache.org/44817] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-07-15 03:13:36,758 INFO [Listener at jenkins-hbase4.apache.org/44817] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-07-15 03:13:36,758 DEBUG [Listener at jenkins-hbase4.apache.org/44817] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x3f1d84a9 to 127.0.0.1:62663 2023-07-15 03:13:36,758 DEBUG [Listener at jenkins-hbase4.apache.org/44817] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-15 03:13:36,758 DEBUG [Listener at jenkins-hbase4.apache.org/44817] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-07-15 03:13:36,759 DEBUG [Listener at jenkins-hbase4.apache.org/44817] util.JVMClusterUtil(257): Found active master hash=273323641, stopped=false 2023-07-15 03:13:36,759 DEBUG [Listener at jenkins-hbase4.apache.org/44817] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-15 03:13:36,759 DEBUG [Listener at jenkins-hbase4.apache.org/44817] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver 2023-07-15 03:13:36,759 INFO [Listener at jenkins-hbase4.apache.org/44817] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase4.apache.org,41669,1689390649760 2023-07-15 03:13:36,762 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): regionserver:43199-0x10166f610e80001, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-07-15 03:13:36,762 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): regionserver:39199-0x10166f610e80002, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-07-15 03:13:36,762 INFO [Listener at jenkins-hbase4.apache.org/44817] procedure2.ProcedureExecutor(629): Stopping 2023-07-15 03:13:36,762 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): master:41669-0x10166f610e80000, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-07-15 03:13:36,762 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): regionserver:38367-0x10166f610e80003, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-07-15 03:13:36,762 DEBUG [Listener at jenkins-hbase4.apache.org/44817] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x5719d199 to 127.0.0.1:62663 2023-07-15 03:13:36,762 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): master:41669-0x10166f610e80000, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-15 03:13:36,762 DEBUG [Listener at jenkins-hbase4.apache.org/44817] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-15 03:13:36,762 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43199-0x10166f610e80001, quorum=127.0.0.1:62663, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-15 03:13:36,762 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39199-0x10166f610e80002, quorum=127.0.0.1:62663, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-15 03:13:36,762 INFO [Listener at jenkins-hbase4.apache.org/44817] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,43199,1689390651225' ***** 2023-07-15 03:13:36,763 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:41669-0x10166f610e80000, quorum=127.0.0.1:62663, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-15 03:13:36,763 DEBUG [Listener at jenkins-hbase4.apache.org/44817] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-15 03:13:36,763 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38367-0x10166f610e80003, quorum=127.0.0.1:62663, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-15 03:13:36,763 INFO [Listener at jenkins-hbase4.apache.org/44817] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-07-15 03:13:36,763 INFO [Listener at jenkins-hbase4.apache.org/44817] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,39199,1689390651299' ***** 2023-07-15 03:13:36,763 DEBUG [Listener at jenkins-hbase4.apache.org/44817] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-15 03:13:36,763 INFO [Listener at jenkins-hbase4.apache.org/44817] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-07-15 03:13:36,763 INFO [Listener at jenkins-hbase4.apache.org/44817] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,38367,1689390651355' ***** 2023-07-15 03:13:36,763 INFO [RS:1;jenkins-hbase4:39199] regionserver.HeapMemoryManager(220): Stopping 2023-07-15 03:13:36,763 DEBUG [Listener at jenkins-hbase4.apache.org/44817] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-15 03:13:36,763 INFO [RS:1;jenkins-hbase4:39199] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-07-15 03:13:36,763 INFO [Listener at jenkins-hbase4.apache.org/44817] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-07-15 03:13:36,764 INFO [RS:1;jenkins-hbase4:39199] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-07-15 03:13:36,763 INFO [RS:0;jenkins-hbase4:43199] regionserver.HeapMemoryManager(220): Stopping 2023-07-15 03:13:36,764 INFO [RS:2;jenkins-hbase4:38367] regionserver.HeapMemoryManager(220): Stopping 2023-07-15 03:13:36,764 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-07-15 03:13:36,764 INFO [RS:1;jenkins-hbase4:39199] regionserver.HRegionServer(3305): Received CLOSE for 7b14de98886c5a063d2453c7b27e4f02 2023-07-15 03:13:36,764 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-07-15 03:13:36,764 INFO [RS:2;jenkins-hbase4:38367] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-07-15 03:13:36,764 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-07-15 03:13:36,764 INFO [RS:0;jenkins-hbase4:43199] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-07-15 03:13:36,764 INFO [RS:0;jenkins-hbase4:43199] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-07-15 03:13:36,764 INFO [RS:0;jenkins-hbase4:43199] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,43199,1689390651225 2023-07-15 03:13:36,764 INFO [RS:1;jenkins-hbase4:39199] regionserver.HRegionServer(3305): Received CLOSE for 39a45926df72fe7e305cdcf6976a1482 2023-07-15 03:13:36,764 INFO [RS:2;jenkins-hbase4:38367] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-07-15 03:13:36,764 INFO [RS:1;jenkins-hbase4:39199] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,39199,1689390651299 2023-07-15 03:13:36,764 DEBUG [RS:0;jenkins-hbase4:43199] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x09c10f09 to 127.0.0.1:62663 2023-07-15 03:13:36,765 DEBUG [RS:1;jenkins-hbase4:39199] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x75adc386 to 127.0.0.1:62663 2023-07-15 03:13:36,765 DEBUG [RS:0;jenkins-hbase4:43199] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-15 03:13:36,765 INFO [RS:2;jenkins-hbase4:38367] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,38367,1689390651355 2023-07-15 03:13:36,765 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 7b14de98886c5a063d2453c7b27e4f02, disabling compactions & flushes 2023-07-15 03:13:36,767 DEBUG [RS:2;jenkins-hbase4:38367] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4a554aa1 to 127.0.0.1:62663 2023-07-15 03:13:36,768 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1689390654321.7b14de98886c5a063d2453c7b27e4f02. 2023-07-15 03:13:36,767 INFO [RS:0;jenkins-hbase4:43199] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,43199,1689390651225; all regions closed. 2023-07-15 03:13:36,765 DEBUG [RS:1;jenkins-hbase4:39199] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-15 03:13:36,768 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1689390654321.7b14de98886c5a063d2453c7b27e4f02. 2023-07-15 03:13:36,768 DEBUG [RS:2;jenkins-hbase4:38367] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-15 03:13:36,768 INFO [RS:1;jenkins-hbase4:39199] regionserver.HRegionServer(1474): Waiting on 2 regions to close 2023-07-15 03:13:36,769 INFO [RS:2;jenkins-hbase4:38367] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-07-15 03:13:36,768 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1689390654321.7b14de98886c5a063d2453c7b27e4f02. after waiting 0 ms 2023-07-15 03:13:36,769 INFO [RS:2;jenkins-hbase4:38367] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-07-15 03:13:36,769 INFO [RS:2;jenkins-hbase4:38367] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-07-15 03:13:36,769 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1689390654321.7b14de98886c5a063d2453c7b27e4f02. 2023-07-15 03:13:36,769 DEBUG [RS:1;jenkins-hbase4:39199] regionserver.HRegionServer(1478): Online Regions={7b14de98886c5a063d2453c7b27e4f02=hbase:namespace,,1689390654321.7b14de98886c5a063d2453c7b27e4f02., 39a45926df72fe7e305cdcf6976a1482=hbase:acl,,1689390655077.39a45926df72fe7e305cdcf6976a1482.} 2023-07-15 03:13:36,769 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 7b14de98886c5a063d2453c7b27e4f02 1/1 column families, dataSize=78 B heapSize=488 B 2023-07-15 03:13:36,769 INFO [RS:2;jenkins-hbase4:38367] regionserver.HRegionServer(3305): Received CLOSE for 1588230740 2023-07-15 03:13:36,769 INFO [RS:2;jenkins-hbase4:38367] regionserver.HRegionServer(1474): Waiting on 1 regions to close 2023-07-15 03:13:36,769 DEBUG [RS:2;jenkins-hbase4:38367] regionserver.HRegionServer(1478): Online Regions={1588230740=hbase:meta,,1.1588230740} 2023-07-15 03:13:36,770 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-07-15 03:13:36,770 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-07-15 03:13:36,770 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-07-15 03:13:36,770 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-07-15 03:13:36,770 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-07-15 03:13:36,770 DEBUG [RS:2;jenkins-hbase4:38367] regionserver.HRegionServer(1504): Waiting on 1588230740 2023-07-15 03:13:36,770 DEBUG [RS:1;jenkins-hbase4:39199] regionserver.HRegionServer(1504): Waiting on 39a45926df72fe7e305cdcf6976a1482, 7b14de98886c5a063d2453c7b27e4f02 2023-07-15 03:13:36,770 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 1588230740 3/3 column families, dataSize=45.93 KB heapSize=71.92 KB 2023-07-15 03:13:36,784 DEBUG [RS:0;jenkins-hbase4:43199] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/oldWALs 2023-07-15 03:13:36,784 INFO [RS:0;jenkins-hbase4:43199] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C43199%2C1689390651225:(num 1689390653630) 2023-07-15 03:13:36,784 DEBUG [RS:0;jenkins-hbase4:43199] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-15 03:13:36,784 INFO [RS:0;jenkins-hbase4:43199] regionserver.LeaseManager(133): Closed leases 2023-07-15 03:13:36,785 INFO [RS:0;jenkins-hbase4:43199] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-07-15 03:13:36,785 INFO [RS:0;jenkins-hbase4:43199] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-07-15 03:13:36,785 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-15 03:13:36,785 INFO [RS:0;jenkins-hbase4:43199] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-07-15 03:13:36,785 INFO [RS:0;jenkins-hbase4:43199] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-07-15 03:13:36,786 INFO [RS:0;jenkins-hbase4:43199] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:43199 2023-07-15 03:13:36,793 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=78 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/data/hbase/namespace/7b14de98886c5a063d2453c7b27e4f02/.tmp/info/c469a7561d9d461db1692b6861fb9cc0 2023-07-15 03:13:36,796 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): master:41669-0x10166f610e80000, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-15 03:13:36,796 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): regionserver:43199-0x10166f610e80001, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,43199,1689390651225 2023-07-15 03:13:36,796 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): regionserver:38367-0x10166f610e80003, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,43199,1689390651225 2023-07-15 03:13:36,796 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): regionserver:38367-0x10166f610e80003, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-15 03:13:36,796 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): regionserver:39199-0x10166f610e80002, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,43199,1689390651225 2023-07-15 03:13:36,796 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): regionserver:39199-0x10166f610e80002, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-15 03:13:36,796 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): regionserver:43199-0x10166f610e80001, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-15 03:13:36,797 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,43199,1689390651225] 2023-07-15 03:13:36,798 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,43199,1689390651225; numProcessing=1 2023-07-15 03:13:36,798 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=40.45 KB at sequenceid=131 (bloomFilter=false), to=hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/data/hbase/meta/1588230740/.tmp/info/9ffed8e6d3db47a2a4ecdb35dee62862 2023-07-15 03:13:36,799 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,43199,1689390651225 already deleted, retry=false 2023-07-15 03:13:36,799 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,43199,1689390651225 expired; onlineServers=2 2023-07-15 03:13:36,801 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/data/hbase/namespace/7b14de98886c5a063d2453c7b27e4f02/.tmp/info/c469a7561d9d461db1692b6861fb9cc0 as hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/data/hbase/namespace/7b14de98886c5a063d2453c7b27e4f02/info/c469a7561d9d461db1692b6861fb9cc0 2023-07-15 03:13:36,803 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 9ffed8e6d3db47a2a4ecdb35dee62862 2023-07-15 03:13:36,806 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/data/hbase/namespace/7b14de98886c5a063d2453c7b27e4f02/info/c469a7561d9d461db1692b6861fb9cc0, entries=2, sequenceid=6, filesize=4.8 K 2023-07-15 03:13:36,807 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for 7b14de98886c5a063d2453c7b27e4f02 in 38ms, sequenceid=6, compaction requested=false 2023-07-15 03:13:36,818 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=1.50 KB at sequenceid=131 (bloomFilter=false), to=hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/data/hbase/meta/1588230740/.tmp/rep_barrier/54d17177fecf4a1e96f807b7cf21f182 2023-07-15 03:13:36,821 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/data/hbase/namespace/7b14de98886c5a063d2453c7b27e4f02/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-15 03:13:36,821 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-15 03:13:36,822 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:namespace,,1689390654321.7b14de98886c5a063d2453c7b27e4f02. 2023-07-15 03:13:36,822 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 7b14de98886c5a063d2453c7b27e4f02: 2023-07-15 03:13:36,822 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1689390654321.7b14de98886c5a063d2453c7b27e4f02. 2023-07-15 03:13:36,823 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 39a45926df72fe7e305cdcf6976a1482, disabling compactions & flushes 2023-07-15 03:13:36,823 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:acl,,1689390655077.39a45926df72fe7e305cdcf6976a1482. 2023-07-15 03:13:36,823 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:acl,,1689390655077.39a45926df72fe7e305cdcf6976a1482. 2023-07-15 03:13:36,823 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:acl,,1689390655077.39a45926df72fe7e305cdcf6976a1482. after waiting 0 ms 2023-07-15 03:13:36,823 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:acl,,1689390655077.39a45926df72fe7e305cdcf6976a1482. 2023-07-15 03:13:36,823 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 39a45926df72fe7e305cdcf6976a1482 1/1 column families, dataSize=914 B heapSize=2.17 KB 2023-07-15 03:13:36,824 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 54d17177fecf4a1e96f807b7cf21f182 2023-07-15 03:13:36,834 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-07-15 03:13:36,841 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-07-15 03:13:36,857 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-07-15 03:13:36,859 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=914 B at sequenceid=18 (bloomFilter=false), to=hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/data/hbase/acl/39a45926df72fe7e305cdcf6976a1482/.tmp/l/bf3bfe4c11404c4b859c3fc384b57e80 2023-07-15 03:13:36,869 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.98 KB at sequenceid=131 (bloomFilter=false), to=hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/data/hbase/meta/1588230740/.tmp/table/b8aead90ee4d412ab29063881b7702ec 2023-07-15 03:13:36,870 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for bf3bfe4c11404c4b859c3fc384b57e80 2023-07-15 03:13:36,870 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/data/hbase/acl/39a45926df72fe7e305cdcf6976a1482/.tmp/l/bf3bfe4c11404c4b859c3fc384b57e80 as hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/data/hbase/acl/39a45926df72fe7e305cdcf6976a1482/l/bf3bfe4c11404c4b859c3fc384b57e80 2023-07-15 03:13:36,874 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for b8aead90ee4d412ab29063881b7702ec 2023-07-15 03:13:36,875 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/data/hbase/meta/1588230740/.tmp/info/9ffed8e6d3db47a2a4ecdb35dee62862 as hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/data/hbase/meta/1588230740/info/9ffed8e6d3db47a2a4ecdb35dee62862 2023-07-15 03:13:36,878 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for bf3bfe4c11404c4b859c3fc384b57e80 2023-07-15 03:13:36,878 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/data/hbase/acl/39a45926df72fe7e305cdcf6976a1482/l/bf3bfe4c11404c4b859c3fc384b57e80, entries=7, sequenceid=18, filesize=5.2 K 2023-07-15 03:13:36,879 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~914 B/914, heapSize ~2.16 KB/2208, currentSize=0 B/0 for 39a45926df72fe7e305cdcf6976a1482 in 56ms, sequenceid=18, compaction requested=false 2023-07-15 03:13:36,883 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 9ffed8e6d3db47a2a4ecdb35dee62862 2023-07-15 03:13:36,883 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/data/hbase/meta/1588230740/info/9ffed8e6d3db47a2a4ecdb35dee62862, entries=48, sequenceid=131, filesize=10.3 K 2023-07-15 03:13:36,887 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/data/hbase/meta/1588230740/.tmp/rep_barrier/54d17177fecf4a1e96f807b7cf21f182 as hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/data/hbase/meta/1588230740/rep_barrier/54d17177fecf4a1e96f807b7cf21f182 2023-07-15 03:13:36,891 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/data/hbase/acl/39a45926df72fe7e305cdcf6976a1482/recovered.edits/21.seqid, newMaxSeqId=21, maxSeqId=1 2023-07-15 03:13:36,892 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-15 03:13:36,892 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:acl,,1689390655077.39a45926df72fe7e305cdcf6976a1482. 2023-07-15 03:13:36,892 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 39a45926df72fe7e305cdcf6976a1482: 2023-07-15 03:13:36,892 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:acl,,1689390655077.39a45926df72fe7e305cdcf6976a1482. 2023-07-15 03:13:36,896 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 54d17177fecf4a1e96f807b7cf21f182 2023-07-15 03:13:36,897 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/data/hbase/meta/1588230740/rep_barrier/54d17177fecf4a1e96f807b7cf21f182, entries=13, sequenceid=131, filesize=6.4 K 2023-07-15 03:13:36,897 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/data/hbase/meta/1588230740/.tmp/table/b8aead90ee4d412ab29063881b7702ec as hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/data/hbase/meta/1588230740/table/b8aead90ee4d412ab29063881b7702ec 2023-07-15 03:13:36,899 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): regionserver:43199-0x10166f610e80001, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-15 03:13:36,899 INFO [RS:0;jenkins-hbase4:43199] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,43199,1689390651225; zookeeper connection closed. 2023-07-15 03:13:36,899 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): regionserver:43199-0x10166f610e80001, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-15 03:13:36,899 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@6e96e912] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@6e96e912 2023-07-15 03:13:36,904 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for b8aead90ee4d412ab29063881b7702ec 2023-07-15 03:13:36,904 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/data/hbase/meta/1588230740/table/b8aead90ee4d412ab29063881b7702ec, entries=24, sequenceid=131, filesize=6.9 K 2023-07-15 03:13:36,905 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~45.93 KB/47028, heapSize ~71.88 KB/73600, currentSize=0 B/0 for 1588230740 in 135ms, sequenceid=131, compaction requested=false 2023-07-15 03:13:36,923 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/data/hbase/meta/1588230740/recovered.edits/134.seqid, newMaxSeqId=134, maxSeqId=1 2023-07-15 03:13:36,924 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-15 03:13:36,924 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-07-15 03:13:36,925 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-07-15 03:13:36,925 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-07-15 03:13:36,925 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-07-15 03:13:36,970 INFO [RS:2;jenkins-hbase4:38367] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,38367,1689390651355; all regions closed. 2023-07-15 03:13:36,970 INFO [RS:1;jenkins-hbase4:39199] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,39199,1689390651299; all regions closed. 2023-07-15 03:13:36,985 DEBUG [RS:1;jenkins-hbase4:39199] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/oldWALs 2023-07-15 03:13:36,985 INFO [RS:1;jenkins-hbase4:39199] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C39199%2C1689390651299:(num 1689390653609) 2023-07-15 03:13:36,986 DEBUG [RS:1;jenkins-hbase4:39199] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-15 03:13:36,986 INFO [RS:1;jenkins-hbase4:39199] regionserver.LeaseManager(133): Closed leases 2023-07-15 03:13:36,987 DEBUG [RS:2;jenkins-hbase4:38367] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/oldWALs 2023-07-15 03:13:36,987 INFO [RS:2;jenkins-hbase4:38367] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C38367%2C1689390651355.meta:.meta(num 1689390653871) 2023-07-15 03:13:36,991 INFO [RS:1;jenkins-hbase4:39199] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-07-15 03:13:36,992 INFO [RS:1;jenkins-hbase4:39199] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-07-15 03:13:36,992 INFO [RS:1;jenkins-hbase4:39199] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-07-15 03:13:36,992 INFO [RS:1;jenkins-hbase4:39199] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-07-15 03:13:36,992 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-15 03:13:36,996 INFO [RS:1;jenkins-hbase4:39199] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:39199 2023-07-15 03:13:36,999 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): regionserver:38367-0x10166f610e80003, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,39199,1689390651299 2023-07-15 03:13:36,999 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): regionserver:39199-0x10166f610e80002, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,39199,1689390651299 2023-07-15 03:13:36,999 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): master:41669-0x10166f610e80000, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-15 03:13:37,002 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,39199,1689390651299] 2023-07-15 03:13:37,002 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,39199,1689390651299; numProcessing=2 2023-07-15 03:13:37,003 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,39199,1689390651299 already deleted, retry=false 2023-07-15 03:13:37,003 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,39199,1689390651299 expired; onlineServers=1 2023-07-15 03:13:37,008 DEBUG [RS:2;jenkins-hbase4:38367] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/oldWALs 2023-07-15 03:13:37,008 INFO [RS:2;jenkins-hbase4:38367] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C38367%2C1689390651355:(num 1689390653629) 2023-07-15 03:13:37,008 DEBUG [RS:2;jenkins-hbase4:38367] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-15 03:13:37,008 INFO [RS:2;jenkins-hbase4:38367] regionserver.LeaseManager(133): Closed leases 2023-07-15 03:13:37,008 INFO [RS:2;jenkins-hbase4:38367] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-07-15 03:13:37,010 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-15 03:13:37,011 INFO [RS:2;jenkins-hbase4:38367] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:38367 2023-07-15 03:13:37,103 INFO [RS:1;jenkins-hbase4:39199] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,39199,1689390651299; zookeeper connection closed. 2023-07-15 03:13:37,103 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): regionserver:39199-0x10166f610e80002, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-15 03:13:37,103 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): regionserver:39199-0x10166f610e80002, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-15 03:13:37,129 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@249963e1] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@249963e1 2023-07-15 03:13:37,129 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): regionserver:38367-0x10166f610e80003, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,38367,1689390651355 2023-07-15 03:13:37,131 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): master:41669-0x10166f610e80000, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-15 03:13:37,132 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,38367,1689390651355] 2023-07-15 03:13:37,132 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,38367,1689390651355; numProcessing=3 2023-07-15 03:13:37,133 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,38367,1689390651355 already deleted, retry=false 2023-07-15 03:13:37,133 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,38367,1689390651355 expired; onlineServers=0 2023-07-15 03:13:37,133 INFO [RegionServerTracker-0] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,41669,1689390649760' ***** 2023-07-15 03:13:37,133 INFO [RegionServerTracker-0] regionserver.HRegionServer(2311): STOPPED: Cluster shutdown set; onlineServer=0 2023-07-15 03:13:37,133 DEBUG [M:0;jenkins-hbase4:41669] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@51779c42, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-07-15 03:13:37,134 INFO [M:0;jenkins-hbase4:41669] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,41669,1689390649760 2023-07-15 03:13:37,134 INFO [M:0;jenkins-hbase4:41669] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,41669,1689390649760; all regions closed. 2023-07-15 03:13:37,134 DEBUG [M:0;jenkins-hbase4:41669] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-15 03:13:37,134 DEBUG [M:0;jenkins-hbase4:41669] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-07-15 03:13:37,134 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-07-15 03:13:37,134 DEBUG [M:0;jenkins-hbase4:41669] cleaner.HFileCleaner(317): Stopping file delete threads 2023-07-15 03:13:37,134 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1689390653044] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1689390653044,5,FailOnTimeoutGroup] 2023-07-15 03:13:37,134 INFO [M:0;jenkins-hbase4:41669] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-07-15 03:13:37,134 INFO [M:0;jenkins-hbase4:41669] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-07-15 03:13:37,134 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1689390653042] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1689390653042,5,FailOnTimeoutGroup] 2023-07-15 03:13:37,134 INFO [M:0;jenkins-hbase4:41669] hbase.ChoreService(369): Chore service for: master/jenkins-hbase4:0 had [] on shutdown 2023-07-15 03:13:37,134 DEBUG [M:0;jenkins-hbase4:41669] master.HMaster(1512): Stopping service threads 2023-07-15 03:13:37,134 INFO [M:0;jenkins-hbase4:41669] procedure2.RemoteProcedureDispatcher(119): Stopping procedure remote dispatcher 2023-07-15 03:13:37,135 ERROR [M:0;jenkins-hbase4:41669] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] Thread[HFileArchiver-22,5,PEWorkerGroup] Thread[HFileArchiver-23,5,PEWorkerGroup] 2023-07-15 03:13:37,135 INFO [M:0;jenkins-hbase4:41669] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-07-15 03:13:37,135 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-07-15 03:13:37,136 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): master:41669-0x10166f610e80000, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-07-15 03:13:37,136 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): master:41669-0x10166f610e80000, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-15 03:13:37,136 DEBUG [M:0;jenkins-hbase4:41669] zookeeper.ZKUtil(398): master:41669-0x10166f610e80000, quorum=127.0.0.1:62663, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-07-15 03:13:37,136 WARN [M:0;jenkins-hbase4:41669] master.ActiveMasterManager(326): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-07-15 03:13:37,136 INFO [M:0;jenkins-hbase4:41669] assignment.AssignmentManager(315): Stopping assignment manager 2023-07-15 03:13:37,137 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:41669-0x10166f610e80000, quorum=127.0.0.1:62663, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-15 03:13:37,137 INFO [M:0;jenkins-hbase4:41669] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-07-15 03:13:37,143 DEBUG [M:0;jenkins-hbase4:41669] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-07-15 03:13:37,143 INFO [M:0;jenkins-hbase4:41669] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-15 03:13:37,143 DEBUG [M:0;jenkins-hbase4:41669] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-15 03:13:37,143 DEBUG [M:0;jenkins-hbase4:41669] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-07-15 03:13:37,143 DEBUG [M:0;jenkins-hbase4:41669] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-15 03:13:37,143 INFO [M:0;jenkins-hbase4:41669] regionserver.HRegion(2745): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=373.15 KB heapSize=449.34 KB 2023-07-15 03:13:37,162 INFO [M:0;jenkins-hbase4:41669] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=373.15 KB at sequenceid=899 (bloomFilter=true), to=hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/004420b8c49d4b2fb311f3f496423006 2023-07-15 03:13:37,167 INFO [M:0;jenkins-hbase4:41669] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 004420b8c49d4b2fb311f3f496423006 2023-07-15 03:13:37,168 DEBUG [M:0;jenkins-hbase4:41669] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/004420b8c49d4b2fb311f3f496423006 as hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/004420b8c49d4b2fb311f3f496423006 2023-07-15 03:13:37,173 INFO [M:0;jenkins-hbase4:41669] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 004420b8c49d4b2fb311f3f496423006 2023-07-15 03:13:37,173 INFO [M:0;jenkins-hbase4:41669] regionserver.HStore(1080): Added hdfs://localhost:37513/user/jenkins/test-data/4d60ad1a-1840-2aa2-bfca-8591827f6280/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/004420b8c49d4b2fb311f3f496423006, entries=119, sequenceid=899, filesize=28.4 K 2023-07-15 03:13:37,174 INFO [M:0;jenkins-hbase4:41669] regionserver.HRegion(2948): Finished flush of dataSize ~373.15 KB/382101, heapSize ~449.33 KB/460112, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 31ms, sequenceid=899, compaction requested=false 2023-07-15 03:13:37,176 INFO [M:0;jenkins-hbase4:41669] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-15 03:13:37,176 DEBUG [M:0;jenkins-hbase4:41669] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-07-15 03:13:37,181 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-15 03:13:37,181 INFO [M:0;jenkins-hbase4:41669] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-07-15 03:13:37,181 INFO [M:0;jenkins-hbase4:41669] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:41669 2023-07-15 03:13:37,183 DEBUG [M:0;jenkins-hbase4:41669] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase4.apache.org,41669,1689390649760 already deleted, retry=false 2023-07-15 03:13:37,232 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): regionserver:38367-0x10166f610e80003, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-15 03:13:37,232 INFO [RS:2;jenkins-hbase4:38367] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,38367,1689390651355; zookeeper connection closed. 2023-07-15 03:13:37,232 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): regionserver:38367-0x10166f610e80003, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-15 03:13:37,232 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@3415b409] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@3415b409 2023-07-15 03:13:37,233 INFO [Listener at jenkins-hbase4.apache.org/44817] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 3 regionserver(s) complete 2023-07-15 03:13:37,332 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): master:41669-0x10166f610e80000, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-15 03:13:37,332 INFO [M:0;jenkins-hbase4:41669] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,41669,1689390649760; zookeeper connection closed. 2023-07-15 03:13:37,332 DEBUG [Listener at localhost/46707-EventThread] zookeeper.ZKWatcher(600): master:41669-0x10166f610e80000, quorum=127.0.0.1:62663, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-15 03:13:37,334 WARN [Listener at jenkins-hbase4.apache.org/44817] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-07-15 03:13:37,338 INFO [Listener at jenkins-hbase4.apache.org/44817] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-15 03:13:37,444 WARN [BP-344765285-172.31.14.131-1689390645349 heartbeating to localhost/127.0.0.1:37513] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-07-15 03:13:37,444 WARN [BP-344765285-172.31.14.131-1689390645349 heartbeating to localhost/127.0.0.1:37513] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-344765285-172.31.14.131-1689390645349 (Datanode Uuid e90030db-cf7a-48c2-b7c2-61e8177567c9) service to localhost/127.0.0.1:37513 2023-07-15 03:13:37,446 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6bc8dbaf-aac0-03cf-90d4-be6af049f709/cluster_2988be05-db52-9f51-9e27-39bd2563d627/dfs/data/data5/current/BP-344765285-172.31.14.131-1689390645349] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-15 03:13:37,446 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6bc8dbaf-aac0-03cf-90d4-be6af049f709/cluster_2988be05-db52-9f51-9e27-39bd2563d627/dfs/data/data6/current/BP-344765285-172.31.14.131-1689390645349] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-15 03:13:37,449 WARN [Listener at jenkins-hbase4.apache.org/44817] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-07-15 03:13:37,456 INFO [Listener at jenkins-hbase4.apache.org/44817] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-15 03:13:37,561 WARN [BP-344765285-172.31.14.131-1689390645349 heartbeating to localhost/127.0.0.1:37513] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-07-15 03:13:37,562 WARN [BP-344765285-172.31.14.131-1689390645349 heartbeating to localhost/127.0.0.1:37513] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-344765285-172.31.14.131-1689390645349 (Datanode Uuid afacc892-def3-4fe1-9973-4ba044fc3825) service to localhost/127.0.0.1:37513 2023-07-15 03:13:37,562 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6bc8dbaf-aac0-03cf-90d4-be6af049f709/cluster_2988be05-db52-9f51-9e27-39bd2563d627/dfs/data/data3/current/BP-344765285-172.31.14.131-1689390645349] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-15 03:13:37,563 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6bc8dbaf-aac0-03cf-90d4-be6af049f709/cluster_2988be05-db52-9f51-9e27-39bd2563d627/dfs/data/data4/current/BP-344765285-172.31.14.131-1689390645349] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-15 03:13:37,566 WARN [Listener at jenkins-hbase4.apache.org/44817] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-07-15 03:13:37,577 INFO [Listener at jenkins-hbase4.apache.org/44817] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-15 03:13:37,682 WARN [BP-344765285-172.31.14.131-1689390645349 heartbeating to localhost/127.0.0.1:37513] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-07-15 03:13:37,682 WARN [BP-344765285-172.31.14.131-1689390645349 heartbeating to localhost/127.0.0.1:37513] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-344765285-172.31.14.131-1689390645349 (Datanode Uuid 328e933e-deae-49cc-862f-2c4c9c703b43) service to localhost/127.0.0.1:37513 2023-07-15 03:13:37,683 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6bc8dbaf-aac0-03cf-90d4-be6af049f709/cluster_2988be05-db52-9f51-9e27-39bd2563d627/dfs/data/data1/current/BP-344765285-172.31.14.131-1689390645349] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-15 03:13:37,683 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6bc8dbaf-aac0-03cf-90d4-be6af049f709/cluster_2988be05-db52-9f51-9e27-39bd2563d627/dfs/data/data2/current/BP-344765285-172.31.14.131-1689390645349] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-15 03:13:37,707 INFO [Listener at jenkins-hbase4.apache.org/44817] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-15 03:13:37,832 INFO [Listener at jenkins-hbase4.apache.org/44817] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-07-15 03:13:37,932 INFO [Listener at jenkins-hbase4.apache.org/44817] hbase.HBaseTestingUtility(1293): Minicluster is down